Profile-based, load-independent anomaly detection and analysis in performance regression testing of software systems

Shadi Ghaith, Miao Wang, Philip Perry, John Murphy

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

23 Citations (Scopus)

Abstract

Performance evaluation through regression testing is an important step in the software production process. It aims to make sure that the performance of new releases do not regress under a field-like load. The main outputs of regression tests are the metrics that represent the response time of various transactions as well as the resource utilization (CPU, disk I/Oand Network). In this paper, we propose to use a concept known as Transaction Profile, which can provide a detailed representation for the transaction in a load independent manner, to detect anomalies through performance test runs. The approach uses data readily available in performance regression tests and a queueing network model of the system under test to infer the Transactions Profiles. Our initial results show that the Transactions Profiles calculated from load regression test data uncover the performance impact of any update to the software. Therefore we conclude that using Transactions Profiles is an effective approach to allow testing teams to easily assure each new software release does not suffer performance regression.

Original languageEnglish
Title of host publicationProceedings of the 17th European Conference on Software Maintenance and Reengineering, CSMR 2013
Place of PublicationGenova, Italy
PublisherIEEE Xplore
Pages379-383
Number of pages5
ISBN (Electronic)978-0-7695-4948-4
ISBN (Print)978-1-4673-5833-0
DOIs
Publication statusPublished (in print/issue) - 13 May 2013
Event17th European Conference on Software Maintenance and Reengineering, CSMR 2013 - Genova, Italy
Duration: 5 Mar 20138 Mar 2013

Publication series

Name 2013 17th European Conference on Software Maintenance and Reengineering
PublisherIEEE Xplore
NumberINSPEC Accession NR13446494
ISSN (Print)1534-5351

Conference

Conference17th European Conference on Software Maintenance and Reengineering, CSMR 2013
Country/TerritoryItaly
CityGenova
Period5/03/138/03/13

Keywords

  • application change
  • performance models
  • regression testing
  • transactions

Fingerprint

Dive into the research topics of 'Profile-based, load-independent anomaly detection and analysis in performance regression testing of software systems'. Together they form a unique fingerprint.

Cite this