Automatic, load-independent detection of performance regressions by transaction profiles

Shadi Ghaith, Miao Wang, Philip Perry, John Murphy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

Performance regression testing is an important step in the production process of enterprise applications. Yet, analysing this type of testing data is mainly conducted manually and depends on the load applied during the test. To ease such a manual task we present an automated, load-independent technique to detect performance regression anomalies based on the analysis of performance testing data using a concept known as Transaction Profile. The approach can be automated and it utilises data already available to the performance testing along with the queueing network model of the testing system. The presented "Transaction Profile Run Report" was able to automatically catch performance regression anomalies ca-used by software changes and isolate them from those caused by load variations with a precision of 80% in a case study conducted against an open source application. Hence, by deploying our system, the testing teams are able to detect performance regression anomalies by avoiding the manual approach and eliminating the need to do extra runs with varying load.

Original languageEnglish
Title of host publication2013 International Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, JAMAICA 2013 - Proceedings
Pages59-64
Number of pages6
DOIs
Publication statusPublished - 13 Aug 2013
Event1st International Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, JAMAICA 2013 - Lugano, Switzerland
Duration: 15 Jul 201315 Jul 2013

Conference

Conference1st International Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, JAMAICA 2013
CountrySwitzerland
CityLugano
Period15/07/1315/07/13

Keywords

  • Application change
  • performance models
  • regression testing

Fingerprint Dive into the research topics of 'Automatic, load-independent detection of performance regressions by transaction profiles'. Together they form a unique fingerprint.

  • Cite this

    Ghaith, S., Wang, M., Perry, P., & Murphy, J. (2013). Automatic, load-independent detection of performance regressions by transaction profiles. In 2013 International Workshop on Joining AcadeMiA and Industry Contributions to Testing Automation, JAMAICA 2013 - Proceedings (pp. 59-64) https://doi.org/10.1145/2489280.2489286