In-Test adaptation of workload in enterprise application performance testing

Maciej Kaczmarski; Philip Perry; John Murphy; A. Omar Portillo-Dominguez

doi:10.1145/3053600.3053614

In-Test adaptation of workload in enterprise application performance testing

Maciej Kaczmarski, Philip Perry, John Murphy, A. Omar Portillo-Dominguez

University College Dublin

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

5 Citations (Scopus)

Abstract

Performance testing is used to assess if an enterprise application can fulfill its expected Service Level Agreements. How- ever, since some performance issues depend on the input workloads, it is common to use time-consuming and complex iterative test methods, which heavily rely on human expertise. This paper presents an automated approach to dynamically adapt the workload so that issues (e.g. bottle- necks) can be identified more quickly as well as with less effort and expertise. We present promising results from an initial validation prototype indicating an 18-fold decrease in the test time without compromising the accuracy of the test results, while only introducing a marginal overhead in the system.

Original language	English
Title of host publication	ICPE 2017 - Companion of the 2017 ACM/SPEC International Conference on Performance Engineering
Publisher	Association for Computing Machinery, Inc
Pages	69-72
Number of pages	4
ISBN (Electronic)	9781450348997
DOIs	https://doi.org/10.1145/3053600.3053614
Publication status	Published (in print/issue) - 18 Apr 2017
Event	8th ACM/SPEC International Conference on Performance Engineering, ICPE 2017 - L'Aquila, Italy Duration: 22 Apr 2017 → 26 Apr 2017

Conference

Conference	8th ACM/SPEC International Conference on Performance Engineering, ICPE 2017
Country/Territory	Italy
City	L'Aquila
Period	22/04/17 → 26/04/17

Funding

This work was supported, in part, by Science Foundation Ireland grant 13/RC/2094 and co-funded under the European Regional Development Fund through the Southern & Eastern Regional Operational Programme to Lero -The Irish Software Research Centre (www.lero.ie).

Keywords

Analysis
Engineering
Performance
Testing

Access to Document

10.1145/3053600.3053614

Cite this

@inproceedings{ca011ea1c4314289a7d53c79044a79a6,

title = "In-Test adaptation of workload in enterprise application performance testing",

abstract = "Performance testing is used to assess if an enterprise application can fulfill its expected Service Level Agreements. How- ever, since some performance issues depend on the input workloads, it is common to use time-consuming and complex iterative test methods, which heavily rely on human expertise. This paper presents an automated approach to dynamically adapt the workload so that issues (e.g. bottle- necks) can be identified more quickly as well as with less effort and expertise. We present promising results from an initial validation prototype indicating an 18-fold decrease in the test time without compromising the accuracy of the test results, while only introducing a marginal overhead in the system.",

keywords = "Analysis, Engineering, Performance, Testing",

author = "Maciej Kaczmarski and Philip Perry and John Murphy and Portillo-Dominguez, \{A. Omar\}",

year = "2017",

month = apr,

day = "18",

doi = "10.1145/3053600.3053614",

language = "English",

pages = "69--72",

booktitle = "ICPE 2017 - Companion of the 2017 ACM/SPEC International Conference on Performance Engineering",

publisher = "Association for Computing Machinery, Inc",

note = "8th ACM/SPEC International Conference on Performance Engineering, ICPE 2017 ; Conference date: 22-04-2017 Through 26-04-2017",

}

Kaczmarski, M, Perry, P, Murphy, J & Portillo-Dominguez, AO 2017, In-Test adaptation of workload in enterprise application performance testing. in ICPE 2017 - Companion of the 2017 ACM/SPEC International Conference on Performance Engineering. Association for Computing Machinery, Inc, pp. 69-72, 8th ACM/SPEC International Conference on Performance Engineering, ICPE 2017, L'Aquila, Italy, 22/04/17. https://doi.org/10.1145/3053600.3053614

In-Test adaptation of workload in enterprise application performance testing. / Kaczmarski, Maciej; Perry, Philip; Murphy, John et al.
ICPE 2017 - Companion of the 2017 ACM/SPEC International Conference on Performance Engineering. Association for Computing Machinery, Inc, 2017. p. 69-72.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - In-Test adaptation of workload in enterprise application performance testing

AU - Kaczmarski, Maciej

AU - Perry, Philip

AU - Murphy, John

AU - Portillo-Dominguez, A. Omar

PY - 2017/4/18

Y1 - 2017/4/18

N2 - Performance testing is used to assess if an enterprise application can fulfill its expected Service Level Agreements. How- ever, since some performance issues depend on the input workloads, it is common to use time-consuming and complex iterative test methods, which heavily rely on human expertise. This paper presents an automated approach to dynamically adapt the workload so that issues (e.g. bottle- necks) can be identified more quickly as well as with less effort and expertise. We present promising results from an initial validation prototype indicating an 18-fold decrease in the test time without compromising the accuracy of the test results, while only introducing a marginal overhead in the system.

AB - Performance testing is used to assess if an enterprise application can fulfill its expected Service Level Agreements. How- ever, since some performance issues depend on the input workloads, it is common to use time-consuming and complex iterative test methods, which heavily rely on human expertise. This paper presents an automated approach to dynamically adapt the workload so that issues (e.g. bottle- necks) can be identified more quickly as well as with less effort and expertise. We present promising results from an initial validation prototype indicating an 18-fold decrease in the test time without compromising the accuracy of the test results, while only introducing a marginal overhead in the system.

KW - Analysis

KW - Engineering

KW - Performance

KW - Testing

UR - https://www.scopus.com/pages/publications/85019488224

U2 - 10.1145/3053600.3053614

DO - 10.1145/3053600.3053614

M3 - Conference contribution

AN - SCOPUS:85019488224

SP - 69

EP - 72

BT - ICPE 2017 - Companion of the 2017 ACM/SPEC International Conference on Performance Engineering

PB - Association for Computing Machinery, Inc

T2 - 8th ACM/SPEC International Conference on Performance Engineering, ICPE 2017

Y2 - 22 April 2017 through 26 April 2017

ER -

In-Test adaptation of workload in enterprise application performance testing

Abstract

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this