A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data

Christodoulou Vyron, Yaxin Bi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

In this work we investigate the use of parametric statistical methods for Anomaly Detection in time series data. The approach involves the use of simple and computationally efficient algorithms, the Cumulative Sum (CUSUM) and Exponentially Weighted Moving Average (EWMA), that have demonstrated an acceptable performance in detecting different shifts from the process mean. However, while the performance of these algorithms is found to be adequate in datasets where anomalies have a profound form, they produce many false positives when anomalies become more complex. To address this limitation, we propose a solution that has greater flexibility, in the form of a combined CUSUM-EWMA algorithm. Four different statistical methods are investigated and implemented, including the classic CUSUM and EWMA, and two variants of a combined CUSUM- EWMA algorithm. These algorithms have been evaluated on ten benchmark datasets. The F-Score for each one of the algorithms has been used to demonstrate their performance appropriately. The preliminary experimental results prove to be promising for the proposed method in detecting anomalies from time series data.
LanguageEnglish
Title of host publicationUnknown Host Publication
Pages1-8
Number of pages8
Publication statusPublished - 2015
Event2015 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2015, Campus des Cordeliers, Paris, France, October 19-21, 2015. -
Duration: 1 Jan 2015 → …

Conference

Conference2015 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2015, Campus des Cordeliers, Paris, France, October 19-21, 2015.
Period1/01/15 → …

Fingerprint

Time series
Statistical methods

Keywords

  • Anomaly Detection
  • CUSUM-EWMA
  • Time Series

Cite this

Vyron, C., & Bi, Y. (2015). A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data. In Unknown Host Publication (pp. 1-8)
Vyron, Christodoulou ; Bi, Yaxin. / A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data. Unknown Host Publication. 2015. pp. 1-8
@inproceedings{fa1ea33789b64baeac6635a391329d7e,
title = "A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data",
abstract = "In this work we investigate the use of parametric statistical methods for Anomaly Detection in time series data. The approach involves the use of simple and computationally efficient algorithms, the Cumulative Sum (CUSUM) and Exponentially Weighted Moving Average (EWMA), that have demonstrated an acceptable performance in detecting different shifts from the process mean. However, while the performance of these algorithms is found to be adequate in datasets where anomalies have a profound form, they produce many false positives when anomalies become more complex. To address this limitation, we propose a solution that has greater flexibility, in the form of a combined CUSUM-EWMA algorithm. Four different statistical methods are investigated and implemented, including the classic CUSUM and EWMA, and two variants of a combined CUSUM- EWMA algorithm. These algorithms have been evaluated on ten benchmark datasets. The F-Score for each one of the algorithms has been used to demonstrate their performance appropriately. The preliminary experimental results prove to be promising for the proposed method in detecting anomalies from time series data.",
keywords = "Anomaly Detection, CUSUM-EWMA, Time Series",
author = "Christodoulou Vyron and Yaxin Bi",
year = "2015",
language = "English",
pages = "1--8",
booktitle = "Unknown Host Publication",

}

Vyron, C & Bi, Y 2015, A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data. in Unknown Host Publication. pp. 1-8, 2015 IEEE International Conference on Data Science and Advanced Analytics, DSAA 2015, Campus des Cordeliers, Paris, France, October 19-21, 2015., 1/01/15.

A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data. / Vyron, Christodoulou; Bi, Yaxin.

Unknown Host Publication. 2015. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data

AU - Vyron, Christodoulou

AU - Bi, Yaxin

PY - 2015

Y1 - 2015

N2 - In this work we investigate the use of parametric statistical methods for Anomaly Detection in time series data. The approach involves the use of simple and computationally efficient algorithms, the Cumulative Sum (CUSUM) and Exponentially Weighted Moving Average (EWMA), that have demonstrated an acceptable performance in detecting different shifts from the process mean. However, while the performance of these algorithms is found to be adequate in datasets where anomalies have a profound form, they produce many false positives when anomalies become more complex. To address this limitation, we propose a solution that has greater flexibility, in the form of a combined CUSUM-EWMA algorithm. Four different statistical methods are investigated and implemented, including the classic CUSUM and EWMA, and two variants of a combined CUSUM- EWMA algorithm. These algorithms have been evaluated on ten benchmark datasets. The F-Score for each one of the algorithms has been used to demonstrate their performance appropriately. The preliminary experimental results prove to be promising for the proposed method in detecting anomalies from time series data.

AB - In this work we investigate the use of parametric statistical methods for Anomaly Detection in time series data. The approach involves the use of simple and computationally efficient algorithms, the Cumulative Sum (CUSUM) and Exponentially Weighted Moving Average (EWMA), that have demonstrated an acceptable performance in detecting different shifts from the process mean. However, while the performance of these algorithms is found to be adequate in datasets where anomalies have a profound form, they produce many false positives when anomalies become more complex. To address this limitation, we propose a solution that has greater flexibility, in the form of a combined CUSUM-EWMA algorithm. Four different statistical methods are investigated and implemented, including the classic CUSUM and EWMA, and two variants of a combined CUSUM- EWMA algorithm. These algorithms have been evaluated on ten benchmark datasets. The F-Score for each one of the algorithms has been used to demonstrate their performance appropriately. The preliminary experimental results prove to be promising for the proposed method in detecting anomalies from time series data.

KW - Anomaly Detection

KW - CUSUM-EWMA

KW - Time Series

M3 - Conference contribution

SP - 1

EP - 8

BT - Unknown Host Publication

ER -

Vyron C, Bi Y. A Combination of CUSUM-EWMA for Anomaly Detection in Time Series Data. In Unknown Host Publication. 2015. p. 1-8