Human-Machine Cooperative Video Anomaly Detection

Research output: Contribution to journalArticlepeer-review

255 Downloads (Pure)


It is still a challenge to detect anomalous events in video sequences in the field of computer vision due to heavy object occlusions, varying crowded densities and complex situations. To address this, we propose a novel human-machine cooperative approach which uses human feedback on anomaly confirmation to inform and enhance video anomaly detection. Specifically, we analyze the spatio-temporal characteristics of sequential frames of a video from the appearance and motion perspective from which spatial and temporal features are identified and extracted. We then develop a convolutional autoencoder neural network to compute an abnormal score based on reconstruction errors. In this process, a group of experts will provide human feedback to a certain proportion of classified frames to be incorporated into the model, and also the final judgment for the event anomalies for training and classification. The proposed approach is evaluated on 3 publicly available surveillance datasets, showing improved accuracy and competitive performance (93.7% AUC) with respect to the best performance (90.6% AUC) of the state-of-the-art approaches. The approach has not been previously
seen to the best of our knowledge.
Original languageEnglish
Article number274
Number of pages18
JournalProceedings of the ACM on Human-Computer Interaction
Publication statusAccepted/In press - 25 Jul 2020


Dive into the research topics of 'Human-Machine Cooperative Video Anomaly Detection'. Together they form a unique fingerprint.

Cite this