Gesture-Radar: a Dual Doppler Radar Based System for Robust Recognition and Quantitative Profiling of Human Gestures

Zhu Wang, Zhiwen Yu, Xinye Lou, Bin Guo, Liming (Luke) Chen

Research output: Contribution to journalArticlepeer-review

13 Downloads (Pure)

Abstract

Gesture recognition is key to enabling natural human-computer interactions. Existing approaches based on wireless sensing focus on accurate identification of arm gesture types. It remains a challenge to recognize and profile the details of arm gestures for precise interaction control. In addition, current approaches have strict positioning requirements between radars and users, making them difficult for real-world deployment. In this paper, we adopt the multi-sensor approach and present Gesture-Radar - a dual Doppler radar-based gesture recognition and profiling system, which can capture subtle arm gestures with less positioning or environmental dependence. Gesture-Radar uses two vertically placed Doppler radars to collect complementary sensing data of gestures, based on which cross-analysis can be performed for gesture recognition and profiling. Specifically, we first propose a two-stage classification model and enhance the signal proximity matching method by applying constraint functions to the DTW algorithm, aiming to improve the accuracy of gesture type recognition. Afterwards, we establish and analyse unique features from the time-frequency spectrogram, which can be used to characterize in-depth gesture details, e.g., the angle or range of an arm movement. Experimental results show that Gesture-Radar achieves up to 93.5%average accuracy for gesture type recognition, and over 80% precision for profiling gesture details. This proves that the proposed approach is viable and can work in real-world environments.
Original languageEnglish
Number of pages12
JournalIEEE Transactions on Human-Machine Systems
DOIs
Publication statusPublished - 20 Nov 2020

Keywords

  • Doppler radar
  • dual channel information
  • gesture recognition
  • human-computer interaction
  • multiple sensors
  • wireless sensing

Fingerprint Dive into the research topics of 'Gesture-Radar: a Dual Doppler Radar Based System for Robust Recognition and Quantitative Profiling of Human Gestures'. Together they form a unique fingerprint.

Cite this