Sensing Affective States using Facial Expression Analysis

Anas Samara, Leo Galway, Raymond Bond, Hui Wang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


An important factor for the next generation of Human Computer Interaction is the implementation of an interaction model that automatically reasons in context of the users goals, attitudes, affective characteristics and capabilities, and adapts the system accordingly. Although various techniques have been proposed for automatically detecting affective states using facial expression, this is still a research challenge in terms of classification accuracy. This paper investigates an extensible automatic affective state detection approach via the analysis of facial expressions from digital photographs. The main contribution of this study can be summarised in two points. Firstly, utilising facial point distance vectors within the representation of facial expressions is shown to be more accurate and robust in comparison to using standard Cartesian coordinates. Secondly, employing a two-stage Support Vector Machine-based classification model, entitled Hierarchical Parallelised Binary Sup- port Vector Machines (HPBSVM), is shown to improve classification performance over other machine learning techniques. The resulting classification model has been evaluated using two different facial expression datasets (namely CKPLUS and KDEF), yielding accuracy rates of 96.9% and 96.2% over each dataset respectively.
Original languageEnglish
Title of host publicationUnknown Host Publication
Number of pages12
ISBN (Print)3319487981
Publication statusAccepted/In press - 8 Aug 2016
Event10th International Conference on Ubiquitous Computing and Ambient ‪Intelligence UCAmI 2016 - Las Palmas, Gran Canaria
Duration: 8 Aug 2016 → …


Conference10th International Conference on Ubiquitous Computing and Ambient ‪Intelligence UCAmI 2016
Period8/08/16 → …


  • User Modelling
  • Facial Expression
  • Emotion Detection
  • Affective Computing
  • Human Computer Interaction


Dive into the research topics of 'Sensing Affective States using Facial Expression Analysis'. Together they form a unique fingerprint.

Cite this