A semi-automated food voting classification system: Combining user interaction and Support Vector Machines

McAllister Patrick, Huiru Zheng, Raymond Bond, Anne Moorhead

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Obesity is prevalent worldwide including UK and Ireland, affecting all demographics. Obesity can have a detrimental affect on an individual's health, which can lead to chronic conditions. Different digital interventions have enabled users to photograph food items to be identified using different feature extraction methods. In this research, we proposed a system that allows users to draw a polygon around a food item for segmentation. After segmented, the region is then classified using an automated voting system. Different features will then be extracted from the specified area. Support Vector Machines will be issued for each feature type. This system is a proof-of-concept and is designed to research the effectiveness of employing multiple feature detection algorithms to classify food images. To classify food regions a Bag-of-features (BoFs) approach will be used for each. Speeded Up Robust Features point detection and descriptors was used along with colour spatial features, and also MSER region detection with SURF. Each of these methods will have their own BoF to train an SVM. The aim of this research was to create a voting classification system that utilises each feature detection algorithm to ultimately identify the segmented food region through plurality (or majority) vote. Testing showed that the system achieved 75% accuracy when combining each feature SVM to create a voting system. The system outperforms two of the feature classifiers (SURF and MSER with SURF). LAB colour classifier slightly outperformed the voting mechanism within the developed system. In regards to future work, further development and testing would be completed through increasing the variety of food items used in the training phase and a larger test dataset would also be used.
LanguageEnglish
Title of host publicationUnknown Host Publication
Pages1-7
Number of pages7
DOIs
Publication statusPublished - 12 Nov 2015
EventIEEE International Symposium on Technology and Society - Dublin
Duration: 12 Nov 2015 → …

Conference

ConferenceIEEE International Symposium on Technology and Society
Period12/11/15 → …

Fingerprint

Support vector machines
Classifiers
Color
Testing
Feature extraction
Health

Keywords

  • Obesity
  • food
  • nutrition
  • machine learning
  • machine vision
  • self-management

Cite this

@inproceedings{d6835eed0ea348aaa62cdb42c0cf0583,
title = "A semi-automated food voting classification system: Combining user interaction and Support Vector Machines",
abstract = "Obesity is prevalent worldwide including UK and Ireland, affecting all demographics. Obesity can have a detrimental affect on an individual's health, which can lead to chronic conditions. Different digital interventions have enabled users to photograph food items to be identified using different feature extraction methods. In this research, we proposed a system that allows users to draw a polygon around a food item for segmentation. After segmented, the region is then classified using an automated voting system. Different features will then be extracted from the specified area. Support Vector Machines will be issued for each feature type. This system is a proof-of-concept and is designed to research the effectiveness of employing multiple feature detection algorithms to classify food images. To classify food regions a Bag-of-features (BoFs) approach will be used for each. Speeded Up Robust Features point detection and descriptors was used along with colour spatial features, and also MSER region detection with SURF. Each of these methods will have their own BoF to train an SVM. The aim of this research was to create a voting classification system that utilises each feature detection algorithm to ultimately identify the segmented food region through plurality (or majority) vote. Testing showed that the system achieved 75{\%} accuracy when combining each feature SVM to create a voting system. The system outperforms two of the feature classifiers (SURF and MSER with SURF). LAB colour classifier slightly outperformed the voting mechanism within the developed system. In regards to future work, further development and testing would be completed through increasing the variety of food items used in the training phase and a larger test dataset would also be used.",
keywords = "Obesity, food, nutrition, machine learning, machine vision, self-management",
author = "McAllister Patrick and Huiru Zheng and Raymond Bond and Anne Moorhead",
year = "2015",
month = "11",
day = "12",
doi = "10.1109/ISTAS.2015.7439433",
language = "English",
pages = "1--7",
booktitle = "Unknown Host Publication",

}

Patrick, M, Zheng, H, Bond, R & Moorhead, A 2015, A semi-automated food voting classification system: Combining user interaction and Support Vector Machines. in Unknown Host Publication. pp. 1-7, IEEE International Symposium on Technology and Society, 12/11/15. https://doi.org/10.1109/ISTAS.2015.7439433

A semi-automated food voting classification system: Combining user interaction and Support Vector Machines. / Patrick, McAllister; Zheng, Huiru; Bond, Raymond; Moorhead, Anne.

Unknown Host Publication. 2015. p. 1-7.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A semi-automated food voting classification system: Combining user interaction and Support Vector Machines

AU - Patrick, McAllister

AU - Zheng, Huiru

AU - Bond, Raymond

AU - Moorhead, Anne

PY - 2015/11/12

Y1 - 2015/11/12

N2 - Obesity is prevalent worldwide including UK and Ireland, affecting all demographics. Obesity can have a detrimental affect on an individual's health, which can lead to chronic conditions. Different digital interventions have enabled users to photograph food items to be identified using different feature extraction methods. In this research, we proposed a system that allows users to draw a polygon around a food item for segmentation. After segmented, the region is then classified using an automated voting system. Different features will then be extracted from the specified area. Support Vector Machines will be issued for each feature type. This system is a proof-of-concept and is designed to research the effectiveness of employing multiple feature detection algorithms to classify food images. To classify food regions a Bag-of-features (BoFs) approach will be used for each. Speeded Up Robust Features point detection and descriptors was used along with colour spatial features, and also MSER region detection with SURF. Each of these methods will have their own BoF to train an SVM. The aim of this research was to create a voting classification system that utilises each feature detection algorithm to ultimately identify the segmented food region through plurality (or majority) vote. Testing showed that the system achieved 75% accuracy when combining each feature SVM to create a voting system. The system outperforms two of the feature classifiers (SURF and MSER with SURF). LAB colour classifier slightly outperformed the voting mechanism within the developed system. In regards to future work, further development and testing would be completed through increasing the variety of food items used in the training phase and a larger test dataset would also be used.

AB - Obesity is prevalent worldwide including UK and Ireland, affecting all demographics. Obesity can have a detrimental affect on an individual's health, which can lead to chronic conditions. Different digital interventions have enabled users to photograph food items to be identified using different feature extraction methods. In this research, we proposed a system that allows users to draw a polygon around a food item for segmentation. After segmented, the region is then classified using an automated voting system. Different features will then be extracted from the specified area. Support Vector Machines will be issued for each feature type. This system is a proof-of-concept and is designed to research the effectiveness of employing multiple feature detection algorithms to classify food images. To classify food regions a Bag-of-features (BoFs) approach will be used for each. Speeded Up Robust Features point detection and descriptors was used along with colour spatial features, and also MSER region detection with SURF. Each of these methods will have their own BoF to train an SVM. The aim of this research was to create a voting classification system that utilises each feature detection algorithm to ultimately identify the segmented food region through plurality (or majority) vote. Testing showed that the system achieved 75% accuracy when combining each feature SVM to create a voting system. The system outperforms two of the feature classifiers (SURF and MSER with SURF). LAB colour classifier slightly outperformed the voting mechanism within the developed system. In regards to future work, further development and testing would be completed through increasing the variety of food items used in the training phase and a larger test dataset would also be used.

KW - Obesity

KW - food

KW - nutrition

KW - machine learning

KW - machine vision

KW - self-management

U2 - 10.1109/ISTAS.2015.7439433

DO - 10.1109/ISTAS.2015.7439433

M3 - Conference contribution

SP - 1

EP - 7

BT - Unknown Host Publication

ER -