Use of smartphone videos and pattern recognition for food authentication

Weiran Song, Nanfeng Jiang, Hui Wang, Jordan Vincent

Research output: Contribution to journalArticle

Abstract

A novel sensor system for food authentication is presented, which is based on computer vision and pattern recognition. The sensor system uses a smartphone to generate a sequence of light with varying colours to illuminate a food sample, and uses the smartphone camera to receive reflected light by way of recording a video. The video is processed using computer vision techniques and transformed into sensor data in the form of a data vector. The sensor data is analysed using pattern recognition techniques. The locally weighted partial least squares regression method is extended for classification to improve the modelling effectiveness and robustness. The sensor system is evaluated on the task of authentication of olive oil and milk – to verify how they are labelled. Large quantities of olive oil and milk were purchased from supermarkets, and sensor videos were created using the sensor system. Test accuracies of 96.2% and 100% were achieved for olive oil and milk authentication respectively. These results suggest the proposed sensor system is effective. Since the sensor system is built in a smartphone, it has the potential to serve as a low-cost and effective solution for food authentication and to empower consumers in food fraud detection.
LanguageEnglish
JournalSensors and Actuators B: Chemical
Publication statusAccepted/In press - 8 Oct 2019

Fingerprint

Smartphones
food
pattern recognition
Authentication
Pattern recognition
sensors
Sensors
Olive oil
milk
oils
computer vision
Computer vision
regression analysis
recording
Cameras
cameras
Color
color

Cite this

@article{a5432176e0b24f498019bb85e6c21606,
title = "Use of smartphone videos and pattern recognition for food authentication",
abstract = "A novel sensor system for food authentication is presented, which is based on computer vision and pattern recognition. The sensor system uses a smartphone to generate a sequence of light with varying colours to illuminate a food sample, and uses the smartphone camera to receive reflected light by way of recording a video. The video is processed using computer vision techniques and transformed into sensor data in the form of a data vector. The sensor data is analysed using pattern recognition techniques. The locally weighted partial least squares regression method is extended for classification to improve the modelling effectiveness and robustness. The sensor system is evaluated on the task of authentication of olive oil and milk – to verify how they are labelled. Large quantities of olive oil and milk were purchased from supermarkets, and sensor videos were created using the sensor system. Test accuracies of 96.2{\%} and 100{\%} were achieved for olive oil and milk authentication respectively. These results suggest the proposed sensor system is effective. Since the sensor system is built in a smartphone, it has the potential to serve as a low-cost and effective solution for food authentication and to empower consumers in food fraud detection.",
author = "Weiran Song and Nanfeng Jiang and Hui Wang and Jordan Vincent",
year = "2019",
month = "10",
day = "8",
language = "English",
journal = "Sensors and Actuators B: Chemical",
issn = "0925-4005",
publisher = "Elsevier",

}

Use of smartphone videos and pattern recognition for food authentication. / Song, Weiran; Jiang, Nanfeng; Wang, Hui; Vincent, Jordan.

In: Sensors and Actuators B: Chemical, 08.10.2019.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Use of smartphone videos and pattern recognition for food authentication

AU - Song, Weiran

AU - Jiang, Nanfeng

AU - Wang, Hui

AU - Vincent, Jordan

PY - 2019/10/8

Y1 - 2019/10/8

N2 - A novel sensor system for food authentication is presented, which is based on computer vision and pattern recognition. The sensor system uses a smartphone to generate a sequence of light with varying colours to illuminate a food sample, and uses the smartphone camera to receive reflected light by way of recording a video. The video is processed using computer vision techniques and transformed into sensor data in the form of a data vector. The sensor data is analysed using pattern recognition techniques. The locally weighted partial least squares regression method is extended for classification to improve the modelling effectiveness and robustness. The sensor system is evaluated on the task of authentication of olive oil and milk – to verify how they are labelled. Large quantities of olive oil and milk were purchased from supermarkets, and sensor videos were created using the sensor system. Test accuracies of 96.2% and 100% were achieved for olive oil and milk authentication respectively. These results suggest the proposed sensor system is effective. Since the sensor system is built in a smartphone, it has the potential to serve as a low-cost and effective solution for food authentication and to empower consumers in food fraud detection.

AB - A novel sensor system for food authentication is presented, which is based on computer vision and pattern recognition. The sensor system uses a smartphone to generate a sequence of light with varying colours to illuminate a food sample, and uses the smartphone camera to receive reflected light by way of recording a video. The video is processed using computer vision techniques and transformed into sensor data in the form of a data vector. The sensor data is analysed using pattern recognition techniques. The locally weighted partial least squares regression method is extended for classification to improve the modelling effectiveness and robustness. The sensor system is evaluated on the task of authentication of olive oil and milk – to verify how they are labelled. Large quantities of olive oil and milk were purchased from supermarkets, and sensor videos were created using the sensor system. Test accuracies of 96.2% and 100% were achieved for olive oil and milk authentication respectively. These results suggest the proposed sensor system is effective. Since the sensor system is built in a smartphone, it has the potential to serve as a low-cost and effective solution for food authentication and to empower consumers in food fraud detection.

M3 - Article

JO - Sensors and Actuators B: Chemical

T2 - Sensors and Actuators B: Chemical

JF - Sensors and Actuators B: Chemical

SN - 0925-4005

ER -