A Scalable, Research Oriented, Generic, Sensor Data Platform

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity – representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This do-main increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive ana-lytics and activity recognition. Several current big data platforms exist; however, they have a range of defi-ciencies including lack of generic interoperability with agnostic sensors and an absence of features support-ing academic research. Due to these deficiencies a custom, research oriented, high performance, big data platform was devised and implemented. This platform is called SensorCentral and is presented within this manuscript. SensorCentral provides a framework which enables interoperability with a large range of ag-nostic sensor devices whist simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classi-fication and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the Open Data Initiative enabling collaboration with the international community of researchers.
LanguageEnglish
JournalIEEE Access
Early online date6 Jul 2018
DOIs
Publication statusE-pub ahead of print - 6 Jul 2018

Fingerprint

Sensors
Ubiquitous computing
Interoperability
Learning systems
Big data
Experiments

Keywords

  • Data Analysis
  • Data Storage Systems
  • Database Systems
  • Internet of Things
  • Machine Learning
  • Sensor Systems
  • Wireless Sensor Networks
  • LoRa
  • Open Data Initative
  • Research Tools

Cite this

@article{4c452fa83df946b5aa9d1889190314e0,
title = "A Scalable, Research Oriented, Generic, Sensor Data Platform",
abstract = "Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity – representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This do-main increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive ana-lytics and activity recognition. Several current big data platforms exist; however, they have a range of defi-ciencies including lack of generic interoperability with agnostic sensors and an absence of features support-ing academic research. Due to these deficiencies a custom, research oriented, high performance, big data platform was devised and implemented. This platform is called SensorCentral and is presented within this manuscript. SensorCentral provides a framework which enables interoperability with a large range of ag-nostic sensor devices whist simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classi-fication and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the Open Data Initiative enabling collaboration with the international community of researchers.",
keywords = "Data Analysis, Data Storage Systems, Database Systems, Internet of Things, Machine Learning, Sensor Systems, Wireless Sensor Networks, LoRa, Open Data Initative, Research Tools",
author = "Joseph Rafferty and Jonathan Synnott and CD Nugent and Andrew Ennis and P Catherwood and Ian McChesney and I Cleland and McClean, {Sally I}",
year = "2018",
month = "7",
day = "6",
doi = "10.1109/ACCESS.2018.2852656",
language = "English",
journal = "IEEE Access",
issn = "2169-3536",

}

TY - JOUR

T1 - A Scalable, Research Oriented, Generic, Sensor Data Platform

AU - Rafferty, Joseph

AU - Synnott, Jonathan

AU - Nugent, CD

AU - Ennis, Andrew

AU - Catherwood, P

AU - McChesney, Ian

AU - Cleland, I

AU - McClean, Sally I

PY - 2018/7/6

Y1 - 2018/7/6

N2 - Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity – representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This do-main increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive ana-lytics and activity recognition. Several current big data platforms exist; however, they have a range of defi-ciencies including lack of generic interoperability with agnostic sensors and an absence of features support-ing academic research. Due to these deficiencies a custom, research oriented, high performance, big data platform was devised and implemented. This platform is called SensorCentral and is presented within this manuscript. SensorCentral provides a framework which enables interoperability with a large range of ag-nostic sensor devices whist simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classi-fication and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the Open Data Initiative enabling collaboration with the international community of researchers.

AB - Research interests spanning numerous domains increasingly rely upon computational systems which can store and process a large volume of variable data that is stored at high velocity – representing a big data problem. This is particularly notable within the domain of ubiquitous and pervasive computing. This do-main increasingly relies on storage and retrieval of sensor data to enable outcomes such as predictive ana-lytics and activity recognition. Several current big data platforms exist; however, they have a range of defi-ciencies including lack of generic interoperability with agnostic sensors and an absence of features support-ing academic research. Due to these deficiencies a custom, research oriented, high performance, big data platform was devised and implemented. This platform is called SensorCentral and is presented within this manuscript. SensorCentral provides a framework which enables interoperability with a large range of ag-nostic sensor devices whist simultaneously providing features which support research. Research supporting features include; facility to define experiments, ability to annotate experimental instances via purpose-built mobile applications, integrated machine learning functionality, facility to export data sets, rule-based classi-fication and an extensible platform. The flagship implementation of this platform has been in operation for over 28 months within a University research group and has been successfully integrated with a range of sensors from a variety of manufacturers. This implementation currently stores over 850 million records and has been central to several research and industrial projects. Future work will integrate this platform into the Open Data Initiative enabling collaboration with the international community of researchers.

KW - Data Analysis

KW - Data Storage Systems

KW - Database Systems

KW - Internet of Things

KW - Machine Learning

KW - Sensor Systems

KW - Wireless Sensor Networks

KW - LoRa

KW - Open Data Initative

KW - Research Tools

U2 - 10.1109/ACCESS.2018.2852656

DO - 10.1109/ACCESS.2018.2852656

M3 - Article

JO - IEEE Access

T2 - IEEE Access

JF - IEEE Access

SN - 2169-3536

ER -