Quality of Data Measurements in the Big Data Era: Lessons Learned from MIDAS Project

Gorka Epelde; Andoni Beristain; Roberto Álvarez; Mónica Arrúe; Iker Ezkerra; Oihana Belar; Roberto Bilbao; Gorana Nikolic; Xi Shi; Bart De Moor; Maurice Mulvenna

doi:10.1109/MIM.2020.9234761

Quality of Data Measurements in the Big Data Era: Lessons Learned from MIDAS Project

Gorka Epelde, Andoni Beristain, Roberto Álvarez, Mónica Arrúe, Iker Ezkerra, Oihana Belar, Roberto Bilbao, Gorana Nikolic, Xi Shi, Bart De Moor, Maurice Mulvenna

Research output: Contribution to journal › Article › peer-review

3 Citations (Scopus)

105 Downloads (Pure)

Abstract

In recent years, digitalization of traditional manual processes with a tendency towards a sensorized world and person-generated information streams has led to a massive availability and exponential generation of heterogeneous data in most areas of life. This has been facilitated by the cost reduction and capability improvements of Information and Communications Technology (ICT) for storage, processing and transmission.

Original language	English
Article number	9234761
Pages (from-to)	18-24
Number of pages	7
Journal	IEEE Instrumentation and Measurement Magazine
Volume	23
Issue number	7
DOIs	https://doi.org/10.1109/MIM.2020.9234761
Publication status	Published (in print/issue) - 20 Oct 2020

Bibliographical note

Funding Information:
Many authors and organizations have described different definitions of dimensions for data quality assessment, reported in [1], [5], [6], to reference a few of them. As an example of this discrepancy, DAMA UK Working Group [5] defined them as: completeness, uniqueness, timeliness, validity, This work was supported by the European Union’s Horizon 2020 Research and Innovation Programme under grant agreement No. 727721 (MIDAS) and by the Gipuzkoan Science, Technology and Innovation Network Programme funding of the HIDRA project.

Publisher Copyright:
© 1998-2012 IEEE.

Copyright:
Copyright 2020 Elsevier B.V., All rights reserved.

Keywords

Data integrity
Information and communications technology
Data Storage Systems
Data Visualization
Decision Making
Measurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertainty

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/MIM.2020.9234761

Accepted author manuscriptAuthor Accepted Manuscript, 195 KB

Cite this

@article{98f1b81813b04eda868b86e4045af230,

title = "Quality of Data Measurements in the Big Data Era: Lessons Learned from MIDAS Project",

abstract = "In recent years, digitalization of traditional manual processes with a tendency towards a sensorized world and person-generated information streams has led to a massive availability and exponential generation of heterogeneous data in most areas of life. This has been facilitated by the cost reduction and capability improvements of Information and Communications Technology (ICT) for storage, processing and transmission.",

keywords = "Data integrity, Information and communications technology, Data Storage Systems, Data Visualization, Decision Making, Measurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertainty",

author = "Gorka Epelde and Andoni Beristain and Roberto {\'A}lvarez and M{\'o}nica Arr{\'u}e and Iker Ezkerra and Oihana Belar and Roberto Bilbao and Gorana Nikolic and Xi Shi and {De Moor}, Bart and Maurice Mulvenna",

note = "Funding Information: Many authors and organizations have described different definitions of dimensions for data quality assessment, reported in [1], [5], [6], to reference a few of them. As an example of this discrepancy, DAMA UK Working Group [5] defined them as: completeness, uniqueness, timeliness, validity, This work was supported by the European Union{\textquoteright}s Horizon 2020 Research and Innovation Programme under grant agreement No. 727721 (MIDAS) and by the Gipuzkoan Science, Technology and Innovation Network Programme funding of the HIDRA project. Publisher Copyright: {\textcopyright} 1998-2012 IEEE. Copyright: Copyright 2020 Elsevier B.V., All rights reserved.",

year = "2020",

month = oct,

day = "20",

doi = "10.1109/MIM.2020.9234761",

language = "English",

volume = "23",

pages = "18--24",

journal = "IEEE Instrumentation and Measurement Magazine",

issn = "1094-6969",

publisher = "IEEE",

number = "7",

}

TY - JOUR

T1 - Quality of Data Measurements in the Big Data Era

T2 - Lessons Learned from MIDAS Project

AU - Epelde, Gorka

AU - Beristain, Andoni

AU - Álvarez, Roberto

AU - Arrúe, Mónica

AU - Ezkerra, Iker

AU - Belar, Oihana

AU - Bilbao, Roberto

AU - Nikolic, Gorana

AU - Shi, Xi

AU - De Moor, Bart

AU - Mulvenna, Maurice

N1 - Funding Information: Many authors and organizations have described different definitions of dimensions for data quality assessment, reported in [1], [5], [6], to reference a few of them. As an example of this discrepancy, DAMA UK Working Group [5] defined them as: completeness, uniqueness, timeliness, validity, This work was supported by the European Union’s Horizon 2020 Research and Innovation Programme under grant agreement No. 727721 (MIDAS) and by the Gipuzkoan Science, Technology and Innovation Network Programme funding of the HIDRA project. Publisher Copyright: © 1998-2012 IEEE. Copyright: Copyright 2020 Elsevier B.V., All rights reserved.

PY - 2020/10/20

Y1 - 2020/10/20

N2 - In recent years, digitalization of traditional manual processes with a tendency towards a sensorized world and person-generated information streams has led to a massive availability and exponential generation of heterogeneous data in most areas of life. This has been facilitated by the cost reduction and capability improvements of Information and Communications Technology (ICT) for storage, processing and transmission.

AB - In recent years, digitalization of traditional manual processes with a tendency towards a sensorized world and person-generated information streams has led to a massive availability and exponential generation of heterogeneous data in most areas of life. This has been facilitated by the cost reduction and capability improvements of Information and Communications Technology (ICT) for storage, processing and transmission.

KW - Data integrity

KW - Information and communications technology

KW - Data Storage Systems

KW - Data Visualization

KW - Decision Making

KW - Measurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertaintyMeasurement uncertainty

UR - http://www.scopus.com/inward/record.url?scp=85094914556&partnerID=8YFLogxK

U2 - 10.1109/MIM.2020.9234761

DO - 10.1109/MIM.2020.9234761

M3 - Article

SN - 1094-6969

VL - 23

SP - 18

EP - 24

JO - IEEE Instrumentation and Measurement Magazine

JF - IEEE Instrumentation and Measurement Magazine

IS - 7

M1 - 9234761

ER -

Quality of Data Measurements in the Big Data Era: Lessons Learned from MIDAS Project

Abstract

Bibliographical note

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this