Custom Hardware Versus Cloud Computing in Big Data

G Lightbody, Browne Fiona, Valeriia Haberland

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The computational and data handling challenges in big data are immense yet a market is steadily growing traditionally supported by technologies such as Hadoop for management and processing of huge and unstructured datasets. With this ever increasing deluge of data we now need the algorithms, tools and computing infrastructure to handle the extremely computationally intense data analytics, looking for patterns and information pertinent to creating a market edge for a range of applications. Cloud computing has provided opportunities for scalable high-performance solutions without the initial outlay of developing and creating the core infrastructure. One vendor in particular, Amazon Web Services, has been leading this field. However, other solutions exist to take on the computational load of big data analytics. This chapter provides an overview of the extent of applications in which big data analytics is used. Then an overview is given of some of the high-performance computing options that are available, ranging from multiple Central Processing Unit (CPU) setups, Graphical Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs) and cloud solutions. The chapter concludes by looking at some of the state of the art solutions for deep learning platforms in which custom hardware such as FPGAs and Application Specific Integrated Circuits (ASICs) are used within a cloud platform for key computational bottlenecks.
LanguageEnglish
Title of host publicationUnderstanding Information
Subtitle of host publicationFrom the Big Bang to Big Data
EditorsAlfons Schuster
Chapter9
Pages175-193
Number of pages22
ISBN (Electronic)978-3-319-59090-5
DOIs
Publication statusPublished - 27 Jul 2017

Publication series

NameAdvanced Information and Knowledge Processing
PublisherSpringer

Fingerprint

Cloud computing
Hardware
Field programmable gate arrays (FPGA)
Data handling
Application specific integrated circuits
Processing
Web services
Program processors
Big data

Cite this

Lightbody, G., Fiona, B., & Haberland, V. (2017). Custom Hardware Versus Cloud Computing in Big Data. In A. Schuster (Ed.), Understanding Information : From the Big Bang to Big Data (pp. 175-193). (Advanced Information and Knowledge Processing). https://doi.org/10.1007/978-3-319-59090-5_9
Lightbody, G ; Fiona, Browne ; Haberland, Valeriia. / Custom Hardware Versus Cloud Computing in Big Data. Understanding Information : From the Big Bang to Big Data. editor / Alfons Schuster. 2017. pp. 175-193 (Advanced Information and Knowledge Processing).
@inbook{2ba16c0144b54fafb8f6ab6479c2ba45,
title = "Custom Hardware Versus Cloud Computing in Big Data",
abstract = "The computational and data handling challenges in big data are immense yet a market is steadily growing traditionally supported by technologies such as Hadoop for management and processing of huge and unstructured datasets. With this ever increasing deluge of data we now need the algorithms, tools and computing infrastructure to handle the extremely computationally intense data analytics, looking for patterns and information pertinent to creating a market edge for a range of applications. Cloud computing has provided opportunities for scalable high-performance solutions without the initial outlay of developing and creating the core infrastructure. One vendor in particular, Amazon Web Services, has been leading this field. However, other solutions exist to take on the computational load of big data analytics. This chapter provides an overview of the extent of applications in which big data analytics is used. Then an overview is given of some of the high-performance computing options that are available, ranging from multiple Central Processing Unit (CPU) setups, Graphical Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs) and cloud solutions. The chapter concludes by looking at some of the state of the art solutions for deep learning platforms in which custom hardware such as FPGAs and Application Specific Integrated Circuits (ASICs) are used within a cloud platform for key computational bottlenecks.",
author = "G Lightbody and Browne Fiona and Valeriia Haberland",
year = "2017",
month = "7",
day = "27",
doi = "10.1007/978-3-319-59090-5_9",
language = "English",
isbn = "978-3-319-59089-9",
series = "Advanced Information and Knowledge Processing",
publisher = "Springer",
pages = "175--193",
editor = "Alfons Schuster",
booktitle = "Understanding Information",

}

Lightbody, G, Fiona, B & Haberland, V 2017, Custom Hardware Versus Cloud Computing in Big Data. in A Schuster (ed.), Understanding Information : From the Big Bang to Big Data. Advanced Information and Knowledge Processing, pp. 175-193. https://doi.org/10.1007/978-3-319-59090-5_9

Custom Hardware Versus Cloud Computing in Big Data. / Lightbody, G; Fiona, Browne; Haberland, Valeriia.

Understanding Information : From the Big Bang to Big Data. ed. / Alfons Schuster. 2017. p. 175-193 (Advanced Information and Knowledge Processing).

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Custom Hardware Versus Cloud Computing in Big Data

AU - Lightbody, G

AU - Fiona, Browne

AU - Haberland, Valeriia

PY - 2017/7/27

Y1 - 2017/7/27

N2 - The computational and data handling challenges in big data are immense yet a market is steadily growing traditionally supported by technologies such as Hadoop for management and processing of huge and unstructured datasets. With this ever increasing deluge of data we now need the algorithms, tools and computing infrastructure to handle the extremely computationally intense data analytics, looking for patterns and information pertinent to creating a market edge for a range of applications. Cloud computing has provided opportunities for scalable high-performance solutions without the initial outlay of developing and creating the core infrastructure. One vendor in particular, Amazon Web Services, has been leading this field. However, other solutions exist to take on the computational load of big data analytics. This chapter provides an overview of the extent of applications in which big data analytics is used. Then an overview is given of some of the high-performance computing options that are available, ranging from multiple Central Processing Unit (CPU) setups, Graphical Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs) and cloud solutions. The chapter concludes by looking at some of the state of the art solutions for deep learning platforms in which custom hardware such as FPGAs and Application Specific Integrated Circuits (ASICs) are used within a cloud platform for key computational bottlenecks.

AB - The computational and data handling challenges in big data are immense yet a market is steadily growing traditionally supported by technologies such as Hadoop for management and processing of huge and unstructured datasets. With this ever increasing deluge of data we now need the algorithms, tools and computing infrastructure to handle the extremely computationally intense data analytics, looking for patterns and information pertinent to creating a market edge for a range of applications. Cloud computing has provided opportunities for scalable high-performance solutions without the initial outlay of developing and creating the core infrastructure. One vendor in particular, Amazon Web Services, has been leading this field. However, other solutions exist to take on the computational load of big data analytics. This chapter provides an overview of the extent of applications in which big data analytics is used. Then an overview is given of some of the high-performance computing options that are available, ranging from multiple Central Processing Unit (CPU) setups, Graphical Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs) and cloud solutions. The chapter concludes by looking at some of the state of the art solutions for deep learning platforms in which custom hardware such as FPGAs and Application Specific Integrated Circuits (ASICs) are used within a cloud platform for key computational bottlenecks.

U2 - 10.1007/978-3-319-59090-5_9

DO - 10.1007/978-3-319-59090-5_9

M3 - Chapter

SN - 978-3-319-59089-9

T3 - Advanced Information and Knowledge Processing

SP - 175

EP - 193

BT - Understanding Information

A2 - Schuster, Alfons

ER -

Lightbody G, Fiona B, Haberland V. Custom Hardware Versus Cloud Computing in Big Data. In Schuster A, editor, Understanding Information : From the Big Bang to Big Data. 2017. p. 175-193. (Advanced Information and Knowledge Processing). https://doi.org/10.1007/978-3-319-59090-5_9