Network Aware Cloud Computing for Data and Virtual Machine Placement

Shane Hallett; Gerard Parr; Sally McClean

Network Aware Cloud Computing for Data and Virtual Machine Placement

Shane Hallett, Gerard Parr, Sally McClean

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Cloud Computing has recently come to the fore as one of the most exciting and advanced paradigms in the world of computing. One of the most salient features of Cloud Computing is the ability to dynamically provision services to grow and contract in accordance with consumer demand. The use of virtualisation technologies enables service providers to optimise the use of resources (e.g. compute, storage, bandwidth, etc) whilst minimising operational costs. This paper explores the issues surrounding the optimal placement of data and associated processing algorithms in large scale on demand distributed infrastructures. In addition to critical network considerations such as bandwidth, parallelisation, co-location, etc, considerations about node performance, cost, storage, operating systems, control middleware, processors, and task interdependencies also need to be taken into account. Where data transfers involve very large files network performance considerations will ultimately determine the resource allocation.

Original language	English
Title of host publication	Unknown Host Publication
Publisher	PGNET
Number of pages	6
ISBN (Print)	978-1-902560-25-0
Publication status	Published (in print/issue) - Jun 2011
Event	12th Annual PostGraduate Symposium on the Convergence of Telecommunications, Networking and Broadcasting - Liverpool, United Kingdom Duration: 1 Jun 2011 → …

Other

Other	12th Annual PostGraduate Symposium on the Convergence of Telecommunications, Networking and Broadcasting
Period	1/06/11 → …

Bibliographical note

Reference text: [1] NIST definition of Cloud Computing v15, http://csrc.nist.gov/groups/SNS/cloud-computing/cloud-def-v15.doc
[2] A. Radding, Storage Magazine, Storage gets a dose of medical data, http://searchstorage.techtarget.com/magazineFeature/0,296894,sid5_gci1320683,00.html, July 2008
[3] R. Pattay, D. Moy, P. Kim, S. Munjal, and J. Aviles, “Analysis of teleradiological data transmission in Iraq by modeling and simulation” In Proceedings of the 28th IEEE conference on Military communications (MILCOM'09). IEEE Press, Piscataway, NJ, USA, p. 402-408.
[4] A. Stoian, R. Ivan, I. Stoian, and A. Marichescu, “Current trends in medical imaging acquisition and communication” In Proceedings of the 2008 IEEE International Conference on Automation, Quality and Testing, Robotics - Volume 03 (AQTR '08), Vol. 3. IEEE Computer Society, Washington, DC, USA, p. 94-99.
[5] A. Chowdhury, H. Chien, S. Khire, S. Fan, X. Tang, N. Jayant, G. Chang, "Next-generation E-health communication infrastructure using converged super-broadband optical and wireless access system," World of Wireless Mobile and Multimedia Networks (WoWMoM), 2010 IEEE International Symposium on a , vol., no., p.1-5, 14-17 June 2010.
[6] Z. Yang-Ming, S.M. Cochoff, "Medical Image Viewing on Multicore Platforms Using Parallel Computing Patterns," IT Professional , vol.12, no.2, p.33-41, March-April 2010
[7] S. Dan, F. Zhengjuan, Y. Hao, D.C. Liu, "Fast GPU-Based Automatic Time Gain Compensation for Ultrasound Imaging," Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010.
[8] S. Dan, L. Xiaoying, D.C. Liu, "Optimized GPU Framework for Speckle Reduction Using Histogram Matching and Region Growing," Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010.
[9] T. Chen, Y. Wang, H. Zhang, C. Xiao, "An embedded 3D medical image processing and visualization platform based on dual-core processor," Intelligent Control and Automation (WCICA), 2010 8th World Congress on , vol., no., p.2936-2941, 7-9 July 2010.
[10] I. Reducindo, E.R. Arce-Santana, D.U. Campos-Delgado, A. Alba, "Evaluation of multimodal medical image registration based on Particle Filter," Electrical Engineering Computing Science and Automatic Control (CCE), 2010 7th International Conference on , vol., no., p.406-411, 8-10 Sept. 2010.
[11] V. Shrimali, R.S. Anand, V. Kumar, "Improved segmentation of ultrasound images for fetal biometry, using morphological operators," Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE , vol., no., p.459-462, 3-6 Sept. 2009.
[12] S. Zahurul, S. Zahidul, R. Jidin, "An Adept Edge Detection Algorithm for Human Knee Osteoarthritis Images," Signal Acquisition and Processing, 2010. ICSAP '10. International Conference on , vol., no., p.375-379, 9-10 Feb. 2010.
[13] A. Galizia, F. Viti, A. Clematis, L. Milanesi, "A Dynamic Parallel Approach to Recognize Tubular Breast Cancer for TMA Image Building," Parallel, Distributed and Network-Based Processing (PDP), 2010 18th Euromicro International Conference on , vol., no., p.403-410, 17-19 Feb. 2010.
[14] D. Krefting, R. Luetzkendorf, K. Peter, J. Bernarding, "Performance Analysis of Diffusion Tensor Imaging in an Academic Production Grid," Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on , vol., no., p.751-756, 17-20 May 2010.
[15] K. Daehyun, J.D. Trzasko, M. Smelyanskiy, C.R. Haider, A. Manduca, P. Dubey, "High-performance 3D Compressive Sensing MRI reconstruction," Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3321-3324, Aug. 31 2010-Sept. 4 2010.
[16] K. Hyunjoo, M. Parashar, D.J. Foran, Y. Lin, "Investigating the use of autonomic cloudbursts for high-throughput medical image registration," Grid Computing, 2009 10th IEEE/ACM International Conference on , vol., no., p.34-41, 13-15 Oct. 2009.
[17] C.T. Yang, C.H. Chen, M.F. Yang. 2010. Implementation of a medical image file accessing system in co-allocation data grids. Future Gener. Comput. Syst. 26, 8 (October 2010), 1127-1140.
[18] Digital Imaging and Communications in Medicine, http://medical.nema.org/dicom/geninfo/Brochure.pdf
[19] Health Level 7 Protocol, http://www.hl7.com.au/FAQ.htm
[20] E.J.C. Arguiñarena, J.E. Macchi, P.P. Escobar, M. del Fresno, J.M. Massa, M.A. Santiago, "Dcm-Ar: A fast Flash-based Web-PACS viewer for displaying large DICOM images," Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3463-3466, Aug. 31 2010-Sept. 4 2010.
[21] J.T. Piao, J. Yan, "A Network-aware Virtual Machine Placement and Migration Approach in Cloud Computing," Grid and Cloud Computing, International Conference on, pp. 87-92, 2010 Ninth International Conference on Grid and Cloud Computing, 2010.
[22] Z.I.M. Yusoh, T. Maolin, "A penalty-based genetic algorithm for the composite SaaS placement problem in the Cloud," Evolutionary Computation (CEC), 2010 IEEE Congress on , vol., no., p.1-8.
[23] Y.M. Chen, S.Y. Tsai, "Optimal Provisioning of Resource in a Cloud Service", IJCSI International Journal of Computer Science Issues, Vol. 7, Issue 6, November 2010.
[24] M. Korupolu, A. Singh, B. Bamba. 2009. "Coupled placement in modern data centers", In Proceedings of the 2009 IEEE International Symposium on Parallel\&Distributed Processing (IPDPS '09). IEEE Computer Society, Washington, DC, USA, p. 1-12.
[25] The Insight Image Segmentation and Registration Toolkit (ITK) http://www.itk.org

Keywords

component
cloud computing
data placement
virtual machine migration

Cite this

@inproceedings{a694fdb5b6244e75b59f27db33ada716,

title = "Network Aware Cloud Computing for Data and Virtual Machine Placement",

abstract = "Cloud Computing has recently come to the fore as one of the most exciting and advanced paradigms in the world of computing. One of the most salient features of Cloud Computing is the ability to dynamically provision services to grow and contract in accordance with consumer demand. The use of virtualisation technologies enables service providers to optimise the use of resources (e.g. compute, storage, bandwidth, etc) whilst minimising operational costs. This paper explores the issues surrounding the optimal placement of data and associated processing algorithms in large scale on demand distributed infrastructures. In addition to critical network considerations such as bandwidth, parallelisation, co-location, etc, considerations about node performance, cost, storage, operating systems, control middleware, processors, and task interdependencies also need to be taken into account. Where data transfers involve very large files network performance considerations will ultimately determine the resource allocation.",

keywords = "component, cloud computing, data placement, virtual machine migration",

author = "Shane Hallett and Gerard Parr and Sally McClean",

note = "Reference text: [1] NIST definition of Cloud Computing v15, http://csrc.nist.gov/groups/SNS/cloud-computing/cloud-def-v15.doc [2] A. Radding, Storage Magazine, Storage gets a dose of medical data, http://searchstorage.techtarget.com/magazineFeature/0,296894,sid5_gci1320683,00.html, July 2008 [3] R. Pattay, D. Moy, P. Kim, S. Munjal, and J. Aviles, “Analysis of teleradiological data transmission in Iraq by modeling and simulation” In Proceedings of the 28th IEEE conference on Military communications (MILCOM'09). IEEE Press, Piscataway, NJ, USA, p. 402-408. [4] A. Stoian, R. Ivan, I. Stoian, and A. Marichescu, “Current trends in medical imaging acquisition and communication” In Proceedings of the 2008 IEEE International Conference on Automation, Quality and Testing, Robotics - Volume 03 (AQTR '08), Vol. 3. IEEE Computer Society, Washington, DC, USA, p. 94-99. [5] A. Chowdhury, H. Chien, S. Khire, S. Fan, X. Tang, N. Jayant, G. Chang, {"}Next-generation E-health communication infrastructure using converged super-broadband optical and wireless access system,{"} World of Wireless Mobile and Multimedia Networks (WoWMoM), 2010 IEEE International Symposium on a , vol., no., p.1-5, 14-17 June 2010. [6] Z. Yang-Ming, S.M. Cochoff, {"}Medical Image Viewing on Multicore Platforms Using Parallel Computing Patterns,{"} IT Professional , vol.12, no.2, p.33-41, March-April 2010 [7] S. Dan, F. Zhengjuan, Y. Hao, D.C. Liu, {"}Fast GPU-Based Automatic Time Gain Compensation for Ultrasound Imaging,{"} Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010. [8] S. Dan, L. Xiaoying, D.C. Liu, {"}Optimized GPU Framework for Speckle Reduction Using Histogram Matching and Region Growing,{"} Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010. [9] T. Chen, Y. Wang, H. Zhang, C. Xiao, {"}An embedded 3D medical image processing and visualization platform based on dual-core processor,{"} Intelligent Control and Automation (WCICA), 2010 8th World Congress on , vol., no., p.2936-2941, 7-9 July 2010. [10] I. Reducindo, E.R. Arce-Santana, D.U. Campos-Delgado, A. Alba, {"}Evaluation of multimodal medical image registration based on Particle Filter,{"} Electrical Engineering Computing Science and Automatic Control (CCE), 2010 7th International Conference on , vol., no., p.406-411, 8-10 Sept. 2010. [11] V. Shrimali, R.S. Anand, V. Kumar, {"}Improved segmentation of ultrasound images for fetal biometry, using morphological operators,{"} Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE , vol., no., p.459-462, 3-6 Sept. 2009. [12] S. Zahurul, S. Zahidul, R. Jidin, {"}An Adept Edge Detection Algorithm for Human Knee Osteoarthritis Images,{"} Signal Acquisition and Processing, 2010. ICSAP '10. International Conference on , vol., no., p.375-379, 9-10 Feb. 2010. [13] A. Galizia, F. Viti, A. Clematis, L. Milanesi, {"}A Dynamic Parallel Approach to Recognize Tubular Breast Cancer for TMA Image Building,{"} Parallel, Distributed and Network-Based Processing (PDP), 2010 18th Euromicro International Conference on , vol., no., p.403-410, 17-19 Feb. 2010. [14] D. Krefting, R. Luetzkendorf, K. Peter, J. Bernarding, {"}Performance Analysis of Diffusion Tensor Imaging in an Academic Production Grid,{"} Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on , vol., no., p.751-756, 17-20 May 2010. [15] K. Daehyun, J.D. Trzasko, M. Smelyanskiy, C.R. Haider, A. Manduca, P. Dubey, {"}High-performance 3D Compressive Sensing MRI reconstruction,{"} Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3321-3324, Aug. 31 2010-Sept. 4 2010. [16] K. Hyunjoo, M. Parashar, D.J. Foran, Y. Lin, {"}Investigating the use of autonomic cloudbursts for high-throughput medical image registration,{"} Grid Computing, 2009 10th IEEE/ACM International Conference on , vol., no., p.34-41, 13-15 Oct. 2009. [17] C.T. Yang, C.H. Chen, M.F. Yang. 2010. Implementation of a medical image file accessing system in co-allocation data grids. Future Gener. Comput. Syst. 26, 8 (October 2010), 1127-1140. [18] Digital Imaging and Communications in Medicine, http://medical.nema.org/dicom/geninfo/Brochure.pdf [19] Health Level 7 Protocol, http://www.hl7.com.au/FAQ.htm [20] E.J.C. Argui{\~n}arena, J.E. Macchi, P.P. Escobar, M. del Fresno, J.M. Massa, M.A. Santiago, {"}Dcm-Ar: A fast Flash-based Web-PACS viewer for displaying large DICOM images,{"} Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3463-3466, Aug. 31 2010-Sept. 4 2010. [21] J.T. Piao, J. Yan, {"}A Network-aware Virtual Machine Placement and Migration Approach in Cloud Computing,{"} Grid and Cloud Computing, International Conference on, pp. 87-92, 2010 Ninth International Conference on Grid and Cloud Computing, 2010. [22] Z.I.M. Yusoh, T. Maolin, {"}A penalty-based genetic algorithm for the composite SaaS placement problem in the Cloud,{"} Evolutionary Computation (CEC), 2010 IEEE Congress on , vol., no., p.1-8. [23] Y.M. Chen, S.Y. Tsai, {"}Optimal Provisioning of Resource in a Cloud Service{"}, IJCSI International Journal of Computer Science Issues, Vol. 7, Issue 6, November 2010. [24] M. Korupolu, A. Singh, B. Bamba. 2009. {"}Coupled placement in modern data centers{"}, In Proceedings of the 2009 IEEE International Symposium on Parallel\&Distributed Processing (IPDPS '09). IEEE Computer Society, Washington, DC, USA, p. 1-12. [25] The Insight Image Segmentation and Registration Toolkit (ITK) http://www.itk.org; 12th Annual PostGraduate Symposium on the Convergence of Telecommunications, Networking and Broadcasting ; Conference date: 01-06-2011",

year = "2011",

month = jun,

language = "English",

isbn = "978-1-902560-25-0",

booktitle = "Unknown Host Publication",

publisher = "PGNET",

}

TY - GEN

T1 - Network Aware Cloud Computing for Data and Virtual Machine Placement

AU - Hallett, Shane

AU - Parr, Gerard

AU - McClean, Sally

N1 - Reference text: [1] NIST definition of Cloud Computing v15, http://csrc.nist.gov/groups/SNS/cloud-computing/cloud-def-v15.doc [2] A. Radding, Storage Magazine, Storage gets a dose of medical data, http://searchstorage.techtarget.com/magazineFeature/0,296894,sid5_gci1320683,00.html, July 2008 [3] R. Pattay, D. Moy, P. Kim, S. Munjal, and J. Aviles, “Analysis of teleradiological data transmission in Iraq by modeling and simulation” In Proceedings of the 28th IEEE conference on Military communications (MILCOM'09). IEEE Press, Piscataway, NJ, USA, p. 402-408. [4] A. Stoian, R. Ivan, I. Stoian, and A. Marichescu, “Current trends in medical imaging acquisition and communication” In Proceedings of the 2008 IEEE International Conference on Automation, Quality and Testing, Robotics - Volume 03 (AQTR '08), Vol. 3. IEEE Computer Society, Washington, DC, USA, p. 94-99. [5] A. Chowdhury, H. Chien, S. Khire, S. Fan, X. Tang, N. Jayant, G. Chang, "Next-generation E-health communication infrastructure using converged super-broadband optical and wireless access system," World of Wireless Mobile and Multimedia Networks (WoWMoM), 2010 IEEE International Symposium on a , vol., no., p.1-5, 14-17 June 2010. [6] Z. Yang-Ming, S.M. Cochoff, "Medical Image Viewing on Multicore Platforms Using Parallel Computing Patterns," IT Professional , vol.12, no.2, p.33-41, March-April 2010 [7] S. Dan, F. Zhengjuan, Y. Hao, D.C. Liu, "Fast GPU-Based Automatic Time Gain Compensation for Ultrasound Imaging," Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010. [8] S. Dan, L. Xiaoying, D.C. Liu, "Optimized GPU Framework for Speckle Reduction Using Histogram Matching and Region Growing," Bioinformatics and Biomedical Engineering (iCBBE), 2010 4th International Conference on , vol., no., p.1-4, 18-20 June 2010. [9] T. Chen, Y. Wang, H. Zhang, C. Xiao, "An embedded 3D medical image processing and visualization platform based on dual-core processor," Intelligent Control and Automation (WCICA), 2010 8th World Congress on , vol., no., p.2936-2941, 7-9 July 2010. [10] I. Reducindo, E.R. Arce-Santana, D.U. Campos-Delgado, A. Alba, "Evaluation of multimodal medical image registration based on Particle Filter," Electrical Engineering Computing Science and Automatic Control (CCE), 2010 7th International Conference on , vol., no., p.406-411, 8-10 Sept. 2010. [11] V. Shrimali, R.S. Anand, V. Kumar, "Improved segmentation of ultrasound images for fetal biometry, using morphological operators," Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE , vol., no., p.459-462, 3-6 Sept. 2009. [12] S. Zahurul, S. Zahidul, R. Jidin, "An Adept Edge Detection Algorithm for Human Knee Osteoarthritis Images," Signal Acquisition and Processing, 2010. ICSAP '10. International Conference on , vol., no., p.375-379, 9-10 Feb. 2010. [13] A. Galizia, F. Viti, A. Clematis, L. Milanesi, "A Dynamic Parallel Approach to Recognize Tubular Breast Cancer for TMA Image Building," Parallel, Distributed and Network-Based Processing (PDP), 2010 18th Euromicro International Conference on , vol., no., p.403-410, 17-19 Feb. 2010. [14] D. Krefting, R. Luetzkendorf, K. Peter, J. Bernarding, "Performance Analysis of Diffusion Tensor Imaging in an Academic Production Grid," Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on , vol., no., p.751-756, 17-20 May 2010. [15] K. Daehyun, J.D. Trzasko, M. Smelyanskiy, C.R. Haider, A. Manduca, P. Dubey, "High-performance 3D Compressive Sensing MRI reconstruction," Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3321-3324, Aug. 31 2010-Sept. 4 2010. [16] K. Hyunjoo, M. Parashar, D.J. Foran, Y. Lin, "Investigating the use of autonomic cloudbursts for high-throughput medical image registration," Grid Computing, 2009 10th IEEE/ACM International Conference on , vol., no., p.34-41, 13-15 Oct. 2009. [17] C.T. Yang, C.H. Chen, M.F. Yang. 2010. Implementation of a medical image file accessing system in co-allocation data grids. Future Gener. Comput. Syst. 26, 8 (October 2010), 1127-1140. [18] Digital Imaging and Communications in Medicine, http://medical.nema.org/dicom/geninfo/Brochure.pdf [19] Health Level 7 Protocol, http://www.hl7.com.au/FAQ.htm [20] E.J.C. Arguiñarena, J.E. Macchi, P.P. Escobar, M. del Fresno, J.M. Massa, M.A. Santiago, "Dcm-Ar: A fast Flash-based Web-PACS viewer for displaying large DICOM images," Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , vol., no., p.3463-3466, Aug. 31 2010-Sept. 4 2010. [21] J.T. Piao, J. Yan, "A Network-aware Virtual Machine Placement and Migration Approach in Cloud Computing," Grid and Cloud Computing, International Conference on, pp. 87-92, 2010 Ninth International Conference on Grid and Cloud Computing, 2010. [22] Z.I.M. Yusoh, T. Maolin, "A penalty-based genetic algorithm for the composite SaaS placement problem in the Cloud," Evolutionary Computation (CEC), 2010 IEEE Congress on , vol., no., p.1-8. [23] Y.M. Chen, S.Y. Tsai, "Optimal Provisioning of Resource in a Cloud Service", IJCSI International Journal of Computer Science Issues, Vol. 7, Issue 6, November 2010. [24] M. Korupolu, A. Singh, B. Bamba. 2009. "Coupled placement in modern data centers", In Proceedings of the 2009 IEEE International Symposium on Parallel\&Distributed Processing (IPDPS '09). IEEE Computer Society, Washington, DC, USA, p. 1-12. [25] The Insight Image Segmentation and Registration Toolkit (ITK) http://www.itk.org

PY - 2011/6

Y1 - 2011/6

N2 - Cloud Computing has recently come to the fore as one of the most exciting and advanced paradigms in the world of computing. One of the most salient features of Cloud Computing is the ability to dynamically provision services to grow and contract in accordance with consumer demand. The use of virtualisation technologies enables service providers to optimise the use of resources (e.g. compute, storage, bandwidth, etc) whilst minimising operational costs. This paper explores the issues surrounding the optimal placement of data and associated processing algorithms in large scale on demand distributed infrastructures. In addition to critical network considerations such as bandwidth, parallelisation, co-location, etc, considerations about node performance, cost, storage, operating systems, control middleware, processors, and task interdependencies also need to be taken into account. Where data transfers involve very large files network performance considerations will ultimately determine the resource allocation.

AB - Cloud Computing has recently come to the fore as one of the most exciting and advanced paradigms in the world of computing. One of the most salient features of Cloud Computing is the ability to dynamically provision services to grow and contract in accordance with consumer demand. The use of virtualisation technologies enables service providers to optimise the use of resources (e.g. compute, storage, bandwidth, etc) whilst minimising operational costs. This paper explores the issues surrounding the optimal placement of data and associated processing algorithms in large scale on demand distributed infrastructures. In addition to critical network considerations such as bandwidth, parallelisation, co-location, etc, considerations about node performance, cost, storage, operating systems, control middleware, processors, and task interdependencies also need to be taken into account. Where data transfers involve very large files network performance considerations will ultimately determine the resource allocation.

KW - component

KW - cloud computing

KW - data placement

KW - virtual machine migration

M3 - Conference contribution

SN - 978-1-902560-25-0

BT - Unknown Host Publication

PB - PGNET

T2 - 12th Annual PostGraduate Symposium on the Convergence of Telecommunications, Networking and Broadcasting

Y2 - 1 June 2011

ER -

Network Aware Cloud Computing for Data and Virtual Machine Placement

Abstract

Other

Bibliographical note

Keywords

Fingerprint

Cite this