Remote Sensing Inversion of PM10 Based on Spark Platform

Zhenyu Yu; Zhibao Wang; Lu Bai; Liangfu Chen; Jinhua Tao

doi:10.1109/IGARSS47720.2021.9554323

Remote Sensing Inversion of PM10 Based on Spark Platform

Zhenyu Yu, Zhibao Wang, Lu Bai, Liangfu Chen, Jinhua Tao

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Citations (Scopus)

Abstract

With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.

Original language	English
Title of host publication	2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS
Publisher	IEEE
Pages	1685-1688
Number of pages	4
ISBN (Electronic)	978-1-6654-0369-6, 978-1-6654-0368-9
ISBN (Print)	978-1-6654-4762-1
DOIs	https://doi.org/10.1109/IGARSS47720.2021.9554323
Publication status	Published (in print/issue) - 12 Oct 2021
Event	IGARSS 2021 - 2021 IEEE International Geoscience and Remote Sensing Symposium - Brussels, Belgium Duration: 11 Jul 2021 → 16 Jul 2021

Conference

Conference	IGARSS 2021 - 2021 IEEE International Geoscience and Remote Sensing Symposium
Period	11/07/21 → 16/07/21

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/IGARSS47720.2021.9554323

Cite this

@inproceedings{4e5cd486fef74932bb9d432af092fbb9,

title = "Remote Sensing Inversion of PM10 Based on Spark Platform",

abstract = "With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.",

author = "Zhenyu Yu and Zhibao Wang and Lu Bai and Liangfu Chen and Jinhua Tao",

year = "2021",

month = oct,

day = "12",

doi = "10.1109/IGARSS47720.2021.9554323",

language = "English",

isbn = "978-1-6654-4762-1",

pages = "1685--1688",

booktitle = "2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS",

publisher = "IEEE",

address = "United States",

note = "IGARSS 2021 - 2021 IEEE International Geoscience and Remote Sensing Symposium ; Conference date: 11-07-2021 Through 16-07-2021",

}

TY - GEN

T1 - Remote Sensing Inversion of PM10 Based on Spark Platform

AU - Yu, Zhenyu

AU - Wang, Zhibao

AU - Bai, Lu

AU - Chen, Liangfu

AU - Tao, Jinhua

PY - 2021/10/12

Y1 - 2021/10/12

N2 - With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.

AB - With the continuous growth of remote sensing data and the application of fast and effective atmosphere remote sensing inversion algorithm, this paper proposes a PM10 fast inversion approach based on Spark platform which uses Apache Spark as the analytics engine and integrates with the traditional atmospheric remote sensing inversion algorithm. We first store aerosol data which is MYD04_3K from NASA into HDFS. Then the inversion algorithm is combined with Spark via the function interface to realise rapid atmospheric remote sensing inversion. The experimental results based on Spark platform are compared with those obtained from the traditional physical hardware. The results prove that the proposed atmospheric remote sensing inversion method based on Spark has high efficiency.

UR - https://ieeexplore.ieee.org/document/9554323/

U2 - 10.1109/IGARSS47720.2021.9554323

DO - 10.1109/IGARSS47720.2021.9554323

M3 - Conference contribution

SN - 978-1-6654-4762-1

SP - 1685

EP - 1688

BT - 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS

PB - IEEE

T2 - IGARSS 2021 - 2021 IEEE International Geoscience and Remote Sensing Symposium

Y2 - 11 July 2021 through 16 July 2021

ER -

Remote Sensing Inversion of PM10 Based on Spark Platform

Abstract

Conference

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this