Data Fusion Performance Prophecy: A Random Forest Revelation

Zhongmin Zhang; Shengli Wu

Data Fusion Performance Prophecy: A Random Forest Revelation

Zhongmin Zhang, Shengli Wu

Research output: Contribution to conference › Paper › peer-review

Abstract

Data fusion synthesizes results from diverse sources, but the performance impact remains mysterious. This research reveals the inner workings of fusion through machine prophecy. Constructing a random forest model using TREC dataset benchmarks, we accurately predicted the performance of two fusion
algorithms. The model achieved near perfect R2 scores above 0.9 by exploiting meaningful statistical features. Compared to linear regression, the tree-based
ensemble provides superior insight. The importance of newly identified drivers,
like P@1000 metrics, is quantified. With this prescient view, researchers can
refine fusion techniques to offer better search. By uncovering the secrets of fusion
success, machine learning guides the path to retrieval excellence.

Original language	English
Pages	192-200
Number of pages	9
Publication status	Published (in print/issue) - 1 Dec 2023
Event	25th International Conference on Information Integration and Web Intelligence - Denpasar, Bali, Indonesia Duration: 4 Dec 2023 → 6 Dec 2023 https://www.iiwas.org/conferences/iiwas2023/

Conference

Conference	25th International Conference on Information Integration and Web Intelligence
Abbreviated title	iiWAS 2023
Country/Territory	Indonesia
City	Bali
Period	4/12/23 → 6/12/23
Internet address	https://www.iiwas.org/conferences/iiwas2023/

Bibliographical note

Publisher Copyright:
© 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.

Keywords

data fusion
performance prediction
random forest
information retrieval

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

https://link.springer.com/chapter/10.1007/978-3-031-48316-5_20Licence: Other

Cite this

@conference{265fe4b6568f4b8381d7ab151ac4d21e,

title = "Data Fusion Performance Prophecy: A Random Forest Revelation",

abstract = "Data fusion synthesizes results from diverse sources, but the performance impact remains mysterious. This research reveals the inner workings of fusion through machine prophecy. Constructing a random forest model using TREC dataset benchmarks, we accurately predicted the performance of two fusionalgorithms. The model achieved near perfect R2 scores above 0.9 by exploiting meaningful statistical features. Compared to linear regression, the tree-basedensemble provides superior insight. The importance of newly identified drivers,like P@1000 metrics, is quantified. With this prescient view, researchers canrefine fusion techniques to offer better search. By uncovering the secrets of fusionsuccess, machine learning guides the path to retrieval excellence.",

keywords = "data fusion, performance prediction, random forest, information retrieval",

author = "Zhongmin Zhang and Shengli Wu",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 25th International Conference on Information Integration and Web Intelligence, iiWAS 2023 ; Conference date: 04-12-2023 Through 06-12-2023",

year = "2023",

month = dec,

day = "1",

language = "English",

pages = "192--200",

url = "https://www.iiwas.org/conferences/iiwas2023/",

}

TY - CONF

T1 - Data Fusion Performance Prophecy: A Random Forest Revelation

AU - Zhang, Zhongmin

AU - Wu, Shengli

PY - 2023/12/1

Y1 - 2023/12/1

N2 - Data fusion synthesizes results from diverse sources, but the performance impact remains mysterious. This research reveals the inner workings of fusion through machine prophecy. Constructing a random forest model using TREC dataset benchmarks, we accurately predicted the performance of two fusionalgorithms. The model achieved near perfect R2 scores above 0.9 by exploiting meaningful statistical features. Compared to linear regression, the tree-basedensemble provides superior insight. The importance of newly identified drivers,like P@1000 metrics, is quantified. With this prescient view, researchers canrefine fusion techniques to offer better search. By uncovering the secrets of fusionsuccess, machine learning guides the path to retrieval excellence.

AB - Data fusion synthesizes results from diverse sources, but the performance impact remains mysterious. This research reveals the inner workings of fusion through machine prophecy. Constructing a random forest model using TREC dataset benchmarks, we accurately predicted the performance of two fusionalgorithms. The model achieved near perfect R2 scores above 0.9 by exploiting meaningful statistical features. Compared to linear regression, the tree-basedensemble provides superior insight. The importance of newly identified drivers,like P@1000 metrics, is quantified. With this prescient view, researchers canrefine fusion techniques to offer better search. By uncovering the secrets of fusionsuccess, machine learning guides the path to retrieval excellence.

KW - data fusion

KW - performance prediction

KW - random forest

KW - information retrieval

UR - http://www.scopus.com/inward/record.url?scp=85178665575&partnerID=8YFLogxK

M3 - Paper

SP - 192

EP - 200

T2 - 25th International Conference on Information Integration and Web Intelligence

Y2 - 4 December 2023 through 6 December 2023

ER -

Data Fusion Performance Prophecy: A Random Forest Revelation

Abstract

Conference

Bibliographical note

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this