Parallel Particle Swarm Optimization Based on Spark for Academic Paper Co-Authorship Prediction

Congmin Yang, Tao Zhu, Huansheng Ning, Luke Chen, Zhenyu Liu

Research output: Contribution to journalArticlepeer-review

Abstract

The particle swarm optimization (PSO) algorithm has been widely used in various optimization problems. Although PSO has been successful in many fields, solving optimization problems in big data applications often requires processing of massive amounts of data, which cannot be handled by traditional PSO on a single machine. There have been several parallel PSO based on Spark, however they are almost proposed for solving numerical optimization problems, and few for big data optimization problems. In this paper, we propose a new Spark-based parallel PSO algorithm to predict the co-authorship of academic papers, which we formulate as an optimization problem from massive academic data. Experimental results show that the proposed parallel PSO can achieve good prediction accuracy.
Original languageEnglish
Article number530
JournalInformation
Volume12
Issue number12
Publication statusPublished - 20 Dec 2021

Fingerprint

Dive into the research topics of 'Parallel Particle Swarm Optimization Based on Spark for Academic Paper Co-Authorship Prediction'. Together they form a unique fingerprint.

Cite this