Multi-class and multi-attribute are two important features of classification problems and have different effects on the requirements and performance of the classifier. Decomposition strategy and overlap function are two effective ways to enhance the performance of classifiers, because the former decomposes a complex multi-class problem into multiple simple sub-problems; the latter uses various functions to specify the conjunctive relationship of input variables in a multi-attribute problem. Extended belief rule-based system (EBRBS) is an advanced rule-based system that has been widely used in classification problems. In order to apply decomposition strategies and overlap functions to enhance the performance of EBRBSs, the present work focuses on the investigative research and comparative evaluation of the commonly used one-versus-one (OVO) decomposition strategy and five common overlap functions to improve the performance of EBRBSs on multi-class and multi-attribute problems. More specifically, three typical kinds of EBRBSs, namely original EBRBS (O-EBRBS), EBRBS with dynamic rule activation (DRA-EBRBS), and a latest EBRBS for big data (Micro-EBRBS), are selected to conduct extensive experimental studies on twenty classification problems. To best of our knowledge, this present work is the first time to provide a meaningful and useful study in revealing the potential capability of the EBRBSs with decomposition strategy and overlap function for multi-class and multi-attribute problems. Experimental results demonstrate that the square product overlap function and the OVO strategy can enhance the performance of EBRBSs over others for twenty classification problems.
|Journal||International Journal of Machine Learning and Cybernetics|
|Publication status||Published (in print/issue) - 14 Jun 2021|
Bibliographical noteFunding Information:
This research was supported by the National Natural Science Foundation of China (Nos. 72001043 and 61773123), the Natural Science Foundation of Fujian Province of China (No. 2020J05122), the Humanities and Social Science Foundation of the Ministry of Education of China (No. 20YJC630188), the Social Science Planning Fund Project of Fujian Province of China (No. FJ2019C032), the Chengdu International Science Cooperation Project (No. 2020-GH02-00064-HZ), and the Spanish Ministry of Economy and Competitiveness through the Spanish National Research Project PGC2018-099402-B-I00.
© 2021, The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.
- Decomposition strategy
- Extended belief rule-based system
- Overlap function