Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets

Yanyan Yang, Degang Chen, H. Wang, Xizhao Wang

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Feature selection based on fuzzy rough sets is an effective approach to select a compact feature subset that optimally predicts a given decision label. Despite being studied extensively, most existing methods of fuzzy rough set based feature selection are restricted to computing the whole dataset in batch, which is often costly or even intractable for large datasets. To improve the time efficiency, we investigate the incremental perspective for fuzzy rough set based feature selection assuming data can be presented in sample subsets one after another. The key challenge for the incremental perspective is how to add and delete features with the subsequent arrival of sample subsets. We tackle this challenge with strategies of adding and deleting features based on the relative discernibility relations that are updated as subsets arrive sequentially. Two incremental algorithms for fuzzy rough set based feature selection are designed based on the strategies. One updates the selected features as each sample subset arrives, and outputs the final feature subset where no sample subset is left. The other updates the relative discernibility relations but only performs feature selection where there is no further subset arriving. Experimental comparisons suggest our incremental algorithms expedite fuzzy rough set based feature selection without compromising performance.
LanguageEnglish
Pages1257-1273
JournalIEEE Transactions on Fuzzy Systems
Volume26
Issue number3
Early online date27 Jun 2017
DOIs
Publication statusPublished - 30 Jun 2018

Fingerprint

Fuzzy Rough Sets
Feature Selection
Feature extraction
Subset
Set theory
Incremental Algorithm
Update
Labels
Large Data Sets
Batch
Predict
Computing
Output

Keywords

  • Attribute reduction, feature selection, fuzzy rough sets, incremental learning, relative discernibility relation

Cite this

Yang, Yanyan ; Chen, Degang ; Wang, H. ; Wang, Xizhao. / Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets. In: IEEE Transactions on Fuzzy Systems. 2018 ; Vol. 26, No. 3. pp. 1257-1273.
@article{675a81facaad4260b256a3e4b971fb0e,
title = "Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets",
abstract = "Feature selection based on fuzzy rough sets is an effective approach to select a compact feature subset that optimally predicts a given decision label. Despite being studied extensively, most existing methods of fuzzy rough set based feature selection are restricted to computing the whole dataset in batch, which is often costly or even intractable for large datasets. To improve the time efficiency, we investigate the incremental perspective for fuzzy rough set based feature selection assuming data can be presented in sample subsets one after another. The key challenge for the incremental perspective is how to add and delete features with the subsequent arrival of sample subsets. We tackle this challenge with strategies of adding and deleting features based on the relative discernibility relations that are updated as subsets arrive sequentially. Two incremental algorithms for fuzzy rough set based feature selection are designed based on the strategies. One updates the selected features as each sample subset arrives, and outputs the final feature subset where no sample subset is left. The other updates the relative discernibility relations but only performs feature selection where there is no further subset arriving. Experimental comparisons suggest our incremental algorithms expedite fuzzy rough set based feature selection without compromising performance.",
keywords = "Attribute reduction, feature selection, fuzzy rough sets, incremental learning, relative discernibility relation",
author = "Yanyan Yang and Degang Chen and H. Wang and Xizhao Wang",
note = "Exception: The lead author (Dr Yanyan Yang) was pregnant with some complications.",
year = "2018",
month = "6",
day = "30",
doi = "10.1109/TFUZZ.2017.2718492",
language = "English",
volume = "26",
pages = "1257--1273",
journal = "IEEE Transactions on Fuzzy Systems",
issn = "1063-6706",
number = "3",

}

Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets. / Yang, Yanyan; Chen, Degang; Wang, H.; Wang, Xizhao.

In: IEEE Transactions on Fuzzy Systems, Vol. 26, No. 3, 30.06.2018, p. 1257-1273.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Incremental Perspective for Feature Selection Based on Fuzzy Rough Sets

AU - Yang, Yanyan

AU - Chen, Degang

AU - Wang, H.

AU - Wang, Xizhao

N1 - Exception: The lead author (Dr Yanyan Yang) was pregnant with some complications.

PY - 2018/6/30

Y1 - 2018/6/30

N2 - Feature selection based on fuzzy rough sets is an effective approach to select a compact feature subset that optimally predicts a given decision label. Despite being studied extensively, most existing methods of fuzzy rough set based feature selection are restricted to computing the whole dataset in batch, which is often costly or even intractable for large datasets. To improve the time efficiency, we investigate the incremental perspective for fuzzy rough set based feature selection assuming data can be presented in sample subsets one after another. The key challenge for the incremental perspective is how to add and delete features with the subsequent arrival of sample subsets. We tackle this challenge with strategies of adding and deleting features based on the relative discernibility relations that are updated as subsets arrive sequentially. Two incremental algorithms for fuzzy rough set based feature selection are designed based on the strategies. One updates the selected features as each sample subset arrives, and outputs the final feature subset where no sample subset is left. The other updates the relative discernibility relations but only performs feature selection where there is no further subset arriving. Experimental comparisons suggest our incremental algorithms expedite fuzzy rough set based feature selection without compromising performance.

AB - Feature selection based on fuzzy rough sets is an effective approach to select a compact feature subset that optimally predicts a given decision label. Despite being studied extensively, most existing methods of fuzzy rough set based feature selection are restricted to computing the whole dataset in batch, which is often costly or even intractable for large datasets. To improve the time efficiency, we investigate the incremental perspective for fuzzy rough set based feature selection assuming data can be presented in sample subsets one after another. The key challenge for the incremental perspective is how to add and delete features with the subsequent arrival of sample subsets. We tackle this challenge with strategies of adding and deleting features based on the relative discernibility relations that are updated as subsets arrive sequentially. Two incremental algorithms for fuzzy rough set based feature selection are designed based on the strategies. One updates the selected features as each sample subset arrives, and outputs the final feature subset where no sample subset is left. The other updates the relative discernibility relations but only performs feature selection where there is no further subset arriving. Experimental comparisons suggest our incremental algorithms expedite fuzzy rough set based feature selection without compromising performance.

KW - Attribute reduction, feature selection, fuzzy rough sets, incremental learning, relative discernibility relation

U2 - 10.1109/TFUZZ.2017.2718492

DO - 10.1109/TFUZZ.2017.2718492

M3 - Article

VL - 26

SP - 1257

EP - 1273

JO - IEEE Transactions on Fuzzy Systems

T2 - IEEE Transactions on Fuzzy Systems

JF - IEEE Transactions on Fuzzy Systems

SN - 1063-6706

IS - 3

ER -