Dissertation/Thesis Abstract

Stability analysis of feature selection approaches with low quality data
by Altidor, Wilker, Ph.D., Florida Atlantic University, 2011, 256; 3480605
Abstract (Summary)

One of the greatest challenges to data mining is erroneous or noisy data. Several studies have noted the weak performance of classification models trained from low quality data. This dissertation shows that low quality data can also impact the effectiveness of feature selection, and considers the effect of class noise on various feature ranking techniques. It presents a novel approach to feature ranking based on ensemble learning and assesses these ensemble feature selection techniques in terms of their robustness to class noise. It presents a noise-based stability analysis that measures the degree of agreement between a feature ranking techniques output on a clean dataset versus its outputs on the same dataset but corrupted with different combinations of noise level and noise distribution. It then considers classification performances from models built with a subset of the original features obtained after applying feature ranking techniques on noisy data. It proposes the focused ensemble feature ranking as a noise-tolerant approach to feature selection and compares focused ensembles with general ensembles in terms of the ability of the selected features to withstand the impact of class noise when used to build classification models. Finally, it explores three approaches for addressing the combined problem of high dimensionality and class imbalance. Collectively, this research shows the importance of considering class noise when performing feature selection.

Indexing (document details)
Advisor: Khoshgoftaar, Taghi M.
School: Florida Atlantic University
School Location: United States -- Florida
Source: DAI-B 73/01, Dissertation Abstracts International
Subjects: Computer science
Keywords: Data mining, Feature selection, Noisy data, Quality data, Stability
Publication Number: 3480605
ISBN: 978-1-124-95267-3
Copyright © 2021 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy