Dissertation/Thesis Abstract

Robust and efficient feature selection for high-dimensional datasets
by Mo, Dengyao, Ph.D., University of Cincinnati, 2011, 131; 3458192
Abstract (Summary)

Feature selection is an active research topic in the community of machine learning and knowledge discovery in databases (KDD). It contributes to making the data mining model more comprehensible to domain experts, improving the prediction performance and robustness of the model, and reducing model training. This dissertation aims to provide solutions to three issues that are overlooked by many current feature selection researchers. These issues are feature interaction, data imbalance, and multiple subsets of features.

Most of extant filter feature selection methods are pair-wise comparison methods which test each pair of variables, i.e., one predictor variable and the response variable, and provide a correlation measure for each feature associated with the response variable. Such methods cannot take into account feature interactions.

Data imbalance is another issue in feature selection. Without considering data imbalance, the features selected will be biased towards the majority class.

In high dimensional datasets with sparse data samples, there will be many different feature sets that are highly correlated with the output. Domain experts usually expect us to identify multiple feature sets for them so that they can evaluate them based on their domain knowledge.

This dissertation aims to solve these three issues based on a criterion called minimum expected cost of misclassification (MECM). MECM is a model independent evaluation measure. It evaluates the classification power of the tested feature subset as a whole. MECM has adjustable weights to deal with imbalanced datasets. A number of case studies showed that MECM had some favorable properties for searching a compact subset of interacting features. In addition, an algorithm and corresponding data structure were developed to produce multiple feature subsets.

The success of this research will have broad applications ranging from engineering, business, to bioinformatics, such as credit card fraud detection, email filter setting for spam classification, gene selection for disease diagnosis.

Indexing (document details)
Advisor: Huang, Samuel H.
Commitee: Anand, Sundararaman, Meller, Jaroslaw, Thompson, David, Wagner, Michael
School: University of Cincinnati
Department: Mechanical Engineering
School Location: United States -- Ohio
Source: DAI-A 72/09, Dissertation Abstracts International
Subjects: Statistics, Industrial engineering, Information science
Keywords: Data mining, Feature selection, Knowledge discovery, Knowledge discovery in database, Machine learning, Statistical modeling
Publication Number: 3458192
ISBN: 978-1-124-69636-2
Copyright © 2021 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy