With PQDT Open, you can read the full text of open access dissertations and theses free of charge.
About PQDT Open
Search
Text Classification is one of the classical problems in computer science, which is primarily used for categorizing data, spam detection, anonymization, information extraction, text summarization etc. Given the large amounts of data involved in the above applications, automated and accurate training models and approaches to classify data efficiently are needed.
In this thesis, an extensive study of the interaction between natural language processing, information retrieval and text classification has been performed. A case study named “keyword extraction” that deals with ‘identifying keywords and tags from millions of text questions’ is used as a reference. Different classifiers are implemented using MapReduce paradigm on the case study and the experimental results are recorded using two newly built distributed computing Hadoop clusters. The main aim is to enhance the prediction accuracy, to examine the role of text pre-processing for noise elimination and to reduce the computation time and resource utilization on the clusters.
Advisor: | Englert, Burkhard |
Commitee: | Aliasgari, Mehrdad, Tankelevich, Roman |
School: | California State University, Long Beach |
Department: | Computer Engineering and Computer Science |
School Location: | United States -- California |
Source: | MAI 55/02M(E), Masters Abstracts International |
Source Type: | DISSERTATION |
Subjects: | Computer science |
Keywords: | Hadoop, Keyword extraction, Map reduce, Svm, Text classification, Tf-idf |
Publication Number: | 1603338 |
ISBN: | 978-1-339-21495-5 |