Dissertation/Thesis Abstract

An evolutionary method for training autoencoders for deep learning networks
by Lander, Sean, M.S., University of Missouri - Columbia, 2014, 43; 10180878
Abstract (Summary)

Introduced in 2006, Deep Learning has made large strides in both supervised an unsupervised learning. The abilities of Deep Learning have been shown to beat both generic and highly specialized classification and clustering techniques with little change to the underlying concept of a multi-layer perceptron. Though this has caused a resurgence of interest in neural networks, many of the drawbacks and pitfalls of such systems have yet to be addressed after nearly 30 years: speed of training, local minima and manual testing of hyper-parameters.

In this thesis we propose using an evolutionary technique in order to work toward solving these issues and increase the overall quality and abilities of Deep Learning Networks. In the evolution of a population of autoencoders for input reconstruction, we are able to abstract multiple features for each autoencoder in the form of hidden nodes, scoring the autoencoders based on their ability to reconstruct their input, and finally selecting autoencoders for crossover and mutation with hidden nodes as the chromosome. In this way we are able to not only quickly find optimal abstracted feature sets but also optimize the structure of the autoencoder to match the features being selected. This also allows us to experiment with different training methods in respect to data partitioning and selection, reducing overall training time drastically for large and complex datasets. This proposed method allows even large datasets to be trained quickly and efficiently with little manual parameter choice required by the user, leading to faster, more accurate creation of Deep Learning Networks.

Indexing (document details)
Advisor: Shang, Yi
School: University of Missouri - Columbia
School Location: United States -- Missouri
Source: MAI 56/01M(E), Masters Abstracts International
Subjects: Artificial intelligence, Computer science
Keywords: Artificial intelligence, Artificial neural networks, Deep networks, Evolutionary algorithm, Genetic algorithm, Unsupervised learning
Publication Number: 10180878
ISBN: 9781369295443
Copyright © 2019 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy