Dissertation/Thesis Abstract

Lecture Video Search Engine Using Hadoop MapReduce
by Deolikar, Piyush P., M.S., California State University, Long Beach, 2017, 60; 10638908
Abstract (Summary)

With the advent of the Internet and ease of uploading video content over video libraries and social networking sites, the video data availability was increased very rapidly during this decade. Universities are uploading video tutorials in the online courses. Companies like Udemy, coursera, Lynda, etc. made video tutorials available over the Internet. We propose and implement a scalable solution, which helps to find relevant videos with respect to a query provided by the user. Our solution maintains an updated list of the available videos on the web and assigns a rank according to their relevance. The proposed solution consists of three main components that can mutually interact. The first component, called the crawler, continuously visits and locally stores the relevant information of all the webpages with videos available on the Internet. The crawler has several threads, concurrently parsing webpages. The second component obtains the inverted index of the web pages stored by the crawler. Given a query, the inverted index is used to obtain the videos that contain the words in the query. The third component computes the rank of the video. This rank is then used to display the results in the order of relevance. We implement a scalable solution in the Apache Hadoop Framework. Hadoop is a distributed operating system that provides a distributed file system able to handle large files as well as distributed computation among the participants.

Indexing (document details)
Advisor: Ponce, Oscar Morales
Commitee: Englert, Burkhard, Johnson, Thomas
School: California State University, Long Beach
Department: Computer Engineering and Computer Science
School Location: United States -- California
Source: MAI 57/01M(E), Masters Abstracts International
Source Type: DISSERTATION
Subjects: Computer science
Keywords: Distributed systems, Hadoop MapReduce, Inverted index, Page ranking, Video search engine, Web crawler
Publication Number: 10638908
ISBN: 9780355521108
Copyright © 2019 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy
ProQuest