Dissertation/Thesis Abstract

Result Distribution in Big Data Systems
by Cheelangi, Madhusudan, M.S., University of California, Irvine, 2013, 63; 1539891
Abstract (Summary)

We are building a Big Data Management System (BDMS) called AsterixDB at UCI. Since AsterixDB is designed to operate on large volumes of data, the results for its queries can be potentially very large, and AsterixDB is also designed to operate under high concurency workloads. As a result, we need a specialized mechanism to manage these large volumes of query results and deliver them to the clients. In this thesis, we present an architecture and an implementation of a new result distribution framework that is capable of handling large volumes of results under high concurency workloads. We present the various components of this result distribution framework and show how they interact with each other to manage large volumes of query results and deliver them to clients. We also discuss various result distribution policies that are possible with our framework and compare their performance through experiments.

We have implemented a REST-like HTTP client interface on top of the result distribution framework to allow clients to submit queries and obtain their results. This client interface provides two modes for clients to choose from to read their query results: synchronous mode and asynchronous mode. In synchronous mode, query results are delivered to a client as a direct response to its query within the same request-response cycle. In asynchronous mode, a query handle is returned instead to the client as a response to its query. The client can store the handle and send another request later, including the query handle, to read the result for the query whenever it wants. The architectural support for these two modes is also described in this thesis. We believe that the result distribution framework, combined with this client interface, successfully meets the result management demands of AsterixDB.

Indexing (document details)
Advisor: Carey, Michael J.
Commitee: Li, Chen, Lopes, Cristina
School: University of California, Irvine
Department: Computer Science - M.S.
School Location: United States -- California
Source: MAI 52/01M(E), Masters Abstracts International
Subjects: Computer Engineering, Computer science
Keywords: Big data, Databases, Distributed systems
Publication Number: 1539891
ISBN: 978-1-303-16137-7
Copyright © 2020 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy