COMING SOON! PQDT Open is getting a new home!

ProQuest Open Access Dissertations & Theses will remain freely available as part of a new and enhanced search experience at

Questions? Please refer to this FAQ.

Dissertation/Thesis Abstract

Spatial Language Driven Robot
by Huo, Zhiyu, Ph.D., University of Missouri - Columbia, 2017, 158; 13869885
Abstract (Summary)

This dissertation investigates the methods to enable a robot to interact with human using spatial language. A prototype system of human-robot interaction using spatial language running on an autonomous robot is proposed in the dissertation. The system includes two complementary works. One is to control the robot by human natural spatial language to find the target object to fetch it. Another work is to generate a natural spatial language description to describe a target object in the robot working environment. The first task is called spatial language grounding and the second work is named as spatial language generation. The spatial language grounding and generation are both end-to-end process which means the system will determine the output only by the natural language command from a human during the interaction and the raw perception data collected from the environment. Furniture recognizers are designed for the robot to detect the environment during the tasks. A hierarchy system is designed to translate the human spatial language to the symbolic grounding model and then to the robot actions. To reduce the ambiguity in the interaction, a human demonstration system is designed to collect the spatial concept of the human user for building the robot behavior policies under different grounding models. A language generation system trained by real human spatial language corpus is proposed to automatically edit spatial descriptions of the location of a target object. All the modules in the system are evaluated in the physical environment, and a 3D robot simulator developed on ROS and GAZEBO.

Indexing (document details)
Advisor: Skubic, Marjorie
Commitee: He, Zhihas, Keller, James, Popescu, Mihail, Skubic, Jarjorie
School: University of Missouri - Columbia
Department: Electrical Engineering
School Location: United States -- Missouri
Source: DAI-B 80/08(E), Dissertation Abstracts International
Subjects: Electrical engineering, Robotics, Artificial intelligence
Keywords: Natural language processing
Publication Number: 13869885
ISBN: 978-1-392-01237-6
Copyright © 2021 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy