While many studies have demonstrated that conversational tutoring systems have a positive effect on learning, the amount of manual effort required to author, design, and tune dialogue behaviors remains a major barrier to widespread deployment and adoption of these systems. Such dialogue systems must not only understand student speech, but must also endeavor to keep students engaged while scaffolding them through the curriculum. Crafting robust, natural tutoring interactions typically involves writing tightly scripted behaviors for a wide variety of student responses and scenarios.
Combining statistical machine learning with corpus-based methods in natural language processing presents a possible path to reducing this effort. Advances in reinforcement learning have been applied toward dialogue systems to learn optimal behaviors for a given task. However, these learned dialogue policies are tightly coupled to the specific dialogue system implementation. For content-rich applications such as intelligent tutoring systems, there is an immediate need to learn tutoring strategies and dialogue behaviors that can be leveraged across a variety of materials, concepts and lessons. Further generalization will require an intermediate representation of dialogue that can abstract the conversation to its underlying action, function, and content.
This work introduces the Dialogue Schema Unifying Speech and Semantics (DISCUSS), an intermediate linguistic representation that captures the semantics and pragmatics of speech while also allowing for domain-independent modeling of tutorial dialogue. To better understand the benefits of the DISCUSS representation, a corpus of computer-mediated tutorial dialogues was manually tagged with DISCUSS labels. These data were then used for three different tasks: utterance classification, dialogue move selection, and learning gains prediction.
System performance in these tasks demonstrate the utility and viability of the DISCUSS representation for analyzing and automating dialogue interactions. Utterance classifiers achieve DISCUSS labeling performance on par with inter-annotator agreement levels. System performance in ranking and selecting follow-up questions illustrates the usefulness of DISCUSS-based features for modeling and identifying the factors behind human decision making when teaching. Correlating features of the dialogue with measured learning gains in students shows how DISCUSS-derived metrics provide a detailed account of real tutoring strategies and student behaviors. Together these results represent a step toward more domain-independent mechanisms for modeling dialogue.
|Advisor:||Ward, Wayne H., Palmer, Martha S.|
|Commitee:||Fox, Barbara, Martin, James H., Sumner, Tamara, van Vuuren, Sarel|
|School:||University of Colorado at Boulder|
|School Location:||United States -- Colorado|
|Source:||DAI-B 74/05(E), Dissertation Abstracts International|
|Subjects:||Educational technology, Computer science|
|Keywords:||Dialogue modeling, Dialogue systems, Intelligent tutoring systems, Linguistic representations, Natural language processing, Question generation|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be