With PQDT Open, you can read the full text of open access dissertations and theses free of charge.
About PQDT Open
Search
When reviewing the performance of Intelligent Virtual Assistants (IVAs), it is desirable to prioritize conversations involving misunderstood human inputs. These conversations uncover error in natural language understanding and help prioritize and expedite improvements to the IVA. As human reviewer time is valuable and manual analysis is time consuming, prioritizing the conversations where misunderstanding has likely occurred reduces costs and speeds improvement. A system for measuring the posthoc risk of missed intent associated with a single human input is presented. Numerous indicators of risk are explored and implemented. These indicators are combined using various means and evaluated on real world data. In addition, the ability for the system to adapt to different domains of language is explored. Finally, the system performance in identifying errors in IVA understanding is compared to that of human reviewers and multiple aspects of system deployment for commercial use are discussed.
Advisor: | Mueen, Abdullah |
Commitee: | De Palma, Paul, Luger, George, Williams, Lance, Wooters, Charles |
School: | The University of New Mexico |
Department: | Computer Science |
School Location: | United States -- New Mexico |
Source: | DAI-B 80/01(E), Dissertation Abstracts International |
Source Type: | DISSERTATION |
Subjects: | Artificial intelligence |
Keywords: | Human-computer interfaces, Intelligent virtual assistants, Natural language processing, Natural language understanding |
Publication Number: | 10816823 |
ISBN: | 978-0-438-40331-4 |