COMING SOON! PQDT Open is getting a new home!

ProQuest Open Access Dissertations & Theses will remain freely available as part of a new and enhanced search experience at

Questions? Please refer to this FAQ.

Dissertation/Thesis Abstract

Identifying latent attributes from video scenes using knowledge acquired from large collections of text documents
by Tran, Anh Xuan, Ph.D., The University of Arizona, 2014, 134; 3634275
Abstract (Summary)

Peter Drucker, a well-known influential writer and philosopher in the field of management theory and practice, once claimed that “the most important thing in communication is hearing what isn't said.” It is not difficult to see that a similar concept also holds in the context of video scene understanding. In almost every non-trivial video scene, most important elements, such as the motives and intentions of the actors, can never be seen or directly observed, yet the identification of these latent attributes is crucial to our full understanding of the scene. That is to say, latent attributes matter.

In this work, we explore the task of identifying latent attributes in video scenes, focusing on the mental states of participant actors. We propose a novel approach to the problem based on the use of large text collections as background knowledge and minimal information about the videos, such as activity and actor types, as query context. We formalize the task and a measure of merit that accounts for the semantic relatedness of mental state terms, as well as their distribution weights. We develop and test several largely unsupervised information extraction models that identify the mental state labels of human participants in video scenes given some contextual information about the scenes. We show that these models produce complementary information and their combination significantly outperforms the individual models, and improves performance over several baseline methods on two different datasets. We present an extensive analysis of our models and close with a discussion of our findings, along with a roadmap for future research.

Indexing (document details)
Advisor: Cohen, Paul R.
Commitee: Barnard, Kobus, McAllister, Ken S., Surdeanu, Mihai
School: The University of Arizona
Department: Computer Science
School Location: United States -- Arizona
Source: DAI-B 76/01(E), Dissertation Abstracts International
Subjects: Information science, Artificial intelligence, Computer science
Keywords: Artificial intelligence, Computer vision, Information extraction, Information retrieval, Mental state inference, Natural language processing
Publication Number: 3634275
ISBN: 978-1-321-14547-2
Copyright © 2021 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy