Dissertation/Thesis Abstract

Interactive Sonification Strategies for the Motion and Emotion of Dance Performances
by Landry, Steven, Ph.D., Michigan Technological University, 2019, 194; 22585377
Abstract (Summary)

The Immersive Interactive SOnification Platform, or iISoP for short, is a research platform for the creation of novel multimedia art, as well as exploratory research in the fields of sonification, affective computing, and gesture-based user interfaces. The goal of the iISoP’s dancer sonification system is to “sonify the motion and emotion” of a dance performance via musical auditory display. An additional goal of this dissertation is to develop and evaluate musical strategies for adding layer of emotional mappings to data sonification. The result of the series of dancer sonification design exercises led to the development of a novel musical sonification framework. The overall design process is divided into three main iterative phases: requirement gathering, prototype generation, and system evaluation. For the first phase help was provided from dancers and musicians in a participatory design fashion as domain experts in the field of non-verbal affective communication. Knowledge extraction procedures took the form of semi-structured interviews, stimuli feature evaluation, workshops, and think aloud protocols. For phase two, the expert dancers and musicians helped create test-able stimuli for prototype evaluation. In phase three, system evaluation, experts (dancers, musicians, etc.) and novice participants were recruited to provide subjective feedback from the perspectives of both performer and audience. Based on the results of the iterative design process, a novel sonification framework that translates motion and emotion data into descriptive music is proposed and described.

Indexing (document details)
Advisor: Jeon, Myounghoon, Mueller, Shane
Commitee: Kuhl, Scott, Barrass, Stephen
School: Michigan Technological University
Department: Cognitive and Learning Sciences
School Location: United States -- Michigan
Source: DAI-B 81/3(E), Dissertation Abstracts International
Subjects: Cognitive psychology
Keywords: Auditory display, Emotion, HCI, Interaction design, Sonification
Publication Number: 22585377
ISBN: 9781088349304
Copyright © 2020 ProQuest LLC. All rights reserved. Terms and Conditions Privacy Policy Cookie Policy