Enhancing user experience is a constant goal for human computer interaction (HCI) researchers, and the methods to achieve this goal are widespread, from changing the properties of the interface to adapting the task to the user’s ability level. By sensing user’s cognitive states, such as interest, workload, frustration, flow, we can adapt the interface immediately to keep them working optimally. This new train of thought in the brain computer interfaces community considers brain activity as an additional source of information, to augment and adapt the interface in conjunction with standard devices, instead of controlling it directly with the brain.
To obtain measures of brain activity, I adopt the relatively less-explored brain sensing technique called functional near-infrared spectroscopy (fNIRS), a safe, non-invasive measurement of changes in blood oxygenation. This dissertation presents a body of technologies and tools that enable the use of real time measures of cognitive load for adaptive interfaces, to support the thesis that fNIRS is an input technology usable in conventional HCI contexts, especially when applied to the general, healthy public as an additional input.
First, I discuss the practicality and applicability of the technology in realistic, desktop environments. Our work shows that fNIRS signals are robust enough to remain unaffected by typing and clicking but that some facial and head movements interfere with the measurements. Then, I investigate the use of fNIRS to obtain meaningful data related to mental workload. My studies progress from very controlled experiments that help us identify centers of brain activity, to experiments using simple user interfaces, showing how this technique may be applied to more realistic, complex interfaces. Our first study distinguishes levels of workload and interaction styles, and our second differentiates levels of game difficulty. Statistical analysis and machine learning classification results show that we discriminate well between subjects performing a mentally demanding task or resting, and distinguish between two levels with some success. Finally, I present a real time analysis and classification system that can communicate user cognitive load information to an application. I categorize adaption of interfaces with brain as an input, and propose a series of adaptations possible using our system.
|Advisor:||Jacob, Robert J.K.|
|Commitee:||Bickmore, Timothy, Fantini, Sergio, Guyer, Samuel, Khardon, Roni|
|School Location:||United States -- Massachusetts|
|Source:||DAI-B 71/10, Dissertation Abstracts International|
|Keywords:||Adaptive interfaces, Brain computer interface, Functional near infrared spectroscopy, Human computer interaction, Mental workload, Task classification|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be