Understanding how animals update their decision-making behavior over time is an important problem in neuroscience. Perceptual decision-making strategies evolve over the course of learning, and continue to vary even in well-trained animals. While reinforcement learning aims to understand such strategies from a normative perspective, there are comparatively fewer purely descriptive tools for capturing behavioral dynamics. Behavior is either treated as fixed or is tracked only with coarse performance statistics, providing limited insight into the evolution of decision-making strategies.
In this dissertation, we present a flexible method for characterizing time-varying behavior during decision-making experiments. Our method consists of a dynamic logistic regression model, parametrized by a set of time-varying weights that express dependence on sensory stimuli as well as task-irrelevant covariates, such as stimulus, choice, and answer history. PsyTrack, the open-source implementation of our method, allows us to characterize behavior on tens of thousands of trials within minutes. We apply our model to behavioral data collected from mice, rats, and human subjects learning either a visual detection or an auditory discrimination task. We uncover the detailed evolution of an animal’s strategy during learning, including adaptation to time-varying task statistics, suppression of sub-optimal strategies, and shared behavioral dynamics between subjects within an experimental population.
Finally, we extend our model to not only track changes in behavior, but also to infer the learning rules animals use to drive those changes. With the ability to decompose a strategy into a learning component and a noise component, we are able to compare and describe the different learning rules that animals may be using to update their policy. The ability to quantify complex and dynamic behavior at a trial-by-trial resolution enables exciting opportunities for animal training and opens a path toward a more rigorous understanding of the behavioral dynamics at play as animals learn.
|Advisor:||Pillow, Jonathan W.|
|Commitee:||Brody, Carlos D., Witten, Ilana B., Daw, Nathaniel D.|
|School Location:||United States -- New Jersey|
|Source:||DAI-B 82/1(E), Dissertation Abstracts International|
|Keywords:||Behavior, Decision-making, Learning, Psychophysics|
Copyright in each Dissertation and Thesis is retained by the author. All Rights Reserved
The supplemental file or files you are about to download were provided to ProQuest by the author as part of a
dissertation or thesis. The supplemental files are provided "AS IS" without warranty. ProQuest is not responsible for the
content, format or impact on the supplemental file(s) on our system. in some cases, the file type may be unknown or
may be a .exe file. We recommend caution as you open such files.
Copyright of the original materials contained in the supplemental file is retained by the author and your access to the
supplemental files is subject to the ProQuest Terms and Conditions of use.
Depending on the size of the file(s) you are downloading, the system may take some time to download them. Please be