Sciweavers

Share
NIPS
2003

Model Uncertainty in Classical Conditioning

11 years 2 months ago
Model Uncertainty in Classical Conditioning
We develop a framework based on Bayesian model averaging to explain how animals cope with uncertainty about contingencies in classical conditioning experiments. Traditional accounts of conditioning fit parameters within a fixed generative model of reinforcer delivery; uncertainty over the model structure is not considered. We apply the theory to explain the puzzling relationship between second-order conditioning and conditioned inhibition, two similar conditioning regimes that nonetheless result in strongly divergent behavioral outcomes. According to the theory, second-order conditioning results when limited experience leads animals to prefer a simpler world model that produces spurious correlations; conditioned inhibition results when a more complex model is justified by additional experience.
Aaron C. Courville, Nathaniel D. Daw, Geoffrey J.
Added 31 Oct 2010
Updated 31 Oct 2010
Type Conference
Year 2003
Where NIPS
Authors Aaron C. Courville, Nathaniel D. Daw, Geoffrey J. Gordon, David S. Touretzky
Comments (0)
books