Timezone: »
Human decision-making underlies all economic behavior. For the past four decades, human decision-making under uncertainty has continued to be explained by theoretical models based on prospect theory, a framework that was awarded the Nobel Prize in Economic Sciences. However, theoretical models of this kind have developed slowly, and robust, high-precision predictive models of human decisions remain a challenge. While machine learning is a natural candidate for solving these problems, it is currently unclear to what extent it can improve predictions obtained by current theories. We argue that this is mainly due to data scarcity, since noisy human behavior requires massive sample sizes to be accurately captured by off-the-shelf machine learning methods. To solve this problem, what is needed are machine learning models with appropriate inductive biases for capturing human behavior, and larger datasets. We offer two contributions towards this end: first, we construct ``cognitive model priors'' by pretraining neural networks with synthetic data generated by cognitive models (i.e., theoretical models developed by cognitive psychologists). We find that fine-tuning these networks on small datasets of real human decisions results in unprecedented state-of-the-art improvements on two benchmark datasets. Second, we present the first large-scale dataset for human decision-making, containing over 240,000 human judgments across over 13,000 decision problems. This dataset reveals the circumstances where cognitive model priors are useful, and provides a new standard for benchmarking prediction of human decisions under uncertainty.
Author Information
Joshua C Peterson (Princeton University)
David D Bourgin (UC Berkeley)
Daniel Reichman (UC Berkeley)
Thomas Griffiths (Princeton University)
Stuart Russell (UC Berkeley)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Oral: Cognitive model priors for predicting human decisions »
Wed. Jun 12th 06:35 -- 06:40 PM Room Room 201
More from the Same Authors
-
2022 : Predicting Human Similarity Judgments Using Large Language Models »
Raja Marjieh · Ilia Sucholutsky · Theodore R Sumers · Nori Jacoby · Thomas Griffiths · Thomas Griffiths -
2023 Poster: Analyzing Diffusion as Serial Reproduction »
Raja Marjieh · Ilia Sucholutsky · Thomas Langlois · Nori Jacoby · Thomas Griffiths -
2022 Poster: For Learning in Symmetric Teams, Local Optima are Global Nash Equilibria »
Scott Emmons · Caspar Oesterheld · Andrew Critch · Vincent Conitzer · Stuart Russell -
2022 Spotlight: For Learning in Symmetric Teams, Local Optima are Global Nash Equilibria »
Scott Emmons · Caspar Oesterheld · Andrew Critch · Vincent Conitzer · Stuart Russell -
2022 Poster: Distinguishing rule- and exemplar-based generalization in learning systems »
Ishita Dasgupta · Erin Grant · Thomas Griffiths -
2022 Poster: Estimating and Penalizing Induced Preference Shifts in Recommender Systems »
Micah Carroll · Anca Dragan · Stuart Russell · Dylan Hadfield-Menell -
2022 Spotlight: Distinguishing rule- and exemplar-based generalization in learning systems »
Ishita Dasgupta · Erin Grant · Thomas Griffiths -
2022 Spotlight: Estimating and Penalizing Induced Preference Shifts in Recommender Systems »
Micah Carroll · Anca Dragan · Stuart Russell · Dylan Hadfield-Menell -
2021 Poster: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment »
Michael Chang · Sid Kaushik · Sergey Levine · Thomas Griffiths -
2021 Oral: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment »
Michael Chang · Sid Kaushik · Sergey Levine · Thomas Griffiths -
2020 : Invited Talk 2: Prof. Tom Griffiths from Princeton University »
Thomas Griffiths -
2020 Poster: Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions »
Michael Chang · Sid Kaushik · S. Matthew Weinberg · Thomas Griffiths · Sergey Levine -
2018 Poster: An Efficient, Generalized Bellman Update For Cooperative Inverse Reinforcement Learning »
Dhruv Malik · Malayandi Palaniappan · Jaime Fisac · Dylan Hadfield-Menell · Stuart Russell · Anca Dragan -
2018 Oral: An Efficient, Generalized Bellman Update For Cooperative Inverse Reinforcement Learning »
Dhruv Malik · Malayandi Palaniappan · Jaime Fisac · Dylan Hadfield-Menell · Stuart Russell · Anca Dragan