Timezone: »
Similarity judgments provide a well-established method for accessing mental representations, with applications in psychology, neuroscience and machine learning. However, collecting similarity judgments can be prohibitively expensive for naturalistic datasets as the number of comparisons grows quadratically in the number of stimuli. We leverage recent advances in language models and online recruitment, proposing an efficient domain-general procedure for predicting human similarity judgments based on text descriptions. Crucially, the number of descriptions required grows only linearly with the number of stimuli, drastically reducing the amount of data required. We test this procedure on six datasets of naturalistic images and show that our models outperform previous approaches based on visual information.
Author Information
Raja Marjieh (Princeton University)
Ilia Sucholutsky (Princeton University)
Theodore R Sumers (Princeton University)
Nori Jacoby (Max-Planck Institute)
Thomas Griffiths (Princeton University)
Thomas Griffiths (Princeton University)
More from the Same Authors
-
2022 : Predicting Human Similarity Judgments Using Large Language Models »
Raja Marjieh -
2022 : How to Talk so Robots will Learn: Instructions, Descriptions, and Alignment »
Theodore R Sumers -
2023 Poster: Distilling Internet-Scale Vision-Language Models into Embodied Agents »
Theodore R Sumers · Kenneth Marino · Arun Ahuja · Rob Fergus · Ishita Dasgupta -
2023 Poster: Analyzing Diffusion as Serial Reproduction »
Raja Marjieh · Ilia Sucholutsky · Thomas Langlois · Nori Jacoby · Thomas Griffiths -
2022 Poster: Distinguishing rule- and exemplar-based generalization in learning systems »
Ishita Dasgupta · Erin Grant · Thomas Griffiths -
2022 Spotlight: Distinguishing rule- and exemplar-based generalization in learning systems »
Ishita Dasgupta · Erin Grant · Thomas Griffiths -
2021 Poster: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment »
Michael Chang · Sid Kaushik · Sergey Levine · Thomas Griffiths -
2021 Oral: Modularity in Reinforcement Learning via Algorithmic Independence in Credit Assignment »
Michael Chang · Sid Kaushik · Sergey Levine · Thomas Griffiths -
2020 : Invited Talk 2: Prof. Tom Griffiths from Princeton University »
Thomas Griffiths -
2020 Poster: Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions »
Michael Chang · Sid Kaushik · S. Matthew Weinberg · Thomas Griffiths · Sergey Levine -
2019 Poster: Cognitive model priors for predicting human decisions »
Joshua C Peterson · David D Bourgin · Daniel Reichman · Thomas Griffiths · Stuart Russell -
2019 Oral: Cognitive model priors for predicting human decisions »
Joshua C Peterson · David D Bourgin · Daniel Reichman · Thomas Griffiths · Stuart Russell