Timezone: »

 
Spotlight
Leveraging Language to Learn Program Abstractions and Search Heuristics
Catherine Wong · Kevin Ellis · Josh Tenenbaum · Jacob Andreas

Tue Jul 20 06:45 PM -- 06:50 PM (PDT) @
in Algorithms 1 »

Inductive program synthesis, or inferring programs from examples of desired behavior, offers a general paradigm for building interpretable, robust, andgeneralizable machine learning systems. Effective program synthesis depends on two key ingredients: a strong library of functions from which to build programs, and an efficient search strategy for finding programs that solve a given task. We introduce LAPS (Language for Abstraction and Program Search), a technique for using natural language annotations to guide joint learning of libraries and neurally-guided search models for synthesis. When integrated into a state-of-the-art library learning system (DreamCoder), LAPS produces higher-quality libraries and improves search efficiency and generalization on three domains – string editing, image composition, and abstract reasoning about scenes – even when no natural language hints are available at test time.

Keywords: Algorithms · Multimodal Learning

Author Information

Catherine Wong (Massachusetts Institute of Technology)
Kevin Ellis (Cornell University)
Josh Tenenbaum (MIT)

Joshua Brett Tenenbaum is Professor of Cognitive Science and Computation at the Massachusetts Institute of Technology. He is known for contributions to mathematical psychology and Bayesian cognitive science. He previously taught at Stanford University, where he was the Wasow Visiting Fellow from October 2010 to January 2011. Tenenbaum received his undergraduate degree in physics from Yale University in 1993, and his Ph.D. from MIT in 1999. His work primarily focuses on analyzing probabilistic inference as the engine of human cognition and as a means to develop machine learning.

Jacob Andreas (UC Berkeley)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors