Invited Talk - Roberta Raileanu: Superhuman Scientific Discovery

In this talk, I will discuss the emergent field of using frontier models such as LLMs for automating scientific discovery and AI research. While current systems excel at hillclimbing and coming up with variations or combinations of existing ideas, they struggle to come up with their own research problems or make meaningful conceptual leaps which are needed for groundbreaking discoveries. I will discuss a potential path towards superhuman scientific discovery and highlight the key ingredients needed to get there: reinforcement learning, open-ended discovery, and meta-learning at scale.