We have seen in the last year an incredible pace of progress in large AI models, with increasing abilities to generate high quality images, videos, text, sound and more. The best of these models display signs of creativity, reasoning, generalization and plasticity beyond what we could imagine just a few years ago. Yet many challenges and open questions remain, both on the technological aspects and the societal impact of these models. Further progress, especially on mitigating the social risks of these models, is hampered by a lack of transparency and reproducibility. In this talk, Joelle will describe ongoing efforts to increase best practices towards the responsible training and deployment of AI research systems, drawing on her experience with the ML reproducibility program, and the recent release of several state-of-the-art large models