Timezone: »
As the computational requirements for machine learning systems and the size and complexity of machine learning frameworks increases, essential framework innovation has become challenging. While computational needs have driven recent compiler, networking, and hardware advancements, utilization of those advancements by machine learning tools is occurring at a slower pace. This is in part due to the difficulties involved in prototyping new computational paradigms with existing frameworks. Large frameworks prioritize machine learning researchers and practitioners as end users and pay comparatively little attention to systems researchers who can push frameworks forward --- we argue that both are equally important stakeholders. We introduce Flashlight, an open-source library built to spur innovation in machine learning tools and systems by prioritizing open, modular, customizable internals and state-of-the-art, research-ready models and training setups across a variety of domains. Flashlight allows systems researchers to rapidly prototype and experiment with novel ideas in machine learning computation and has low overhead, competing with and often outperforming other popular machine learning frameworks. We see Flashlight as a tool enabling research that can benefit widely used libraries downstream and bring machine learning and systems researchers closer together.
Author Information
Jacob Kahn (Facebook AI Research (FAIR))
Vineel Pratap (Facebook)
Tatiana Likhomanenko (Apple)
Qiantong Xu (Facebook AI Research)
Awni Hannun (Zoom AI)
Jeff Cai (None)
Paden Tomasello (Facebook AI Research)
Ann Lee (Facebook, Inc.)
Edouard Grave (Facebook AI Research)
Gilad Avidov (Facebook)
Benoit Steiner (FAIR)
Vitaliy Liptchinsky (Facebook)
Gabriel Synnaeve (Facebook AI Research)
Ronan Collobert (Facebook AI Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Spotlight: Flashlight: Enabling Innovation in Tools for Machine Learning »
Thu. Jul 21st 06:45 -- 06:50 PM Room Room 309
More from the Same Authors
-
2021 : Learning Space Partitions for Path Planning »
Kevin Yang · Tianjun Zhang · Chris Cummins · Brandon Cui · Benoit Steiner · Linnan Wang · Joseph E Gonzalez · Dan Klein · Yuandong Tian -
2023 : The Framework Tax: Disparities Between Inference Efficiency in Research and Deployment »
Jared Fernandez · Jacob Kahn · Clara Na · Yonatan Bisk · Emma Strubell -
2023 Poster: MODeL: Memory Optimizations for Deep Learning »
Benoit Steiner · Mostafa Elhoushi · Jacob Kahn · James Hegarty -
2022 Poster: Position Prediction as an Effective Pretraining Strategy »
Shuangfei Zhai · Navdeep Jaitly · Jason Ramapuram · Dan Busbridge · Tatiana Likhomanenko · Joseph Cheng · Walter Talbott · Chen Huang · Hanlin Goh · Joshua M Susskind -
2022 Spotlight: Position Prediction as an Effective Pretraining Strategy »
Shuangfei Zhai · Navdeep Jaitly · Jason Ramapuram · Dan Busbridge · Tatiana Likhomanenko · Joseph Cheng · Walter Talbott · Chen Huang · Hanlin Goh · Joshua M Susskind -
2022 : [Apple] Machine Learning at Apple »
Tatiana Likhomanenko -
2020 : End-to-End ASR: from Supervised to Semi-Supervised Learning with Modern Architectures »
Jacob Kahn -
2020 Poster: Growing Action Spaces »
Gregory Farquhar · Laura Gustafson · Zeming Lin · Shimon Whiteson · Nicolas Usunier · Gabriel Synnaeve -
2020 Poster: Word-Level Speech Recognition With a Letter to Word Encoder »
Ronan Collobert · Awni Hannun · Gabriel Synnaeve -
2019 Poster: A fully differentiable beam search decoder »
Ronan Collobert · Awni Hannun · Gabriel Synnaeve -
2019 Oral: A fully differentiable beam search decoder »
Ronan Collobert · Awni Hannun · Gabriel Synnaeve -
2017 Workshop: Video Games and Machine Learning »
Gabriel Synnaeve · Julian Togelius · Tom Schaul · Oriol Vinyals · Nicolas Usunier -
2017 Poster: Parseval Networks: Improving Robustness to Adversarial Examples »
Moustapha Cisse · Piotr Bojanowski · Edouard Grave · Yann Dauphin · Nicolas Usunier -
2017 Talk: Parseval Networks: Improving Robustness to Adversarial Examples »
Moustapha Cisse · Piotr Bojanowski · Edouard Grave · Yann Dauphin · Nicolas Usunier