Invited Talk 2 - Historical perspective on extreme classification in language modeling - Tomas Mikolov
Tomas Mikolov
2020 Talk
in
Workshop: Workshop on eXtreme Classification: Theory and Applications
in
Workshop: Workshop on eXtreme Classification: Theory and Applications
Abstract
In this talk, I will present several simple ideas that were proposed a long time ago to deal with extremely large output spaces in the language modeling. These include various types of hierarchical softmax, and other approaches that decompose the labels into smaller parts such as sub-word language modeling.
Video
Chat is not available.
Successful Page Load