Workshop: Workshop on eXtreme Classification: Theory and Applications

Invited Talk 2 - Historical perspective on extreme classification in language modeling - Tomas Mikolov

Tomas Mikolov

[ Abstract ]
Fri 17 Jul 6:50 a.m. PDT — 7:20 a.m. PDT


In this talk, I will present several simple ideas that were proposed a long time ago to deal with extremely large output spaces in the language modeling. These include various types of hierarchical softmax, and other approaches that decompose the labels into smaller parts such as sub-word language modeling.

Chat is not available.