Timezone: »

 
Oral
Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction
Siyuan Qi · Baoxiong Jia · Song-Chun Zhu

Fri Jul 13 12:50 AM -- 01:00 AM (PDT) @ K1
in Computer Vision 2 »

Future predictions on sequence data (e.g., videos or audios) require the algorithms to capture non-Markovian and compositional properties of high-level semantics. Context-free grammars are natural choices to capture such properties, but traditional grammar parsers (e.g., Earley parser) only take symbolic sentences as inputs. In this paper, we generalize the Earley parser to parse sequence data which is neither segmented nor labeled. This generalized Earley parser integrates a grammar parser with a classifier to find the optimal segmentation and labels, and makes top-down future predictions. Experiments show that our method significantly outperforms other approaches for future human activity prediction.

[ PDF]  [ Video] 

Author Information

Siyuan Qi (UCLA)

I am a third year Ph.D. Candidate in the Computer Science Department at the University of California, Los Angeles advised by Professor Song-Chun Zhu.

Baoxiong Jia (Peking University)
Song-Chun Zhu (UCLA)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors