Poster
|
Tue 4:30
|
STELLA: Continual Audio-Video Pre-training with SpatioTemporal Localized Alignment
Jaewoo Lee · Jaehong Yoon · Wonjae Kim · Yunji Kim · Sung Ju Hwang
|
|
Poster
|
Wed 4:30
|
Scalable Pre-training of Large Autoregressive Image Models
Alaaeldin Ali · Michal Klein · Shuangfei Zhai · Miguel Angel Bautista Martin · Vaishaal Shankar · Alexander Toshev · Joshua M Susskind · Armand Joulin
|
|
Workshop
|
|
ExPLoRA: Parameter-Efficient Extended Pre-Training to Adapt Vision Transformers under Domain Shifts
Samar Khanna · Medhanie Irgau · David Lobell · Stefano Ermon
|
|
Poster
|
Tue 4:30
|
Enhancing Class-Imbalanced Learning with Pre-Trained Guidance through Class-Conditional Knowledge Distillation
Lan Li · Xin-Chun Li · Han-Jia Ye · De-Chuan Zhan
|
|
Workshop
|
|
Class-aware Initialization of Early Exits for Pre-training Large Language Models
Alperen Gormez · Erdem Koyuncu
|
|
Workshop
|
|
The Efficacy of Pre-training in Chemical Graph Out-of-distribution Generalization
Qi Liu · Rosa Chan · Rose Yu
|
|
Workshop
|
Sat 0:05
|
Andreas Blattman - Pre-Training Rectified Flow Transformer Models for Controllable Video Generation
Andreas Blattman
|
|
Poster
|
Thu 4:30
|
Accelerating Transformer Pre-training with 2:4 Sparsity
Yuezhou Hu · Kang Zhao · Weiyu Huang · Jianfei Chen · Jun Zhu
|
|
Poster
|
Wed 4:30
|
Deep Fusion: Efficient Network Training via Pre-trained Initializations
Hanna Mazzawi · Xavi Gonzalvo · Michael Wunder · Sammy Jerome · Benoit Dherin
|
|
Workshop
|
|
Analyzing & Eliminating Learning Rate Warmup in GPT Pre-Training
Atli Kosson · Bettina Messmer · Martin Jaggi
|
|
Poster
|
Tue 4:30
|
LangCell: Language-Cell Pre-training for Cell Identity Understanding
Suyuan Zhao · Jiahuan Zhang · Yushuai Wu · YIZHEN LUO · Zaiqing Nie
|
|
Poster
|
Thu 2:30
|
Relational Learning in Pre-Trained Models: A Theory from Hypergraph Recovery Perspective
Yang Chen · Cong Fang · Zhouchen Lin · Bing Liu
|
|