Skip to yearly menu bar Skip to main content


(4 events)   Timezone:  
Show all
Toggle Poster Visibility
Oral
Thu Jul 25 07:30 AM -- 07:45 AM (PDT) @ Hall A1 None
Accurate LoRA-Finetuning Quantization of LLMs via Information Retention
In Oral 6B Low Rank Learning
Haotong Qin · Xudong Ma · Xingyu Zheng · Xiaoyang Li · Yang Zhang · Shouda Liu · Jie Luo · Xianglong Liu · Michele Magno
Oral
Thu Jul 25 07:45 AM -- 08:00 AM (PDT) @ Hall A1 None
DoRA: Weight-Decomposed Low-Rank Adaptation
In Oral 6B Low Rank Learning
Shih-Yang Liu · Chien-Yi Wang · Hongxu Yin · Pavlo Molchanov · Yu-Chiang Wang · Kwang-Ting Cheng · Min-Hung Chen
Oral
Thu Jul 25 08:00 AM -- 08:15 AM (PDT) @ Hall A1 None
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
In Oral 6B Low Rank Learning
Jiawei Zhao · Zhenyu Zhang · Beidi Chen · Zhangyang “Atlas” Wang · Anima Anandkumar · Yuandong Tian
Oral
Thu Jul 25 08:15 AM -- 08:30 AM (PDT) @ Hall A1 None
LoRA Training in the NTK Regime has No Spurious Local Minima
In Oral 6B Low Rank Learning
Uijeong Jang · Jason Lee · Ernest Ryu
[ Slides]