Skip to yearly menu bar Skip to main content


(4 events)   Timezone:  
Show all
Toggle Poster Visibility
Oral
Thu Jul 25 11:30 PM -- 11:45 PM (KST) @ Hall A1 None
Accurate LoRA-Finetuning Quantization of LLMs via Information Retention
In Oral 6B Low Rank Learning
Haotong Qin · Xudong Ma · Xingyu Zheng · Xiaoyang Li · Yang Zhang · Shouda Liu · Jie Luo · Xianglong Liu · Michele Magno
Oral
Thu Jul 25 11:45 PM -- 12:00 AM (KST) @ Hall A1 None
DoRA: Weight-Decomposed Low-Rank Adaptation
In Oral 6B Low Rank Learning
Shih-Yang Liu · Chien-Yi Wang · Hongxu Yin · Pavlo Molchanov · Yu-Chiang Wang · Kwang-Ting Cheng · Min-Hung Chen
Oral
Fri Jul 26 12:00 AM -- 12:15 AM (KST) @ Hall A1 None
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
In Oral 6B Low Rank Learning
Jiawei Zhao · Zhenyu Zhang · Beidi Chen · Zhangyang “Atlas” Wang · Anima Anandkumar · Yuandong Tian
Oral
Fri Jul 26 12:15 AM -- 12:30 AM (KST) @ Hall A1 None
LoRA Training in the NTK Regime has No Spurious Local Minima
In Oral 6B Low Rank Learning
Uijeong Jang · Jason Lee · Ernest Ryu
[ Slides]