Rahaf Aljundi: 3 Forms of Test Time Adaptation

I will discuss three forms of efficiently adapting small multimodal models. The first approach involves classical parameter adaptation through sparse structural updates. The second strategy leverages in-context demonstrations within an efficient collaboration framework between small and large models. The third combines gradient updates with in-context examples to enable a model to accumulate experience over time. I will conclude with an open discussion on how these three forms of adaptation can be integrated into a unified framework for continuous model adaptation.