Timezone: »

 
Oral
Transfer Learning via Learning to Transfer
Ying WEI · Yu Zhang · Junzhou Huang · Qiang Yang

Wed Jul 11 02:00 AM -- 02:20 AM (PDT) @ A3
in Transfer and Multi-Task Learning 1 »

In transfer learning, what and how to transfer are two primary issues to be addressed, as different transfer learning algorithms applied between a source and a target domain result in different knowledge transferred and thereby the performance improvement in the target domain. Determining the optimal one that maximizes the performance improvement requires either exhaustive exploration or considerable expertise. Meanwhile, it is widely accepted in educational psychology that human beings improve transfer learning skills of deciding what to transfer through meta-cognitive reflection on inductive transfer learning practices. Motivated by this, we propose a novel transfer learning framework known as Learning to Transfer (L2T) to automatically determine what and how to transfer are the best by leveraging previous transfer learning experiences. We establish the L2T framework in two stages: 1) we learn a reflection function encrypting transfer learning skills from experiences; and 2) we infer what and how to transfer are the best for a future pair of domains by optimizing the reflection function. We also theoretically analyse the algorithmic stability and generalization bound of L2T, and empirically demonstrate its superiority over several state-of-the-art transfer learning algorithms.

[ PDF]  [ Video] 

Author Information

Ying WEI (Tencent AI Lab)
Yu Zhang (Hong Kong UST)
Junzhou Huang (University of Texas at Arlington / Tencent AI Lab)
Qiang Yang (Hong Kong UST)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors