Timezone: »

 
TaskMet: Task-Driven Metric Learning for Model Learning
Dishank Bansal · Ricky T. Q. Chen · Mustafa Mukadam · Brandon Amos

@
in Differentiable Almost Everything: Differentiable Relaxations, Algorithms, Operators, and Simulators »
Event URL: https://differentiable.xyz/papers/paper_43.pdf »

Deep learning models are often used with some downstream task. Models solely trained to achieve accurate predictions may struggle to perform well on thedesired downstream tasks. We propose using the task'sloss to learn a metric which parameterizes a loss to train the model.This approach does not alter the optimal prediction modelitself, but rather changes the model learning to emphasizethe information important for the downstream task.This enables us to achieve the best of both worlds:a prediction model trained in the original prediction space whilealso being valuable for the desired downstream task.We validate our approach through experimentsconducted in two main settings: 1) decision-focused model learningscenarios involving portfolio optimization and budget allocation, and2) reinforcement learning in noisy environments with distractingstates.

Author Information

Dishank Bansal (Meta AI)
Dishank Bansal

AI Resident at Meta working on reinforcement learning and embodied AI.

Ricky T. Q. Chen (Meta AI)
Mustafa Mukadam (Meta AI / FAIR)
Brandon Amos (Meta)

More from the Same Authors