Timezone: »

 
Implications of kernel mismatch for OOD data
Beau Coker · Finale Doshi-Velez

@
in Structured Probabilistic Inference and Generative Modeling »
Event URL: https://openreview.net/forum?id=AoJUCbkLWP »

Gaussian processes provide reliable uncertainty estimates in nonlinear modeling, but a poor choice of the kernel can lead to slow learning. Although learning the hyperparameters of the kernel typically leads to optimal generalization on in-distribution test data, we show that the generalization can be poor on out-of-distribution test data. We then investigate a smoothness learning method, heavier tails, and deep kernel learning as solutions, finding some evidence in favor of the first two.

Keywords: Gaussian Processes · misspecification · kernels · out-of-distribution

Author Information

Beau Coker (Harvard)
Finale Doshi-Velez (Harvard University)
Finale Doshi-Velez

Finale Doshi-Velez is a Gordon McKay Professor in Computer Science at the Harvard Paulson School of Engineering and Applied Sciences. She completed her MSc from the University of Cambridge as a Marshall Scholar, her PhD from MIT, and her postdoc at Harvard Medical School. Her interests lie at the intersection of machine learning, healthcare, and interpretability. Selected Additional Shinies: BECA recipient, AFOSR YIP and NSF CAREER recipient; Sloan Fellow; IEEE AI Top 10 to Watch

More from the Same Authors