Poster
in
Workshop: Shift happens: Crowdsourcing metrics and test datasets beyond ImageNet

ImageNet-D: A new challenging robustness dataset inspired by domain adaptation

Evgenia Rusak · Steffen Schneider · Peter V Gehler · Oliver Bringmann · Wieland Brendel · Matthias Bethge

Keywords: robustness benchmarking datasets

Project Page [ OpenReview]

Abstract

We propose a new challenging dataset to benchmark robustness of ImageNet-trained models: ImageNet-D. ImageNet-D has six different domains (Real'',Painting'', Clipart'',Sketch'', Infograph'' andQuickdraw''). We show that even state-of-the-art models struggle on this dataset and find that they make well-interpretable errors.

Chat is not available.