Timezone: »

 
TRAC: Trustworthy Retrieval Augmented Chatbot
Shuo Li · Sangdon Park · Insup Lee · Osbert Bastani

@
in Challenges in Deployable Generative AI »
Event URL: https://openreview.net/forum?id=hMK2OENc4R »

Although neural conversational AIs have demonstrated fantastic performance, they often generate incorrect information, or \textit{hallucinations}. Retrieval augmented generation has emerged as a promising solution to reduce these hallucinations. However, these techniques still cannot guarantee correctness. Focusing on question answering, we propose a framework that can provide statistical guarantees for the retrieval augmented question answering system by combining conformal prediction and global testing. In addition, we use Bayesian optimization to choose hyperparameters of the global test to maximize the performance of the system. Our empirical results on the Natural Questions dataset demonstrate that our method can provide the desired coverage guarantee while minimizing the average prediction set size.

Keywords: Trustworthy AI; Question Answering; Conformal Prediction; Knowledge Retrieval

Author Information

Shuo Li (University of Pennsylvania)
Sangdon Park (Georgia Institute of Technology)
Insup Lee (University of Pennsylvania)
Osbert Bastani (University of Pennsylvania)

More from the Same Authors