Processing math: 100%
Skip to yearly menu bar Skip to main content


Poster

Bottleneck-Minimal Indexing for Generative Document Retrieval

Xin Du · Lixin Xiu · Kumiko Tanaka-Ishii

Hall C 4-9 #813

Abstract: We apply an information-theoretic perspective to reconsider generative document retrieval (GDR), in which a document xX is indexed by tT, and a neural autoregressive model is trained to map queries Q to T. GDR can be considered to involve information transmission from documents X to queries Q, with the requirement to transmit more bits via the indexes T. By applying Shannon's rate-distortion theory, the optimality of indexing can be analyzed in terms of the mutual information, and the design of the indexes T can then be regarded as a *bottleneck* in GDR. After reformulating GDR from this perspective, we empirically quantify the bottleneck underlying GDR. Finally, using the NQ320K and MARCO datasets, we evaluate our proposed bottleneck-minimal indexing method in comparison with various previous indexing methods, and we show that it outperforms those methods.

Chat is not available.