Dr-CiK: A Testbed for Foresight-Driven Agents
Abstract
Time series forecasting in real-world settings often depends not only on historical observations, but also on external context that must be actively discovered from noisy, heterogeneous information sources. Yet existing context-aided forecasting benchmarks typically assume that supporting context is already provided, leaving open whether agents can identify it on their own. When it comes to forecasting, Context is Key (CiK). However, identifying the right context from a large knowledge base and distilling it into forecast-useful evidence requires Deep Research (DR). Therefore, we introduce Dr-CiK, a benchmark for evaluating whether agents can retrieve forecasting-relevant supporting context from a document corpus, filter out distractors, distill the retrieved context into forecast-useful evidence, and generate forecasts supported by that evidence. Through context ablations and evaluations of state-of-the-art deep research and forecasting methods paired together, we show that high-quality context substantially improves forecasting performance in Dr-CiK. However, current DR agents recover only a small fraction of the ground-truth supporting evidence (usually <5\%), are frequently misled by distractors (>80% distractor citations), and can cause forecasters to perform worse with retrieved context than with no context at all. Our results motivate research on foresight-driven agents that search for the right context to predict the future. We provide anonymized source code here.