Words Towards Explainability: Caption Label-Free Learning via Dual Loop Agentic Time Series Captioning
Abstract
Explainability is essential for applying time series analysis in high-stakes domains. While Time Series Captioning (TSC) offers a pathway to enhance temporal explainability, achieving reliable caption generation usually necessitates high-quality textual annotations. However, as interpreting abstract temporal dynamics requires specialized domain knowledge, acquiring such caption annotations is challenging, thereby impeding the advancement of TSC. To address this challenge, we introduce a novel Caption Label-Free Learning (CLFL) paradigm. Departing from the supervised learning tradition of imitating human annotations, CLFL formulates captioning as an agentic exploration task optimized by feedback from a proxy reward. Specifically, we propose a Dual Loop Agentic Captioning (DLAC) framework to achieve such an exploration-feedback mechanism. In the inner loop, a Time Series Captioning Agent (TSCAgent) reflectively explores potential semantic captions. In turn, the outer loop evaluates these captions via downstream reasoning to derive proxy reward, which feeds back to optimize the TSCAgent. Empirical results validate the effectiveness of the CLFL, proving that the exploration-feedback mechanism is sufficient for learning complex temporal semantics and autonomously generating captions, without any caption label supervision. Furthermore, we release TFTSC, an industrial expert-level time series caption dataset, which is available at: https://github.com/chunhuiz/TFTSC/tree/master.
Lay Summary
Understanding how computers analyze time series data is vital for making important decisions. Having machines describe this data in plain text improves system transparency. However, teaching models to do this usually requires massive amounts of text written by humans, which is extremely difficult and expensive to obtain from domain experts. To solve this problem, we developed a novel learning method that eliminates the need for human annotations. We built an LLM agent that learns through continuous exploration and feedback. The agent attempts to describe the data, evaluates how useful its description is for solving practical tasks, and uses the performance score as a reward to improve its descriptions. This approach allows models to learn complex temporal patterns and generate professional text autonomously. Additionally, we released an industrial dataset comprising over 60000 samples to help researchers evaluate similar models. Ultimately, our work makes complex data analysis more transparent and understandable without relying on expensive human annotation labor.