SafeCompass: Dynamic Chain-of-Thought Steering via Inference-Time Safety Signals
Abstract
Lay Summary
Powerful AI models solve complex problems by "thinking step-by-step", but attackers can hijack this reasoning process to bypass safety rules. Current defense methods are often too rigid, making the AI overly cautious and prone to refusing perfectly safe requests. We wanted to secure this reasoning process without losing the model's helpfulness. To tackle this, we developed SafeCompass, a framework that monitors the AI's internal states in real-time while it generates an answer. By analyzing these internal signals, SafeCompass detects exactly when the AI's thoughts start turning dangerous. Instead of completely shutting down the response, it steps in to steer the reasoning back on track only at that specific moment. We found that this targeted approach reduces successful attacks by up to 10 times. Ultimately, SafeCompass provides a practical way to build highly robust AI systems that remain capable and helpful for everyday users.