ActiveScope: Actively Seeking and Correcting Perception for MLLMs
Abstract
Lay Summary
Advanced AI models can understand both images and text well. However, they often struggle to find tiny details in large pictures. We noticed these models either get distracted by prominent objects or fixate on a single main subject. To solve this, we developed a new framework called ActiveScope. It acts like a smart magnifying glass for the AI. ActiveScope helps the system search for multiple objects and refine their exact locations. It achieves this by intentionally blocking out irrelevant background clutter to keep the AI focused. Our experiments show that this method improves the ability of AI to accurately perceive tiny details without requiring any costly retraining, which makes AI systems much more reliable for tasks that demand careful observation.