Multimodal Learning 相关度: 9/10

Less Detail, Better Answers: Degradation-Driven Prompting for VQA

Haoxuan Han, Weijie Wang, Zeyu Zhang, Yefei He, Bohan Zhuang
arXiv: 2604.04838v1 发布: 2026-04-06 更新: 2026-04-06

AI 摘要

通过降级图像和结构化提示,DDP框架提升了VQA模型在复杂视觉基准上的推理准确性。

主要贡献

  • 提出Degradation-Driven Prompting (DDP)框架
  • 利用图像降级策略减少视觉噪声
  • 结合结构化视觉提示和In-Context Learning增强模型关注点

方法论

DDP通过图像降采样、结构化辅助视觉信息和特定任务工具,降低图像保真度,引导模型关注关键信息。

原文摘要

Recent advancements in Vision-Language Models (VLMs) have significantly pushed the boundaries of Visual Question Answering (VQA).However,high-resolution details can sometimes become noise that leads to hallucinations or reasoning errors. In this paper,we propose Degradation-Driven Prompting (DDP), a novel framework that improves VQA performance by strategically reducing image fidelity to force models to focus on essential structural information. We evaluate DDP across two distinct tasks. Physical attributes targets images prone to human misjudgment, where DDP employs a combination of 80p downsampling, structural visual aids (white background masks and orthometric lines), and In-Context Learning (ICL) to calibrate the model's focus. Perceptual phenomena addresses various machine-susceptible visual anomalies and illusions, including Visual Anomaly (VA), Color (CI), Motion(MI),Gestalt (GI), Geometric (GSI), and Visual Illusions (VI).For this task, DDP integrates a task-classification stage with specialized tools such as blur masks and contrast enhancement alongside downsampling. Our experimental results demonstrate that less is more: by intentionally degrading visual inputs and providing targeted structural prompts, DDP enables VLMs to bypass distracting textures and achieve superior reasoning accuracy on challenging visual benchmarks.

标签

VQA Multimodal Learning Image Degradation Prompting

arXiv 分类

cs.CV