3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models
AI 摘要
提出Smoke-GS框架,结合视觉先验和3D高斯溅射,实现烟雾场景重建和新视角合成。
主要贡献
- 提出利用多模态大模型视觉先验辅助烟雾场景重建
- 开发Smoke-GS框架,处理烟雾引起的视角依赖外观变化
- 在烟雾环境中生成一致且清晰的新视角
方法论
使用Nano-Banana-Pro增强图像,利用带视角依赖媒介分支的3D高斯溅射模型Smoke-GS重建场景。
原文摘要
Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-dependent appearance changes, and severe degradation of cross-view consistency. To address these issues, we propose a framework that integrates visual priors with efficient 3D scene modeling. We employ Nano-Banana-Pro to enhance smoke-degraded images and provide clearer visual observations for reconstruction and develop Smoke-GS, a medium-aware 3D Gaussian Splatting framework for smoke scene reconstruction and restoration-oriented novel view synthesis. Smoke-GS models the scene using explicit 3D Gaussians and introduces a lightweight view-dependent medium branch to capture direction-dependent appearance variations caused by smoke. Our method preserves the rendering efficiency of 3D Gaussian Splatting while improving robustness to smoke-induced degradation. Results demonstrate the effectiveness of our method for generating consistent and visually clear novel views in challenging smoke environments.