Multimodal Learning 相关度: 7/10

3D Smoke Scene Reconstruction Guided by Vision Priors from Multimodal Large Language Models

Xinye Zheng, Fei Wang, Yiqi Nie, Kun Li, Junjie Chen, Jiaqi Zhao, Yanyan Wei, Zhiliang Wu
arXiv: 2604.05687v1 发布: 2026-04-07 更新: 2026-04-07

AI 摘要

提出Smoke-GS框架,结合视觉先验和3D高斯溅射,实现烟雾场景重建和新视角合成。

主要贡献

  • 提出利用多模态大模型视觉先验辅助烟雾场景重建
  • 开发Smoke-GS框架,处理烟雾引起的视角依赖外观变化
  • 在烟雾环境中生成一致且清晰的新视角

方法论

使用Nano-Banana-Pro增强图像,利用带视角依赖媒介分支的3D高斯溅射模型Smoke-GS重建场景。

原文摘要

Reconstructing 3D scenes from smoke-degraded multi-view images is particularly difficult because smoke introduces strong scattering effects, view-dependent appearance changes, and severe degradation of cross-view consistency. To address these issues, we propose a framework that integrates visual priors with efficient 3D scene modeling. We employ Nano-Banana-Pro to enhance smoke-degraded images and provide clearer visual observations for reconstruction and develop Smoke-GS, a medium-aware 3D Gaussian Splatting framework for smoke scene reconstruction and restoration-oriented novel view synthesis. Smoke-GS models the scene using explicit 3D Gaussians and introduces a lightweight view-dependent medium branch to capture direction-dependent appearance variations caused by smoke. Our method preserves the rendering efficiency of 3D Gaussian Splatting while improving robustness to smoke-induced degradation. Results demonstrate the effectiveness of our method for generating consistent and visually clear novel views in challenging smoke environments.

标签

3D重建 烟雾场景 多视角图像 高斯溅射 视觉先验

arXiv 分类

cs.CV