Tokenization Allows Multimodal Large Language Models to Understand, Generate and Edit Architectural Floor Plans
AI 摘要
HouseMind通过tokenization统一了建筑平面图的理解、生成和编辑,提高了空间推理和可控性。
主要贡献
- 提出了一种新的多模态大语言模型HouseMind
- 引入了离散房间实例token构建统一词汇
- 实现了平面图理解、生成和编辑的统一框架
方法论
利用多模态对齐和指令微调,模型能够从文本指令合成连贯、可控的平面图布局。
原文摘要
Architectural floor plan design demands joint reasoning over geometry, semantics, and spatial hierarchy, which remains a major challenge for current AI systems. Although recent diffusion and language models improve visual fidelity, they still struggle with coherent spatial reasoning and controllable generation. We present HouseMind, a multimodal large language model that unifies floor plan understanding, generation, and editing in one framework. We introduce discrete room-instance tokens to construct a unified vocabulary that bridges layouts and symbolic reasoning. With multimodal alignment and instruction tuning, the model synthesizes coherent, controllable layouts from text instructions. Experiments show how the framework achieves superior geometric validity and controllability while remaining efficient and locally deployable.