Multimodal Learning 相关度: 6/10

Inferring Height from Earth Embeddings: First insights using Google AlphaEarth

Alireza Hamoudzadeh, Valeria Belloni, Roberta Ravanelli
arXiv: 2602.17250v1 发布: 2026-02-19 更新: 2026-02-19

AI 摘要

利用AlphaEarth Embeddings和深度学习模型进行地表高度推断的研究,效果初步验证。

主要贡献

  • 探索了Earth Embeddings在区域地表高度映射中的应用潜力
  • 评估了U-Net和U-Net++在高度推断中的表现
  • 分析了Earth Embeddings的局限性并提出了改进方向

方法论

使用U-Net和U-Net++作为轻量级卷积解码器,将Earth Embeddings转换为地表高度估计,并使用DSM进行评估。

原文摘要

This study investigates whether the geospatial and multimodal features encoded in \textit{Earth Embeddings} can effectively guide deep learning (DL) regression models for regional surface height mapping. In particular, we focused on AlphaEarth Embeddings at 10 m spatial resolution and evaluated their capability to support terrain height inference using a high-quality Digital Surface Model (DSM) as reference. U-Net and U-Net++ architectures were thus employed as lightweight convolutional decoders to assess how well the geospatial information distilled in the embeddings can be translated into accurate surface height estimates. Both architectures achieved strong training performance (both with $R^2 = 0.97$), confirming that the embeddings encode informative and decodable height-related signals. On the test set, performance decreased due to distribution shifts in height frequency between training and testing areas. Nevertheless, U-Net++ shows better generalization ($R^2 = 0.84$, median difference = -2.62 m) compared with the standard U-Net ($R^2 = 0.78$, median difference = -7.22 m), suggesting enhanced robustness to distribution mismatch. While the testing RMSE (approximately 16 m for U-Net++) and residual bias highlight remaining challenges in generalization, strong correlations indicate that the embeddings capture transferable topographic patterns. Overall, the results demonstrate the promising potential of AlphaEarth Embeddings to guide DL-based height mapping workflows, particularly when combined with spatially aware convolutional architectures, while emphasizing the need to address bias for improved regional transferability.

标签

Earth Embeddings 深度学习 地表高度映射 U-Net U-Net++

arXiv 分类

cs.CV