Multimodal Learning 相关度: 8/10

Robust Multilingual Text-to-Pictogram Mapping for Scalable Reading Rehabilitation

Soufiane Jhilal, Martina Galletti
arXiv: 2603.24536v1 发布: 2026-03-25 更新: 2026-03-25

AI 摘要

开发了一种多语言AI系统,自动将文本映射为象形图,辅助特殊教育儿童的阅读理解。

主要贡献

  • 开发多语言文本-象形图映射系统
  • 系统评估了五种不同语言的覆盖率、质量和延迟
  • 专家评估验证了象形图的语义准确性

方法论

该系统通过AI动态识别关键概念,并将其映射到上下文相关的象形图,然后在五种语言上进行了覆盖率、专家评估和延迟评估。

原文摘要

Reading comprehension presents a significant challenge for children with Special Educational Needs and Disabilities (SEND), often requiring intensive one-on-one reading support. To assist therapists in scaling this support, we developed a multilingual, AI-powered interface that automatically enhances text with visual scaffolding. This system dynamically identifies key concepts and maps them to contextually relevant pictograms, supporting learners across languages. We evaluated the system across five typologically diverse languages (English, French, Italian, Spanish, and Arabic), through multilingual coverage analysis, expert clinical review by speech therapists and special education professionals, and latency assessment. Evaluation results indicate high pictogram coverage and visual scaffolding density across the five languages. Expert audits suggested that automatically selected pictograms were semantically appropriate, with combined correct and acceptable ratings exceeding 95% for the four European languages and approximately 90% for Arabic despite reduced pictogram repository coverage. System latency remained within interactive thresholds suitable for real-time educational use. These findings support the technical viability, semantic safety, and acceptability of automated multimodal scaffolding to improve accessibility for neurodiverse learners.

标签

多语言 象形图 特殊教育 阅读理解 可访问性

arXiv 分类

cs.CL cs.HC