Multimodal Learning 相关度: 7/10

Oral to Web: Digitizing 'Zero Resource'Languages of Bangladesh

Mohammad Mamun Or Rashid
arXiv: 2603.05272v1 发布: 2026-03-05 更新: 2026-03-05

AI 摘要

构建了孟加拉国首个国家级多语种平行多模态语料库,覆盖多种濒危语言。

主要贡献

  • 创建了孟加拉国少数民族语言的大规模多语种语料库
  • 系统性的田野调查和数据收集方法
  • 公开可用的带注释的音频和文本数据

方法论

通过田野调查收集数据,包含文本、语音和IPA转录,由语言学家进行标注和校对,最终构建多模态语料库。

原文摘要

We present the Multilingual Cloud Corpus, the first national-scale, parallel, multimodal linguistic dataset of Bangladesh's ethnic and indigenous languages. Despite being home to approximately 40 minority languages spanning four language families, Bangladesh has lacked a systematic, cross-family digital corpus for these predominantly oral, computationally "zero resource" varieties, 14 of which are classified as endangered. Our corpus comprises 85792 structured textual entries, each containing a Bengali stimulus text, an English translation, and an IPA transcription, together with approximately 107 hours of transcribed audio recordings, covering 42 language varieties from the Tibeto-Burman, Indo-European, Austro-Asiatic, and Dravidian families, plus two genetically unclassified languages. The data were collected through systematic fieldwork over 90 days across nine districts of Bangladesh, involving 16 data collectors, 77 speakers, and 43 validators, following a predefined elicitation template of 2224 unique items organized at three levels of linguistic granularity: isolated lexical items (475 words across 22 semantic domains), grammatical constructions (887 sentences across 21 categories including verbal conjugation paradigms), and directed speech (862 prompts across 46 conversational scenarios). Post-field processing included IPA transcription by 10 linguists with independent adjudication by 6 reviewers. The complete dataset is publicly accessible through the Multilingual Cloud platform (multiling.cloud), providing searchable access to annotated audio and textual data for all documented varieties. We describe the corpus design, fieldwork methodology, dataset structure, and per-language coverage, and discuss implications for endangered language documentation, low-resource NLP, and digital preservation in linguistically diverse developing countries.

标签

语料库构建 濒危语言 多语种 自然语言处理 语音

arXiv 分类

cs.CL cs.HC