Multimodal Learning 相关度: 9/10

XR-CareerAssist: An Immersive Platform for Personalised Career Guidance Leveraging Extended Reality and Multimodal AI

N. D. Tantaroudas, A. J. McCracken, I. Karachalios, E. Papatheou, V. Pastrikakis
arXiv: 2604.06901v1 发布: 2026-04-08 更新: 2026-04-08

AI 摘要

XR-CareerAssist结合XR和多模态AI,打造个性化沉浸式职业指导平台。

主要贡献

  • 提出XR-CareerAssist平台,融合XR与多模态AI。
  • 集成语音识别、机器翻译、对话训练、视觉语言模型等AI模块。
  • 构建基于用户画像的动态职业路径可视化。
  • 在Unity和AWS上实现并进行了初步评估。

方法论

使用Unity构建XR应用,结合AWS后端服务,集成多种AI模块,实现多模态交互的职业指导平台。

原文摘要

Conventional career guidance platforms rely on static, text-driven interfaces that struggle to engage users or deliver personalised, evidence-based insights. Although Computer-Assisted Career Guidance Systems have evolved since the 1960s, they remain limited in interactivity and pay little attention to the narrative dimensions of career development. We introduce XR-CareerAssist, a platform that unifies Extended Reality (XR) with several Artificial Intelligence (AI) modules to deliver immersive, multilingual career guidance. The system integrates Automatic Speech Recognition for voice-driven interaction, Neural Machine Translation across English, Greek, French, and Italian, a Langchain-based conversational Training Assistant for personalised dialogue, a BLIP-based Vision-Language model for career visualisations, and AWS Polly Text-to-Speech delivered through an interactive 3D avatar. Career trajectories are rendered as dynamic Sankey diagrams derived from a repository of more than 100,000 anonymised professional profiles. The application was built in Unity for Meta Quest 3, with backend services hosted on AWS. A pilot evaluation at the University of Exeter with 23 participants returned 95.6% speech recognition accuracy, 78.3% overall user satisfaction, and 91.3% favourable ratings for system responsiveness, with feedback informing subsequent improvements to motion comfort, audio clarity, and text legibility. XR-CareerAssist demonstrates how the fusion of XR and AI can produce more engaging, accessible, and effective career development tools, with the integration of five AI modules within a single immersive environment yielding a multimodal interaction experience that distinguishes it from existing career guidance platforms.

标签

XR AI Multimodal Career Guidance Personalization

arXiv 分类

cs.CE cs.AI cs.CV cs.CY cs.ET