XR-CareerAssist: An Immersive Platform for Personalised Career Guidance Leveraging Extended Reality and Multimodal AI
In an era where career guidance is more crucial than ever, traditional platforms often fall short in providing interactive and engaging experiences for users. The introduction of XR-CareerAssist marks a significant leap forward in this domain, merging Extended Reality (XR) with advanced Artificial Intelligence (AI) technologies to create a multifaceted career guidance experience.
Revolutionizing Career Guidance
Conventional career guidance systems have relied heavily on static, text-driven interfaces, making it challenging for users to engage fully. Despite advancements in Computer-Assisted Career Guidance Systems since the 1960s, many still lack interactivity and fail to address the narrative aspects of career development. XR-CareerAssist seeks to bridge these gaps, providing a platform that offers immersive, multilingual guidance tailored to individual needs.
Key Features of XR-CareerAssist
The XR-CareerAssist platform integrates several cutting-edge AI modules to enhance user experience:
- Automatic Speech Recognition: Facilitates voice-driven interactions, allowing users to engage effortlessly with the system.
- Neural Machine Translation: Supports multiple languages, including English, Greek, French, and Italian, making the platform accessible to a wider audience.
- Langchain-based Conversational Training Assistant: Provides personalized dialogue, adapting responses based on user input.
- BLIP-based Vision-Language Model: Offers visualizations of career trajectories and opportunities, enhancing understanding through imagery.
- AWS Polly Text-to-Speech: Delivers information through an interactive 3D avatar, adding a layer of engagement to the user experience.
Dynamic Career Visualizations
One of the standout features of XR-CareerAssist is its ability to render career trajectories as dynamic Sankey diagrams. These visualizations are derived from a comprehensive repository of over 100,000 anonymized professional profiles, enabling users to see potential pathways in a visually engaging manner.
Development and Evaluation
The XR-CareerAssist application was developed using Unity for the Meta Quest 3 platform, with backend services hosted on AWS. A pilot evaluation conducted at the University of Exeter involved 23 participants and yielded impressive results:
- 95.6% speech recognition accuracy
- 78.3% overall user satisfaction
- 91.3% favorable ratings for system responsiveness
Feedback from participants has been instrumental in refining the platform, leading to improvements in motion comfort, audio clarity, and text legibility.
The Future of Career Development Tools
XR-CareerAssist exemplifies how the integration of XR and AI can transform career development tools into more engaging, accessible, and effective solutions. By combining five distinct AI modules within a single immersive environment, it offers a unique multimodal interaction experience, setting a new standard for career guidance platforms.
As the landscape of career guidance continues to evolve, platforms like XR-CareerAssist will undoubtedly play a pivotal role in shaping how individuals navigate their professional journeys.