Llama-backed virtual AI companions make personalized XR training more efficient and effective
At a glance
Industry
TechnologyUse case
Producing real-time extended reality (XR) training featuring virtual charactersGoal
Improve simulated training and break down production barriersLlama version
Llama 3.1 8BDeployment
Google Cloud Platform (GCP) and Amazon Web Services (AWS)
Empowering workforce agility in a changing world
Cornerstone — a leader in workforce agility platforms — helps enterprises identify skills gaps and development opportunities, retain and engage top talent and provide multimodal learning experiences to meet the diverse needs of the modern workforce.Improve simulated training and break down production barriers
XR training immerses employees in real-world scenarios that bring them face-to-face with virtual characters that role-play challenging situations and behaviors. XR sessions offer high-impact learning that can scale, but producing simulations takes months and current virtual characters struggle to understand context and converse naturally.Cornerstone wanted to develop an AI-native solution to simplify production and improve character behavior so HR professionals could quickly create XR simulations with context-aware virtual characters.
Llama-powered production and characters for immersive XR simulations
Using Llama 3.1 8B as a foundational model, Cornerstone created Immerse Companion. This generative AI solution makes it easy to produce real-time employee training simulations populated with virtual coaches, mentors, experts and role-playing characters. Multilingual Llama even translates simulations into local languages — a must-have capability for Cornerstone’s global customer base.As an open-source model, Llama brought the cost benefits, transparency and customizability that Cornerstone needed to develop an effective, profitable product that adhered to the company’s ethos of enabling open, non-jealous XR architectures and ethical, responsible and transparent AI.
Fine-tuning and RAG create sophisticated training simulations
Cornerstone fine-tuned Llama 3.1 8B with learning and skills data to increase accuracy and used prompt engineering to configure the LLM for downstream processes such as animation, text-to-speech and reflections.Retrieval augmented generation (RAG) workflows inject context from multiple sources — including customer-defined sources such as organizational strategy, hiring data or product documentation. The result: immersive training simulations with expert characters that detect intent, speak naturally and tap into extensive knowledge bases.
Expert XR training simulations in minutes
Cornerstone achieved an unprecedented level of real-time, fully adaptable immersive training. With the Llama-backed Immerse Creator and Companion, it now takes one person as little as five minutes to create a 30-minute training simulation complete with expert virtual characters.Cornerstone follows an open architecture ethos deployed on multi-cloud infrastructure, including Google Cloud Platform (GCP) and Amazon Web Services (AWS). With Immerse Creator and Companion, HR departments can help employees build skills faster with expert advice, sophisticated coaching and role-playing that scales on their preferred infrastructure.
Projected results:
