Meta Global AI Developer Hackathon. $1M in prizes.Get notified
LLAMA 3.1 8B
Litmos
95%
reduction in time to complete content authoring tasks140%
improvement in MMLU-PRO benchmark accuracy59%
improvement in MMLU versus previous models110%
increase in IFEVAL benchmark performance*All results are self-reported and not identifiably repeatable. Generally, expected individual results will differ.
CASE STUDY
Improving search and engagement with Llama-powered learning assistant
At a glance
Industry
Technology and softwareUse case
Powering natural language search with AI for faster content discoveryGoal
Increasing engagement, outcomes and adoption of immersive learningLlama version
Llama 3.1 8BDeployment
Self-hosted on Kubernetes, Azure AKSTHEIR STORY
Innovative learning solutions fueling business success
Litmos develops learning solutions for over 4,000 top-performing companies and 30 million users. Its learning solutions include the easiest-to-use learning management solution (LMS), comprehensive learning content collections, integrations with top workflow tools and services to support success.
THEIR GOAL
Replace keyword-based search with an intuitive, AI-powered experience
The Litmos LMS has vast libraries of learning materials in text, images and video in unique file formats. However, the platform’s keyword-based search made it difficult to find content, a frustrating experience that discouraged learning and lowered engagement. The Litmos team wanted to bypass the constraints of exact keyword matches with an AI-powered assistant that could help learners search through natural conversations.
THEIR SOLUTION
Llama-powered AI transforms content discovery with natural language
Litmos replaced its keyword-based search with a Llama 3.1 8B-powered assistant, allowing learners to use natural, conversational language to find courses and materials. For example, a learner might ask, “What are the best courses to improve my project management skills?” The assistant summarizes completed courses and asks follow-up questions to reinforce learning.
THEIR APPROACH
Portable Llama improves performance and security
Litmos chose Llama 3.1 8B for its combination of cutting-edge performance, small footprint and portable, open-source licensing. The assistant combines off-the-shelf Llama and a retrieval augmented generation (RAG) workflow with prompt engineering in a Kubernetes deployment running on private, Azure AKS GPU clusters. By eliminating API calls to external AI providers, the solution safeguards proprietary content and learner data while meeting Litmos’s clients’ enterprise security requirements.
The Llama-powered Litmos assistant transformed keyword search into a natural language discovery and learning tool.
THEIR SUCCESS
Llama-powered assistant improves learning, fuels platform adoption
Litmos’s Llama-powered assistant has transformed how learners discover content and engage with the Litmos LMS. By eliminating the friction of traditional keyword-based search, the platform encourages deeper interaction, making learning more seamless and engaging. Improving the learning experiences is expanding adoption of the platform and helping Litmos solidify its position as an innovator in AI-driven eLearning solutions.
Projected results:
- 95% reduction in time to complete content authoring tasks
- 140% improvement in MMLU-PRO benchmark accuracy
- 59% improvement in MMLU versus previous models
- 110% increase in IFEVAL benchmark performance
“The AI assistant, powered by Llama, is a game-changer. With it, we’ve set a new standard in eLearning solutions. Learners engage more, administrators work smarter and the entire experience feels seamless.”
Tommy Richardson — Chief Product and Technology Officer, Litmos
“Llama 3.1 8B outperformed across all metrics while requiring similar resources, making it an ideal choice for our infrastructure. Plus, the responses feel more human — leading learners to use natural language when interacting with the AI assistant.”
Tommy Richardson — Chief Product and Technology Officer, Litmos
“As a self-hosted solution, Llama provides complete oversight over data, alleviating potential client concerns regarding data privacy. Llama’s open-source nature was a key factor in our decision-making process.”
Tommy Richardson — Chief Product and Technology Officer, Litmos
“I’ve witnessed firsthand the transformative power of Llama in our corporate learning platform. By integrating Llama’s advanced AI capabilities, we’ve significantly improved content discovery, learner engagement and LMS adoption across our user base.”
Tommy Richardson — Chief Product and Technology Officer, Litmos
Previous slide
Next slide
Start building
Explore more
ConsumerBusiness
Shopify | Llama case studiesShopify uses Llama to generate product pages, localize content, and automate support, helping developers scale workflows and save time.Read more
ConsumerTech
Scribd, INC | Llama case studiesDelivering faster, cheaper and more accurate results with a Llama-powered AI content discovery assistant.Read more
Stay up-to-date
Our latest updates delivered to your inbox
Subscribe to our newsletter to keep up with the latest AI updates, releases and more.