Meta Global AI Developer Hackathon. $1M in prizes.Get notified

LLAMA 3.1 WITH LoRA

Upwork

Hero image
Meta blue bg

+58.8%

higher engagement than previous solutions for freelancers using Uma for proposal development

+24%

better sentiment for users leveraging Uma’s Llama model to write cover letters compared to competing models

-19.25%

reduction in cost per token compared to proprietary solutions

15%

jump in patent filings from accelerated innovation
*All results are self-reported and not identifiably repeatable. Generally expected individual results will differ.

CASE STUDY

Helping Upwork freelancers win more business with Llama

Oxide logo

At a glance

Industry

Technology

Use case

Enhancing proposal drafting for freelancers

Goal

Enable freelancers to efficiently create compelling proposals

Llama version

Llama 3.1 with low-rank adaptation (LoRA)

Deployment

Fireworks AI, Amazon Web Services and Upwork’s proprietary infrastructure

THEIR STORY

Connecting talent with opportunities around the world

Upwork is the world’s largest work marketplace, connecting businesses with independent talent across over 10,000 skill categories and 180+ countries. By helping clients and freelancers collaborate seamlessly, Upwork delivers innovative, scalable workforce solutions.

THEIR GOAL

Help freelancers stand out in a competitive marketplace

Upwork freelancers, especially people new to the platform or marketing their skills, struggled to stand out and book work. Even seasoned pros found responding to job postings and writing proposals a time-consuming process that required a deep understanding of job qualifications and the ability to convey personal qualities that made them a unique fit for the assignment.Upwork knew that its mindful AI companion, Uma, could help freelancers craft effective, compelling proposals faster and improve their win rates. To succeed, Uma would need to deliver high-quality, instantaneous AI assistance in a complex environment that connects freelancers with businesses around the globe.

THEIR SOLUTION

A proposal-writing companion that asks pointed questions

Upwork upgraded Uma with a fine-tuned Llama 3.1 model, giving the AI companion the ability to analyze job postings and freelancer profiles, converse candidly with freelancers about their skills and draft effective proposals — all in real-time.
their solution graphic

THEIR APPROACH

Multiple expert models provide comprehensive assistance

Upwork fine-tuned a general-purpose Llama model for Uma to derive multiple expert models for the diverse roles Uma had to fill. These included tasks such as analyzing complex job descriptions, developing proposals and providing real-time feedback to freelancers. Rather than retraining the entire Llama model for each specific task, the Upwork team used LoRA.With LoRA, only a small fraction of the weights in a model are fine-tuned to achieve expertise in a task. The Upwork team created LoRA adaptations for each use case, resulting in multiple expert models with far less training time.LoRA adaptations load at run time and share a single base Llama model, so the solution can scale up with minimal per-token computing costs. The Upwork team used Fireworks AI to serve up Llama 3.1 and LoRA adaptations on demand, allowing Uma to deliver responsive, expert assistance in real-time.

THEIR SUCCESS

AI-powered proposal drafting transforms the freelancer experience

As Uma scaled up to meet the demands of millions of freelancers, engagement grew by 56% over previous incarnations of the AI companion. By simplifying the proposal drafting process and providing expert advice, Uma saved freelancers time and boosted their win rates, proving Llama was the ideal choice for Upwork’s AI efforts.
  • +55.8% higher engagement for freelancers using Uma for proposal development versus previous solutions
  • +24% increase in first-time-right chip manufacturing
  • 50% better sentiment for users leveraging Uma’s Llama model to write cover letters compared to competing models
  • -19.25% reduction in cost per token compared to proprietary solutions
*All results are self-reported and not identifiably repeatable. Generally expected individual results will differ.
“We selected Llama for its ability to be fully customized and fine-tuned to our unique needs, giving us complete control over data workflows and on-premise model management. Its open-source foundation made it possible to develop and deploy faster while ensuring long-term security and adaptability.”

Andrew Rabinovich, Head of AI and Machine Learning at Upwork

Slide 1 of 3

Start building

Explore more

ConsumerBusiness
Shopify | Llama case studiesShopify uses Llama to generate product pages, localize content, and automate support, helping developers scale workflows and save time.Read more
ConsumerTech
Scribd, INC | Llama case studiesDelivering faster, cheaper and more accurate results with a Llama-powered AI content discovery assistant.Read more
Tech
Exati | Llama case studiesTransforming support for smart city platform clientsRead more
Meta blue bg
Stay up-to-date

Our latest updates delivered to your inbox

Subscribe to our newsletter to keep up with the latest AI updates, releases and more.

Meta
Products
Models
Documentation
Resources
Community
Terms & policies