Helping students find their path forward
Info Edge India Limited’s online platform, Shiksha.com, empowers students to make informed education and career decisions. The platform provides them with credible, updated and personalized information about colleges, courses, exams and career paths in India and abroad.Speed up and personalize the college research process
Students in India and abroad struggled to find reliable college, course and exam information, navigating scattered sources and tools that didn’t understand the context of their questions. Shiksha.com, part of Info Edge, was solving the problem for millions of students with a single site for credible information. But they wanted to use generative AI to make the college research process faster and more personalized. Their goal was to build a conversational chat solution that could deliver precise, real-time answers while keeping performance high and costs manageable as they scaled.
A scalable and cost-efficient Llama-enabled chatbot for students
The team built ShikshaGPT, an AI chatbot for college research, using lightweight Llama 3.1 8B. After testing multiple models, they selected Llama 3.1 8B for its strong balance of performance and cost, avoiding the high compute demands and rising inference fees of larger closed models. The model’s compact size allowed Shiksha to deploy efficiently on premises, ensuring data control, security and scalability. Llama 3.1 8B delivered fast inference times, handled multiple users at once without issue and demonstrated proficiency with academic language. Plus, its open-source nature gave the team flexibility to deploy and iterate quickly.