Ganga-1B — pre-trained Hindi AI model developed at IITGN

The Ganga-1B model has been based on the dataset found on the public domain in regard to Hindi language, including news articles, web documents, books, government publications, educational materials and quality-filtered social media conversations.

“The unity project aims to develop pocket size open-source Large Language Models (LLMs) for Indic languages, created and trained from scratch from Indian data. This initiative will propel the Indian open-source community to build LLMs and chatbots that can be trained and deployed under resource-constrained scenarios,” Professor Mayank Singh told The Indian Express.

Ganga-1B — which has already been downloaded by over 600 people in less than 48 hours following the announcement — was built over nearly 1.5 years to develop, using open-source data from various websites.

The research team has been working on models for other languages including Gujarati, Urdu, Tamil, Telugu and Marathi; they are exploring the use of AI in e-governance for regional languages as well as on an education LLM to support school students and teachers.
Native Indian speakers have further curated the dataset to ensure high quality.