AI Startup Jivi’s LLM Beats OpenAI’s GPT-4 & Google’s Med-PaLM 2 in Answering Medical Questions 

Jivi MedX ranks number 1 on the Open Medical LLM Leaderboard; will launch healthcare product globally later this year

A purpose-built medical LLM developed by Jivi, an Indian startup co-founded by former BharatPe Chief Product Officer Ankur Jain, has claimed the number one slot on the Open Medical LLM Leaderboard. 

Jivi’s Large Language Model (LLM), Jivi MedX has beaten established LLMs such as OpenAI’s GPT-4 and Google’s Med-PaLM 2 with an average score of 91.65 across the leaderboard’s nine benchmark categories. Hosted by leading AI platform Hugging Face, the leaderboard ranks medical-specific LLMs on their performance on how well they answer medical questions from exams and research. The evaluation covers medical exams such as the US Medical Licensing Examination (USMLE), Indian medical entrance exams (AIIMS and NEET), and detailed assessments in clinical knowledge, medical genetics, and professional medicine, among others.

Founded in January 2024, Jivi is an Indian AI startup with a team of physicians, surgeons, AI engineers, and data scientists. Jivi’s lean team comprises physicians, surgeons, AI engineers and data scientists. It is developing technology to transform accessibility, affordability, and quality of healthcare. 

“Jivi is revolutionizing primary healthcare through generative AI, making top-quality care accessible 24/7 at a fraction of the cost. Our mission at Jivi is to harness artificial intelligence to enhance patient care. Our platform accelerates diagnostics and ensures higher accuracy, enabling timely and precise treatment for all,” said Ankur Jain, Co-founder and CEO of Jivi.

JIVI uses its large proprietary medical dataset consisting of millions of medical research papers, journals, clinical notes, and other sources to train its Jivi MedX LLM. This dataset is among the largest in the world. Jivi MedX was trained using an instruction fine-tuning algorithm called Odds Ratio Preference Optimisation (ORPO).

Sign up for the free insideAI News newsletter.

Join us on Twitter: https://twitter.com/InsideBigData1

Join us on LinkedIn: https://www.linkedin.com/company/insidebigdata/

Join us on Facebook: https://www.facebook.com/insideAI NewsNOW