China’s Baidu claims its Ernie Bot beats ChatGPT on key tests as A.I. race heats up

Baidu stated Tuesday the bogus intelligence mannequin underpinning its chatbot outperformed OpenAI’s ChatGPT in a number of key areas.

The Chinese search engine has been publicly testing the Ernie Bot in China because it was revealed in March. The chatbot relies on Baidu’s foundational AI mannequin known as Ernie. A foundational mannequin is AI that is skilled on enormous quantities of knowledge. The newest iteration of Baidu’s mannequin is known as Ernie 3.5.

Citing the China Science Daily journal, Baidu stated Ernie 3.5 surpassed ChatGPT in numerous benchmark assessments. ChatGPT relies on OpenAI’s GPT 3.5 mannequin.

Ernie 3.5 additionally beat GPT 4, OpenAI’s newest and extra superior mannequin, in Chinese language assessments, in response to the science journal.

The deal with Baidu’s developments underscore the extraordinary competitors going down within the space of generative AI with know-how giants within the U.S. and China quickly advancing developments.

One check cited by the Chinese science journal was based mostly on normal admission and qualification exams equivalent to these required to get into school or qualify as a lawyer. Ernie 3.5 surpassed ChatGPT and GPT 4 in Chinese.

However, it was behind GPT 4 in English although it was forward of ChatGPT. This check was launched by Microsoft.

Another check targeted on Chinese and comprises over 13,000 multiple-choice questions protecting greater than 50 completely different topics. Ernie 3.5 was forward of ChatGPT and GPT 4 on this analysis.

A 3rd check comprises questions on varied topics equivalent to science and humanities and was developed by a gaggle of U.S. universities. Ernie 3.5 was behind each ChatGPT and GPT 4.

Baidu spoke about its advances with its AI because it appears to be like to take a lead within the know-how versus rivals equivalent to Alibaba.

“Just three months after the beta release of Ernie Bot, Baidu’s large language model (LLM) built on Ernie 3.0, Ernie 3.5 has achieved broad enhancements in efficacy, functionality, and performance,” Haifeng Wang, CTO of Baidu stated in a press release.

“These improvements are evident in creative writing, Q&A, reasoning, and code generation, as well as in training performance and inference performance.”

Baidu stated one defining function of its newest mannequin is the power to entry “plugins” that are principally apps that may be accessed through Ernie Bot. Baidu’s search function has been built-in with Ernie Bot through a plugin, for instance.