Top ex-Google Brain researchers start AI research company in Tokyo

Two outstanding former Google researchers, one among whom was a co-inventor of the “transformer” synthetic intelligence structure that paved the best way for the generative AI increase, introduced on Thursday they’d began a brand new AI firm based mostly in Tokyo.

Sakana AI, based by David Ha and Llion Jones, declined to reveal funding particulars.

Jones is the fifth creator on Google’s 2017 analysis paper “Attention Is All You Need”, which launched the “transformer” deep studying structure that went on to grow to be the premise for viral chatbot ChatGPT and the present race to develop merchandise powered by generative AI. Ha was beforehand the top of analysis at Stability AI and a Google Brain researcher.

After the well-known paper got here out, advances in generative AI basis fashions have centered round making the “transformer”-based fashions bigger and bigger. Instead of doing that, Sakana AI will concentrate on creating new architectures for basis fashions, Jones advised Reuters.

“Rather than building one huge model that sucks all this data, our approach could be using a large number of smaller models, each with their own unique advantage and smaller data set, and having these models communicate and work with each other to solve a problem,” mentioned Ha, although he clarified this was simply an concept.

All the authors on the “Attention Is All You Need” paper have now left Google. The authors’ new ventures have attracted hundreds of thousands in funding from enterprise buyers, together with Noam Shazeer, who’s operating AI chatbot startup Character.AI, and Aidan Gomez, who based massive language mannequin startup Cohere.

Stay on high of know-how and startup news that issues. Subscribe to our each day e-newsletter for the newest and must-read tech news, delivered straight to your inbox.