Jen-Hsun Huang, president and chief govt officer of Nvidia Corp., proclaims the EGX Edge Supercomputing Platform throughout the firm’s occasion at Mobile World Congress Americas in Los Angeles, California, Oct. 21, 2019.
Patrick T. Fallon | Bloomberg | Getty Images
Nvidia’s most-advanced graphics playing cards are promoting for greater than $40,000 on eBay, as demand soars for chips wanted to coach and deploy synthetic intelligence software program.
The costs for Nvidia’s H100 processors had been famous by 3D gaming pioneer and former Meta consulting expertise chief John Carmack on Twitter. On Friday, at the very least eight H100s had been listed on eBay at costs starting from $39,995 to simply below $46,000. Some retailers have supplied it up to now for round $36,000.
The H100, introduced final 12 months, is Nvidia’s newest flagship AI chip, succeeding the A100, a roughly $10,000 chip that is been known as the “workhorse” for AI purposes.
Developers are utilizing the H100 to construct so-called giant language fashions (LLMs), that are on the coronary heart of AI purposes like OpenAI’s ChatGPT. Running these methods is dear and requires highly effective computer systems to churn via terabytes of knowledge for days or even weeks at a time. They additionally depend on hefty computing energy so the AI mannequin can generate textual content, photographs or predictions.
Training AI fashions, particularly giant ones like GPT, requires a whole bunch of high-end Nvidia GPUs working collectively.
Microsoft spent a whole bunch of tens of millions of {dollars} on tens of 1000’s of Nvidia A100 chips to assist construct ChatGPT. Nvidia controls the overwhelming majority of the marketplace for AI chips.
Nvidia additionally gives a supercomputer with eight GPUs working collectively known as the DGX. Earlier this 12 months, the corporate introduced new companies that might permit corporations to hire entry to DGX computer systems for $37,000 per thirty days. At that value, the system would use Nvidia’s older A100 processors.
Nvidia says the H100 is the primary chip to be optimized for the particular AI structure underpinning lots of the latest advances in AI, known as transformers. Industry consultants say the extra highly effective chips will likely be vital to construct even greater and extra data-hungry fashions than these which are at present obtainable.
WATCH: Google chip manufacturing takes purpose at Nvidia’s generative A.I.
Source: www.cnbc.com