Nvidia CEO Jensen Huang kicked off his company’s annual developer conference on Monday with a slew of announcements designed to keep the chip maker in a dominant position in the artificial intelligence industry.
On a hockey arena stage in the heart of Silicon Valley, Huang introduced Nvidia’s latest chip, which is 30 times speedier at some tasks than its predecessor.
He also detailed a new set of software tools to help developers sell AI models more easily to companies that use technology from Nvidia, whose customers include most of the world’s biggest technology firms.
Nvidia’s chip and software announcements at GTC 2024 will help determine whether the company can maintain its 80% share of the market for AI chips.
“I hope you realise this is not a concert,” Huang said, wearing his signature leather jacket and joking that the day’s keynote would be full of dense maths and science.
It was a nod to how Nvidia, once mostly known among computer gaming enthusiasts, has earned recognition on par with tech giants like Microsoft and has become a Wall Street standout, with sales that more than doubled in its most recent fiscal year to surpass US$60-billion.
Nvidia’s new flagship chip, called the B200, takes two squares of silicon the size of the company’s previous offering and binds them together into a single component.
While the B200 “Blackwell” chip is 30 times speedier at tasks like serving up answers from chatbots, Huang did not give specific details about how well it performs when chewing through huge amounts data to train those chatbots — which is the kind of work that has powered most of Nvidia’s soaring sales. He also gave no price details.
Rally
Altogether, Huang’s announcements failed to provide new fuel for a rally in which Nvidia’s shares have surged 240% over the past 12 months, making it the US stock market’s third-most valuable company, behind only Microsoft and Apple. Nvidia stock dipped 1.4% in extended trade, while Super Micro Computer, which makes AI-optimised servers with Nvidia’s chips, fell 4%. AMD stock dipped nearly 3% during the keynote.
Tom Plumb, CEO and portfolio manager at Plumb Funds, whose largest holdings include Nvidia, said the Blackwell chip was not a surprise.
“But it reinforces that this company is still at the cutting edge and the leader in all graphics processing. That doesn’t mean the market is not going to be big enough for AMD and others to come in. But it shows that their lead is pretty insurmountable,” said Plumb.
Read: Nvidia is now worth more than the world’s biggest oil company
Nvidia said major customers including Amazon.com, Google, Microsoft, OpenAI and Oracle, are expected to use the new chip in cloud computing services they sell, and also for their own AI offerings.
Nvidia also is shifting from selling single chips to selling total systems. Its latest iteration houses 72 of its AI chips and 36 central processors.
Many analysts expect Nvidia’s market share to drop several percentage points in 2024 as new products from competitors come to market and Nvidia’s largest customers make their own chips.
“Rivals like AMD, Intel, start-ups and even Big Tech’s own chip aspirations threaten to chip away at Nvidia’s market share, particularly among cost-conscious enterprise customers,” said Insider Intelligence analyst Jason Bourne.
Though Nvidia is widely known for its hardware offerings, the company has built a significant battery of software products as well. The new software tools, called microservices, improve system efficiency across a wide variety of uses, making it easier for a business to incorporate an AI model into its work, just as a good computer operating system can help apps work well.
In addition to AI software, Nvidia dived deeper into software for emulating the physical world with 3D models. For work on designing cars, jets and products, Huang also announced partnerships with design software companies Ansys, Cadence and Synopsys. Shares of the three companies jumped around 3% in extended trade following Huang’s comments.
Huang also said that Nvidia’s software would be able to stream 3D worlds to Apple’s new Vision Pro headset.
Nvidia also introduced a new line of chips designed for cars with new capabilities to run chatbots inside the vehicle. The company deepened its already extensive relationships with Chinese car makers, saying that electric vehicle makers BYD and Xpeng will both use its new chips.
Read: Nvidia CEO says AI could pass human tests within five years
Towards the end of his keynote speech, Huang also outlined a new series of chips for creating humanoid robots, inviting several of the robots made using the chips to join him on the stage. — Max A Cherney and Stephen Nellis, with Arsheeya Bajwa, Noel Randewich, Chibuike Oguh and Chuck Mikolajczak, (c) 2024 Reuters