November 23, 2024
Nvidia to Rent Out Supercomputers Behind ChatGPT for ,000 a Month
Nvidia Chief Executive Jensen Huang on Tuesday laid out the company's plans to make the powerful and expensive supercomputers used to develop AI technologies like ChatGPT available for rent to nearly any business.

Nvidia Corp Chief Executive Jensen Huang on Tuesday laid out the company’s plans to make the powerful and expensive supercomputers used to develop AI technologies like ChatGPT available for rent to nearly any business.

While that access will not come cheap – at $37,000 (roughly Rs. 30 lakhs) a month for eight of Nvidia’s flagship A100 or H100 chips strung together – offering it to a wider swath of business customers could accelerate an AI boom that has driven Nvidia shares up 77 percent this year, making it about five times more valuable than longtime rival Intel Corp.

The Santa Clara, California-based company already dominates the field for artificial intelligence chips and has helped partners like Microsoft Corp build huge systems for ChatGPT creator OpenAI’s services to answer questions with human-like text and generate images from prompts.

At Nvidia’s annual software developer conference on Tuesday, Huang said the company was working with partners such as Oracle Corp to offer access to Nvidia’s DGX supercomputers with as many as 32,000 of Nvidia’s chips to anyone who can log on with a web browser.

“The iPhone moment of AI has started,” Huang said in the virtual keynote address, referring to how Apple Inc opened up the market for smartphones.

Huang said Nvidia was also working with Microsoft and Alphabet Inc to offer its supercomputers, used to create new AI products, as a service. Nvidia on Tuesday announced new chips and software designed to make products like chatbots much cheaper to operate on a day-to-day basis after they have been created with supercomputers.

Those products “are years ahead of the competition,” said Hans Mosesmann, a semiconductors analyst at Rosenblatt Securities. “Nvidia’s leadership on the software side of AI is not only monumental – it is accelerating.”

Nvidia is also partnering with AT&T Inc to make dispatching trucks more efficient, collaborating with quantum computing researchers to speed software development, and working with industry giant Taiwan Semiconductor Manufacturing Co to speed up chip development, Huang added.

Nvidia’s new rental service, called DGX Cloud, could give many more developers the chance to access tens of thousands of its chips at once. Biotech firm Amgen Inc and software firm ServiceNow Inc have started using the service, Nvidia said.

Nvidia also launched a service called AI Foundations to help companies train their customized artificial intelligence models. Several major owners of stock image databases plan to use the service, which would avert legal questions about copyright of images used to generate AI content.

Huang also announced technology to speed up the design and manufacturing of semiconductors. The software uses Nvidia’s chips to speed up a step that sits between the software-based design of a chip and the physical fabrication of the lithography masks used to print that design on a piece of silicon.

Those calculations could take a traditional computing chip two weeks to complete, but Nvidia said Tuesday its chips and software can handle the task overnight and reduce the electricity used in the task from 35 megawatts to 5 megawatts.

Nvidia said it was working with ASML Holding, Synopsys Inc and TSMC to bring it to market. TSMC will start readying the technology for production in June, Huang said. 

© Thomson Reuters 2023


After facing headwinds in India last year, Xiaomi is all set to take on the competition in 2023. What are the company’s plans for its wide product portfolio and its Make in India commitment in the country? We discuss this and more on Orbital, the Gadgets 360 podcast. Orbital is available on Spotify, Gaana, JioSaavn, Google Podcasts, Apple Podcasts, Amazon Music and wherever you get your podcasts.
Affiliate links may be automatically generated – see our ethics statement for details.