Nvidia's annual GPU Technology Conference (GTC) has become a platform for the AI industry, robotics, autonomous vehicles, manufacturing, and science to showcase their latest innovations. This conference aims to inspire the world on the art-of-the-possible of accelerated computing and celebrate the achievements of the scientists who use it.
One of the highlights of last year’s announcement was that Nvidia's Hopper H100 is finally in full production and being deployed at data centers, including those from Google, Oracle, and more. This GPU is the heart of the latest DGX supercomputers, consisting of eight H100 GPUs with massive heatsinks packed onto a single system. Although it may be costly for companies to have their own DGX H100 setup, DGX Cloud solutions will offer them as on-demand services.
Nvidia's Hopper H100 offers a single platform that can scale up to the largest installations, making it advantageous for companies. Nvidia also announced its Grace-Hopper solution, the first time it has been mentioned during a keynote. The company also introduced its new L4, L40, and H100 NVL, a PCI Express solution that uses two Hopper H100 GPUs linked together by NVLink. This solution can handle the 165 billion parameter GPT-3 model, thanks to the 160GB of total HBM2e memory.
Nvidia also showcased its Omniverse, a platform that enables real-time simulation and collaboration across industries. The company introduced OVX servers that will be coming from a variety of vendors, including Nvidia L40 Ada RTX GPUs, and Nvidia's BlueField-3 processors for connectivity. Additionally, new workstations powered by Ada RTX GPUs were announced for both desktop and laptop configurations, available now.
Cloud solutions are becoming increasingly important for AI and machine learning development. Services like ChatGPT, Stable Diffusion, and Dall-E have leveraged cloud solutions for some of their training, and DGX Cloud aims to open that up to even more people. Nvidia's GTC provides a platform for industry leaders to showcase their latest innovations, and this year's event demonstrated the growing demands of the modern digital world, with growth that at times outpaces the rate of Moore's Law.
In conclusion, Nvidia's GTC 2023 highlighted the latest innovations in AI, robotics, autonomous vehicles, manufacturing, and science. Nvidia's Hopper H100, Grace-Hopper solution, and NVL solutions, as well as its Omniverse platform and new workstations, were showcased at the event. Cloud solutions are becoming increasingly important for AI and machine learning development, and DGX Cloud aims to open up access to these solutions to even more people. Nvidia's GTC provides a platform for industry leaders to showcase their latest innovations and demonstrates the continued growth of the modern digital world.