Google Launches Artificial Intelligence Supercomputer Powered by Nvidia H100 GPUs
Google launches Google I/O speaking for over an hour this afternoon about his quite a few developments in synthetic intelligence. The corporate mentioned the brand new PaLM 2 main language mannequin (LLM) that powers the Bard chatbot software for productive AI. It is a basis for including AI-infused options to Google’s product portfolio, together with Google Maps, Google Photographs, and Gmail (amongst others).
With that in thoughts, severe horsepower is required within the cloud to energy fashions within the wild, as tens of millions (and ultimately billions) of customers submit requests for duties as mundane as eradicating an individual from the background of an image. compose a full e mail for you based mostly on a brief textual content immediate. That is the place Google’s new A3 GPU supercomputer focuses. Google says the brand new A3 supercomputers are “custom-built to coach and serve essentially the most demanding AI fashions powering immediately’s productive AI and main language mannequin innovation,” whereas delivering 26 exaFlops of AI efficiency.
Each A3 supercomputer is filled with 4th era Intel Xeon Scalable processors powered by 2TB of DDR5-4800 reminiscence. However the true ‘brains’ of operation come from eight Nvidia H100 ‘Hopper’ GPUs with entry to three.6 TB/s of dual-partition bandwidth leveraging NVLink 4.0 and NVSwitch.
In keeping with Google, the A3 represents the primary production-level deployment of a GPU-to-GPU knowledge interface that enables knowledge sharing at 200 Gbps, bypassing the principle CPU. This interface, which Google calls the Infrastructure Processing Unit (IPU), supplies a 10x improve in accessible community bandwidth for A3 digital machines (VMs) in comparison with A2 digital machines.
“A3 VMs powered by Google Cloud’s next-generation NVIDIA H100 GPUs will speed up the coaching and supply of productive AI purposes,” mentioned Ian Buck, VP of hyperscale and high-performance computing at NVIDIA. “We’re proud to proceed working with Google Cloud to assist rework companies all over the world with purpose-built AI infrastructure, proper after Google Cloud’s just lately launched G2 situations.”
If your small business desires to benefit from A3 digital machines, the one approach to achieve entry is with Google. A3 Preview Interest Form To take part within the Early Entry Program. Nevertheless, as Google has made clear, getting into your data doesn’t assure a spot in this system.
#Google #Launches #Synthetic #Intelligence #Supercomputer #Powered #Nvidia #H100 #GPUs
