GB200 NVL72 introduces cutting-edge capabilities and a second-generation Transformer Engine, which enables FP4 AI. When coupled with fifth-generation NVIDIA NVLink, it delivers 30X faster real-time LLM inference performance for trillion-parameter language models.

NVIDIA DGX™ GB200 is purpose-built for training and inferencing trillion-parameter generative AI models. Designed as a rack-scale solution, each liquid-cooled rack features 36 NVIDIA GB200 Grace Blackwell Superchips—–36 NVIDIA Grace CPUs and 72 Blackwell GPUs—–connected as one with NVIDIA NVLink™.

The NVIDIA GB200 NVL2 platform brings the new era of computing to every data center, delivering unparalleled performance for mainstream large language model (LLM) inference, vector database search, and data processing through 2 Blackwell GPUs and 2 Grace CPUs.

Jul 17, 2024 · Nvidia’s GB200 brings significant advances in performance via superior hardware architecture, but the deployment complexities rise dramatically. While on the face of it, Nvidia has released a standard rack that people will just install in their datacenters without much trouble, plug-and-play style, the reality is there are dozens of different ...

Mar 18, 2024 · The GB200 introduces cutting-edge capabilities and a second-generation transformer engine that accelerates LLM inference workloads. It delivers a 30x speedup for resource-intensive applications like the 1.8T parameter GPT-MoE compared to …

Mar 21, 2024 · GTC Nvidia revealed its most powerful DGX server to date on Monday. The 120kW rack scale system uses NVLink to stitch together 72 of its new Blackwell accelerators into what's essentially one big GPU capable of more than 1.4 exaFLOPS performance — at FP4 precision anyway.

Oct 15, 2024 · The NVIDIA GB200 NVL72 rack, with four NVLink cartridges housing over 5,000 energy efficient coaxial copper cables, enables each GPU to communicate with every other GPU 36x faster than state-of-the-art Ethernet standards

NVIDIA DGX GB200 is liquid-cooled, rack-scale AI infrastructure with intelligent predictive management capabilities that scales to tens of thousands of NVIDIA GB200 Grace Blackwell Superchips for training and inferencing trillion-parameter generative AI models.

NVIDIA's GB200 GPU uses the Blackwell architecture and is made using a 5 nm production process at TSMC. GB200 does not support DirectX. For GPU compute applications, OpenCL version 3.0 and CUDA 12.0 can be used. It features 18432 shading units, 576 texture mapping units and 24 ROPs.

Apr 15, 2025 · With further optimizations taking advantage of GB200 NVL72’s large unified memory, FP4 precision and a 72-GPU NVIDIA NVLink domain — where every GPU is connected to operate in concert — Cohere is getting dramatically higher throughput with shorter time to first and subsequent tokens for more performant, cost-effective inference.