Nvidia's AI Enterprise suite, which covers a host of AI frameworks including access to its inference microservices ( NIMs ), ...
The GPU will include 288GB of new HBM4 memory, a format that is considered important for AI. The system will also include a faster NVLink 6 interconnect, with total data transfer speeds of 260TB ...
the Blackwell Ultra GPU, and the NVIDIA Grace CPU, all connected by the NVLink-C2C. Inside the supercomputer also sits an NVIDIA ConnectX-8 SuperNIC, which supports networking at up to 800Gb/s.
The company has previously said that this generation of NVLink enables bidirectional throughput per GPU to reach 1.8 TB/s. Nvidia said the GB200 NVL4 Superchip features 1.3 TB of coherent memory ...