Rack footprints to scale: 34 racks of 750 × 1,200 mm, in rows with 1.2 m aisles. The arrangement is one possible layout.
NVIDIA · priced at Broadberry, Insight
1,024-GPU AI factory
1,024 B200 GPUs in 128 DGX B200 systems, four to a rack, joined by 48 Quantum-2 switches: 32 leaf switches with 32 ports down to the GPUs and 32 up, and 16 spine switches.
Key features
- 1,024 B200 GPUs in 128 DGX B200: 184 TB of GPU memory
- 2,304 PFLOPS of dense FP16: 2.3 exaflops
- 48 InfiniBand switches in a two-level fat tree, a 400 Gb/s port for every GPU
- About 1.9 MW at full load across 34 racks
- 34 racks of 750 × 1200 mm, 32 for compute and 2 for the network
Parts and prices
| Part | Qty | Price |
|---|---|---|
| NVIDIA DGX B200 | 128 | $562,154.09 × 128 = $71,955,723.52 Broadberry, 25 Oct 2026 |
| NVIDIA Quantum-2 QM9700 InfiniBand switch MQM9700-NS2F | 48 | $39,250.99 × 48 = $1,884,047.52 Insight, 25 Oct 2026 |
| APC NetShelter SX 42U rack, 750 × 1200 mm AR3350B2 | 34 | $4,306.99 × 34 = $146,437.66 Insight, 25 Oct 2026 |
| Total | $73,986,208.70 | |
Not included: cables and optics (about 2,048 InfiniBand links), power distribution, cooling, storage and the building. At full load the systems and switches draw about 1.9 MW.
Specifications
NVIDIA DGX B200 × 128
- GPUs
- 8 × B200 (180 GB each)
- CPU
- 2 × Intel Xeon Platinum 8570, 112 cores in total
- System memory
- 4 TB DDR5 as configured (NVIDIA: 2 TB, up to 4 TB)
- Storage
- 2 × 1.92 TB M.2 + 8 × 3.84 TB NVMe
- Networking
- 8 × ConnectX-7 400 Gb/s InfiniBand/Ethernet; 2 × BlueField-3
- Form factor
- 10U, 897 mm deep, 142 kg
- Note
- 1,440 GB of GPU memory in total; 3-year support included in the price
- Power
- 14.3 kW (maximum, NVIDIA)
Sources: NVIDIA DGX B200 specifications ↗ · NVIDIA DGX B200 user guide (size) ↗ · NVIDIA HGX B200 (FP16) ↗ · Broadberry configuration ↗
NVIDIA Quantum-2 QM9700 InfiniBand switch × 48
- Networking
- 64 ports of 400 Gb/s NDR InfiniBand in 32 OSFP cages, 51.2 Tb/s
- Form factor
- 1U
- Power
- 1.7 kW (maximum, with active cables)
Sources: NVIDIA QM9700 user manual ↗ · NVIDIA QM9700 specifications ↗
APC NetShelter SX 42U rack, 750 × 1200 mm × 34
- Form factor
- 42U enclosure, 1991 mm tall, 750 mm wide, 1200 mm deep
Sources: APC AR3350B2 product page ↗
Power adds each part's maximum rated power, before cooling and power losses. Model sizes are memory arithmetic: 2 bytes per parameter at 16-bit, half a byte at 4-bit, keeping a fifth of the memory for the context cache. They say what fits, not how fast it runs.
Can't afford it? Rent it for real.
Cloud providers rent the NVIDIA B200 from $7.99 per GPU an hour, or $2.50 on spot, compared on GlobeGPU (rates of 25 Oct 2026).
Compare NVIDIA B200 prices on GlobeGPU ▸