NVIDIA B200 low power usage for inference AI workload

(lightly.ai)

2 points | by viyops 3 hours ago

1 comments

  • viyops 2 hours ago
    Full Cluster Power: Our entire 8xB200 node (GPUs only) drew approximately 4.8 kW under heavy training load. Including CPUs, RAM, storage, etc., the total system power draw was roughly 6.5–7 kW at the wall.