The NVIDIA GB200 NVL72 by HPE is a rack-scale system optimized to accelerate large AI model training, fine-tuning, and real-time inferencing for AI models over 1 trillion parameters.

This architecture is comprised of 36 NVIDIA Grace ARM processors and 72 NVIDIA Blackwell GPUs all interconnected with NVIDIA’s 5th-gen NVLink technology. The rack is powered by a set of power shelves through a bus bar and the compute trays are cooled with cold plates that are mounted on the CPUs and GPUs.

NVIDIA GB200 NVL72 by HPE

The HPE offering incorporates direct liquid cooling technologies from HPE. NVIDIA GB200 NVL72 by HPE offers a complete, scalable solution for AI & HPC customers everywhere. NVIDIA GB200 NVL72 by HPE provides maximum performance for Large Model AI Training and Deep Learning. Built with high-speed networking technologies, integrated storage, a robust software portfolio and management tools, NVIDIA GB200 NVL72 by HPE systems enable customers to innovate and prepare for tomorrow’s challenges.

On System Management Chipset

Based on NVIDIA OpenBMC

ASPEED 2600 management controller

Memory

Soldered on 512 GB LPDDR5x – 480 GB usable of LPDDR5x

Memory ECC – Supported and enabled by default

Notes: Memory is not configurable

Front Panel Connections

System Unit Specifications

Dimensions (Height x Width x Depth)

• – Rack

1068 mm (L) x 600 mm (W) x 2495 mm

Weight (approximate)

• – Fully Loaded (with PGW):
• 3245 lbs

Internal Storage

Hot-pluggable and hot-swappable

Power Delivery and Requirements

The NVL72 rack is powered by a set of 6 (max: 8) power shelves and a DC bus bar. Each power shelf is fed by a power whip with input connector type IEC 60309 5-wire 560P6W. Each power shelf can provide up to 33 kW of power to the rack.

The rack’s TDP (thermal design power) is 132 kW nominal with a EDPp (electrical design power – peak) of 1.5x TDP or approximately 192 kW

HPE suggests that data centers should provision their bus ways to be able to support 192 kW EDPp.

1 Power Shelf contains

• – 6x 5.5 kW PSU – Power Supply Units
• – 1x PMC – Power shelf management controller
• – 1x Power Shelf Chassis

CDU (Cooling Distribution Unit) for NVIDIA GB200 NVL72 by HPE

The cooling distribution unit (CDU) is a liquid-to-liquid heat exchanger that is used to remove heat from HPE GB200 NVL72 by HPE.

The CDU uses a secondary loop to circulate a heat transfer liquid to the cold plates. The heat captured in the secondary loop is transferred to the facilities primary loop via a liquid-to-liquid heat exchanger. The CDU is designed to circulate and control the heat transfer fluid to the manifolds that are in each rack.

The in-row CDU is rated for 1.3 MW of cooling. One CDU supports a maximum of 8 racks.

HPE supports overhead (top feed) and underfloor (bottom feed) secondary loop configurations. A spacer manifold can be used for racks that do not need liquid cooling.

Operating Systems and Virtualization Software Support for HPE Servers

Currently, the only supported OS with NVIDIA GB200 NVL72 by HPE is:

Ubuntu 24.04

HPE Server UEFI (under development – subject to change)

Unified Extensible Firmware Interface (UEFI) is an industry standard that provides better manageability and more secured configuration than the legacy ROM while interacting with your server at boot time. HPE ProLiant Gen11 servers have a UEFI Class 3 implementation and support UEFI Mode only.

Notes: The UEFI System Utilities tool is analogous to the HPE ROM-Based Setup Utility (RBSU) of legacy BIOS. For more information, please visit http://www.hpe.com/servers/uefi.

UEFI enables numerous new capabilities specific to HPE ProLiant servers such as

• – Secure Boot and Secure Start enable for enhanced security
• – Embedded UEFI Shell
• – Operating system specific functionality
• – Mass Configuration Deployment Tool using iLO RESTful API that is Redfish API Conformant
• – Support for greater than 2.2 TB (using GPT) boot drives
• – PXE boot support for IPv6 networks
• – USB 3.0 Stack
• – Workload Profiles for simple performance optimization

UEFI Boot Mode only

• – TPM 2.0 Support
• – iSCSI Software Initiator Support.
• – NVMe Boot Support
• – HTTP/HTTPs Boot support as a PXE alternative.
• – Platform Trust Technology (PTT) can be enabled.
• – Boot support for option cards that only support a UEFI option ROM

Notes: For UEFI Boot Mode, boot environment and OS image installations should be configured properly to support UEFI.

Industry Standard Compliance (under development – subject to change)

• – ACPI 6.3 Compliant
• – IPMI 2.0
• – PCIe 4.0 Compliant
• – PCIe 5.0 Compliant
• – PXE Support
• – Redfish API
• – TPM 2.0 Support
• – Triple Data Encryption Standard (3DES)
• – UEFI (Unified Extensible Firmware Interface Forum) 2.6
• – USB 2.0 Compliant
• – USB 3.0 Compliant

Embedded Management (under development – subject to change)

Based off of NVIDIA’s Reference Firmware with HPE Enhancements such as

• – Security Features

  • Ultimaco ESKM appliance support
  • Remote Keys
  • Self-encrypting devices (OPAL compliance)
• – Audit Logging
• – Restricted SSH Access
• – Serviceability Features

  • AHS logging limited to sensors and events
  • CLI Interface
  • Remote Support
• o Software delivered as a package to capture and surface data
• o Redfish Crawler built-in
• o Secure connectivity layer (provided by RDA)
• o Provides a method of secure remote access to customer systems
• o Manufacturability Features

  • Non-volatile Hostname/Password
• – Branding

  • HPE Branded GUI

Server Management

NVIDIA GB200 NVL72 by HPE Baseboard Management Controller

Embedded, in-depth server-level monitoring and management technology offering system management, service alerting, reporting and remote management including remote console and virtual media mount.

Industry Standard Redfish

The NVIDIA GB200 NVL72 by HPE supports industry standard DMTF Redfish that provides API conformance and offers simplified server management automation such as configuration and maintenance tasks based on modern industry standards. Learn more at: https://dmtf.org/standards/redfish.

Security (under development – subject to change)

• – Secure Start – only boot Signed FW
• – UEFI Secure Boot
• – NIST SP800-193 Protect, Detect, Recover for BIOS and BMC Tamper-free updates – components digitally signed and verified using CNSA strength RSA4096 signing key.
• – Secure Recovery – recover critical firmware to known good state on detection of compromised firmware. Event recorded in the event log.
• – UEFI TPM 2.0 (Trusted Platform Module 2.0) - supports OpenSSL 3.0 to provide secure remote connectivity sessions to the system.
• – SPI BUS monitoring to ensure BIOS and BMC FW are always signed and secure.
• – Secure out-of-the-box high-entropy RMC administrator password is unique for each system.
• – Support for multiple Redfish role-based access control (RBAC) accounts ensuring that passwords need not be shared and can provide separation of duties.

HPE Education Services

Training and certification designed for IT and business professionals across all industries. Broad catalogue of course offerings to expand skills and proficiencies in topics ranging from cloud and cybersecurity to AI and DevOps. Create learning paths to expand proficiency in a specific subject. Schedule training in a way that works best for your business with flexible continuous learning options.

https://www.hpe.com/services/training

HPE Consulting Services

No matter where you are in your journey to hybrid cloud, experts can help you map out your next steps. From determining what workloads should live where, to handling governance and compliance, to managing costs, our experts can help you optimize your operations.

https://www.hpe.com/services/consulting

HPE Managed Services

HPE runs your IT operations, providing services that monitor, operate, and optimize your infrastructure and applications, delivered consistently and globally to give you unified control and let you focus on innovation.

HPE Managed Services | HPE

Emissions Classification (EMC) – Regulatory Information

To view the regulatory information for your product, view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products, available at the Hewlett Packard Enterprise Support Center:

http://www.hpe.com/support/Safety-Compliance-EnterpriseProducts

Environmentally Friendly Products and Approach End-of-life Management and Recycling

Hewlett Packard Enterprise offers end-of-life product return, trade-in, and recycling programs, in many geographic areas, for our products. Products returned to Hewlett Packard Enterprise will be recycled, recovered or disposed of in a responsible manner.

The European Union Waste Electrical and Electronic Equipment Directive [EU WEEE] (2002/95/EC) requires manufacturers to provide treatment information for each product type for use by treatment facilities. This information (product disassembly instructions) is posted on the Hewlett Packard Enterprise website. These instructions may be used by recyclers and other WEEE treatment facilities as well as Hewlett Packard Enterprise OEM customers who integrate and re-sell Hewlett Packard Enterprise equipment.

Emissions Classification (EMC) – Regulatory Information

To view the regulatory information for your product, view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products, available at the Hewlett Packard Enterprise Support Center:

http://www.hpe.com/support/Safety-Compliance-EnterpriseProducts

Environmentally friendly Products and Approach End-of-life Management and Recycling

Hewlett Packard Enterprise offers end-of-life product return, trade-in, and recycling programs, in many geographic areas, for our products. Products returned to Hewlett Packard Enterprise will be recycled, recovered or disposed of in a responsible manner.

The European Union Waste Electrical and Electronic Equipment Directive [EU WEEE] (2002/95/EC) requires

manufacturers to provide treatment information for each product type for use by treatment facilities. This information (product disassembly instructions) is posted on the Hewlett Packard Enterprise web site. These instructions may be used by recyclers and other WEEE treatment facilities as well as Hewlett Packard Enterprise OEM customers who integrate and re-sell Hewlett Packard Enterprise equipment.