Skip to main content

NVIDIA GB300 NVL72 by HPE QuickSpecs

Shape the Future of QuickSpecs - Your Input Matters

Table of Contents

Table of Contents

    The NVIDIA GB300 NVL72 by HPE is a rack-scale system optimized to accelerate large AI model training, fine-tuning, and real-time inference for AI models over 1 trillion parameters.


    This architecture is comprised of 36 NVIDIA Grace ARM processors and 72 NVIDIA Blackwell Ultra GPUs all interconnected with NVIDIA’s 5th-gen NVLink technology. The rack is powered by a set of power shelves through a bus bar and the compute trays are cooled with cold plates on the CPUs and GPUs. The HPE offering incorporates direct-liquid cooling technologies from HPE. NVIDIA GB300 NVL72 by HPE offers a complete, scalable solution for AI and HPC customers everywhere. NVIDIA GB300 NVL72 by HPE provides maximum performance for Large Model AI Training and Deep Learning. Built with high-speed networking technologies, integrated storage, a robust software portfolio and management tools, NVIDIA GB300 NVL72 by HPE systems enable customers to innovate and prepare for tomorrow’s challenges.

    Overview

    image

    Front / Rear View - Rack

    Item

    Description

    Item

    Description

    1.

    Top-of-rack switches

    2.

    Power Shelves

    3.

    NVLink Switch Trays

    4.

    Compute Trays

    5.

    Cable Cartridges

    6.

    44U Rack Manifolds

    NVIDIA GB300 NVL72 by HPE SKUs

    Below is a list of SKUs to configure the NVL72 System

    Additional Software and Support SKUs will be added soon

    Models

    SKU

    NVIDIA GB200 NVL72 by HPE Base System Code

    S5T77A

    NVIDIA GB200 NVL72 by HPE Upgrade System Code

    S5T78A

    NVIDIA GB300 NVL72 by HPE Base Rack

    S6C60A

    NVIDIA GB300 NVL72 by HPE Hybrid Cooling Base Compute Tray

    S6C59A

    Compute Tray Options

    SKU

    HPE 3.84 TB NVMe Read Intensive E1.S ST Self-encrypting Multivendor SSD

    S6F53A

    HPE 7.68 TB NVMe Read Intensive E1.S ST Self-encrypting Multivendor SSD

    S6F54A

    HPE 15 TB NVMe Read Intensive E1.S ST Self-encrypting Multivendor SSD

    S6F55A

    Rack Options

    SKU

    NVIDIA Spectrum SN2201 48-port 1/100 GbE QSFP28/RJ45 ToR Switch

    S6F61A

    HPE 1U 33 kW 50VDC Air Cooling Left Power-Capacitance Shelf Kit

    S6E21A

    Power Whip Kits

    SKU

    HPE 400 V 60Amp Top Feed NA Power Whip Kit

    S6X18A

    HPE 400 V 60Amp Bottom Feed NA Power Whip Kit

    S6X19A

    HPE 400 V 60Amp Top Feed INTL Power Whip Kit

    S6X20A

    HPE 400 V 60Amp Bottom Feed INTL Power Whip Kit

    S6X21A

    HPE 480 V 60Amp Top Feed NA Power Whip Kit

    S6X22A

    HPE 480 V 60Amp Bottom Feed NA Power Whip Kit

    S6X23A

    Cooling

    RDHX options

    SKU

    HPE M12 48U 600 mm G2 Rack 208-230 V Top Feed Rear Door Heat Exchanger

    S4N09A

    HPE M12 48U 600 mm G2 Rack 208-230 V Bottom Feed Rear Door Heat Exchanger

    S4N11A

    CDU options

    SKU

    HPE 3-phase 380-480 V Top Feed Primary Bottom Feed Secondary XDU1350 Coolant Distribution Unit

    S5R40A

    HPE 3-phase 380-480 V Bottom Feed Primary Bottom Feed Secondary XDU1350 Coolant Distribution Unit

    S5R41A

    HPE 3-phase 380-480 V Top Feed Primary Top Feed Secondary XDU1350 Coolant Distribution Unit

    S5S27A

    HPE 3-phase 380-480 V Bottom Feed Primary Top Feed Secondary XDU1350 Coolant Distribution Unit

    S5S28A

    Sellable Service Kit

    SKU

    Vertiv XDU1350 Essential Spare Parts Kit

    S5R44A

    Vertiv XDU1350 Recommended Spare Parts Kit

    S6D83A

    Service / Deployment

    SKU

    HPE Rack-scale Fill Station

    S6H12A

    HPE Rack-scale EU Fill Station

    S6J45A

    HPE Quick Disconnect Adapter for NVIDIA NVL72

    S6K93A

    HPE Cray Fill and Drain Hand Pump Kit

    P59920-B21

    CDU Power Cord

    SKU

    HPE 560P6W 400 V 3 m CDU Power Cord for Vertiv XDU1350

    S5Z51A

    HPE 560P6W 400 V 6 m CDU Power Cord for Vertiv XDU1350

    S5Z52A

    HPE 560P7W 400 V 6 m CDU Power Cord for Vertiv XDU1350

    S5Z53A

    HPE 560P7W 400 V 3 m CDU Power Cord for Vertiv XDU1350

    S5Z54A

    CDU Connection Kit

    SKU

    HPE CDU Con Flex Hose Kit Universal

    S5S29A

    HPE CDU Connection Hard Pipe Kit for Vertiv XDU1350

    S5S30A

    Secondary Fluid Network Manifold

    SKU

    HPE In-Row CDU Top Feed Secondary Manifold Kit

    S5R42A

    HPE In-Row CDU Bottom Feed Secondary Manifold Kit

    S5R43A

    Optional for Secondary Manifold

    SKU

    HPE Secondary Manifold Single Rack Spacer for NVIDIA NVL72

    S5T44A

    HPE Secondary Manifold Double Rack Spacer for NVIDIA NVL72

    S5T45A

    Standard Faetures

    Platform Information

    Form Factor

    • − 48U rack-scale system

    System

    • − 18x Compute Trays
      • • 2x Grace CPUs
      • • 4x Blackwell GPUs
      • • PCIe slots (non-configurable): 1x BlueField-3 DPUs and 2x ConnectX-8 IO modules
      • • Storage: SEDs – Opal/TCP-Capable
        • o 8x E1.S
        • o 1x M.2
    • − 9x NVIDIA NV Link Switch Trays
    • − 8 33 kW Power shelves
    • − 50 V DC Busbar
    • − 2x SN2201_M Top-of-rack switches
    • − 44U Rack Liquid Manifold
    • − FIO:
      • • 1x USB 3.0
      • • 1x USB 2.0 for UART
      • • 1x Mini Display Port
      • • 1x Management 1 GbE Port
    • − 3x Status LEDs

    Processors – Grace ARM processor

    Notes: NVL72 contains 18 compute trays. Each compute tray contains 2 GB300 boards. Each board has 1 Grace ARM processor

    Grace CPU

    CPU core count

    72 Arm Neoverse V2 cores

    L1 cache

    64KB i-cache & 64KB d-cache

    L2 cache

    1 MB per Core

    L3 cache

    114 MB

    Base frequency | all-core SIMD freq

    3.1 GHz | 3.0 GHz

    LPDDR5X Size

    512 GB (480 GB usable)

    On System Management Chipset

    • − Based on NVIDIA OpenBMC
    • − ASPEED 2600 management controller
    • − Other BMC Chipsets under investigation

    Memory

    • − Soldered on 512 GB LPDDR5X – 480 GB usable of LPDDR5X
    • − Memory ECC – Supported and enabled by default
      • Notes: Memory is not configurable

    Front Panel Connections

    image
    • − 2x NVIDIA ConnectX-8 (800 Gbps)
    • − 1x NVIDIA BlueField-3 B3240
    • − 8x E1.S SSDs
    • − 1x FIO panel

    Front IO

    Technology

    1.

    E1.S SSDs

    2.

    FIO (RJ45 1 GbE port, USB 3.0, USB 2.0 UART, Mini Display Port)

    3.

    BlueField-3 DPUs (RJ45 BF3 BMC port, 2x QSFP)

    4.

    ConnectX-8 IO Board (2x OSFP)

    System Unit Specifications

    Dimensions (Height x Width x Depth)

    • Rack
      • 2495 mm (H) x 600 mm (W) x 1068 mm (L)

    Weight (approximate)

    • Fully Loaded (with PGW):
      • 3300 lbs

    Internal Storage

    Hot-pluggable and hot-swappable

    Drive

    Capacity

    Configuration

    Front facing [DATA] - E1.S SSD

    3.84 TB, 7.68 TB, 15 TB

    4x, 8x

    Internal [BOOT] - M.2 SSD

    1.98 TB

    1 x 1.98 TB

    Power Delivery and Requirements

    The NVL72 rack is powered by a set of 8 power shelves and a DC bus bar. Each power shelf is fed by a power whip with input connector type IEC 60309 5-wire 560P6W. Each power shelf can provide up to 33 kW of power to the rack.


    The rack’s TDP (thermal design power) is 132 kW nominal with an EDPp (electrical design power – peak) of approximately 155 kW


    HPE suggests that data centers should provision their bus ways to be able to support 192 kW EDPp.

    • − 1 Power Shelf contains
      • • 6x 5.5 kW PSU – Power Supply Units
      • • 1x PMC – Power shelf management controller
      • • 1x Power Shelf Chassis

    CDU (Cooling Distribution Unit) For NVIDIA GB300 NVL72 by HPE

    The cooling distribution unit (CDU) is a liquid-to-liquid heat exchanger that is used to remove heat from HPE GB300 NVL72 by HPE.

    The CDU uses a secondary loop to circulate a heat transfer liquid to the cold plates. The heat captured in the secondary loop is transferred to the facilities primary loop via a liquid-to-liquid heat exchanger. The CDU is designed to circulate and control the heat transfer fluid to the manifolds that are in each rack.


    The in-row CDU is rated for 1.3 MW of cooling. One CDU supports a maximum of 8 racks.

    HPE supports overhead (top feed) and underfloor (bottom feed) secondary loops configurations. A spacer manifold can be used for racks that do not need liquid cooling

    image

    Operating Systems and Virtualization Software Support for HPE Servers

    Currently, the only supported OS with NVIDIA GB300 NVL72 by HPE is:

    • − Ubuntu 24.04

    HPE Server UEFI (under development – subject to change)

    Unified Extensible Firmware Interface (UEFI) is an industry standard that provides better manageability and more secured configuration than the legacy ROM while interacting with your server at boot time. HPE ProLiant Gen11 servers have a UEFI Class 3 implementation and support UEFI Mode only.


    Notes: The UEFI System Utilities tool is analogous to the HPE ROM-Based Setup Utility (RBSU) of legacy BIOS. For more information, please visit http://www.HPE.com/servers/uefi.


    UEFI enables numerous new capabilities specific to HPE ProLiant servers such as:

    • − Secure Boot and Secure Start enabled for enhanced security
    • − Embedded UEFI Shell
    • − Operating system specific functionality
    • − Mass Configuration Deployment Tool using iLO RESTful API that is Redfish API Conformant
    • − Support for > 2.2 TB (using GPT) boot drives
    • − PXE boot support for IPv6 networks
    • − USB 3.0 Stack
    • − Workload Profiles for simple performance optimization

    UEFI Boot Mode only

    • − TPM 2.0 Support
    • − iSCSI Software Initiator Support.
    • − NVMe Boot Support
    • − HTTP/HTTPs Boot support as a PXE alternative.
    • − Platform Trust Technology (PTT) can be enabled.
    • − Boot support for option cards that only support a UEFI option ROM

    Notes: For UEFI Boot Mode, boot environment and OS image installations should be configured properly to support UEFI.


    Industry Standard Compliance (under development – subject to change)

    • − ACPI 6.3 Compliant
    • − IPMI 2.0
    • − PCIe 4.0 Compliant
    • − PCIe 5.0 Compliant
    • − PXE Support
    • − Redfish API
    • − TPM 2.0 Support
    • − Triple Data Encryption Standard (3DES)
    • − UEFI (Unified Extensible Firmware Interface Forum) 2.6
    • − USB 2.0 Compliant
    • − USB 3.0 Compliant

    Embedded Management (under development – subject to change)

    Based on NVIDIA’s Reference Firmware with HPE Enhancements such as

    • − Security Features
      • • Ultimaco ESKM appliance support
      • • Remote Keys
      • • Self-encrypting devices (OPAL compliance)
    • − Audit Logging
    • − Restricted SSH Access
    • − Serviceability Features
      • • AHS logging limited to sensors and events
      • • CLI Interface
      • • Remote Support
        • o Software delivered as a package to capture and surface data
        • o Redfish Crawler built-in
        • o Secure connectivity layer (provided by RDA)
        • o Provides method of secure remote access to customer systems
    • − Manufacturability Features
      • • Non-volatile Hostname/Password
    • − Branding
      • • HPE Branded GUI

    Server Management

    NVIDIA GB300 NVL72 by HPE Baseboard Management Controller

    Embedded, in-depth server-level monitoring and management technology offering system management, service alerting, reporting and remote management including remote console and virtual media mount.


    Industry Standard Redfish

    The NVIDIA GB300 NVL72 by HPE supports industry standard DMTF Redfish that provides API conformance and offers simplified server management automation such as configuration and maintenance tasks based on modern industry standards. Learn more at:

    https://dmtf.org/standards/redfish


    Security (under development – subject to change)

    • − Secure Start – only boot Signed Firmware
    • − UEFI Secure Boot
    • − NIST SP800-193 Protect, Detect, Recover for BIOS and BMC Tamper-free updates – components digitally signed and verified using CNSA strength RSA4096 signing key.
    • − Secure Recovery – recover critical firmware to known good state on detection of compromised firmware. Event recorded in the event log.
    • − UEFI TPM 2.0 (Trusted Platform Module 2.0) - supports OpenSSL 3.0 provide for secure remote connectivity session to system
    • − SPI BUS monitoring to ensure BIOS and BMC FW are always signed and secure.
    • − Secure, out-of-the-box high-entropy RMC administrator password is unique for each system.
    • − Support for multiple Redfish role-based access control (RBAC) accounts ensuring that passwords need not be shared and can provide separation of duties.

    Technical Specifications

    Warranty

    This product is covered by a global limited warranty and supported by HPE Services and a worldwide network of Hewlett Packard EnterpriseAuthorized Channel Partners resellers. Hardware diagnostic support and repair is available for three years from date of purchase. Support for software and initial setup is available for 90 days from date of purchase. Enhancements to warranty services are available through HPE Services operational services or customized service agreements. Hard drives have either a one-year or three-year warranty; refer to the specific hard drive QuickSpecs for details.


    Notes: Server Warranty includes 3-Year Parts, 3-Year Labor, 3-Year Onsite support with next business day response. Warranty repairs may be accomplished using Customer Self Repair (CSR) parts. These parts fall into two categories: 1) Mandatory CSR parts are designed for easy replacement. A travel and labor charge will result when customers decline to replace a Mandatory CSR part; 2) Optional CSR parts are also designed for easy replacement but may involve added complexity. Customers may choose to have Hewlett Packard Enterprise replace Optional CSR parts at no charge. Additional information regarding worldwide limited warranty and technical support is available at: https://www.HPE.com/support/ProLiantServers-Warranties


    HPE Services

    No matter where you are in your digital transformation journey, you can count on HPE Services to deliver the expertise you need when, where and how you need it. From planning to deployment, ongoing operations and beyond, our experts can help you realize your digital ambitions.

    https://www.HPE.com/services


    Consulting Services

    No matter where you are in your journey to hybrid cloud, experts can help you map out your next steps. From determining what workloads should live where, to handling governance and compliance, to managing costs, our experts can help you optimize your operations.

    https://www.HPE.com/services/consulting


    HPE Managed Services

    HPE runs your IT operations, providing services that monitor, operate, and optimize your infrastructure and applications, delivered consistently and globally to give you unified control and let you focus on innovation.

    HPE Managed Services | HPE


    Operational services

    Optimize your entire IT environment and drive innovation. Manage day-to-day IT operational tasks while freeing up valuable time and resources. Meet service-level targets and business objectives with features designed to drive better business outcomes.

    https://www.HPE.com/services/operational


    HPC&AI Custom Service

    This is a Statement of Work (SoW) based service that provides site readiness verification, installation planning and management, unpacking, plug-ins for the system, and installation of a secondary coolant loop between Nvidia NVL72 Rack Scale System cabinets. The service also helps set up the CDU, powers up the Nvidia NVL72 Rack Scale and performs connectivity validation.

    https://www.HPE.com/psnow/doc/a50002850enw

    https://www.HPE.com/psnow/doc/a50002922enw


    HPE Lifecycle Services

    HPE Lifecycle Services provide a variety of options to help maintain your HPE systems and solutions at all stages of the product lifecycle. A few popular examples include:

    • − Lifecycle Install and Startup Services: Various levels for physical installation and power on, remote access setup, installation and startup, and enhanced installation services with the operating system.
    • − HPE Firmware Update Analysis Service: Recommendations for firmware revision levels for selected HPE products, taking into account the relevant revision dependencies within your IT environment.
    • − HPE Firmware Update Implementation Service: Implementation of firmware updates for selected HPE server, storage, and solution products, taking into account the relevant revision dependencies within your IT environment.
    • − Implementation assistance services: Highly trained technical service specialists to assist you with a variety of activities, ranging from design, implementation, and platform deployment to consolidation, migration, project management, and onsite technical forums.
    • − HPE Service Credits: Access to prepaid services for flexibility to choose from a variety of specialized service activities, including assessments, performance maintenance reviews, firmware management, professional services, and operational best practices.

    Notes:

    To review the list of Lifecycle Services available for your product go to: https://www.HPE.com/services/lifecycleFor a list of the most frequently purchased services using service credits, see the HPE Service Credits Menu


    Other Related Services from HPE Services:

    HPE Education Services

    Training and certification designed for IT and business professionals across all industries. Broad catalogue of course offerings to expand skills and proficiencies in topics ranging from cloud and cybersecurity to AI and DevOps. Create learning paths to expand proficiency in a specific subject. Schedule training in a way that works best for your business with flexible continuous learning options.

    https://www.HPE.com/services/training


    Defective Media Retention

    An option available with HPE Complete Care Service and HPE Tech Care Service and applies only to Disk or eligible SSD/Flash Drives replaced by HPE due to malfunction.


    Consult your HPE Sales Representative or Authorized Channel Partner of choice for any additional questions and services options.

    Parts and Materials

    HPE will provide HPE-supported replacement parts and materials necessary to maintain the covered hardware product in operating condition, including parts and materials for available and recommended engineering improvements.


    Parts and components that have reached their maximum supported lifetime and/or the maximum usage limitations as set forth in the manufacturer's operating manual, product QuickSpecs, or the technical product data sheet will not be provided, repaired, or replaced as part of these services.


    How to Purchase Services

    Services are sold by Hewlett Packard Enterprise and Hewlett Packard Enterprise Authorized Service Partners:

    • − Services for customers purchasing from HPE or an enterprise reseller are quoted using HPE order configuration tools.
    • − Customers purchasing from a commercial reseller can find services at https://ssc.HPE.com/portal/site/ssc/

    AI Powered and Digitally Enabled Support Experience

    Achieve faster time to resolution with access to product-specific resources and expertise through a digital and data driven customer experience


    Sign into the HPE Support Center experience, featuring streamlined self-serve case creation and management capabilities with inline knowledge recommendations. You will also find personalized task alerts and powerful troubleshooting support through an intelligent virtual agent with seamless transition when needed to a live support agent.

    https://support.HPE.com/hpesc/public/home/signin


    Emissions Classification (EMC) – Regulatory Information

    To view the regulatory information for your product, view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products, available at the Hewlett Packard Enterprise Support Center:

    http://www.HPE.com/support/Safety-Compliance-EnterpriseProducts


    Environment-friendly Products and Approach End-of-life Management and Recycling

    Hewlett Packard Enterprise offers end-of-life product return, trade-in, and recycling programs, in many geographic areas, for our products. Products returned to Hewlett Packard Enterprise will be recycled, recovered or disposed of in a responsible manner.


    The EU WEEE directive (2002/95/EC) requires manufacturers to provide treatment information for each product type for use by treatment facilities. This information (product disassembly instructions) is posted on the Hewlett Packard Enterprise web site. These instructions may be used by recyclers and other WEEE treatment facilities as well as Hewlett Packard Enterprise OEM customers who integrate and re-sell Hewlett Packard Enterprise equipment.

    Summary of Changes

    Date

    Version History

    Action

    Description of Change

    04-May-2026

    Changed

    Updated internal storage configuration options, including boot and data designations, drive quantities, and supported capacities (3.84 TB, 7.68 TB, and 15 TB).

    01-Dec-2025

    New

    New QuickSpecs

    Recommended for you