HPE ProLiant Compute DL384 Gen12 is the first server from HPE enabled with NVIDIA GH200 NVL2. It is optimized for AI inferencing for large language models requiring large memory capacity and for non-AI workloads such as large-scale simulation, EDA, and weather forecasting.

With up to 1.2 TB of fast unified memory and 5TB/s bandwidth, the NVIDIA GH200 NVL2 can handle large language models fine-tuning and inferencing with Retrieval Augmented Generation (RAG) and more users featuring twice the performance of the previous generation.

What’s New

• −The first HPE ProLiant rack mount server with the latest NVIDIA GH200 Grace Hopper™ Superchip
• − Support for dual superchips with NVIDIA GH200 NVL2. NVLink between two GH200 for twice the memory and performance.
• − Support for the latest NVIDIA InfiniBand, Ethernet, and Bluefield adapters ensures your AI fabric runs at top performance.
• − NVIDIA OVX™ certified for Artificial Intelligence workloads
• − High-performance LLM inference to maximize data center utilization
• − With up to 2X higher inference performance compared to H100
• − HPE Silicon Root of Trust offers industry leading innovation based on the HPE zero trust architecture, to protect your infrastructure, workloads, and data

Platform Information

Form Factor

• − 2U standard 19” rack design, air cooled server

Notes: * With sparsity, ** 96GB GH200 available to select customers. Check with your HPE representative for details.

On System Management Chipset

HPE iLO 6 ASIC

Notes: Read and learn more in the iLO QuickSpecs

European Union (EU) Lot 9 regulation

Beginning on January 1^st, 2024, units sold into the European Union (EU), European Economic Area (EEA), the United Kingdom, Ireland, Switzerland or Turkey, must include more efficient AC power supplies: 94% for multi-output and 96% for single-output. HPE Flexible Slot power supplies are single-output, and part numbers 865438-B21, P03178-B21, and P44712-B21 are 96% efficient, thus meeting requirements.

HPE is on target to fulfill compliant systems ahead of time and will begin enforcing these requirements in advance to satisfy requests with the current power supplies by the set deadline. For more information regarding HPE Lot 9 conformance, please visit: https://www.hpe.com/us/en/about/environment/msds-specs-more.html

Operating Systems and Virtualization Software Support for HPE Servers

HPE servers are designed for seamless integration with partner Operating Systems and Virtualization Software. By collaborating closely with our partners, we ensure that their products are optimized, certified, and fully supported within your HPE server environment.

• For the latest information please access the certified and supported servers for each of the OS and Virtualization software to see latest completed certifications: HPE Servers Support & Certification Matrices
• Initial certification plans are RHEL 9.4, Ubuntu 24.04, and SLES15 SP5 QU1, and will be posted to above matrix upon completion and certification.

Embedded Management

HPE Integrated Lights-Out (HPE iLO)

Monitor your servers for ongoing management, service alerting, reporting and remote management with HPE iLO.

Learn more at http://www.hpe.com/info/ilo.

The most commonly used iLO features are enabled in HPE ARM servers, and we continue to enhance support for ARM. To see the latest, please visit the HPE Support Center iLO 6 User Guide for a list of unsupported features for the HPE ProLiant Compute DL384 Gen12 server at

https://support.hpe.com/hpesc/public/docDisplay?docId=sd00002007en_us&page=GUID-ED2BEBFE-3298-4D0C-8D10-B091B5084AC3.html

UEFI

Configure and boot your servers securely with industry standard Unified Extensible Firmware Interface (UEFI).

iLO RESTful API

iLO RESTful API is Redfish API conformance and offer simplified server management automation such as configuration and maintenance tasks based on modern industry standards. Learn more at http://www.hpe.com/info/restfulapi.

HPE Server UEFI

Unified Extensible Firmware Interface (UEFI) is an industry standard that provides better manageability and more secured configuration than the legacy ROM while interacting with your server at boot time. HPE ProLiant Gen11 servers have a UEFI Class 3 implementation.

UEFI enables numerous new capabilities specific to HPE ProLiant servers such as:

• Secure Boot and Secure Start enable for enhanced security
• Support for > 2.2 TB (using GPT) boot drives
• Embedded UEFI Shell
• Redfish assistance for configuring BIOS settings
• PXE boot support for IPv6 networks
• UEFI Boot Mode only
• NVMe Boot Support
• iSCSI Software Initiator Support.
• HTTP/HTTPs Boot support as a PXE alternative.
• Boot support for option cards that only support a UEFI option ROM

Notes: No support for Legacy mode

Server Utilities

Active Health System

The HPE Active Health System (AHS) is an essential component of the iLO management portfolio that provides continuous, proactive health monitoring of HPE servers. Learn more at http://www.hpe.com/servers/ahs.

RESTful Interface Tool

RESTful Interface tool (iLOREST) is a single scripting tool to provision using iLO RESTful API to discover and deploy servers at scale. Learn more at http://www.hpe.com/info/resttool.

Scripting Tools

Provision one to many servers using your own scripts to discover and deploy with Scripting Tool (STK) for Windows and Linux or Scripting Tools for Windows PowerShell. Learn more at http://www.hpe.com/servers/powershell.

Warranty

This product is covered by a global limited warranty and supported by HPE Services and a worldwide network of HPE Authorized Channel Partners resellers. Hardware diagnostic support and repair is available for three years from date of purchase. Support for software and initial setup is available for 90 days from date of purchase. Enhancements to warranty services are available through HPE Services operational services or customized service agreements. Hard drives have either a one year or three year warranty; refer to the specific hard drive QuickSpecs for details.

Notes: Server Warranty includes 3-Year Parts, 3-Year Labor, 3-Year Onsite support with next business day response. Warranty repairs may be accomplished through the use of Customer Self Repair (CSR) parts. These parts fall into two categories: 1) Mandatory CSR parts are designed for easy replacement. A travel and labor charge will result when customers decline to replace a Mandatory CSR part; 2) Optional CSR parts are also designed for easy replacement but may involve added complexity. Customers may choose to have Hewlett Packard Enterprise replace Optional CSR parts at no charge. Additional information regarding worldwide limited warranty and technical support is available at:

https://www.hpe.com/support/ProLiantServers-Warranties

Server Management

HPE iLO Advanced

HPE iLO Advanced licenses offer smart remote functionality without compromise, for all HPE ProLiant servers. The license includes the full integrated remote console, virtual keyboard, video, and mouse (KVM), multi-user collaboration, console record and replay, and GUI-based and scripted virtual media and virtual folders. You can also activate the enhanced security and power management functionality.

Rack and Power Infrastructure

The story may end with servers, but it starts with the foundation that makes compute go – and business grow. We’ve reinvented our entire portfolio of rack and power products to make IT infrastructure more secure, more practical, and more efficient. In other words, we’ve created a stronger, smarter, and simpler infrastructure to help you get the most out of your IT equipment. As an industry leader, Hewlett Packard Enterprise is uniquely positioned to address the key concerns of power, cooling, cable management and system access.

HPE G2 Advanced and Enterprise Racks are perfect for the server room or today’s modern data center with enhanced airflow and thermal management, flexible cable management, and a 10 year Warranty to support higher density computing.

HPE G2 PDUs offer reliable power in flexible form factors that operate at temperatures up to 60°C, include color-coded outlets and load segments and a low-profile design for optimal access to the rack and support for dense rack environments.

HPE Uninterruptible Power Systems are cost-effective power protection for any type workload. Some UPSs include options for remote management and extended runtime modules so your critical dense data center is covered in power outages.

HPE KVM Solutions include a console and switches designed to work with your server and IT equipment reliably. We’ve got a cost-effective KVM switch for your first rack and multiple connection IP switches with remote management and security capabilities to keep your data center rack up and running.

For the most up-to-date information on HPE Services, please refer to the HPE Services – Supplemental QuickSpecs, which provides a comprehensive and regularly updated overview of available services.

Mainstream SKUs

This section lists some of the steps required to configure a Factory Integrated Model. To ensure only valid configurations are ordered, Hewlett Packard Enterprise recommends the use of an HPE approved configurator. Contact your local sales representative for information on configurable product offerings and requirements.

• − Factory Integrated Models must start with a CTO Server.
• − FIO indicates that this option is only available as a factory installable option.
• − All Factory Integrated Models will be populated with sufficient hard drive blanks based on the number of initial hard drives ordered with the server.
• − Some options may not be integrated at the factory. Contact your local sales representative for additional information.

Step 1: Base Configuration (choose single or dual GH200 configuration)

The block diagram below shows a GH200 NVL2 configuration with dual superchips. For a single superchip configuration only the left side superchip would be populated.

Per superchip, the DL384 is highly symmetric. Each superchip will support 2 EDSFF NVME drives and a full height half length PCIe (FHHL) card standard. Then we have a factory configurable option to choose either another FHHL PCIe card, an OCP, or 2 more drives per superchip.

To simplify your experience, configuration of the server has been streamlined significantly. In brief we have set up only three core hardware kits- the server itself, a kit with a single GH200 superchip, and a kit with two GH200 superchips. The superchip kits include the enablement items needed to build any supported configuration of the server. Then we have a small number of configuration settings to choose that set whether you configure with the spare PCIe, OCP, or added drives. This is summarized in tables below:

Notes: To maintain quality and reliability of the expensive GH200, this system is sold only as a completely assembled system. The configurations below are not able to be updated or modified in the field. Options can be changed, but the fundamental configurations are set as in the next table.

1a: Single NVIDIA GH200 per server configuration (one superchip.)

Choose your desired PCIe, OCP, and drive configuration from table below, use listed SKUs to configure

Notes:

AOC are Active Optical Cables. DAC are Direct Attach (copper) Cables

1. CX-7 Class adapters

   • − 400Gb 1P MCX75310AAS-NEAT
   • − 200Gb 1P MCX75310AAS-HEAT
   • − 200Gb 2P MCX755106AC-HEAT
2. H1: Environment specifications for high-density air-cooling, 18C to 22C, Dry-Bulb Temp.
3. There are no field upgrade kits for the HPE ProLiant Compute DL384 Gen12. HPE does not support changes outside the quality controlled factory environment to the number of superchip, drives, PCIe, or OCP slots.
4. While NVIDIA has bundled NVIDIA AI Enterprise licenses with select PCIe GPU, NVIDIA AI Enterprise is not included in purchase of the GH200, but is a supported option which can be purchased through HPE. To know more about the NVIDIA SW products that HPE offers, please refer to the QS: NVIDIA Software Products at HPE. Refer to more on NVIDIA software from HPE at https://www.hpe.com/psnow/doc/a00059765enw

1b: NVIDIA GH200 NVL2 server configuration (dual superchip.)

Choose your desired PCIe, OCP, and drive configuration from table below, use listed SKUs to configure.

Notes:

AOC are Active Optical Cables. DAC are Direct Attach (copper) Cables

1. CX-7 Class adapters

   • − 400Gb 1P MCX75310AAS-NEAT
   • − 200Gb 1P MCX75310AAS-HEAT
   • − 200Gb 2P MCX755106AC-HEAT
2. H1: Environment specifications for high-density air-cooling, 18C to 22C, Dry-Bulb Temp.
3. There are no field upgrade kits for the HPE ProLiant Compute DL384 Gen12. HPE does not support changes outside the quality controlled factory environment to the number of superchip, drives, PCIe, or OCP slots.
4. While NVIDIA has bundled NVIDIA AI Enterprise licenses with select PCIe GPU, NVIDIA AI Enterprise is not included in purchase of the GH200, but is a supported option which can be purchased through HPE. To know more about the NVIDIA SW products that HPE offers, please refer to the QS: NVIDIA Software Products at HPE. Refer to more on NVIDIA software from HPE at https://www.hpe.com/psnow/doc/a00059765enw

HPE Networking

Step 2: Choose Power Supplies and jumper cords

HPE Power Supplies

HPE Flexible Slot (Flex Slot) Power Supplies share a common electrical and physical design that allows for hot plug, tool-less installation into HPE ProLiant Gen10 Plus Performance Servers. Flex Slot power supplies are certified for high-efficiency operation and offer multiple power output options, allowing users to "right-size" a power supply for specific server configurations. This flexibility helps to reduce power waste, lower overall energy costs, and avoid "trapped" power capacity in the data center.

Select power supplies from below.

For a single superchip configuration two HPE 1800 W-2200 W Flex Slot Titanium Hot Plug Power Supply Kit are sufficient, three provides 2+1 redundancy and four provides 2+2 redundancy.

For a dual superchip configuration four HPE 1800 W-2200 W Flex Slot Titanium Hot Plug Power Supply Kit are the required configuration, and provides 3+1 redundancy.

Step 3: Choose additional options for Factory Integration from Core and Additional Options sections below

Some options may not be integrated at the factory. To ensure only valid configurations are ordered, Hewlett Packard Enterprise recommends the use of an HPE approved configurator. Contact your local sales representative for additional information.

Internal Storage Devices

The HPE ProLiant Compute DL384 Gen12 server supports up to two M.2 devices. In this product generation hardware RAID controllers are not supported. As these are PCIe Gen3, HPE recommends use of M.2 for boot drives and not for local cache.

The HPE ProLiant Compute DL384 Gen12 server supports up to 8 EDSFF NVMe Gen5 E3S drives in a NVIDIA GH200 NVL2 configuration with dual superchips. In this NVIDIA Grace product generation neither hardware RAID controllers nor hot pluggable drives are supported.

In a single superchip configuration all drives below will be configured to the boot superchip. While drives may be upgraded in the field, with this novel Grace Hopper technology, the initial choice of server configuration for the maximum number of drives, PCIe and OCP as set in factory is not field upgradeable.

For dual superchip configurations, HPE supports placing all your drives on the boot superchip in our unbalanced storage configuration (max 4 drives,) or with an even number of drives you can elect to distribute your cache drives equally on the superchips in a balanced configuration.

HPE Racks

• Refer to the HPE Advanced Series Racks QuickSpecs for information on additional racks options and rack specifications. HPE G2 Advanced Series Racks
• Refer to the HPE Enterprise Series Racks QuickSpecs for information on additional racks options and rack specifications. HPE G2 Enterprise Series Racks
• For more detail on HPE’s complete portfolio of Rack and Power Infrastructure products please visit

http://www.hpe.com/info/rackandpower

HPE Power Distribution Units (PDUs)

• Refer to the HPE Basic Power Distribution Units (PDU) QuickSpecs for information on these products and their specifications.
• Refer to the HPE Metered Power Distribution Units (PDU) QuickSpecs for information on these products and their specifications.
• Refer to the HPE Intelligent Power Distribution Unit (PDU) QuickSpecs for information on these products and their specifications.
• Refer to the HPE Metered and Switched Power Distribution Units (PDU) QuickSpecs for information on these products and their specifications.

HPE Uninterruptible Power Systems (UPS)

• To learn more, please visit the HPE Uninterruptible Power Systems (UPS) web page.
• Refer to the HPE DirectFlow Three Phase Uninterruptible Power System QuickSpecs for information on these products and their specifications.
• Refer to the HPE Line Interactive Single Phase UPS QuickSpecsfor information on these products and their specifications.

HPE Rack Options

• Refer to the HPE KVM Switches web page for information on these products and their specifications.

Rail Kits

Easy Install rail kits contain telescoping rails which allow for in-rack serviceability. Each HPE ProLiant Compute DL384 Gen12 server is shipped with a rail kit as a standard component.

To assist in the installation of the server into the rack an optional installation tool is available by contacting your local services representative (695539-001).

Notes:

− The HPE ProLiant Compute DL384 Gen12 server ships with a rail kit included.

− Hewlett Packard Enterprise recommends that a minimum of two people are required for all Rack Server installations. Please refer to your installation instructions for proper tools and number of people to use for any installation.

− HPE rail kits are designed to work with HPE racks in compliance with industry standard EIA-310-E. In the event a customer elects to purchase a third-party rack for use with an HPE rail kit, any such use is at customer’s own risk. HPE makes no express or implied warranties with respect to such third-party racks and specifically disclaims any implied warranties of merchantability and fitness for a particular purpose. Furthermore, HPE has no obligation and assumes no liability for the materials, design, specifications, installation, safety, and compatibility of any such third-party racks with any rail kits, including HPE rail kits.

Recommended HPE Support Services, link to full list below:

Have feedback on QuickSpecs? We’re listening