HPC and AI require high-performance storage

High-performance computing (HPC) and artificial intelligence (AI) workloads are dramatically different than enterprise compute workloads. Instead of small file sizes and enterprise applications, HPC and AI workloads are usually batch jobs with large data sets on large distributed compute clusters. Parallel distributed file systems are typically required to provide high-speed, concurrent access to data. 

+ show more

Key differences among HPC, AI and enterprise storage

Enterprise storage

HPC storage

AI storage

Typical workload

Transactional

Job (Data Set)

Job (Data set)

Performance requirement

IOPS

Bandwidth

Bandwidth

Typical file size

Small

Large

Mixed

Typical file access

Random

Sequential

Mixed

Data movement

Minimal

Extensive

Moderate

Read/write intensity

Mixed

Write-intensive

Read-intensive

Meet the varied storage requirements for HPC and AI

Storage supports compute by providing the data needed for applications and users. HPE provides storage solutions that meet IO requirements, manage data, minimise TCO and streamline data workflows.

WekalO Matrix
Leverage a high-performance storage solution optimised for flash technology and designed to provide the storage throughput needed for large data sets and next-generation workloads. WekaIO Matrix provides a high-performance, scalable parallel file system offering high IOPS and low-latency throughput ideal for HPC and AI workloads.
HPE Data Management Framework
Optimise storage resources by enabling a hierarchical, tiered storage management architecture. The HPE Data Management Framework optimises storage resource utilisation for lower TCO and streamlines data workflows with time proven automated data movement.
Scalable Storage for Lustre
The Scalable Storage for Lustre solution offers a custom, modular Lustre configuration that can be tailored to your workload specifications. Opt to have Lustre preinstalled in the factory for a turnkey custom Lustre solution.

Services to take your storage further

HPE services utilise the most innovative technologies to change the way you think about storage. From data migration to artificial intelligence and blockchain services, HPE services streamline your storage methods for optimal efficiency.