A highly scalable data management system for unstructured data in HPC and AI environments.

HPE Data Management Framework 7 (DMF7) helps organizations manage an ever-expanding universe of data across storage systems and data lakes. It tracks where data resides, helps users manage files, and helps administrators manage file systems.

With 30 years of real-world experience, DMF7 is a centralized system for storing files and copies of files. The DMF7 storage repository can be customized to store files to disk, tape, cloud, or in any combination. Administrators can choose the destinations, the number of copies, and the retention policies for each. DMF7 easily adapts to new storage technologies by automating file migration to the new storage systems and media from systems that have reached the end of their useful lives. DMF7 migrates data in the background, keeping this process completely transparent to the end users.

Namespace Reflection

A standard feature in DMF7 captures changes in filesystem namespaces and metadata.

• – Integrates with Lustre, HPE XFS and IBM Spectrum Scale (GPFS)
• – Low overhead reflection using changelogs without needing complete filesystem scans

Distributed Scalable Metadata Database

The DMF7 database can be scaled out to accommodate the rate of change within the managed filesystems, the growth of the DMF7 storage repositories, or an increase in the number of managed filesystems.

• – Allows users to use DMF7 for storage of their files, to query DMF7 for the files they need, and recovery to any managed filesystem
• – Database searches are parallel for high performance
• – Offloads metadata searches from the managed filesystem

Flexible Policy Engine

DMF7 includes a powerful and flexible policy engine to manage data storage and automate workflows driven by filesystem and user defined metadata.

• – Enables set-it-and-forget-it policies for migration of files to less costly storage medium
• – Automates management of free space thresholds for high performance filesystems
• – Sets customized retention periods for number of copies and versions

High-performance parallel data movement

The DMF7 data movers can be scaled out to meet the data access requirements of users and applications.

• – N+N Active/Active data movement delivers high performance and resiliency
• – Supports Tape, Zero Watt Storage, and Object Storage targets

Zero Watt Storage

A standard feature in DMF7 software that is paired with the HPE high density storage enclosures to provide a high-performance power managed disk tier.

• – Eliminates long latency inherent to tape
• – Used for fast backup to disk, fast recovery from disk, or tape caching
• – Power managed disk control enables spin down HDDs reducing power consumption and cooling costs
• – Sector parity protection provides fast recovery from minor on disk bit errors improving the MTBF of high-capacity disk drives
• – Periodic disk scrubbing provides an efficient and effective option for data integrity verification

Cloud Service Provider Namespace

A standard feature in DMF7 software for customers who wish to reduce utilization of an object store by moving infrequently accessed objects to a lower cost tier of storage e.g. tape. The feature connects DMF to a front end object storage namespace and uses the S3 API for transfer of objects between the namespace and DMF. Data Management SW in the object store manages workflows like backup, HSM, archive and/or recovery. DMF performs the storage management functions, like managing policies for copies, target storage pools and performance optimizations.

• – Reduces the cost of storing data by moving objects from flash/disk based object stores to disk/tape based long term storage.
• – An object-based workflow using the S3 API
• – Currently supported with Scality ARTESCA.

Tier Zero Storage

A standard feature in DMF7 software that enables HPC and AI workflow acceleration via dynamic flash storage pools.

• – Used for dynamic provisioning of flash storage for machine learning applications
• – Dynamically creates a managed namespace on demand and allows users to recall files into a high-performance flash tier
• – The user or an automated policy can migrate new or modified files back to DMF7 before the storage resources are returned to the unallocated flash pool

Supported Servers

• – HPE ProLiant DL360 Server
• – HPE ProLiant DL380 Server
• – HPE ProLiant DL325 Server
• – HPE ProLiant DL385 Server

https://www.HPE.com/us/en/servers/proliant-dl-servers.html

For the most up-to-date information on HPE Services, please refer to the HPE Services – Supplemental QuickSpecs, which provides a comprehensive and regularly updated overview of available services.

Subscription Upgrades

Incremental SKUs purchased as add-ons to an existing system with an active subscription are not co-terminus. The term of an active subscription cannot be extended with additional SKUs.

Test and Development Systems

All of the DMF Base system SKUs include the use of one production system and one non-production test system at the same location.

Configuration examples

Example: 3 Nodes and 5 PB of capacity for 3 years.

Example: 3 Nodes and 26 PB of capacity for 3 years.

Example: 3 Nodes and 120 PB of capacity for 5 years.

Example: 20 Nodes and 280 PB of capacity for 1 year.

5 DMF DB/Core, 4 DMF Mover, 3 HPE XFS metadata servers, and 8 Tier Zero R-pool nodes

Expansion of DMF6 systems

Use of DMF6 software was entitled through perpetual licenses, and all existing entitlements remain valid. However, all SKUs for DMF6 licensing have been retired and can no longer be purchased.

DMF6 users who wish to expand entitlement for their DMF6 systems can continue to do so by purchasing additional entitlement via the subscription licenses above. Customers may add incremental capacity, incremental DMF servers and/or incremental HPE XFS servers.

Subscription SKUs are purchased as add-ons to an existing DMF6 system and are separate from the active support contract for DMF6 perpetual licenses. They do not replace or invalidate the existing perpetual licenses, and the existing support contracts remain in effect. Subscription SKUs and active support contracts for perpetual licenses do not have coterminous end dates.

License keys generated by the subscription SKUs are not required for DMF6 software release 6.9 and later. However, customers running DMF6 release 6.8 or earlier must contact HPE Support for assistance in obtaining license keys.

Configuration examples

Example: Two (2) data mover nodes, one (1) ZWS4106 enclosure, and 106 drives using Peak Performance Cabling.

Notes: Ordering 10-pack and 24-pack drive bundles will reduce post-delivery packaging disposal compared to individual drives.

Example: Two (2) data mover nodes, eight (8) ZWS4106 enclosures, and 848 drives using Maximum Capacity Cabling.

Notes: Ordering 10-pack and 24-pack drive bundles will reduce post-delivery packaging disposal compared to individual drives.