DMF7 provides a centralized database for storing metadata about files as they were stored in the managed filesystem. The scalable database within DMF7 supports extensible metadata that allows users and/or applications to better manage their data from cradle to grave. Users can uniquely tag their data files and directories with extended attributes, storing everything in DMF7, and then easily query DMF7 to manage and/or recall their data sets. DMF7 is designed to offload metadata intensive activities from production filesystems to maintain their performance for HPC applications.

DMF7 integrates with popular parallel filesystems commonly used in HPC and AI environments. It is a tool that helps administrators implement site policies consistently across one or many filesystems. It can act upon a system event, like a filesystem dropping below a threshold for free space. It can operate on a schedule, like taking a snapshot of the namespace reflection at prescribed intervals. It can automate site policies, like staging datasets or migrating files that have been untouched for 30 days. Taken together, the tools for managing filesystems in DMF7 help customers lower the total cost of ownership (TCO) for high performance storage systems, increase administrator productivity, and lower the cost of storing data.

DMF7 protects data at scale. It is a backup & recovery service for large parallel filesystems that uses an incremental forever approach to preserve versions of files, directories, and even entire filesystems. In the event of accidental data deletion, filesystem corruption, or complete unavailability it helps administrators implement and manage Recovery Point Objectives (RPO).

DMF7 helps users manage their data. Users can instruct DMF7 to move their files from filesystems and data lakes, into the data management system. This allows users to put their files into a centralized storage system and then later recall their data to a different computing system.

DMF7 automates the management of filesystem utilization. HPC system administrators are constantly challenged to optimize the performance of parallel filesystems. DMF7 automates management of the thresholds for both the storage capacity and the filesystem metadata. When the filesystem utilization reaches a preset threshold, DMF7 migrates files to a lower cost storage tier and frees up capacity and catalog space for new files.

DMF7 is a high-performance system for data mobility. It enables high speed parallel data transfers between storage resources. Data movement can be performed between parallel filesystems and DMF back end pools, between different DMF back end pools, or between different parallel filesystems.

Because data is the lifeblood of many HPC and AI workflows, DMF7 is a data management system designed for high availability and resiliency. DMF7 uses distributed databases and containerized frameworks to ensure uninterrupted operation through hardware component failures. Data Movers work in parallel to provide scalable and redundant data paths to the storage devices in the repository. Further, DMF7 is designed for multi-site operation, a common requirement for production HPC sites. In the event of a loss of the primary facility, DMF7 at the standby facility can recover individual files or sets of files into a locally managed filesystem helping administrators meet recovery time objectives (RTO) for their critical HPC/AI applications.

DMF7 is the industry-leading data management system for HPC/AI workflows that scales with Apollo and ProLiant servers.

Namespace Reflection

A standard feature in DMF7 captures changes in filesystem namespaces and metadata.

• – Integrates with Lustre, HPE XFS and IBM Spectrum Scale (GPFS)
• – Low overhead reflection using changelogs without needing complete filesystem scans

Distributed Scalable Metadata Database

The DMF7 database can be scaled out to accommodate the rate of change within the managed filesystems, the growth of the DMF7 storage repositories, or an increase in the number of managed filesystems.

• – Allows users to use DMF7 for storage of their files, to query DMF7 for the files they need, and recovery to any managed filesystem
• – Database searches are parallel for high performance
• – Offloads metadata searches from the managed filesystem

Flexible Policy Engine

DMF7 includes a powerful and flexible policy engine to manage data storage and automate workflows driven by filesystem and user defined metadata.

• – Enables set-it-and-forget-it policies for migration of files to less costly storage medium
• – Automates management of free space thresholds for high performance filesystems
• – Sets customized retention periods for number of copies and versions

High Performance Parallel Data Movement

The DMF7 data movers can be scaled out to meet the data access requirements of users and applications.

• – N+N Active/Active data movement delivers high performance and resiliency
• – Supports Tape, Zero Watt Storage, and Object Storage targets

Zero Watt Storage

A standard feature in DMF7 software that is paired with the HPE high density storage enclosures to provide a high-performance power managed disk tier.

• – Eliminates long latency inherent to tape
• – Used for fast backup to disk, fast recovery from disk, or tape caching
• – Power managed disk control enables spin down HDDs reducing power consumption and cooling costs
• – Sector parity protection provides fast recovery from minor on disk bit errors improving the MTBF of high-capacity disk drives
• – Periodic disk scrubbing provides an efficient and effective option for data integrity verification

Cloud Service Provider Namespace

A standard feature in DMF7 software for customers who wish to reduce utilization of an object store by moving infrequently accessed objects to a lower cost tier of storage e.g. tape. The feature connects DMF to a front end object storage namespace and uses the S3 API for transfer of objects between the namespace and DMF. Data Management SW in the object store manages workflows like backup, HSM, archive and/or recovery. DMF performs the storage management functions, like managing policies for copies, target storage pools and performance optimizations.

• – Reduces the cost of storing data by moving objects from flash/disk based object stores to disk/tape based long term storage.
• – An object-based workflow using the S3 API
• – Currently supported with Scality ARTESCA.

Tier Zero Storage

A standard feature in DMF7 software that enables HPC and AI workflow acceleration via dynamic flash storage pools.

• – Used for dynamic provisioning of flash storage for machine learning applications
• – Dynamically creates a managed namespace on demand and allows users to recall files into a high-performance flash tier
• – The user or an automated policy can migrate new or modified files back to DMF7 before the storage resources are returned to the unallocated flash pool

Supported Servers

• – HPE ProLiant DL360 Server
• – HPE ProLiant DL380 Server
• – HPE ProLiant DL325 Server
• – HPE ProLiant DL385 Server

https://www.HPE.com/us/en/servers/proliant-dl-servers.html

HPE Services

No matter where you are in your digital transformation journey, you can count on HPE Services to deliver the expertise you need when, where and how you need it. From planning to deployment, ongoing operations and beyond, our experts can help you realize your digital ambitions.

https://www.HPE.com/services

Consulting Services

No matter where you are in your journey to hybrid cloud, experts can help you map out your next steps. From determining what workloads should live where, to handling governance and compliance, to managing costs, our experts can help you optimize your operations.

https://www.HPE.com/services/consulting

HPE Managed Services

HPE runs your IT operations, providing services that monitor, operate, and optimize your infrastructure and applications, delivered consistently and globally to give you unified control and let you focus on innovation.

HPE Managed Services | HPE

Operational services

Optimize your entire IT environment and drive innovation. Manage day-to-day IT operational tasks while freeing up valuable time and resources. Meet service-level targets and business objectives with features designed to drive better business outcomes.

https://www.HPE.com/services/operational

HPE Complete Care Service

HPE Complete Care Service is a modular, edge-to-cloud IT environment service designed to help optimize your entire IT environment and achieve agreed upon IT outcomes and business goals through a personalized experience. All delivered by an assigned team of HPE Services experts. HPE Complete Care Service provides:

• – A complete coverage approach -- edge to cloud
• – An assigned HPE team
• – Modular and fully personalized engagement
• – Enhanced Incident Management experience with priority access
• – Digitally enabled and AI driven customer experience

https://www.HPE.com/services/completecare

HPE Tech Care Service

HPE Tech Care Service is the operational support service experience for HPE products. The service goes beyond traditional support by providing access to product specific experts, an AI driven digital experience, and general technical guidance to not only reduce risk but constantly search for ways to do things better. HPE Tech Care Service delivers a customer-centric, AI driven, and digitally enabled customer experience to move your business forward. HPE Tech Care Service is available in three response levels. Basic, which provides 9x5 business hour availability and a 2-hour response time. Essential which provides a 15-minute response time 24x7 for most enterprise level customers, and Critical which includes a 6-hour repair commitment where available and outage management response for severity 1 incidents.

https://www.HPE.com/services/techcare

Shape the Future of QuickSpecs - Your Input Matters