Installing Object Store with S3-Compatible API

The Object Store with S3-Compatible API (Object Store) is an object storage server that can be used with the Amazon S3 cloud storage service.

The Object Store is included in MEP repositories beginning with MEP 6.0.0. This topic provides instructions for manually installing the Object Store version 2.0.0 on an Edge node or on a server node (for example, a data-fabric cluster node) that is running core software.

Parent topic: Step 10: Install Ecosystem Components Manually

Requirements

Before installation, review these requirements for the Object Store with S3-Compatible API:
Requirement Description
Cluster packages The Object Store with S3-Compatible API requires a working data-fabric cluster. Connecting to the cluster requires either mapr-core or mapr-client, depending on the node type:
  • A server node must have mapr-core installed.
  • An edge node must have mapr-client installed.
syslinux- utils package (Ubuntu only) For Ubuntu only, you must install the syslinux-utils package: 
sudo apt install syslinux-utils
libcap- progs package (Zypper only) For Zypper only, you must install the libcap-progs package:
sudo zypper install libcap-progs
POSIX client A POSIX client must be installed and configured on each node where the Object Store with S3-Compatible API will be used. See Installing and Configuring a POSIX client for the Object Store with S3-Compatible API.
Object Store packages Two packages are available for download:
  • mapr-objectstore-client - the binary package
  • mapr-objectstore-gateway - the role package that includes the Warden configuration information
For edge nodes, you install the mapr-objectstore-client package only. For server nodes, you install the mapr-objectstore-gateway and mapr-objectstore-client packages.

Installing and Configuring a POSIX client for the Object Store with S3-Compatible API

To install and configure the POSIX client on a node:
  1. Install the POSIX client:
    • Red Hat / CentOS:
      sudo yum install mapr-posix-client-basic
    • Ubuntu:
      sudo apt install mapr-posix-client-basic
    • SUSE:
      sudo zypper install mapr-posix-client-basic
  2. In the /opt/mapr/conf/fuse.conf file, set the mount directory and the path to the user ticket:
    1. Use the fuse.mount.point parameter to set the mount directory. The default setting is /mapr.
    2. Use the fuse.ticketfile.location parameter to set the path to the user ticket.
  3. Create a mount directory and set permissions as follows: 
    mkdir -m 777 /mapr
  4. Start the POSIX service:
    sudo systemctl start
mapr-posix-client-basic.service
  5. Verify that the data-fabric cluster is mounted to the /mapr directory:
    ls -la /mapr
    For example:
    ls -la /mapr/
total 1
drwxr-xr-x 7 mapr mapr 6 Feb 16 18:06 example.mapr.cluster

You should see a directory with the data-fabric cluster name and cluster data inside. By default, the directory is my.cluster.com unless you define a different name for the cluster.

Installation

You can install the Object Store version 2.0.0 on an edge node or server node that runs data-fabric software. To install the Object Store manually, use the following steps. To install the Object Store using the Installer, see Installing the Object Store Using the Installer.

Edge Node Installation (Manual Steps)

Use the following steps to install the Object Store with S3-Compatible API on an edge node:
  1. Install the mapr-objectstore-client package:
    • Red Hat / CentOS:
      sudo yum install mapr-objectstore-client
    • Ubuntu:
      sudo apt install mapr-objectstore-client
    • SUSE:
      sudo zypper install mapr-objectstore-client
  2. Run the objectstore configure.sh script, as shown, to configure the Object Store:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/configure.sh -c -u <userName> -g <groupName> --path /path/to/filesystem/
    In this command:
    -c is the client node of the mapr-objectstore-client
    -u (--user) is the user admin for working with the mapr-objectstore-client
    -g (--group) is the group
    -p (--path) is the path for mounting the filesystem
    For example:
    sudo /opt/mapr/objectstore-client/objectstore-client-2.0.0/bin/configure.sh -c -u mapr -g mapr --path /mapr/my.cluster.com/objectstore
  3. Run the objectstore.sh script to start the Object Store:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh start
  4. Verify that the Object Store process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status
    When the process is running, the system prints the following message:
    Minio is running
  5. Configure the Object Store. For details, see Configuring Object Store with S3-Compatible API.

Server Node Installation (Manual Steps)

Use the following steps to install the Object Store with S3-Compatible API on a server node:
  1. Install the mapr-objectstore-gateway and mapr-objectstore-client packages:
    • Red Hat / CentOS:
      sudo yum install mapr-objectstore-client mapr-objectstore-gateway
    • Ubuntu:
      sudo apt install mapr-objectstore-client mapr-objectstore-gateway
    • SUSE:
      sudo zypper install mapr-objectstore-client mapr-objectstore-gateway
  2. Set the accessKey and secretKey in /opt/mapr/objectstore-client/objectstore-client-<version>/conf/minio.json.
  3. To configure Warden, use configure.sh on the first run:
    sudo /opt/mapr/server/configure.sh -R
  4. Verify that the Object Store process is running:
    sudo /opt/mapr/objectstore-client/objectstore-client-<version>/bin/objectstore.sh status
    When the process is running, the system prints the following message:
    Minio is running
  5. Configure the Object Store. For details, see Configuring Object Store with S3-Compatible API.

For More Information

To use the Object Store, see these topics:

For more information about S3 commands, see the Amazon S3 Documentation.