MapR: Manage MapR Cluster

Document created by RSA Information Design and Development on Sep 14, 2017Last modified by RSA Information Design and Development on Oct 15, 2017
Version 5Show Document
  • View in full screen mode
  

You can manage the MapR cluster using the following procedures:

Access MapR Control System UI for Cluster Administration

You can access the MapR Control System user interface for RSA NetWitnessWarehouse cluster administration. MapR Control System user interface enables you to administer the RSA NetWitnessWarehouse cluster. The MapR Control System user interface provides details of the following:

  • Nodes
  • Node Heatmap
  • Jobs
  • MapR Tables
  • Volumes
  • Mirrors
  • User Disk Usage
  • Snapshots
  • Schedules
  • NFS Setup
  • Virtual IP Assignments
  • NFS Nodes
  • Node Alarms
  • Volume Alarms
  • User/Group Alarms
  • HBase
  • JobTracker
  • CLDB

To access the MapR Control System user interface:

  1. Log on to one of the appliances in the RSA NetWitnessWarehouse cluster.
  2. Start the webserver. Enter the following command:

    /opt/mapr/adminuiapp/webserver start

    Note: The default port used by the webserver is 8443.

    Note: If you receive the error /opt/mapr/conf/ssl_keystore (No such file or directory) in the /opt/mapr/logs/adminuiapp.log after executing the command /opt/mapr/adminuiapp/webserver start, enter the following commands:
    ./configure.sh -R –genkeys
    service mapr-warden restart

  3. Using a web browser to access the MapR Control System, type the following url:

    https://<NODE-IP-OR-HOSTNAME>:8443

    The MapR Control System user interface is displayed.
    MapR control System User Interface

Enable MapR Metrics on RSA NetWitnessWarehouse Cluster

You can enable MapR Metrics on the RSA NetWitnessWarehouse cluster. This optional procedure enables Administrators to see job details in the MapR Control System UI rather than going to the JobTracker for details.

Prerequisites

Make sure that you have the following MapR Metrics dependencies installed in your environment:

  • MySQL Server installed and configured.
  • Libraries hosted on the EPEL Repository. 
  • Libraries hosted on the CentOS base repositories.

To Enable MapR Metrics

To enable MapR Metrics on the RSA NetWitnessWarehouse cluster, follow the instructions at the following links:

Note: Make sure you install MapR Mertics on the nodes in your RSA NetWitnessWarehouse Cluster where Job Tracker or Web Server is running.

Edit and Remove Virtual IP Addresses (Command Line)

You can edit and remove virtual IP addresses in the Warehouse cluster using the command line. This procedure is optional and used when you want to change the virtual IP addresses in the Warehouse cluster.

Adding and removing Warehouse appliances to and from a virtual IP group is accomplished by executing an edit command. This is the same as the add command, except that ALL of the MAC addresses are replaced with ONLY the MAC addresses that you enter.

Prerequisites

Make sure you note down the MAC addresses of all the Warehouse appliances in the cluster. Use the following command on the appliance to view the MAC address of the appliance:

ifconfig <interface> | grep HWaddr

where <interface> is the network interface.

Also note the MAC addresses of the Warehouse appliances that you want to add.

To add or remove a virtual IP address in the primary Warehouse appliance:

  1. Log on to the primary appliance as root user.
  2. Edit the virtual IP address. Enter the following command:

    maprcli virtualip edit -virtualip <VIP_address> -netmask <netmask> -macs <mac_node1> <mac_node2> <mac_node3> ……< mac_node n>

    where:

    • <VIP_address> is the virtual IP address for the primary Warehouse appliance.
    • <netmask> is the netmask address of the primary Warehouse appliance.
    • <mac_node1> is the MAC address of the first node in the Warehouse cluster.
    • <mac_node2> is the MAC address of the second node in the Warehouse cluster.

    For example, if the IP address of the primary warehouse is 192.168.100.10 and the MAC address for node 1 is 01:Z1:1X:00:20:Y1, node 2 is 32:Y2:4Z:40:10:X3, and you want to add node 3, which is 20:Y2:4Z:20:10:X3, then enter the following:

    maprcli virtualip edit -virtualip 192.168.100.10 -netmask <netmask> -macs 01:Z1:1X:00:20:Y1 32:Y2:4Z:40:10:X3 20:Y2:4Z:20:10:X3

  3. Verify the virtual IP addresses. Enter the following command:

    maprcli virtualip list

To remove the virtual IP address of the primary Warehouse appliance group entirely:
Enter the following command:

maprcli virtualip remove -virtualip 192.168.100.10

Add and Remove a Virtual IP Address (MapR UI)

You can add a virtual IP address in the Warehouse cluster using the MapR Control System.  This procedure is optional and used when you want to add a virtual IP address (VIP) in the Warehouse cluster.

Prerequisites

Follow the instructions in Access MapR Control System UI for Cluster Administration before completing this procedure. 

  1. Log on to the MapR Control System.
    Logon to MapR Control System
  2. In the Navigation panel, select NFS HA > NFS Setup.
    The NFS Setup tab is displayed. The NFS Setup tab enables you to edit, remove or add VIPs in the Warehouse cluster.
  3. On the NFS Setup tab, click the Add VIP button.
    Add VIP button

The Add Virtual IP dialog is displayed.
Add Virtual IP dialog is displayed

  1. In the Add Virtual IP dialog, do the following:
    1. In the Starting VIP field, type the starting IP Address for VIP.
    2. In the Ending VIP field, type the ending IP Address for VIP. If this field is left blank, only one IP address is used for VIP allocation.
    3. In the Netmask field, type the Netmask for the deployment.
    4. Select Select Desired Network Interfaces to choose the available Network Interfaces that need to be used for VIP assignment. Select all of the external Interfaces from the list of available nodes by clicking the plus button next to the interface entry. Selected Interfaces will appear in the bottom list. 
    5. Click OK to add the VIP. 
      The newly added VIP appears in the list on the NFS Setup tab.
      NFS setup tab

Note: VIP allocation can also be removed or edited from the NFS HA > NFS Setup tab by selecting a VIP and clicking the Edit or Remove button.

  1. In the Navigation panel, select NFS HA > VIP Assignment to view the node that is assigned to the newly added VIP.
    VIP assignment

Add a Virtual IP Address with Multiple Nodes (MapR UI)

You can add a virtual IP address (VIP) with multiple nodes. Virtual IP (VIP) is a technique used to load balance data access into HDFS by using a floating IP Address among the cluster nodes. This technique is mostly used by the MapR Hadoop Distribution along with the MapR-NFS Service. VIP can provide High Availability and Load Balancing by dynamically allocating the Floating IP among the nodes.

Optimal VIP Configuration

We recommend using one VIP for every three Nodes, because the replication factor for HDFS is 3 by default. This also helps in optimizing the performance of the cluster.

In the case of High Data Load ( >20K EPS ), a single NFS might overload while replicating the file into the cluster. If the NFS Server crashes before the data is replicated, you may lose data.

Multiple NFS Servers also allow more distributed data locality which helps in High Availability and Fault Tolerance.

Prerequisites

Calculate how many VIPs you can afford. 

  • We suggest One VIP per 3 Nodes
  • In case the number of nodes that you have is not a multiple of three, you can allocate multiple VIPs to more than three nodes. For example, two VIPs among five Nodes.

The steps to add the VIP are the same as adding any other VIP, but instead of choosing “all nodes” for VIP, you choose a subset of nodes to participate in the VIP.

Optimal Configuration with the Warehouse Connector

The recommended configuration is to have one VIP per Warehouse Connector. In cases where Warehouse Connector numbers are higher than VIPs, configure multiple Warehouse Connectors to write to a VIP in a way so that traffic on VIPs can be normalized.

Add a Virtual IP Address that has Multiple Nodes

  1. Log on to the MapR Control System.
  2. In the Navigation panel, select NFS-HA > VIP Assignments.
  3. On the NFS Setup tab, click the Add VIP button.

    Add VIP button

  4. In the Add Virtual IP dialog, do the following:

    1. Specify the Starting and Ending VIP as the same IP address.
      Specify the starting and ending VIP
    2. Select Select the Desired Network Interfaces to choose the available Network Interfaces that need to be used for the VIP assignment. Select the NIC Cards that you want to participate in the VIP.  A node can have multiple NICs, so depending on the Network Configuration you can select them.
    3. Click OK to add the VIP.

Example VIP Configurations

The following table shows example configurations of virtual IP addresses (VIPs) with different numbers of nodes in the cluster.

                                 
Number of Nodes in Cluster Number of VIPs
3 Nodes1 VIP
5 Nodes2 VIPs (3 Nodes each, 1 Common Node)
7 Nodes2 VIPs (3 Nodes each, 1 Free Node)
8 Nodes3 VIPs (3 Nodes each, 1 Common Node among 2 VIPs)
11 Nodes4 VIPs (3 Nodes each, 1 Common Node among 2 VIPs)
11 Nodes3 VIPs (3 Nodes each, 2 Free Nodes)
You are here
Table of Contents > Manage MapR

Attachments

    Outcomes