Ubuntu: Install GemFire XD from a Debian Package

If your operating system is Ubuntu, you can install GemFire XD from a Debian package.

Prerequisites

Procedure

  1. From the Pivotal GemFire XD download page, download the Debian package pivotal-gemfirexd_1.4.0-50226_all.deb.
  2. From the Ubuntu computer on which you will install GemFire XD, log in as the root user (or as an unprivileged user who has sudo privileges) and start a terminal.
    Note: If you are not logged in as the root user, you must use the sudo command to run the commands in the following steps.
  3. In the terminal window, change directories to the directory where you downloaded the Debian package.
  4. Execute the following command:
    $ dpkg -i pivotal-gemfirexd_1.4.0-50226_all.deb
    If necessary, use sudo to run the preceding command if you are not logged in as the root user:
    $ sudo dpkg -i pivotal-gemfirexd_1.4.0-50226_all.deb

    The dpkg command begins the install process, resolves dependencies, and displays the packages it will install. The GemFire XD software is installed into the /opt/pivotal/gemfirexd/Pivotal_GemFireXD_140 directory.

    If necessary, the install process creates a gemfirexd non-interactive user in the pivotal group. This user owns the installed GemFire XD directories and files, including any disk store files that you create later.
    Note: You cannot log in directly as the gemfirexd user because interactive login has been disabled. Rather, you must first log in as the root user or as a user with sudo privileges. You can then execute commands as the gemfirexd user by using sudo -u gemfirexd command_name.
  5. If you have not already done so, download and install a compatible JDK or JRE on the computer or VM.
  6. GemFire XD requires libraries from Pivotal HD Enterprise in order to create HDFS tables or use the MapReduce API. If you installed GemFire XD on the same machine as Pivotal HD, then GemFire XD will automatically locate the required libraries in the default locations:
    • /usr/lib/gphd/hadoop
    • /usr/lib/gphd/hadoop-mapreduce
    • /usr/lib/gphd/hadoop-hdfs/
    If you installed GemFire XD on a machine that does not have a Pivotal HD installation, then you can use the /opt/pivotal/gemfirexd/Pivotal_GemFireXD_140/bin/create_hdfsclient_dist.sh script to create a ZIP file of the necessary libraries, which you can then add to the local GemFire XD installation. Follow these steps to use the script:
    1. Copy the /opt/pivotal/gemfirexd/Pivotal_GemFireXD_140/bin/create_hdfsclient_dist.sh script to a machine that has a Pivotal HD installation.
    2. Execute the create_hdfsclient_dist.sh on the Pivotal HD machine:
      $ ./create_hdfsclient_dist.sh

      The script packages the necessary library files into a ZIP file named gfxd_hdfsclient_dist.zip in the directory where you executed the script.

    3. Copy the gfxd_hdfsclient_dist.zip back to the machine where you installed GemFire XD.
    4. Unzip the gfxd_hdfsclient_dist.zip file's contents into the /opt/pivotal/gemfirexd/Pivotal_GemFireXD_140/ext-lib directory. GemFire XD will now automatically load the necessary Pivotal HD libraries when you start the local member.
  7. Verify the local installation by executing the gfxd version command. You should receive output showing that GemFire XD is installed, similar to:
    $ gfxd version
    GemFireXD product directory: /opt/pivotal/gemfirexd/Pivotal_GemFireXD_140
    Java version:   1.4.0 build 50226 12/09/2014 14:26:16 PST javac 1.7.0_72
    Native version: 1.0 build 45646 01/23/2014 15:00:30 PST optimized i386 Linux 2.6.32-220.23.1.el6.x86_64
    Running on: hostname/ip-address, 1 cpu(s), amd64 Linux 3.13.0-24-generic

Post-Install Configuration for Debian Package Installations

Although the GemFire XD software is installed on each machine, you must perform additional steps to configure and run GemFire XD member(s) on the machine:

  1. Follow the instructions in Steps to Plan and Configure a GemFire XD Deployment to configure one or more GemFire XD members on each machine, and to start those members in a new distributed system.
  2. If you configured Kerberos for security with Pivotal HD, follow the instructions in Configuration Requirements for Secure HDFS to ensure that your GemFire XD members can authenticate with Pivotal HD and persist table data in HDFS.
  3. If you intend to use HAWQ to to access data from HDFS-persistent GemFire XD tables, follow the instructions in Using HAWQ to Access HDFS Table Data to ensure that the Pivotal Extension Framework (PXF) includes the gemfirexd.jar library in its list of dependencies.

Uninstalling GemFire XD

To uninstall the Pivotal GemFire XD Debian package, enter the command:
sudo dpkg -r pivotal-gemfirexd

This removes the product installation directory and services, but does not remove any separate GemFire XD member directories or persistence files that you have created.