SYSHDFSSTORES

Contains information about all HDFS stores created in the GemFire XD distributed system.

See CREATE HDFSSTORE.

Table 1. SYSHDFSSTORES system table
Column Name Type Length Nullable Contents
NAME VARCHAR 128 No The unique identifier of the HDFS store configuration.
NAMENODE VARCHAR 32672 No The URL of the Hadoop NameNode for your Pivotal HD cluster (for example, hdfs://server-name:8020).
HOMEDIR VARCHAR 32672 No The Hadoop directory in which you will persist GemFire XD tables. By default, GemFire XD stores all log files for the HDFS store in /user/user-name/store-name where user-name is the owner of the GemFire XD JVM and store-name is the name of the HDFS store.
MAXQUEUEMEMORY INTEGER 10 No The maximum amount of memory in megabytes that the queue can consume before overflowing to disk.
BATCHSIZE INTEGER 10 No The maximum size (in megabytes) of each batch that is written to the Hadoop directory.
BATCHTIMEINTERVALMILLIS INTEGER 10 No The maximum number of milliseconds that can elapse between writing batches to HDFS.
QUEUEPERSISTENT BOOLEAN 1 No Specifies whether GemFire XD persists the event queue that it uses to send table data to HDFS.
DISKSYNCHRONOUS BOOLEAN 1 No Specifies whether GemFire XD performs synchrous writes to HDFS.
DISKSTORENAME VARCHAR 32672 Yes The local GemFire XD disk store to use for storing the queue overflow, or for persisting the queue (for persistent HDFS stores).
MINORCOMPACT BOOLEAN 1 No Specifies whether automatic minor compaction is enabled for HDFS read/write log files. Minor compaction combines multiple files into one larger file by discarding older row values.
MAJORCOMPACT BOOLEAN 1 No Specifies whether automatic major compaction is enabled for HDFS read/write log files. Major compaction combines all of the row values for a given bucket into a single persistence file. After major compaction is performed only the latest row values are stored in the persistence files, and the file represents a snapshot of the bucket values.
MAXINPUTFILESIZE INTEGER 10 No The maximum size of a file (in megabytes) that GemFire XD will consider for minor compaction cycles. Files larger than this value are only affected during major compaction.
MININPUTFILECOUNT INTEGER 10 No The minimum number of input files that can be created before GemFire XD begins automatically compacting files. GemFire XD performs no minor compaction until this number of files have been created, after which files smaller than MAXINPUTFILESIZE may be compacted.
MAXINPUTFILECOUNT INTEGER 10 No The maximum number of input files that GemFire XD includes in a minor compaction cycle.
MINORCOMPACTIONTHREADS INTEGER 10 No The maximum number of threads that GemFire XD uses to perform minor compaction.
MAJORCOMPACTIONINTERVALMINS INTEGER 10 No The amount of time (in minutes) after which GemFire XD performs the next major compaction cycle.
MAJORCOMPACTIONTHREADS INTEGER 10 No The maximum number of threads that GemFire XD uses to perform major compaction.
CLIENTCONFIGFILE VARCHAR 32672 Yes The full path to the HDFS client configuration file that the store uses.
BLOCKCACHESIZE DOUBLE 52 No The size of the block cache as a percentage (a float in the range 0 to 100) of the available heap space.
MAXWRITEONLYFILESIZE INTEGER 10 No The maximum size (in megabytes) that an HDFS log file can reach before GemFire XD closes the file and begins writing to a new file. This setting applies only to HDFS write-only tables. Keep in mind that the operational logs files are not available for MapReduce processing until the file is closed.
WRITEONLYFILEROLLOVERINTERVALSECS INTEGER 10 No The maximum time (in seconds) that can elapse before GemFire XD closes an HDFS log file and begins writing to a new file. This setting applies only to HDFS write-only tables.
PURGEINTERVALMINS INTEGER 10 No The amount of time in minutes that GemFire XD allows expired HDFS log files to remain available for MapReduce jobs. After this interval has passed, GemFire XD deletes the expired files. By default expired log files are kept for 12 hours.