Collector Type: Agent

Collector Type: Agent

Category: Application Monitors

Application Name: HDFSNameNode

Global Template Name: LINUX Hadoop HDFS NameNode Template

Introduction

The NameNode is the centerpiece of an HDFS file system are kept. The directory tree of all files in the file system, and tracked across the cluster where the file data is kept. It does not store the data of these files itself.

Prerequisite

For Virtual Machines, install the Linux Agent.

Parameters

NameDefault Value
Host IP Address

The host on which HDFS is running.
127.0.0.1
NameNodePort

The port on which HDFS NameNode is running.
50070

Note: All field attributes are mandatory, use default values wherever applicable.

Collected Metrics

Metric NameDisplay Name
hdfs.namenode.capacity_total

Total disk capacity in bytes.
HDFS Namenode CapacityTotal
hdfs.namenode.capacity_used_percent

Disk usage in Percent.
HDFS Namenode CapacityUsedPercent
hdfs.namenode.nondfs_used_percent

Total space used by NonDfs in Percentage.
HDFS Namenode NonDfsUsedPercent
hdfs.namenode.capacity_remaining_percent

Remaining disk space left in Percent.
HDFS Namenode CapacityRemainingPercent
hdfs.namenode.blocks_total

Total number of blocks.
HDFS Namenode BlocksTotal
hdfs.namenode.files_total

Total number of files.
HDFS Namenode FilesTotal
hdfs.namenode.num_live_data_nodes

Total number of live data nodes.
HDFS Namenode NumLiveDataNodes
hdfs.namenode.num_dead_data_nodes

Total number of dead data nodes.
HDFS Namenode NumDeadDataNodes
hdfs.namenode.num_failed_data_nodes

Total number of failed data nodes.
HDFS Namenode NumFailedDataNodes
hdfs.namenode.total_load

Total load on the file system.
HDFS Namenode TotalLoad
hdfs.namenode.max_objects

Maximum number of files HDFS supports.
HDFS Namenode MaxObjects
hdfs.namenode.pending_replication_blocks

Number of blocks pending replication.
HDFS Namenode PendingReplicationBlocks
hdfs.namenode.under_replicated_blocks

Number of under replicated blocks.
HDFS Namenode UnderReplicatedBlocks
hdfs.namenode.scheduled_replication_blocks

Number of blocks scheduled for replication.
HDFS Namenode ScheduledReplicationBlocks
hdfs.namenode.pending_deletion_blocks

Number of pending deletion blocks.
HDFS Namenode PendingDeletionBlocks
hdfs.namenode.num_decom_live_data_nodes

Number of decommissioning live data nodes.
HDFS Namenode NumDecomLiveDataNodes
hdfs.namenode.num_decom_dead_data_nodes

Number of decommissioning dead data nodes.
HDFS Namenode NumDecomDeadDataNodes
hdfs.namenode.num_decommissioning_data_nodes

Number of decommissioning data nodes.
HDFS Namenode NumDecommissioningDataNodes
hdfs.namenode.num_stale_data_nodes

Number of stale data nodes.
HDFS Namenode NumStaleDataNodes
hdfs.namenode.num_stale_storages

Number of stale storages.
HDFS Namenode NumStaleStorages
hdfs.namenode.volume_failures_total

Total volume failures.
HDFS Namenode VolumeFailuresTotal
hdfs.namenode.estimated_capacity_lost_total

Estimated capacity lost in bytes.
HDFS Namenode EstimatedCapacityLostTotal
hdfs.namenode.missing_blocks

Number of missing blocks.
HDFS Namenode MissingBlocks
hdfs.namenode.corrupt_blocks

Number of corrupt blocks.
HDFS Namenode CorruptBlocks