Collector Type: Agent
Category: Application Monitors
Application Name: HDFSDataNode
Global Template Name: LINUX Hadoop HDFS DataNode Template
Introduction
A DataNode stores data in HadoopFileSystem. A functional filesystem has more than one DataNode, with data replicated across them. HDFS DataNode parameters are monitored through Hadoop JMX API. DataNode stores data in HadoopFileSystem. A functional filesystem has more than one DataNode, with data replicated across them.
Prerequisite
For Virtual Machines, install the Linux Agent.
Parameters
| Name | Default Value |
|---|---|
| IPAddress Address on which the Hadoop HDFS DataNode listens. | 127.0.0.1 |
| Data Node Port The port on which Hadoop HDFS DataNode runs. | 50075 |
Note: All field attributes are mandatory, use default values wherever applicable.
Collected Metrics
| Metric Name | Display Name |
|---|---|
| hdfs.datanode.dfs_capacity Disk capacity in bytes. | HDFS Datanode Dfs Capacity |
| hdfs.datanode.dfs_used_percent Disk usage in Percent. | HDFS Datanode Dfs Used Percent |
| hdfs.datanode.dfs_remaining_percent The remaining disk space left in Percent. | HDFS Datanode Dfs Remaining Percent |
| hdfs.datanode.process_cpu_load The CPU Load of the Process. | HDFS Datanode Process CpuLoad |
| hdfs.datanode.cache_capacity TCache capacity in bytes. | HDFS Datanode Cache Capacity |
| hdfs.datanode.cache_used Cache used in bytes. | HDFS Datanode Cache Used |
| hdfs.datanode.num_failed_volumes Number of failed volumes. | HDFS Datanode NumFailedVolumes |
| hdfs.datanode.last_volume_failure_date The date/time of the last volume failure in milliseconds since epoch. | HDFS Datanode LastVolumeFailureDate |
| hdfs.datanode.estimated_capacity_lost_total The estimated capacity lost in bytes. | HDFS Datanode EstimatedCapacityLostTotal |
| hdfs.datanode.num_blocks_cached The number of blocks cached. | HDFS Datanode NumBlocksCached |
| hdfs.datanode.num_blocks_failed_to_cache The number of blocks that failed to cache. | HDFS Datanode NumBlocksFailedToCache |
| hdfs.datanode.num_blocks_failed_to_uncache The number of failed blocks to remove from cache. | HDFS Datanode NumBlocksFailedToUncache |