ElasticSearch - Cluster Health and Statistics

Description

It monitors elastic search cluster related metrics like cluster status,delayed unassigned shards,active primary shards,active shards,unassigned shards,number of data nodes,number of nodes,relocating shards,initializing shards and pending tasks total. Validated this template on elastic search 6.5.2

Prerequisites

No prerequisite

Supported Metric

Monitor NameMetric NameMetric Display NameUnitDescription
ElasticSearch - Cluster Health and Statisticselasticsearch.cluster_statusElasticsearch Cluster StatusNULLThe elasticsearch cluster health as a number: red = 0,yellow = 1,green = 2
elasticsearch.active_shardsElasticsearch Active ShardscountThe number of active shards in the cluster.
elasticsearch.unassigned_shardsElasticsearch Unassgined ShardscountThe number of shards that are unassigned to a node.
elasticsearch.relocating_shardsElasticsearch Relocating ShardscountThe number of shards that are reloacting from one node to another.
elasticsearch.active_primary_shardsElasticsearch Active Primary ShardscountThe number of shards whose allocation has been delayed.
elasticsearch.initializing_shardsElasticsearch Intializing ShardscountThe number of shards that are currently initializing.
elasticsearch.pending_tasks_totalElasticsearch Pending Tasks TotalcountThe total number of pending tasks.
elasticsearch.delayed_unassigned_shardsElasticsearch Delayed Unassigned ShardscountThe number of shards whose allocation has been delayed.
elasticsearch.number_of_data_nodesElasticsearch Number Of Data NodescountThe number of data nodes in the cluster.
elasticsearch.number_of_nodesElasticsearch Number Of NodescountThe total number of nodes in the cluster.

ElasticSearch - Jvm

Description

It monitors Jvm metrics related to garbage collecor,heap memory,non heap memory and threads. Validated this template on elastic search 6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor NameMetric NameMetric Display NameUnitDescription
ElasticSearch - Jvmelasticsearch.jvm.threads.peak_countElasticsearch Jvm Threads Peak CountcountThe peak number of threads used by the JVM.
elasticsearch.jvm.mem.non_heap_committedElasticsearch Jvm Mem NonHeapCommittedBytesThe amount of memory guaranteed to be available to JVM non-heap.
elasticsearch.jvm.mem.heap_in_useElasticsearch Jvm Mem HeapInUseBytesThe amount of memory currently used by the JVM heap as a value between 0 and 1.
elasticsearch.jvm.gc.collectors.young.collection.countElasticsearch Jvm Gc Collectors Young Collection CountcountThe total count of minor GCs in the JVM that collects young generation objects.
elasticsearch.jvm.mem.pools.survivor.maxElasticsearch Jvm Mem Pools Survivor MaxBytesThe maximum amount of memory that can be used by the Survivor Space.
elasticsearch.jvm.mem.heap_maxElasticsearch Jvm Mem HeapMaxBytesThe maximum amount of memory that can be used by the JVM heap.
elasticsearch.jvm.mem.pools.young.usedElasticsearch Jvm Mem Pools Young UsedBytesThe amount of memory in bytes currently used by the Young Generation heap reagion.
elasticsearch.jvm.gc.collectors.old.collection.timeElasticsearch Jvm Gc Collectors Old Collection TimesThe total time spent in major GCs in the JVM that collect old generation objects.
elasticsearch.jvm.gc.collectors.old.collection.countElasticsearch Jvm Gc Collectors Old Collection CountcountThe total count of major GCs in the JVM that collect old generation objects.
elasticsearch.jvm.mem.pools.old.maxElasticsearch Jvm Mem Pools Old MaxBytesThe maximum amount of memory that can be used by the Old Generation heap reagion.
elasticsearch.jvm.mem.heap_committedElasticsearch Jvm Mem HeapCommittedBytesThe amount of memory guaranteed to be available to the JVM heap.
elasticsearch.jvm.gc.collectors.young.collection.timeElasticsearch Jvm Gc Collectors Young Collection TimesThe total time spent in minor GCs in the JVM that collects young generation objects.
elasticsearch.jvm.mem.pools.survivor.usedElasticsearch Jvm Mem Pools Survivor UsedBytesThe amount of memory in bytes currently used by the Survivor Space.
elasticsearch.jvm.mem.non_heap_usedElasticsearch Jvm Mem NonHeapUsedBytesThe amount of memory in bytes currently used by the JVM non-heap.
elasticsearch.jvm.mem.pools.young.maxElasticsearch Jvm Mem Pools Young MaxBytesThe maximum amount of memory that can be used by the Young Generation heap reagion.
elasticsearch.jvm.mem.heap_usedElasticsearch Jvm Mem HeapUsedBytesThe amount of memory in bytes currently used by the JVM heap.
elasticsearch.jvm.threads.countElasticsearch Jvm Threads CountcountThe number of active threads in the JVM.
elasticsearch.jvm.mem.pools.old.usedElasticsearch Jvm Mem Pools Old UsedBytesThe amount of memory in bytes currently used by the Old Generation heap reagion.

ElasticSearch - Performance - Node

Description

It monitors elastic search metrics related to process,http,file structures and indices Component - nodes Validated this template on elasticsearch 6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor NameMetric NameMetric Display NameUnitDescription
ElasticSearch - Performance - Nodeelasticsearch.fs.total.available_in_bytesElasticsearch Fs Total Available In BytesBytesThe total number of bytes available to this Java virtual machine on this file store.
elasticsearch.indices.request_cache.hit_countElasticsearch Indices RequestCache HitCountcountThe number of request cache hits.
elasticsearch.http.current_openElasticsearch Http Current OpencountThe number of current open HTTP connections.
elasticsearch.indices.indexing.index.timeElasticsearch Indices Indexing Index TimesThe total time spent indexing documents to an index.
elasticsearch.indices.segments.countElasticsearch Indices Segments CountcountThe number of segments in an index shard.
elasticsearch.indices.indexing.index_failedElasticsearch Indices Indexing Index FailedcountThe number of failed indexing operations.
elasticsearch.indices.fielddata.sizeElasticsearch Indices Fielddata SizeBytesThe size of the fielddata cache.
elasticsearch.indices.fielddata.evictionsElasticsearch Indices Fielddata EvictionscountThe total number of evictions from the fielddata cache.
elasticsearch.indices.request_cache.memory_size_in_bytesElasticsearch Indices RequestCache Memory SizeBytesThe memory used by the request cache.
elasticsearch.process.open_fdElasticsearch Process Open FdcountThe number of opened file descriptors associated with the current process,or -1 if not supported.
elasticsearch.indices.segments.memory_in_bytesElasticsearch Indices Segments MemoryBytesThe memory used by index segments.
elasticsearch.indices.docs.countElasticsearch Indices Docs CountcountThe number of indices in the cluster.
elasticsearch.indices.segments.doc_values_memory_in_bytesElasticsearch Indices Segments Doc Values MemoryBytesThe memory used by doc values.
elasticsearch.indices.segments.stored_fields_memory_in_bytesElasticsearch Indices Segments Stored Fields MemoryBytesThe memory used by stored fields.
elasticsearch.indices.segments.index_writer_memory_in_bytesElasticsearch Indices Segments Index Writer MemoryBytesThe memory used by the index writer.
elasticsearch.indices.query_cache.hit_countElasticsearch Indices QueryCache Hit CountcountThe number of query cache hits.
elasticsearch.indices.segments.version_map_memory_in_bytesElasticsearch Indices Segments Version Map MemoryBytesThe memory used by the segment version map.
elasticsearch.indices.segments.norms_memory_in_bytesElasticsearch Indices Segments Norms MemoryBytesThe memory used by norms.
elasticsearch.indices.segments.terms_memory_in_bytesElasticsearch Indices Segments Terms MemoryBytesThe memory used by terms.
elasticsearch.indices.query_cache.miss_countElasticsearch Indices QueryCache Miss CountcountThe number of query cache misses.
elasticsearch.indices.search.query.timeElasticsearch Indices Search Query TimesThe total time spent on queries.
elasticsearch.indices.query_cache.memory_size_in_bytesElasticsearch Indices QueryCache Memory SizeBytesThe memory used by the query cache.
elasticsearch.indices.request_cache.miss_countElasticsearch Indices RequestCache Miss CountcountThe number of request cache misses.
elasticsearch.indices.merges.total.timeElasticsearch Indices Merges Total TimesThe total time spent on segment merging.
elasticsearch.indices.segments.fixed_bit_set_memory_in_bytesElasticsearch Indices Segments Fixed Bit Set MemoryBytesThe memory used by fixed bit set.
elasticsearch.indices.segments.term_vectors_memory_in_bytesElasticsearch Indices Segments Term Vectors MemoryBytesThe memory used by term vectors.
elasticsearch.indices.request_cache.evictionsElasticsearch Indices RequestCache EvictionscountThe number of request cache evictions.
elasticsearch.fs.total.free_in_bytesElasticsearch Fs Total Free In BytesBytesThe total number of unallocated bytes in the file store.
elasticsearch.fs.total.total_in_bytesElasticsearch Fs Total Total In BytesBytesThe total size in bytes of the file store.

ElasticSearch - Threadpool - Node

Description

It monitors elastic search metrics related to threadpool. Component - nodes Validated this template on elastic search6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor NameMetric NameMetric Display NameUnitDescription
ElasticSearch - Threadpool - Nodeelasticsearch.thread_pool.snapshot.queueElasticsearch Threapool Snapshot QueuecountThe number of queued threads in the snapshot pool.
elasticsearch.thread_pool.listener.queueElasticsearch Threapool Listener QueuecountThe number of queued threads in the listener pool.
elasticsearch.thread_pool.generic.activeElasticsearch Threadpool Generic ActivecountThe number of active threads in the generic pool.
elasticsearch.thread_pool.flush.activeElasticsearch Threadpool Flush ActivecountThe number of active threads in the flush queue.
elasticsearch.thread_pool.generic.queueElasticsearch Threadpool Generic QueuecountThe number of queued threads in the generic pool.
elasticsearch.thread_pool.search.queueElasticsearch Threapool Search QueuecountThe number of queued threads in the search pool.
elasticsearch.thread_pool.listener.activeElasticsearch Threapool Listener ActivecountThe number of active threads in the listener pool.
elasticsearch.transport.server_openElasticsearch Transport ServerOpencountThe number of connections opened for cluster communication.
elasticsearch.thread_pool.fetch_shard_store.activeElasticsearch Threadpool FetchShardStore ActivecountThe number of active threads in the fetch shard store pool.
elasticsearch.thread_pool.snapshot.activeElasticsearch Threapool Snapshot ActivecountThe number of active threads in the snapshot pool.
elasticsearch.thread_pool.search.activeElasticsearch Threapool Search ActivecountThe number of active threads in the search pool.
elasticsearch.thread_pool.index.queueElasticsearch Threapool Index QueuecountThe number of queued threads in the index pool.
elasticsearch.thread_pool.fetch_shard_started.queueElasticsearch Threadpool FetchShardStarted QueuecountThe number of queued threads in the fetch shard started pool.
elasticsearch.thread_pool.force_merge.queueElasticsearch Threadpool ForceMerge QueuecountThe number of queued threads for force merge operations.
elasticsearch.thread_pool.refresh.activeElasticsearch Threapool Refresh ActivecountThe number of active threads in the refresh pool.
elasticsearch.thread_pool.management.activeElasticsearch Threapool Management ActivecountThe number of active threads in the management pool.
elasticsearch.thread_pool.get.activeElasticsearch Threapool Get ActivecountThe number of active threads in the get pool.
elasticsearch.thread_pool.get.queueElasticsearch Threapool Get QueuecountThe number of queued threads in the get pool.
elasticsearch.thread_pool.index.activeElasticsearch Threapool Index ActivecountThe number of active threads in the index pool.
elasticsearch.thread_pool.management.queueElasticsearch Threapool Management QueuecountThe number of queued threads in the management pool.
elasticsearch.transport.rx_sizeElasticsearch Transport RxSizeBytesThe total size of data received in cluster communication.
elasticsearch.transport.tx_sizeElasticsearch Transport TxSizeBytesThe total size of data sent in cluster communication.
elasticsearch.thread_pool.write.activeElasticsearch Threapool Write ActivecountThe number of active threads in the write pool.
elasticsearch.thread_pool.write.queueElasticsearch Threapool Write QueuecountThe number of queued threads in the write pool.
elasticsearch.thread_pool.force_merge.activeElasticsearch Threadpool ForceMerge ActivecountThe number of active threads for force merge operations.
elasticsearch.thread_pool.fetch_shard_store.queueElasticsearch Threadpool FetchShardStore QueuecountThe number of queued threads in the fetch shard store pool.
elasticsearch.thread_pool.flush.queueElasticsearch Threadpool Flush QueuecountThe number of queued threads in the flush pool.
elasticsearch.thread_pool.fetch_shard_started.activeElasticsearch Threadpool FetchShardStarted ActivecountThe number of active threads in the fetch shard started pool.
elasticsearch.thread_pool.refresh.queueElasticsearch Threapool Refresh QueuecountThe number of queued threads in the refresh pool.