ElasticSearch

ElasticSearch - Cluster Health and Statistics

Description

It monitors elastic search cluster related metrics like cluster status,delayed unassigned shards,active primary shards,active shards,unassigned shards,number of data nodes,number of nodes,relocating shards,initializing shards and pending tasks total. Validated this template on elastic search 6.5.2

Prerequisites

No prerequisite

Supported Metric

Monitor Name	Metric Name	Metric Display Name	Unit	Description
ElasticSearch - Cluster Health and Statistics	elasticsearch.cluster_status	Elasticsearch Cluster Status	NULL	The elasticsearch cluster health as a number: red = 0,yellow = 1,green = 2
	elasticsearch.active_shards	Elasticsearch Active Shards	count	The number of active shards in the cluster.
	elasticsearch.unassigned_shards	Elasticsearch Unassgined Shards	count	The number of shards that are unassigned to a node.
	elasticsearch.relocating_shards	Elasticsearch Relocating Shards	count	The number of shards that are reloacting from one node to another.
	elasticsearch.active_primary_shards	Elasticsearch Active Primary Shards	count	The number of shards whose allocation has been delayed.
	elasticsearch.initializing_shards	Elasticsearch Intializing Shards	count	The number of shards that are currently initializing.
	elasticsearch.pending_tasks_total	Elasticsearch Pending Tasks Total	count	The total number of pending tasks.
	elasticsearch.delayed_unassigned_shards	Elasticsearch Delayed Unassigned Shards	count	The number of shards whose allocation has been delayed.
	elasticsearch.number_of_data_nodes	Elasticsearch Number Of Data Nodes	count	The number of data nodes in the cluster.
	elasticsearch.number_of_nodes	Elasticsearch Number Of Nodes	count	The total number of nodes in the cluster.

ElasticSearch - Jvm

Description

It monitors Jvm metrics related to garbage collecor,heap memory,non heap memory and threads. Validated this template on elastic search 6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor Name	Metric Name	Metric Display Name	Unit	Description
ElasticSearch - Jvm	elasticsearch.jvm.threads.peak_count	Elasticsearch Jvm Threads Peak Count	count	The peak number of threads used by the JVM.
	elasticsearch.jvm.mem.non_heap_committed	Elasticsearch Jvm Mem NonHeapCommitted	Bytes	The amount of memory guaranteed to be available to JVM non-heap.
	elasticsearch.jvm.mem.heap_in_use	Elasticsearch Jvm Mem HeapInUse	Bytes	The amount of memory currently used by the JVM heap as a value between 0 and 1.
	elasticsearch.jvm.gc.collectors.young.collection.count	Elasticsearch Jvm Gc Collectors Young Collection Count	count	The total count of minor GCs in the JVM that collects young generation objects.
	elasticsearch.jvm.mem.pools.survivor.max	Elasticsearch Jvm Mem Pools Survivor Max	Bytes	The maximum amount of memory that can be used by the Survivor Space.
	elasticsearch.jvm.mem.heap_max	Elasticsearch Jvm Mem HeapMax	Bytes	The maximum amount of memory that can be used by the JVM heap.
	elasticsearch.jvm.mem.pools.young.used	Elasticsearch Jvm Mem Pools Young Used	Bytes	The amount of memory in bytes currently used by the Young Generation heap reagion.
	elasticsearch.jvm.gc.collectors.old.collection.time	Elasticsearch Jvm Gc Collectors Old Collection Time	s	The total time spent in major GCs in the JVM that collect old generation objects.
	elasticsearch.jvm.gc.collectors.old.collection.count	Elasticsearch Jvm Gc Collectors Old Collection Count	count	The total count of major GCs in the JVM that collect old generation objects.
	elasticsearch.jvm.mem.pools.old.max	Elasticsearch Jvm Mem Pools Old Max	Bytes	The maximum amount of memory that can be used by the Old Generation heap reagion.
	elasticsearch.jvm.mem.heap_committed	Elasticsearch Jvm Mem HeapCommitted	Bytes	The amount of memory guaranteed to be available to the JVM heap.
	elasticsearch.jvm.gc.collectors.young.collection.time	Elasticsearch Jvm Gc Collectors Young Collection Time	s	The total time spent in minor GCs in the JVM that collects young generation objects.
	elasticsearch.jvm.mem.pools.survivor.used	Elasticsearch Jvm Mem Pools Survivor Used	Bytes	The amount of memory in bytes currently used by the Survivor Space.
	elasticsearch.jvm.mem.non_heap_used	Elasticsearch Jvm Mem NonHeapUsed	Bytes	The amount of memory in bytes currently used by the JVM non-heap.
	elasticsearch.jvm.mem.pools.young.max	Elasticsearch Jvm Mem Pools Young Max	Bytes	The maximum amount of memory that can be used by the Young Generation heap reagion.
	elasticsearch.jvm.mem.heap_used	Elasticsearch Jvm Mem HeapUsed	Bytes	The amount of memory in bytes currently used by the JVM heap.
	elasticsearch.jvm.threads.count	Elasticsearch Jvm Threads Count	count	The number of active threads in the JVM.
	elasticsearch.jvm.mem.pools.old.used	Elasticsearch Jvm Mem Pools Old Used	Bytes	The amount of memory in bytes currently used by the Old Generation heap reagion.

ElasticSearch - Performance - Node

Description

It monitors elastic search metrics related to process,http,file structures and indices Component - nodes Validated this template on elasticsearch 6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor Name	Metric Name	Metric Display Name	Unit	Description
ElasticSearch - Performance - Node	elasticsearch.fs.total.available_in_bytes	Elasticsearch Fs Total Available In Bytes	Bytes	The total number of bytes available to this Java virtual machine on this file store.
	elasticsearch.indices.request_cache.hit_count	Elasticsearch Indices RequestCache HitCount	count	The number of request cache hits.
	elasticsearch.http.current_open	Elasticsearch Http Current Open	count	The number of current open HTTP connections.
	elasticsearch.indices.indexing.index.time	Elasticsearch Indices Indexing Index Time	s	The total time spent indexing documents to an index.
	elasticsearch.indices.segments.count	Elasticsearch Indices Segments Count	count	The number of segments in an index shard.
	elasticsearch.indices.indexing.index_failed	Elasticsearch Indices Indexing Index Failed	count	The number of failed indexing operations.
	elasticsearch.indices.fielddata.size	Elasticsearch Indices Fielddata Size	Bytes	The size of the fielddata cache.
	elasticsearch.indices.fielddata.evictions	Elasticsearch Indices Fielddata Evictions	count	The total number of evictions from the fielddata cache.
	elasticsearch.indices.request_cache.memory_size_in_bytes	Elasticsearch Indices RequestCache Memory Size	Bytes	The memory used by the request cache.
	elasticsearch.process.open_fd	Elasticsearch Process Open Fd	count	The number of opened file descriptors associated with the current process,or -1 if not supported.
	elasticsearch.indices.segments.memory_in_bytes	Elasticsearch Indices Segments Memory	Bytes	The memory used by index segments.
	elasticsearch.indices.docs.count	Elasticsearch Indices Docs Count	count	The number of indices in the cluster.
	elasticsearch.indices.segments.doc_values_memory_in_bytes	Elasticsearch Indices Segments Doc Values Memory	Bytes	The memory used by doc values.
	elasticsearch.indices.segments.stored_fields_memory_in_bytes	Elasticsearch Indices Segments Stored Fields Memory	Bytes	The memory used by stored fields.
	elasticsearch.indices.segments.index_writer_memory_in_bytes	Elasticsearch Indices Segments Index Writer Memory	Bytes	The memory used by the index writer.
	elasticsearch.indices.query_cache.hit_count	Elasticsearch Indices QueryCache Hit Count	count	The number of query cache hits.
	elasticsearch.indices.segments.version_map_memory_in_bytes	Elasticsearch Indices Segments Version Map Memory	Bytes	The memory used by the segment version map.
	elasticsearch.indices.segments.norms_memory_in_bytes	Elasticsearch Indices Segments Norms Memory	Bytes	The memory used by norms.
	elasticsearch.indices.segments.terms_memory_in_bytes	Elasticsearch Indices Segments Terms Memory	Bytes	The memory used by terms.
	elasticsearch.indices.query_cache.miss_count	Elasticsearch Indices QueryCache Miss Count	count	The number of query cache misses.
	elasticsearch.indices.search.query.time	Elasticsearch Indices Search Query Time	s	The total time spent on queries.
	elasticsearch.indices.query_cache.memory_size_in_bytes	Elasticsearch Indices QueryCache Memory Size	Bytes	The memory used by the query cache.
	elasticsearch.indices.request_cache.miss_count	Elasticsearch Indices RequestCache Miss Count	count	The number of request cache misses.
	elasticsearch.indices.merges.total.time	Elasticsearch Indices Merges Total Time	s	The total time spent on segment merging.
	elasticsearch.indices.segments.fixed_bit_set_memory_in_bytes	Elasticsearch Indices Segments Fixed Bit Set Memory	Bytes	The memory used by fixed bit set.
	elasticsearch.indices.segments.term_vectors_memory_in_bytes	Elasticsearch Indices Segments Term Vectors Memory	Bytes	The memory used by term vectors.
	elasticsearch.indices.request_cache.evictions	Elasticsearch Indices RequestCache Evictions	count	The number of request cache evictions.
	elasticsearch.fs.total.free_in_bytes	Elasticsearch Fs Total Free In Bytes	Bytes	The total number of unallocated bytes in the file store.
	elasticsearch.fs.total.total_in_bytes	Elasticsearch Fs Total Total In Bytes	Bytes	The total size in bytes of the file store.

ElasticSearch - Threadpool - Node

Description

It monitors elastic search metrics related to threadpool. Component - nodes Validated this template on elastic search6.5.3

Prerequisites

No prerequisite

Supported Metric

Monitor Name	Metric Name	Metric Display Name	Unit	Description
ElasticSearch - Threadpool - Node	elasticsearch.thread_pool.snapshot.queue	Elasticsearch Threapool Snapshot Queue	count	The number of queued threads in the snapshot pool.
	elasticsearch.thread_pool.listener.queue	Elasticsearch Threapool Listener Queue	count	The number of queued threads in the listener pool.
	elasticsearch.thread_pool.generic.active	Elasticsearch Threadpool Generic Active	count	The number of active threads in the generic pool.
	elasticsearch.thread_pool.flush.active	Elasticsearch Threadpool Flush Active	count	The number of active threads in the flush queue.
	elasticsearch.thread_pool.generic.queue	Elasticsearch Threadpool Generic Queue	count	The number of queued threads in the generic pool.
	elasticsearch.thread_pool.search.queue	Elasticsearch Threapool Search Queue	count	The number of queued threads in the search pool.
	elasticsearch.thread_pool.listener.active	Elasticsearch Threapool Listener Active	count	The number of active threads in the listener pool.
	elasticsearch.transport.server_open	Elasticsearch Transport ServerOpen	count	The number of connections opened for cluster communication.
	elasticsearch.thread_pool.fetch_shard_store.active	Elasticsearch Threadpool FetchShardStore Active	count	The number of active threads in the fetch shard store pool.
	elasticsearch.thread_pool.snapshot.active	Elasticsearch Threapool Snapshot Active	count	The number of active threads in the snapshot pool.
	elasticsearch.thread_pool.search.active	Elasticsearch Threapool Search Active	count	The number of active threads in the search pool.
	elasticsearch.thread_pool.index.queue	Elasticsearch Threapool Index Queue	count	The number of queued threads in the index pool.
	elasticsearch.thread_pool.fetch_shard_started.queue	Elasticsearch Threadpool FetchShardStarted Queue	count	The number of queued threads in the fetch shard started pool.
	elasticsearch.thread_pool.force_merge.queue	Elasticsearch Threadpool ForceMerge Queue	count	The number of queued threads for force merge operations.
	elasticsearch.thread_pool.refresh.active	Elasticsearch Threapool Refresh Active	count	The number of active threads in the refresh pool.
	elasticsearch.thread_pool.management.active	Elasticsearch Threapool Management Active	count	The number of active threads in the management pool.
	elasticsearch.thread_pool.get.active	Elasticsearch Threapool Get Active	count	The number of active threads in the get pool.
	elasticsearch.thread_pool.get.queue	Elasticsearch Threapool Get Queue	count	The number of queued threads in the get pool.
	elasticsearch.thread_pool.index.active	Elasticsearch Threapool Index Active	count	The number of active threads in the index pool.
	elasticsearch.thread_pool.management.queue	Elasticsearch Threapool Management Queue	count	The number of queued threads in the management pool.
	elasticsearch.transport.rx_size	Elasticsearch Transport RxSize	Bytes	The total size of data received in cluster communication.
	elasticsearch.transport.tx_size	Elasticsearch Transport TxSize	Bytes	The total size of data sent in cluster communication.
	elasticsearch.thread_pool.write.active	Elasticsearch Threapool Write Active	count	The number of active threads in the write pool.
	elasticsearch.thread_pool.write.queue	Elasticsearch Threapool Write Queue	count	The number of queued threads in the write pool.
	elasticsearch.thread_pool.force_merge.active	Elasticsearch Threadpool ForceMerge Active	count	The number of active threads for force merge operations.
	elasticsearch.thread_pool.fetch_shard_store.queue	Elasticsearch Threadpool FetchShardStore Queue	count	The number of queued threads in the fetch shard store pool.
	elasticsearch.thread_pool.flush.queue	Elasticsearch Threadpool Flush Queue	count	The number of queued threads in the flush pool.
	elasticsearch.thread_pool.fetch_shard_started.active	Elasticsearch Threadpool FetchShardStarted Active	count	The number of active threads in the fetch shard started pool.
	elasticsearch.thread_pool.refresh.queue	Elasticsearch Threapool Refresh Queue	count	The number of queued threads in the refresh pool.