Hive JMX Metrics

Every 10 seconds, the collectd service uses the Hive plug-in to gather the following Hive JMX metrics on each node in the cluster. Descriptions for the Hive metrics are not currently available.

Metric Collection

Metrics collected in Hive relate specifically to the HiveServer2 and Hive metastore processes. Each process runs in a separate JVM, and the JVMs provide values for the metrics.

Starting in MEP 6.3.2 and MEP 7.0.1, the hive.exec.submit.local.task.via.child option (in hive-site.xml) is set to true, by default, and enables HiveServer2 to spawn local tasks (typically mapjoin hashtable generation phase) in child JVMs. The system does not collect metrics for the child JVMs. The system only collects metrics for the HiveServer2 and Hive metastore processes.

Hive Metastore Metrics

The following are the JMX metrics provided for the Hive metastore:

mapr.hivemetastore.hivemetastore_buffers_direct_capacity
mapr.hivemetastore.hivemetastore_buffers_direct_count
mapr.hivemetastore.hivemetastore_buffers_direct_used
mapr.hivemetastore.hivemetastore_buffers_mapped_capacity
mapr.hivemetastore.hivemetastore_buffers_mapped_count
mapr.hivemetastore.hivemetastore_buffers_mapped_used
mapr.hivemetastore.hivemetastore_class_loading_loaded
mapr.hivemetastore.hivemetastore_class_loading_unloaded
mapr.hivemetastore.hivemetastore_gc_ps_mark_sweep_count
mapr.hivemetastore.hivemetastore_gc_ps_mark_sweep_time
mapr.hivemetastore.hivemetastore_gc_ps_scavenge_count
mapr.hivemetastore.hivemetastore_gc_ps_scavenge_time
mapr.hivemetastore.hivemetastore_init_total_count_dbs
mapr.hivemetastore.hivemetastore_init_total_count_partitions
mapr.hivemetastore.hivemetastore_init_total_count_tables
mapr.hivemetastore.hivemetastore_memory_heap_committed
mapr.hivemetastore.hivemetastore_memory_heap_init
mapr.hivemetastore.hivemetastore_memory_heap_max
mapr.hivemetastore.hivemetastore_memory_heap_usage
mapr.hivemetastore.hivemetastore_memory_heap_used
mapr.hivemetastore.hivemetastore_memory_non_heap_committed
mapr.hivemetastore.hivemetastore_memory_non_heap_init
mapr.hivemetastore.hivemetastore_memory_non_heap_max
mapr.hivemetastore.hivemetastore_memory_non_heap_usage
mapr.hivemetastore.hivemetastore_memory_non_heap_used
mapr.hivemetastore.hivemetastore_memory_pools_code_cache_usage
mapr.hivemetastore.hivemetastore_memory_pools_compressed_class_space_usage
mapr.hivemetastore.hivemetastore_memory_pools_metaspace_usage
mapr.hivemetastore.hivemetastore_memory_pools_ps_eden_space_usage
mapr.hivemetastore.hivemetastore_memory_pools_ps_old_gen_usage
mapr.hivemetastore.hivemetastore_memory_pools_ps_survivor_space_usage
mapr.hivemetastore.hivemetastore_memory_total_committed
mapr.hivemetastore.hivemetastore_memory_total_init
mapr.hivemetastore.hivemetastore_memory_total_max
mapr.hivemetastore.hivemetastore_memory_total_used
mapr.hivemetastore.hivemetastore_threads_blocked_count
mapr.hivemetastore.hivemetastore_threads_count
mapr.hivemetastore.hivemetastore_threads_daemon_count
mapr.hivemetastore.hivemetastore_threads_deadlock_count
mapr.hivemetastore.hivemetastore_threads_deadlocks
mapr.hivemetastore.hivemetastore_threads_new_count
mapr.hivemetastore.hivemetastore_threads_runnable_count
mapr.hivemetastore.hivemetastore_threads_terminated_count
mapr.hivemetastore.hivemetastore_threads_timed_waiting_count
mapr.hivemetastore.hivemetastore_threads_waiting_count
mapr.hivemetastore.hivemetastore_active_calls_api_get_all_databases
mapr.hivemetastore.hivemetastore_active_calls_api_get_all_functions
mapr.hivemetastore.hivemetastore_active_calls_api_get_all_tables
mapr.hivemetastore.hivemetastore_active_calls_api_get_database
mapr.hivemetastore.hivemetastore_active_calls_api_get_multi_table
mapr.hivemetastore.hivemetastore_active_calls_api_get_table_objects_by_name_req
mapr.hivemetastore.hivemetastore_active_calls_api_init
mapr.hivemetastore.hivemetastore_jvm_pause_extra_sleep_time
mapr.hivemetastore.hivemetastore_open_connections
mapr.hivemetastore.hivemetastore_api_get_all_databases_count
mapr.hivemetastore.hivemetastore_api_get_all_databases_max
mapr.hivemetastore.hivemetastore_api_get_all_databases_mean
mapr.hivemetastore.hivemetastore_api_get_all_databases_min
mapr.hivemetastore.hivemetastore_api_get_all_databases_p50
mapr.hivemetastore.hivemetastore_api_get_all_databases_p75
mapr.hivemetastore.hivemetastore_api_get_all_databases_p95
mapr.hivemetastore.hivemetastore_api_get_all_databases_p98
mapr.hivemetastore.hivemetastore_api_get_all_databases_p99
mapr.hivemetastore.hivemetastore_api_get_all_databases_p999
mapr.hivemetastore.hivemetastore_api_get_all_databases_stddev
mapr.hivemetastore.hivemetastore_api_get_all_databases_m15_rate
mapr.hivemetastore.hivemetastore_api_get_all_databases_m1_rate
mapr.hivemetastore.hivemetastore_api_get_all_databases_m5_rate
mapr.hivemetastore.hivemetastore_api_get_all_databases_mean_rate
mapr.hivemetastore.hivemetastore_api_get_all_functions_count
mapr.hivemetastore.hivemetastore_api_get_all_functions_max
mapr.hivemetastore.hivemetastore_api_get_all_functions_mean
mapr.hivemetastore.hivemetastore_api_get_all_functions_min
mapr.hivemetastore.hivemetastore_api_get_all_functions_p50
mapr.hivemetastore.hivemetastore_api_get_all_functions_p75
mapr.hivemetastore.hivemetastore_api_get_all_functions_p95
mapr.hivemetastore.hivemetastore_api_get_all_functions_p98
mapr.hivemetastore.hivemetastore_api_get_all_functions_p99
mapr.hivemetastore.hivemetastore_api_get_all_functions_p999
mapr.hivemetastore.hivemetastore_api_get_all_functions_stddev
mapr.hivemetastore.hivemetastore_api_get_all_functions_m15_rate
mapr.hivemetastore.hivemetastore_api_get_all_functions_m1_rate
mapr.hivemetastore.hivemetastore_api_get_all_functions_m5_rate
mapr.hivemetastore.hivemetastore_api_get_all_functions_mean_rate
mapr.hivemetastore.hivemetastore_api_get_all_tables_count
mapr.hivemetastore.hivemetastore_api_get_all_tables_max
mapr.hivemetastore.hivemetastore_api_get_all_tables_mean
mapr.hivemetastore.hivemetastore_api_get_all_tables_min
mapr.hivemetastore.hivemetastore_api_get_all_tables_p50
mapr.hivemetastore.hivemetastore_api_get_all_tables_p75
mapr.hivemetastore.hivemetastore_api_get_all_tables_p95
mapr.hivemetastore.hivemetastore_api_get_all_tables_p98
mapr.hivemetastore.hivemetastore_api_get_all_tables_p99
mapr.hivemetastore.hivemetastore_api_get_all_tables_p999
mapr.hivemetastore.hivemetastore_api_get_all_tables_stddev
mapr.hivemetastore.hivemetastore_api_get_all_tables_m15_rate
mapr.hivemetastore.hivemetastore_api_get_all_tables_m1_rate
mapr.hivemetastore.hivemetastore_api_get_all_tables_m5_rate
mapr.hivemetastore.hivemetastore_api_get_all_tables_mean_rate
mapr.hivemetastore.hivemetastore_api_get_multi_table_count
mapr.hivemetastore.hivemetastore_api_get_multi_table_max
mapr.hivemetastore.hivemetastore_api_get_multi_table_mean
mapr.hivemetastore.hivemetastore_api_get_multi_table_min
mapr.hivemetastore.hivemetastore_api_get_multi_table_p50
mapr.hivemetastore.hivemetastore_api_get_multi_table_p75
mapr.hivemetastore.hivemetastore_api_get_multi_table_p95
mapr.hivemetastore.hivemetastore_api_get_multi_table_p98
mapr.hivemetastore.hivemetastore_api_get_multi_table_p99
mapr.hivemetastore.hivemetastore_api_get_multi_table_p999
mapr.hivemetastore.hivemetastore_api_get_multi_table_stddev
mapr.hivemetastore.hivemetastore_api_get_multi_table_m15_rate
mapr.hivemetastore.hivemetastore_api_get_multi_table_m1_rate
mapr.hivemetastore.hivemetastore_api_get_multi_table_m5_rate
mapr.hivemetastore.hivemetastore_api_get_multi_table_mean_rate
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_count
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_max
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_mean
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_min
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p50
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p75
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p95
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p98
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p99
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p999
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_stddev
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m15_rate
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m1_rate
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m5_rate
mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_mean_rate
mapr.hivemetastore.hivemetastore_api_init_count
mapr.hivemetastore.hivemetastore_api_init_max
mapr.hivemetastore.hivemetastore_api_init_mean
mapr.hivemetastore.hivemetastore_api_init_min
mapr.hivemetastore.hivemetastore_api_init_p50
mapr.hivemetastore.hivemetastore_api_init_p75
mapr.hivemetastore.hivemetastore_api_init_p95
mapr.hivemetastore.hivemetastore_api_init_p98
mapr.hivemetastore.hivemetastore_api_init_p99
mapr.hivemetastore.hivemetastore_api_init_p999
mapr.hivemetastore.hivemetastore_api_init_stddev
mapr.hivemetastore.hivemetastore_api_init_m15_rate
mapr.hivemetastore.hivemetastore_api_init_m1_rate
mapr.hivemetastore.hivemetastore_api_init_m5_rate
mapr.hivemetastore.hivemetastore_api_init_mean_rate

HiveServer2 Metrics

The following are the JMX metrics provided for HiveServer2 (hs2):

mapr.hiveserver2.hiveserver2_buffers_direct_capacity
mapr.hiveserver2.hiveserver2_buffers_direct_count
mapr.hiveserver2.hiveserver2_buffers_direct_used
mapr.hiveserver2.hiveserver2_buffers_mapped_capacity
mapr.hiveserver2.hiveserver2_buffers_mapped_count
mapr.hiveserver2.hiveserver2_buffers_mapped_used
mapr.hiveserver2.hiveserver2_class_loading_loaded
mapr.hiveserver2.hiveserver2_class_loading_unloaded
mapr.hiveserver2.hiveserver2_exec_async_pool_size
mapr.hiveserver2.hiveserver2_exec_async_queue_size
mapr.hiveserver2.hiveserver2_gc_ps_mark_sweep_count
mapr.hiveserver2.hiveserver2_gc_ps_mark_sweep_time
mapr.hiveserver2.hiveserver2_gc_ps_scavenge_count
mapr.hiveserver2.hiveserver2_gc_ps_scavenge_time
mapr.hiveserver2.hiveserver2_active_sessions
mapr.hiveserver2.hiveserver2_open_sessions
mapr.hiveserver2.hiveserver2_init_total_count_dbs
mapr.hiveserver2.hiveserver2_init_total_count_partitions
mapr.hiveserver2.hiveserver2_init_total_count_tables
mapr.hiveserver2.hiveserver2_memory_heap_committed
mapr.hiveserver2.hiveserver2_memory_heap_init
mapr.hiveserver2.hiveserver2_memory_heap_max
mapr.hiveserver2.hiveserver2_memory_heap_usage
mapr.hiveserver2.hiveserver2_memory_heap_used
mapr.hiveserver2.hiveserver2_memory_non_heap_committed
mapr.hiveserver2.hiveserver2_memory_non_heap_init
mapr.hiveserver2.hiveserver2_memory_non_heap_max
mapr.hiveserver2.hiveserver2_memory_non_heap_usage
mapr.hiveserver2.hiveserver2_memory_non_heap_used
mapr.hiveserver2.hiveserver2_memory_pools_code_cache_usage
mapr.hiveserver2.hiveserver2_memory_pools_compressed_class_space_usage
mapr.hiveserver2.hiveserver2_memory_pools_metaspace_usage
mapr.hiveserver2.hiveserver2_memory_pools_ps_eden_space_usage
mapr.hiveserver2.hiveserver2_memory_pools_ps_old_gen_usage
mapr.hiveserver2.hiveserver2_memory_pools_ps_survivor_space_usage
mapr.hiveserver2.hiveserver2_memory_total_committed
mapr.hiveserver2.hiveserver2_memory_total_init
mapr.hiveserver2.hiveserver2_memory_total_max
mapr.hiveserver2.hiveserver2_memory_total_used
mapr.hiveserver2.hiveserver2_threads_blocked_count
mapr.hiveserver2.hiveserver2_threads_count
mapr.hiveserver2.hiveserver2_threads_daemon_count
mapr.hiveserver2.hiveserver2_threads_deadlock_count
mapr.hiveserver2.hiveserver2_threads_deadlocks
mapr.hiveserver2.hiveserver2_threads_new_count
mapr.hiveserver2.hiveserver2_threads_runnable_count
mapr.hiveserver2.hiveserver2_threads_terminated_count
mapr.hiveserver2.hiveserver2_threads_timed_waiting_count
mapr.hiveserver2.hiveserver2_threads_waiting_count
mapr.hiveserver2.hiveserver2_active_calls_api_get_all_databases
mapr.hiveserver2.hiveserver2_active_calls_api_get_all_functions
mapr.hiveserver2.hiveserver2_active_calls_api_get_all_tables
mapr.hiveserver2.hiveserver2_active_calls_api_get_database
mapr.hiveserver2.hiveserver2_active_calls_api_get_multi_table
mapr.hiveserver2.hiveserver2_active_calls_api_get_table_objects_by_name_req
mapr.hiveserver2.hiveserver2_active_calls_api_init
mapr.hiveserver2.hiveserver2_jvm_pause_extra_sleep_time
mapr.hiveserver2.hiveserver2_open_connections
mapr.hiveserver2.hiveserver2_api_get_all_databases_count
mapr.hiveserver2.hiveserver2_api_get_all_databases_max
mapr.hiveserver2.hiveserver2_api_get_all_databases_mean
mapr.hiveserver2.hiveserver2_api_get_all_databases_min
mapr.hiveserver2.hiveserver2_api_get_all_databases_p50
mapr.hiveserver2.hiveserver2_api_get_all_databases_p75
mapr.hiveserver2.hiveserver2_api_get_all_databases_p95
mapr.hiveserver2.hiveserver2_api_get_all_databases_p98
mapr.hiveserver2.hiveserver2_api_get_all_databases_p99
mapr.hiveserver2.hiveserver2_api_get_all_databases_p999
mapr.hiveserver2.hiveserver2_api_get_all_databases_stddev
mapr.hiveserver2.hiveserver2_api_get_all_databases_m15_rate
mapr.hiveserver2.hiveserver2_api_get_all_databases_m1_rate
mapr.hiveserver2.hiveserver2_api_get_all_databases_m5_rate
mapr.hiveserver2.hiveserver2_api_get_all_databases_mean_rate
mapr.hiveserver2.hiveserver2_api_get_all_functions_count
mapr.hiveserver2.hiveserver2_api_get_all_functions_max
mapr.hiveserver2.hiveserver2_api_get_all_functions_mean
mapr.hiveserver2.hiveserver2_api_get_all_functions_min
mapr.hiveserver2.hiveserver2_api_get_all_functions_p50
mapr.hiveserver2.hiveserver2_api_get_all_functions_p75
mapr.hiveserver2.hiveserver2_api_get_all_functions_p95
mapr.hiveserver2.hiveserver2_api_get_all_functions_p98
mapr.hiveserver2.hiveserver2_api_get_all_functions_p99
mapr.hiveserver2.hiveserver2_api_get_all_functions_p999
mapr.hiveserver2.hiveserver2_api_get_all_functions_stddev
mapr.hiveserver2.hiveserver2_api_get_all_functions_m15_rate
mapr.hiveserver2.hiveserver2_api_get_all_functions_m1_rate
mapr.hiveserver2.hiveserver2_api_get_all_functions_m5_rate
mapr.hiveserver2.hiveserver2_api_get_all_functions_mean_rate
mapr.hiveserver2.hiveserver2_api_get_all_tables_count
mapr.hiveserver2.hiveserver2_api_get_all_tables_max
mapr.hiveserver2.hiveserver2_api_get_all_tables_mean
mapr.hiveserver2.hiveserver2_api_get_all_tables_min
mapr.hiveserver2.hiveserver2_api_get_all_tables_p50
mapr.hiveserver2.hiveserver2_api_get_all_tables_p75
mapr.hiveserver2.hiveserver2_api_get_all_tables_p95
mapr.hiveserver2.hiveserver2_api_get_all_tables_p98
mapr.hiveserver2.hiveserver2_api_get_all_tables_p99
mapr.hiveserver2.hiveserver2_api_get_all_tables_p999
mapr.hiveserver2.hiveserver2_api_get_all_tables_stddev
mapr.hiveserver2.hiveserver2_api_get_all_tables_m15_rate
mapr.hiveserver2.hiveserver2_api_get_all_tables_m1_rate
mapr.hiveserver2.hiveserver2_api_get_all_tables_m5_rate
mapr.hiveserver2.hiveserver2_api_get_all_tables_mean_rate
mapr.hiveserver2.hiveserver2_api_get_multi_table_count
mapr.hiveserver2.hiveserver2_api_get_multi_table_max
mapr.hiveserver2.hiveserver2_api_get_multi_table_mean
mapr.hiveserver2.hiveserver2_api_get_multi_table_min
mapr.hiveserver2.hiveserver2_api_get_multi_table_p50
mapr.hiveserver2.hiveserver2_api_get_multi_table_p75
mapr.hiveserver2.hiveserver2_api_get_multi_table_p95
mapr.hiveserver2.hiveserver2_api_get_multi_table_p98
mapr.hiveserver2.hiveserver2_api_get_multi_table_p99
mapr.hiveserver2.hiveserver2_api_get_multi_table_p999
mapr.hiveserver2.hiveserver2_api_get_multi_table_stddev
mapr.hiveserver2.hiveserver2_api_get_multi_table_m15_rate
mapr.hiveserver2.hiveserver2_api_get_multi_table_m1_rate
mapr.hiveserver2.hiveserver2_api_get_multi_table_m5_rate
mapr.hiveserver2.hiveserver2_api_get_multi_table_mean_rate
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_count
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_max
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_mean
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_min
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p50
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p75
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p95
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p98
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p99
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p999
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_stddev
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m15_rate
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m1_rate
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m5_rate
mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_mean_rate
mapr.hiveserver2.hiveserver2_api_init_count
mapr.hiveserver2.hiveserver2_api_init_max
mapr.hiveserver2.hiveserver2_api_init_mean
mapr.hiveserver2.hiveserver2_api_init_min
mapr.hiveserver2.hiveserver2_api_init_p50
mapr.hiveserver2.hiveserver2_api_init_p75
mapr.hiveserver2.hiveserver2_api_init_p95
mapr.hiveserver2.hiveserver2_api_init_p98
mapr.hiveserver2.hiveserver2_api_init_p99
mapr.hiveserver2.hiveserver2_api_init_p999
mapr.hiveserver2.hiveserver2_api_init_stddev
mapr.hiveserver2.hiveserver2_api_init_m15_rate
mapr.hiveserver2.hiveserver2_api_init_m1_rate
mapr.hiveserver2.hiveserver2_api_init_m5_rate
mapr.hiveserver2.hiveserver2_api_init_mean_rate