Metrics
AIStor Server publishes cluster and node metrics using the Prometheus Data Model. You can use any scraping tool to pull metrics data from AIStor Server for further analysis and alerting.
Metrics version 3 adds metrics and endpoints beyond version 2. Existing deployments can continue to use version 2 metrics.
Version 3 endpoints
The base endpoint, without an added path, returns cluster, node, and per-bucket statistic metrics from /cluster/usage/buckets.
To scrape a specific category, append the desired path to the base /minio/metrics/v3 endpoint.
For example, the following endpoint returns audit metrics:
http://HOSTNAME:PORT/minio/metrics/v3/audit
Replace HOSTNAME:PORT with the FQDN and port of the MinIO AIStor deployment.
For deployments with a load balancer managing connections between MinIO AIStor nodes, specify the address of the load balancer.
Bucket-level metrics
The /cluster/usage/buckets path returns high level statistics for all buckets.
To scrape metrics for a specific bucket, specify the bucket name in the path as /bucket/<metric-group>/<bucket-name>.
For example, the following returns bucket-level API metrics for data:
http://HOSTNAME:PORT/minio/metrics/v3/bucket/api/data
You can use wildcard patterns to query metrics for multiple buckets at once:
*matches any sequence of characters?matches any single character
For example, /minio/metrics/v3/bucket/api/logs-* returns metrics for all buckets with names starting with logs-.
You can refine a wildcard query with the following query parameters:
ordersorts the matched buckets by name. Accepted values areasc(ascending, A to Z) anddesc(descending, Z to A). An invalid value returns a400 Bad Requestresponse.offsetskips the specified number of matched buckets before returning results, which you can use to page through large match sets. The default is0.
For example, the following endpoint sorts matching buckets in descending order and skips the first five:
http://HOSTNAME:PORT/minio/metrics/v3/bucket/api/*?order=desc&offset=5
Each request returns metrics for at most 10 buckets. If no buckets match the pattern, the request returns an empty result.
The following paths provide individual bucket metrics:
/bucket/api/bucket/batch/bucket/replication
List available metrics
You can list all available metrics by appending ?list to the appropriate endpoint.
For example, the following returns a list of available audit metrics:
http://HOSTNAME:PORT/minio/metrics/v3/audit?list
MinIO AIStor only returns metrics with populated values, ignoring any metrics with null or non-existant values.
To set the output format, set the request Content-Type to the desired format. Accepted values are application/json for JSON output or text/plain for a Markdown-formatted table.
The default is Markdown.
Authentication
By default, AIStor Server requires authentication to scrape the metrics endpoints.
mc admin prometheus generate signs the bearer token locally using the credentials of the mc alias you point it at.
For least-privilege scraping, create a dedicated access key with an inline policy that grants only the admin:Prometheus action, then generate the scrape configuration using an alias for that access key.
See Create a dedicated access key for Prometheus for the full procedure.
You can also disable metrics endpoint authentication by setting MINIO_PROMETHEUS_AUTH_TYPE to public.
Metric endpoints
AIStor Server provides the following scraping endpoints, relative to the base URL:
| Category | Path |
|---|---|
| API | /api/requests/bucket/api |
| Audit | /audit |
| Batch | /batch/bucket/batch |
| Cluster | /cluster/config/cluster/erasure-set/cluster/health/cluster/iam/cluster/usage/buckets/cluster/usage/objects |
| Debug | /debug/go |
| ILM | /ilm |
| Logger webhook | /logger/webhook |
| Notification | /notification |
| Replication | /replication/bucket/replication |
| Scanner | /scanner |
| System | /system/cpu/system/drive/system/memory/system/network/internode/system/process |
| Tables | /tables |
For a complete list of metrics for each endpoint, see Available metrics.
Available metrics
AIStor Server publishes a number of metrics at the cluster, node, or bucket levels. Each metric includes a label for the Object Store which generated that metric.
- API request metrics
- Audit metrics
- Batch metrics
- Cluster metrics
- Debug metrics
- ILM metrics
- Logger webhook metrics
- Notification metrics
- Replication metrics
- Scanner metrics
- System metrics
- Tables metrics
API request metrics
Metrics about requests served by the current node.
| Path | Description |
|---|---|
/api/requests |
Metrics over all requests. |
/bucket/api |
Metrics over all requests for a given bucket. |
/api/rdma |
Metrics about S3-over-RDMA (GPU-Direct) operations. |
/api/requests
| Name | Description | Labels |
|---|---|---|
minio_api_requests_rejected_auth_total |
Total number of requests rejected due to authentication failure Type: counter |
type, server |
minio_api_requests_rejected_header_total |
Total number of requests rejected due to invalid or malformed headers Type: counter |
type, server |
minio_api_requests_rejected_timestamp_total |
Total number of requests rejected due to invalid or expired timestamps Type: counter |
type, server |
minio_api_requests_rejected_invalid_total |
Total number of requests rejected due to invalid request format or parameters Type: counter |
type, server |
minio_api_requests_rejected_notimplemented_total |
Total number of requests rejected because the API operation is not implemented Type: counter |
type, server |
minio_api_requests_write_verification_failures_total |
Total number of PutObject/PutObjectPart requests that failed write verification. Tracks data integrity failures where the server could not verify the data was written correctly Type: counter |
type, server |
minio_api_requests_waiting_total |
Current number of requests waiting in the queue before being processed Type: gauge |
type, server |
minio_api_requests_incoming_total |
Current number of incoming requests being accepted by the server Type: gauge |
type, server |
minio_api_requests_inflight_total |
Current number of API requests actively being processed Type: gauge |
name, type, server |
minio_api_requests_total |
Total number of API requests processed since server start Type: counter |
name, type, server |
minio_api_requests_errors_total |
Total number of API requests that resulted in 4xx or 5xx error responses Type: counter |
name, type, server |
minio_api_requests_5xx_errors_total |
Total number of API requests that resulted in 5xx server error responses Type: counter |
name, type, server |
minio_api_requests_4xx_errors_total |
Total number of API requests that resulted in 4xx client error responses Type: counter |
name, type, server |
minio_api_requests_canceled_total |
Total number of API requests canceled by the client before completion Type: counter |
name, type, server |
minio_api_requests_ttfb_seconds_distribution |
Histogram distribution of time to first byte (TTFB) in seconds for API requests Type: counter |
name, type, le, server |
minio_api_requests_duration_total |
Total cumulative duration of all API requests in milliseconds since server start Type: counter |
name, type, server |
minio_api_requests_traffic_sent_bytes |
Total number of bytes sent in API responses since server start Type: counter |
type, server |
minio_api_requests_traffic_received_bytes |
Total number of bytes received in API requests since server start Type: counter |
type, server |
minio_api_requests_stale_multipart_drive_purged_total |
Total stale multipart upload entries purged, node-level total across all drives Type: counter |
server |
minio_api_requests_stale_multipart_drive_cleanup_cycles_total |
Total stale multipart cleanup cycles completed, node-level total across all drives Type: counter |
server |
minio_api_requests_stale_multipart_last_cleanup_seconds |
Seconds since the most recent stale multipart cleanup cycle completed on this node Type: gauge |
server |
Note: The minio_api_requests_ttfb_seconds_distribution metric tracks TTFB for all API operations including both read operations (for example, GetObject) and write operations (for example, PutObject).
/bucket/api
| Name | Description | Labels |
|---|---|---|
minio_bucket_api_traffic_received_bytes |
Total number of bytes received for a bucket Type: counter |
bucket, type, server |
minio_bucket_api_traffic_sent_bytes |
Total number of bytes sent for a bucket Type: counter |
bucket, type, server |
minio_bucket_api_inflight_total |
Total number of requests currently in flight for a bucket Type: gauge |
bucket, name, type, server |
minio_bucket_api_total |
Total number of requests for a bucket Type: counter |
bucket, name, type, server |
minio_bucket_api_canceled_total |
Total number of requests canceled by the client for a bucket Type: counter |
bucket, name, type, server |
minio_bucket_api_4xx_errors_total |
Total number of requests with 4xx errors for a bucket Type: counter |
bucket, name, type, server |
minio_bucket_api_5xx_errors_total |
Total number of requests with 5xx errors for a bucket Type: counter |
bucket, name, type, server |
minio_bucket_api_ttfb_seconds_distribution |
Distribution of time to first byte across API calls for a bucket Type: counter |
bucket, name, le, type, server |
minio_bucket_api_last_minute_qos_throttled_total |
Total number of requests throttled by QoS in the last minute for a bucket Type: gauge |
bucket, name, ruleID, prefix, server |
minio_bucket_api_qos_req_configured_counts_per_second |
Total number of requests configured by QoS per second for a bucket Type: gauge |
bucket, name, ruleID, prefix, server |
minio_bucket_api_last_minute_qos_rate_limit_exceeded_counts |
Total number of requests exceeding rate limit for a bucket in the last full minute Type: gauge |
bucket, name, ruleID, prefix, server |
/api/rdma
Metrics about S3-over-RDMA (GPU-Direct) operations.
| Name | Description | Labels |
|---|---|---|
minio_api_rdma_write_bytes_total |
Total bytes written via S3-over-RDMA (GPU-Direct) Type: counter |
server |
minio_api_rdma_read_bytes_total |
Total bytes read via S3-over-RDMA (GPU-Direct) Type: counter |
server |
minio_api_rdma_write_ops_total |
Total S3-over-RDMA write operations (GPU-Direct) Type: counter |
server |
minio_api_rdma_read_ops_total |
Total S3-over-RDMA read operations (GPU-Direct) Type: counter |
server |
minio_api_rdma_errors_total |
Total S3-over-RDMA errors by category (GPU-Direct) Type: counter |
category, server |
Audit metrics
Metrics about the MinIO audit functionality.
| Path | Description |
|---|---|
/audit |
Metrics related to audit functionality. |
/audit
| Name | Description | Labels |
|---|---|---|
minio_audit_failed_messages |
Total number of messages that failed to send since start Type: counter |
target_id, server |
minio_audit_target_queue_length |
Number of unsent messages in queue for target Type: gauge |
target_id, server |
minio_audit_total_messages |
Total number of messages sent since start Type: counter |
target_id, server |
minio_audit_global_queue_size |
Total number of events in queue for all targets Type: counter |
target_id, server |
minio_audit_total_requests |
Total number of requests made to the audit endpoint Type: counter |
target_id, server |
minio_audit_failed_requests |
Total number of failed requests when sending to the audit endpoint Type: counter |
target_id, server |
minio_audit_total_targets |
Total number of audit endpoint targets Type: counter |
target_id, server |
minio_audit_worker_count |
Total number of async audit workers Type: counter |
target_id, server |
minio_audit_disk_size |
Total size on disk in bytes, for the global audit event queue Type: counter |
target_id, server |
minio_audit_disk_file_count |
Total number of files on disk related to the global audit event queue Type: counter |
target_id, server |
Note: The target_id label uses the format <type> for default targets (for example, http, kafka) or <type>_<name> for named targets (for example, http_1, kafka_main) where type is the audit target type and name is the configured target identifier.
Batch metrics
Metrics about the MinIO batch jobs.
| Path | Description |
|---|---|
/batch |
Metrics related to batch jobs. |
/bucket/batch |
Metrics related to batch jobs by bucket. |
/batch
| Name | Description | Labels |
|---|---|---|
minio_batch_jobs_completed |
Number of completed batch jobs Type: gauge |
type, server |
minio_batch_jobs_failed |
Number of failed batch jobs Type: gauge |
type, server |
minio_batch_jobs_in_progress |
Number of in-progress batch jobs Type: gauge |
type, server |
Note: The type label indicates the batch job type: catalog, expire, keyrotate, or replicate.
/bucket/batch
| Name | Description | Labels |
|---|---|---|
minio_bucket_batch_objects_completed |
Number of objects successfully processed by batch jobs for this bucket Type: gauge |
bucket, type, server |
minio_bucket_batch_objects_failed |
Number of objects that failed processing by batch jobs for this bucket Type: gauge |
bucket, type, server |
Note: The type label indicates the batch job type: catalog, expire, keyrotate, or replicate.
Cluster metrics
Metrics about an entire MinIO cluster.
| Path | Description |
|---|---|
/cluster/config |
Cluster configuration metrics. |
/cluster/erasure-set |
Erasure set metrics. |
/cluster/health |
Cluster health metrics. |
/cluster/iam |
Cluster iam metrics. |
/cluster/replication |
Cluster site replication metrics. |
/cluster/usage/buckets |
Object statistics by bucket. |
/cluster/usage/objects |
Object statistics. |
/cluster/config
| Name | Description | Labels |
|---|---|---|
minio_cluster_config_rrs_parity |
Reduced redundancy storage class parity Type: gauge |
- |
minio_cluster_config_standard_parity |
Standard storage class parity Type: gauge |
- |
minio_cluster_config_license_expires_in |
Seconds until license expires (-1 for never) Type: gauge |
- |
minio_cluster_config_license_status |
License operational status: normal (full functionality), readonly (reads only), offline (no I/O) Type: gauge |
state |
minio_cluster_config_license_renewal_status |
License renewal status: success, failed, expired, or disabled Type: gauge |
result |
/cluster/erasure-set
| Name | Description | Labels |
|---|---|---|
minio_cluster_erasure_set_overall_write_quorum |
Overall write quorum across pools and sets Type: gauge |
- |
minio_cluster_erasure_set_overall_health |
Overall health across pools and sets (1=healthy, 0=unhealthy) Type: gauge |
- |
minio_cluster_erasure_set_read_quorum |
Read quorum for the erasure set in a pool Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_write_quorum |
Write quorum for the erasure set in a pool Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_online_drives_count |
Count of online drives in the erasure set in a pool Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_healing_drives_count |
Count of healing drives in the erasure set in a pool Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_health |
Health of the erasure set in a pool (1=healthy, 0=unhealthy) Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_read_tolerance |
Number of drive failures that can be tolerated without disrupting read operations Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_write_tolerance |
Number of drive failures that can be tolerated without disrupting write operations Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_read_health |
Health of the erasure set in a pool for read operations (1=healthy, 0=unhealthy) Type: gauge |
pool_id, set_id |
minio_cluster_erasure_set_write_health |
Health of the erasure set in a pool for write operations (1=healthy, 0=unhealthy) Type: gauge |
pool_id, set_id |
/cluster/health
| Name | Description | Labels |
|---|---|---|
minio_cluster_health_drives_offline_count |
Count of offline drives in the cluster Type: gauge |
- |
minio_cluster_health_drives_online_count |
Count of online drives in the cluster Type: gauge |
- |
minio_cluster_health_drives_count |
Count of all drives in the cluster Type: gauge |
- |
minio_cluster_health_nodes_offline_count |
Count of offline nodes in the cluster Type: gauge |
- |
minio_cluster_health_nodes_online_count |
Count of online nodes in the cluster Type: gauge |
- |
minio_cluster_health_capacity_raw_total_bytes |
Total cluster raw storage capacity in bytes Type: gauge |
- |
minio_cluster_health_capacity_raw_free_bytes |
Total cluster raw storage free in bytes Type: gauge |
- |
minio_cluster_health_capacity_usable_total_bytes |
Total cluster usable storage capacity in bytes Type: gauge |
- |
minio_cluster_health_capacity_usable_free_bytes |
Total cluster usable storage free in bytes Type: gauge |
- |
/iam
| Name | Description | Labels |
|---|---|---|
minio_iam_last_sync_duration_millis |
Last successful IAM data sync duration in milliseconds Type: counter |
server |
minio_iam_plugin_authn_service_failed_requests_minute |
When plugin authentication is configured, returns failed requests count in the last full minute Type: counter |
server |
minio_iam_plugin_authn_service_last_fail_seconds |
When plugin authentication is configured, returns time (in seconds) since the last failed request to the service Type: counter |
server |
minio_iam_plugin_authn_service_last_succ_seconds |
When plugin authentication is configured, returns time (in seconds) since the last successful request to the service Type: counter |
server |
minio_iam_plugin_authn_service_succ_avg_rtt_ms_minute |
When plugin authentication is configured, returns average round-trip time of successful requests in the last full minute Type: counter |
server |
minio_iam_plugin_authn_service_succ_max_rtt_ms_minute |
When plugin authentication is configured, returns maximum round-trip time of successful requests in the last full minute Type: counter |
server |
minio_iam_plugin_authn_service_total_requests_minute |
When plugin authentication is configured, returns total requests count in the last full minute Type: counter |
server |
minio_iam_since_last_sync_millis |
Time (in milliseconds) since last successful IAM data sync. Type: counter |
server |
minio_iam_sync_failures |
Number of failed IAM data syncs since server start. Type: counter |
server |
minio_iam_sync_successes |
Number of successful IAM data syncs since server start. Type: counter |
server |
minio_iam_ldap_idp_health |
LDAP IDP connectivity health check status (1 = successful, 0 = failed) Type: gauge |
server |
/cluster/replication
| Name | Description | Labels |
|---|---|---|
minio_cluster_replication_received_bytes |
Total number of bytes replicated to this cluster from site replication peer Type: counter |
- |
minio_cluster_replication_received_count |
Total number of objects received by this cluster Type: gauge |
- |
minio_cluster_replication_proxied_get_request_total |
Number of GET requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_head_request_total |
Number of HEAD requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_put_tagging_request_total |
Number of PUT tagging requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_get_tagging_request_total |
Number of GET tagging requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_delete_tagging_request_total |
Number of DELETE tagging requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_get_request_failures |
Number of failures in GET requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_head_request_failures |
Number of failures in HEAD requests proxied to replication target Type: counter |
- |
minio_cluster_replication_proxied_put_tagging_request_failures |
Number of failures in PUT tagging proxy requests to replication target Type: counter |
- |
minio_cluster_replication_proxied_get_tagging_request_failures |
Number of failures in GET tagging proxy requests to replication target Type: counter |
- |
minio_cluster_replication_proxied_delete_tagging_request_failures |
Number of failures in DELETE tagging proxy requests to replication target Type: counter |
- |
minio_cluster_replication_queued_bytes |
Number of bytes queued for site replication Type: gauge |
- |
minio_cluster_replication_queued_count |
Number of objects queued for site replication Type: gauge |
- |
minio_cluster_replication_in_progress_bytes |
Number of bytes currently being replicated for site replication Type: gauge |
- |
minio_cluster_replication_in_progress_count |
Number of objects currently being replicated for site replication Type: gauge |
- |
minio_cluster_replication_active_workers |
Current number of active site replication workers Type: gauge |
- |
minio_cluster_replication_retries_last_hour |
Number of site replication retries in the last hour Type: gauge |
- |
minio_cluster_replication_retries_last_minute |
Number of site replication retries in the last minute Type: gauge |
- |
minio_cluster_replication_retries_total |
Total number of site replication retries since server start Type: counter |
- |
minio_cluster_replication_errors_last_hour |
Number of site replication errors in the last hour Type: gauge |
- |
minio_cluster_replication_errors_last_minute |
Number of site replication errors in the last minute Type: gauge |
- |
minio_cluster_replication_errors_total |
Total number of site replication errors since server start Type: counter |
- |
minio_cluster_replication_sent_bytes |
Total number of bytes replicated to the target Type: counter |
endpoint |
minio_cluster_replication_sent_count |
Total number of objects replicated to the target Type: gauge |
endpoint |
minio_cluster_replication_last_minute_failed_bytes |
Total number of bytes failed at least once to replicate in the last full minute Type: gauge |
endpoint |
minio_cluster_replication_last_minute_failed_count |
Total number of objects which failed replication in the last full minute Type: gauge |
endpoint |
minio_cluster_replication_last_hour_failed_bytes |
Total number of bytes failed at least once to replicate in the last hour Type: gauge |
endpoint |
minio_cluster_replication_last_hour_failed_count |
Total number of objects which failed replication in the last hour Type: gauge |
endpoint |
minio_cluster_replication_total_failed_bytes |
Total number of bytes failed at least once to replicate since server uptime Type: counter |
endpoint |
minio_cluster_replication_total_failed_count |
Total number of objects which failed replication since server uptime Type: counter |
endpoint |
minio_cluster_replication_credential_errors |
Total number of credential errors in site replication Type: counter |
endpoint |
/cluster/usage/buckets
| Name | Description | Labels |
|---|---|---|
minio_cluster_usage_buckets_since_last_update_seconds |
Time since last update of usage metrics in seconds Type: gauge |
- |
minio_cluster_usage_buckets_total_bytes |
Total bucket size in bytes Type: gauge |
bucket |
minio_cluster_usage_buckets_objects_count |
Total objects count in bucket Type: gauge |
bucket |
minio_cluster_usage_buckets_versions_count |
Total object versions count in bucket, including delete markers Type: gauge |
bucket |
minio_cluster_usage_buckets_delete_markers_count |
Total delete markers count in bucket Type: gauge |
bucket |
minio_cluster_usage_buckets_quota_total_bytes |
Total bucket quota in bytes Type: gauge |
bucket |
minio_cluster_usage_buckets_object_size_distribution |
Bucket object size distribution Type: gauge |
range, bucket |
minio_cluster_usage_buckets_object_version_count_distribution |
Bucket object version count distribution Type: gauge |
range, bucket |
minio_cluster_usage_buckets_object_age_distribution |
Bucket object age distribution Type: gauge |
range, bucket |
minio_cluster_usage_buckets_shards_distribution |
Per-bucket distribution of failed shard writes Type: gauge |
missing_shards, bucket |
minio_cluster_usage_buckets_shards_legacy_count |
Per-bucket count of object versions without shard write status information Type: gauge |
bucket |
/cluster/usage/objects
| Name | Description | Labels |
|---|---|---|
minio_cluster_usage_objects_since_last_update_seconds |
Time since last update of usage metrics in seconds Type: gauge |
- |
minio_cluster_usage_objects_total_bytes |
Total cluster usage in bytes Type: gauge |
- |
minio_cluster_usage_objects_count |
Total cluster objects count Type: gauge |
- |
minio_cluster_usage_objects_versions_count |
Total cluster object versions count, including delete markers Type: gauge |
- |
minio_cluster_usage_objects_delete_markers_count |
Total cluster delete markers count Type: gauge |
- |
minio_cluster_usage_objects_buckets_count |
Total cluster buckets count Type: gauge |
- |
minio_cluster_usage_objects_size_distribution |
Cluster object size distribution Type: gauge |
range |
minio_cluster_usage_objects_version_count_distribution |
Cluster object version count distribution Type: gauge |
range |
minio_cluster_usage_objects_age_distribution |
Cluster object age distribution Type: gauge |
range |
minio_cluster_usage_objects_shards_distribution |
Cluster-wide distribution of failed shard writes Type: gauge |
missing_shards |
minio_cluster_usage_objects_shards_legacy |
Cluster-wide count of object versions without shard write status information Type: gauge |
- |
Debug metrics
Standard Go runtime metrics from the Prometheus Go Client base collector.
| Path | Description |
|---|---|
/debug/go |
Go runtime metrics. |
/debug/erasure-sets |
Erasure sets debug metrics. |
/debug/heal |
Healing debug metrics. |
/debug/erasure-sets
| Name | Description | Labels |
|---|---|---|
minio_debug_erasure_sets_shards_health |
Health of the shards in a given erasure set Type: gauge |
pool_id, set_id, drive_id, server |
/debug/heal
Debug metrics for healing operations.
| Name | Description | Labels |
|---|---|---|
minio_debug_heal_manual_intervention_total |
Total objects requiring manual intervention Type: counter |
server |
minio_debug_heal_undecided_total |
Total objects in undecided state Type: counter |
server |
minio_debug_heal_transitioned_object_total |
Total transitioned objects skipped from dangling detection Type: counter |
server |
minio_debug_heal_non_actionable_errors_total |
Total number of objects with non-actionable errors that cannot be automatically healed Type: counter |
server |
STDOUT metrics
| Path | Description |
|---|---|
/stdout |
Metrics related to stdout. |
/stdout
| Name | Description | Labels |
|---|---|---|
minio_stdout_failed_messages |
Total number of logs that failed to send since start Type: counter |
target_id, server |
minio_stdout_target_queue_length |
Number of unsent logs in queue for the specific target Type: gauge |
target_id, server |
minio_stdout_total_messages |
Total number of logs sent since start Type: counter |
target_id, server |
minio_stdout_global_queue_size |
Total number of logs in queue for all targets Type: counter |
target_id, server |
minio_stdout_total_targets |
Total number of system endpoint targets Type: counter |
target_id, server |
ILM metrics
Metrics about the MinIO ILM functionality.
| Path | Description |
|---|---|
/ilm |
Metrics related to ILM functionality. |
/ilm
| Name | Description | Labels |
|---|---|---|
minio_ilm_expiry_pending_tasks |
Number of pending ILM expiry tasks in the queue Type: gauge |
server |
minio_ilm_transition_active_tasks |
Number of active ILM transition tasks Type: gauge |
server |
minio_ilm_transition_pending_tasks |
Number of pending ILM transition tasks in the queue Type: gauge |
server |
minio_ilm_transition_missed_immediate_tasks |
Number of missed immediate ILM transition tasks Type: counter |
server |
minio_ilm_versions_scanned |
Total number of object versions checked for ILM actions since server start Type: counter |
server |
minio_ilm_transitioned_bytes |
Total bytes transitioned to a tier Type: gauge |
tier, server |
minio_ilm_transitioned_objects |
Total number of objects transitioned to a tier Type: gauge |
tier, server |
minio_ilm_transitioned_versions |
Total number of versions transitioned to a tier Type: gauge |
tier, server |
minio_ilm_expiry_missed_free_versions |
Number of missed free version deletion tasks Type: counter |
server |
minio_ilm_expiry_missed_tasks |
Number of missed ILM expiry tasks Type: counter |
server |
minio_ilm_expiry_missed_tier_journal_tasks |
Number of missed tier journal tasks Type: counter |
server |
minio_ilm_expiry_num_workers |
Current size of the ILM expiry worker pool Type: gauge |
server |
minio_ilm_transition_num_workers |
Current size of the ILM transition worker pool Type: gauge |
server |
minio_ilm_action_count_delete |
Total action outcome of lifecycle checks for deleting object Type: counter |
server |
minio_ilm_action_count_delete_version |
Total action outcome of lifecycle checks for deleting object version Type: counter |
server |
minio_ilm_action_count_delete_all_versions |
Total action outcome of lifecycle checks for deleting all object versions Type: counter |
server |
minio_ilm_action_count_transition |
Total action outcome of lifecycle checks for transitioning object Type: counter |
server |
minio_ilm_action_count_transition_version |
Total action outcome of lifecycle checks for transitioning object version Type: counter |
server |
minio_ilm_action_count_delete_restored |
Total action outcome of lifecycle checks for deleting restored object Type: counter |
server |
minio_ilm_action_count_delete_restored_version |
Total action outcome of lifecycle checks for deleting restored object version Type: counter |
server |
KMS metrics
Metrics about MinIO AIStor Key Management Server (KMS).
| Path | Description |
|---|---|
/kms |
Metrics related to KMS requests. |
/kms
| Name | Description | Labels |
|---|---|---|
minio_kms_request_succeeded |
Total number of successful KMS requests Type: counter |
server |
minio_kms_request_failed_internal |
Total number of KMS requests that failed due to some internal failure (HTTP 5xx status code) Type: counter |
server |
minio_kms_request_failed_error |
Total number of KMS requests that failed due to some error (HTTP 4xx status code) Type: counter |
server |
minio_kms_online |
Status of KMS cluster reachability (1=online, 0=offline). Tracks aggregate cluster state since KMS/KES SDKs use round-robin but don’t expose which endpoint serves each successful request Type: gauge |
server |
minio_kms_online_seconds |
Duration in seconds that MinIO has maintained successful connectivity with the KMS cluster. Aggregate metric since SDKs don’t expose per-endpoint request routing Type: gauge |
server |
minio_kms_request_duration_seconds_distribution |
Histogram distribution of KMS request durations (aggregate across KMS/KES cluster). SDKs use round-robin but don’t expose which endpoint served each request. Use with Prometheus histogram_quantile() for percentiles Type: histogram |
le, server |
Webhook metrics
Metrics about MinIO webhook targets (audit and system logger webhooks).
| Path | Description |
|---|---|
/webhook |
Metrics related to webhook targets. |
/webhook
| Name | Description | Labels |
|---|---|---|
minio_webhook_online |
Is the webhook online (1=online, 0=offline) Type: gauge |
name, endpoint, server |
minio_webhook_queue_length |
Webhook queue length Type: gauge |
name, endpoint, server |
minio_webhook_total_messages |
Total number of messages sent to this webhook target Type: counter |
name, endpoint, server |
minio_webhook_failed_messages |
Total number of messages that failed to send to this webhook target Type: counter |
name, endpoint, server |
Notification metrics
Metrics about the MinIO notification functionality.
| Path | Description |
|---|---|
/notification |
Metrics related to notification functionality. |
/notification
| Name | Description | Labels |
|---|---|---|
minio_notification_events_errors_total |
Total number of events that failed to send to the targets Type: counter |
server |
minio_notification_events_send_in_progress |
Number of concurrent async Send calls active to all targets Type: counter |
server |
minio_notification_events_sent_total |
Total number of events sent to the targets Type: counter |
server |
minio_notification_events_skipped_total |
Number of events not sent to the targets due to the in-memory queue being full Type: counter |
server |
minio_notification_target_current_send_in_progress |
Number of concurrent async Send calls active for this target Type: gauge |
target_id, server |
minio_notification_target_queue_length |
Number of unsent notifications in queue for this target Type: gauge |
target_id, server |
minio_notification_target_total_events |
Total number of events sent to this target Type: counter |
target_id, server |
minio_notification_target_failed_events |
Total number of failed events for this target Type: counter |
target_id, server |
Note: The target_id label uses the format <type> for default targets (for example, webhook, kafka) or <type>_<name> for named targets (for example, webhook_1, kafka_primary) where type is the notification target type, such as webhook, kafka, or amqp, and name is the configured target identifier.
Replication metrics
Metrics about MinIO site and bucket replication.
| Path | Description |
|---|---|
/bucket/replication |
Metrics related to bucket replication. |
/replication |
Metrics related to site replication. |
/bucket/replication
| Name | Description | Labels |
|---|---|---|
minio_bucket_replication_last_hour_failed_bytes |
Total number of bytes on a bucket which failed to replicate at least once in the last hour Type: gauge |
bucket, targetArn, server |
minio_bucket_replication_last_hour_failed_count |
Total number of objects on a bucket which failed to replicate in the last hour Type: gauge |
bucket, targetArn, server |
minio_bucket_replication_last_minute_failed_bytes |
Total number of bytes on a bucket which failed at least once in the last full minute Type: gauge |
bucket, targetArn, server |
minio_bucket_replication_last_minute_failed_count |
Total number of objects on a bucket which failed to replicate in the last full minute Type: gauge |
bucket, targetArn, server |
minio_bucket_replication_latency_ms |
Replication latency on a bucket in milliseconds Type: gauge |
bucket, operation, range, targetArn, server |
minio_bucket_replication_proxied_delete_tagging_requests_total |
Number of DELETE tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_get_requests_failures |
Number of failures in GET requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_get_requests_total |
Number of GET requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_get_tagging_requests_failures |
Number of failures in GET tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_get_tagging_requests_total |
Number of GET tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_head_requests_failures |
Number of failures in HEAD requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_head_requests_total |
Number of HEAD requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_put_tagging_requests_failures |
Number of failures in PUT tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_put_tagging_requests_total |
Number of PUT tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_sent_bytes |
Total number of bytes replicated to the target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_sent_count |
Total number of objects replicated to the target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_received_count |
Total number of objects received from the source Type: counter |
bucket, server |
minio_bucket_replication_received_bytes |
Total number of bytes received from the source Type: counter |
bucket, server |
minio_bucket_replication_total_failed_bytes |
Total number of bytes failed to replicate at least once since server start Type: counter |
bucket, targetArn, server |
minio_bucket_replication_total_failed_count |
Total number of objects that failed to replicate since server start Type: counter |
bucket, targetArn, server |
minio_bucket_replication_proxied_delete_tagging_requests_failures |
Number of failures in DELETE tagging requests proxied to replication target Type: counter |
bucket, targetArn, server |
minio_bucket_replication_credential_errors |
Total number of credential errors in bucket replication since server start Type: counter |
bucket, targetArn, server |
/replication
| Name | Description | Labels |
|---|---|---|
minio_replication_average_active_workers |
Average number of active replication workers Type: gauge |
server |
minio_replication_average_queued_bytes |
Average number of bytes queued for replication since server start Type: gauge |
server |
minio_replication_average_queued_count |
Average number of objects queued for replication since server start Type: gauge |
server |
minio_replication_average_transfer_rate |
Average replication data transfer rate in bytes/sec Type: gauge |
server |
minio_replication_current_active_workers |
Total number of active replication workers Type: gauge |
server |
minio_replication_current_transfer_rate |
Current replication data transfer rate in bytes/sec Type: gauge |
server |
minio_replication_last_minute_queued_bytes |
Number of bytes queued for replication in the last full minute Type: gauge |
server |
minio_replication_last_minute_queued_count |
Number of objects queued for replication in the last full minute Type: gauge |
server |
minio_replication_max_active_workers |
Maximum number of active replication workers seen since server start Type: gauge |
server |
minio_replication_max_queued_bytes |
Maximum number of bytes queued for replication since server start Type: gauge |
server |
minio_replication_max_queued_count |
Maximum number of objects queued for replication since server start Type: gauge |
server |
minio_replication_max_transfer_rate |
Maximum replication data transfer rate in bytes/sec since server start Type: gauge |
server |
minio_replication_recent_backlog_count |
Total number of objects seen in replication backlog in the last 5 minutes Type: gauge |
server |
minio_replication_average_link_latency_ms |
Average replication link latency in milliseconds Type: gauge |
endpoint, server |
minio_replication_current_link_latency_ms |
Current replication link latency in milliseconds Type: gauge |
endpoint, server |
minio_replication_max_link_latency_ms |
Maximum replication link latency in milliseconds Type: gauge |
endpoint, server |
minio_replication_link_online |
Replication link online status (1 for online, 0 for offline) Type: gauge |
endpoint, server |
minio_replication_link_offline_duration_seconds |
Total time replication link has been offline in seconds Type: counter |
endpoint, server |
minio_replication_link_downtime_duration_seconds |
Total downtime duration for replication link in seconds Type: counter |
endpoint, server |
minio_replication_missed_threshold_total |
Total count of S3 RTC MissedThreshold events (replication failed after exceeding the configured threshold) Type: counter |
server |
minio_replication_replicated_after_threshold_total |
Total count of S3 RTC ReplicatedAfterThreshold events (replication succeeded but exceeded the configured threshold) Type: counter |
server |
Scanner metrics
Metrics about the MinIO scanner.
| Path | Description |
|---|---|
/scanner |
Metrics related to the MinIO scanner. |
/scanner
| Name | Description | Labels |
|---|---|---|
minio_scanner_bucket_scans_finished |
Total number of bucket scans completed since server start Type: counter |
server |
minio_scanner_bucket_scans_started |
Total number of bucket scans started since server start Type: counter |
server |
minio_scanner_directories_scanned |
Total number of directories scanned since server start Type: counter |
server |
minio_scanner_objects_scanned |
Total number of unique objects scanned since server start Type: counter |
server |
minio_scanner_versions_scanned |
Total number of object versions scanned since server start Type: counter |
server |
minio_scanner_last_activity_seconds |
Time elapsed (in seconds) since last scan activity Type: gauge |
server |
Healing metrics
Metrics about MinIO self-healing functionality.
| Path | Description |
|---|---|
/heal |
Metrics related to healing activity. |
/heal
| Name | Description | Labels |
|---|---|---|
minio_heal_objects_total |
Objects scanned in current self healing run Type: counter |
type, server |
minio_heal_objects_heal_total |
Objects healed in current self healing run Type: counter |
type, server |
minio_heal_objects_errors_total |
Objects for which healing failed in current self healing run Type: counter |
type, server |
minio_heal_objects_lock_errors_total |
Objects with locking conflict/timeout errors since server uptime Type: counter |
server |
minio_heal_time_last_activity_seconds |
Time elapsed in seconds since last self healing activity Type: gauge |
server |
minio_heal_dangling_objects_total |
Total dangling objects detected, by action taken Type: counter |
action, server |
minio_heal_dangling_bytes_total |
Total bytes of dangling objects detected, by action taken Type: counter |
action, server |
minio_heal_quarantine_drive_purged_total |
Total quarantined entries purged after expiry, node-level total across all drives Type: counter |
server |
minio_heal_quarantine_drive_purged_bytes_total |
Total bytes purged from quarantine after expiry, node-level total across all drives Type: counter |
server |
Lambda metrics
Metrics about MinIO lambda event targets.
| Path | Description |
|---|---|
/lambda |
Metrics related to lambda event targets. |
/lambda
| Name | Description | Labels |
|---|---|---|
minio_lambda_active_requests |
Number of in progress lambda requests Type: gauge |
target_id, server |
minio_lambda_total_requests |
Total number of lambda requests sent since start Type: counter |
target_id, server |
minio_lambda_failed_requests |
Total number of lambda requests that failed to send since start Type: counter |
target_id, server |
Note: The target_id label uses the format <type> for default targets (for example, webhook) or <type>_<name> for named targets (for example, webhook_1) where type is the lambda target type and name is the configured target identifier.
Locks metrics
Metrics about distributed locks in MinIO.
| Path | Description |
|---|---|
/locks |
Metrics related to distributed locks. |
/locks
| Name | Description | Labels |
|---|---|---|
minio_locks_total |
Number of current locks on this peer Type: gauge |
server |
minio_locks_dropped |
Number of dropped calls of any lock APIs Type: gauge |
server |
minio_locks_timeout |
Number of timed out calls of any lock APIs Type: gauge |
server |
minio_locks_expired |
Number of expired locks on this peer Type: gauge |
server |
minio_locks_dist_max_latency |
Maximum recorded time of the execution of network lock APIs in nanoseconds, during the last minute Type: gauge |
server |
minio_locks_dist_avg_latency |
Highest per-location average time of network lock API execution in nanoseconds, during the last minute Type: gauge |
server |
minio_locks_local_max_latency |
Maximum recorded time of the execution of local lock APIs in nanoseconds, during the last minute Type: gauge |
server |
minio_locks_local_avg_latency |
Highest per-location average time of local lock API execution in nanoseconds, during the last minute Type: gauge |
server |
Software metrics
Metrics about MinIO software version information.
| Path | Description |
|---|---|
/software |
Metrics related to software version details. |
/software
| Name | Description | Labels |
|---|---|---|
minio_software_version_info |
MinIO Release tag for the server Type: gauge |
version, server |
minio_software_commit_info |
Git commit hash for the MinIO release Type: gauge |
commit, server |
Tier metrics
Metrics about MinIO tiering functionality.
| Path | Description |
|---|---|
/tier |
Metrics related to tiering activity. |
/tier
| Name | Description | Labels |
|---|---|---|
minio_tier_ttlb_seconds_distribution |
Distribution of time to last byte for tiering requests Type: histogram |
tier, le, server |
minio_tier_requests_success |
Number of requests to download object from warm tier that were successful Type: counter |
tier, server |
minio_tier_requests_failure |
Number of requests to download object from warm tier that were failure Type: counter |
tier, server |
System metrics
Metrics about the MinIO process and the node.
| Path | Description |
|---|---|
/system/cpu |
Metrics about CPUs on the system. |
/system/drive |
Metrics about drives on the system. |
/system/drive/smart |
S.M.A.R.T. disk health metrics. |
/system/network/internode |
Metrics about internode requests made by the node. |
/system/network/internode/rdma |
Metrics about internode RDMA network communication. |
/system/network/interface |
Metrics about network interfaces on the system. |
/system/memory |
Metrics about memory on the system. |
/system/process |
Standard process metrics. |
/system/drive
| Name | Description | Labels |
|---|---|---|
minio_system_drive_used_bytes |
Total storage used on a drive in bytes Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_free_bytes |
Total storage free on a drive in bytes Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_total_bytes |
Total storage available on a drive in bytes Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_used_inodes |
Total used inodes on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_free_inodes |
Total free inodes on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_total_inodes |
Total inodes available on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_timeout_errors_total |
Total timeout errors on a drive Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_io_errors_total |
Total I/O errors on a drive Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_availability_errors_total |
Total availability errors (I/O errors, timeouts) on a drive Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_waiting_io |
Total waiting I/O operations on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_api_latency_micros |
Average last minute latency in µs for drive API storage operations Type: gauge |
drive, pool_index, set_index, drive_index, api, server |
minio_system_drive_health |
Drive health (0 = offline, 1 = healthy, 2 = healing) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_offline_count |
Count of offline drives Type: gauge |
server |
minio_system_drive_online_count |
Count of online drives Type: gauge |
server |
minio_system_drive_count |
Count of all drives Type: gauge |
server |
minio_system_drive_reads_per_sec |
Reads per second on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_reads_kb_per_sec |
Kilobytes read per second on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_reads_await |
Average time for read requests served on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_writes_per_sec |
Writes per second on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_writes_kb_per_sec |
Kilobytes written per second on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_writes_await |
Average time for write requests served on a drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_perc_util |
Percentage of time the drive was busy Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_capacity |
Total configured cache capacity Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_used |
Total drive cache currently used Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_hits |
Total drive cache hits Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_misses |
Total drive cache misses Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_delete_hits |
Total drive cache delete hits Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_delete_misses |
Total drive cache delete misses Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_cache_collisions |
Total drive cache collisions Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_corruption_detected_total |
Total number of silent data corruption errors (bitrot) detected on the drive since server start Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_corruption_healed_total |
Total number of corrupted objects healed on the drive since server start Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_trash_purged_bytes_total |
Total bytes purged from the drive’s trash directory Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_trash_purged_objects_total |
Total entries purged from the drive’s trash directory Type: counter |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_trash_last_cleanup_seconds |
Seconds since the last trash cleanup completed on the drive Type: gauge |
drive, pool_index, set_index, drive_index, server |
/system/drive/smart
S.M.A.R.T. (Self-Monitoring, Analysis and Reporting Technology) metrics for proactive drive failure detection. MinIO AIStor collects health telemetry directly from NVMe and SATA drives using native Linux ioctl calls without external dependencies.
S.M.A.R.T. data collection requires the MinIO AIStor process to run with root access or with
CAP_SYS_ADMIN and CAP_DAC_OVERRIDE Linux capabilities.
If permissions are insufficient, SMART metrics are omitted without failing other requests.
| Name | Description | Labels |
|---|---|---|
minio_system_drive_smart_status |
Drive SMART health status (0=unknown, 1=healthy, 2=warning, 3=critical, 4=collection_error) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_temperature_celsius |
Drive temperature in Celsius from SMART data Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_power_on_hours |
Drive power-on hours from SMART data Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_power_cycles |
Drive power cycle count from SMART data Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_failure_risk |
Estimated annual drive failure risk (0.0-1.0+) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_available_spare_percent |
NVMe available spare capacity percentage Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_percentage_used |
NVMe percentage of rated endurance used Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_media_errors |
NVMe media and data integrity error count Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_reallocated_sectors |
SATA reallocated sector count (failure predictor) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_pending_sectors |
SATA current pending sector count (failure predictor) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_offline_uncorrectable |
SATA offline uncorrectable sector count (failure predictor) Type: gauge |
drive, pool_index, set_index, drive_index, server |
minio_system_drive_smart_megaraid_pd_state |
MegaRAID physical drive firmware state (0=unconfiguredGood, 1=unconfiguredBad, 2=hotSpare, 16=offline, 17=failed, 20=rebuild, 24=online, 32=copyback, 64=system) Type: gauge |
controller, enclosure, slot, server |
minio_system_drive_smart_megaraid_pd_media_errors |
MegaRAID physical drive media error count Type: gauge |
controller, enclosure, slot, server |
minio_system_drive_smart_megaraid_pd_other_errors |
MegaRAID physical drive other error count Type: gauge |
controller, enclosure, slot, server |
minio_system_drive_smart_megaraid_pd_predictive_failures |
MegaRAID physical drive predictive failure count Type: gauge |
controller, enclosure, slot, server |
/system/memory
| Name | Description | Labels |
|---|---|---|
minio_system_memory_total |
Total physical RAM installed on the server node in bytes Type: gauge |
server |
minio_system_memory_used |
Amount of physical RAM currently in use by the system in bytes Type: gauge |
server |
minio_system_memory_free |
Amount of physical RAM not currently in use and immediately available in bytes Type: gauge |
server |
minio_system_memory_available |
Estimated amount of physical RAM available for starting new applications without swapping in bytes Type: gauge |
server |
minio_system_memory_buffers |
Amount of physical RAM used by kernel buffers in bytes Type: gauge |
server |
minio_system_memory_cache |
Amount of physical RAM used for file system cache and page cache in bytes Type: gauge |
server |
minio_system_memory_shared |
Amount of physical RAM used by shared memory segments in bytes Type: gauge |
server |
minio_system_memory_used_perc |
Percentage of total physical RAM currently in use by the system Type: gauge |
server |
minio_system_memory_available_avg |
Average estimated amount of physical RAM available for starting new applications without swapping in bytes Type: gauge |
server |
minio_system_memory_available_max |
Maximum estimated amount of physical RAM available for starting new applications without swapping in bytes Type: gauge |
server |
minio_system_memory_buffers_avg |
Average amount of physical RAM used by kernel buffers in bytes Type: gauge |
server |
minio_system_memory_buffers_max |
Maximum amount of physical RAM used by kernel buffers in bytes Type: gauge |
server |
minio_system_memory_cache_avg |
Average amount of physical RAM used for file system cache and page cache in bytes Type: gauge |
server |
minio_system_memory_cache_max |
Maximum amount of physical RAM used for file system cache and page cache in bytes Type: gauge |
server |
minio_system_memory_free_avg |
Average amount of physical RAM not currently in use and immediately available in bytes Type: gauge |
server |
minio_system_memory_free_max |
Maximum amount of physical RAM not currently in use and immediately available in bytes Type: gauge |
server |
minio_system_memory_shared_avg |
Average amount of physical RAM used by shared memory segments in bytes Type: gauge |
server |
minio_system_memory_shared_max |
Maximum amount of physical RAM used by shared memory segments in bytes Type: gauge |
server |
minio_system_memory_total_avg |
Average total physical RAM installed on the server node in bytes Type: gauge |
server |
minio_system_memory_total_max |
Maximum total physical RAM installed on the server node in bytes Type: gauge |
server |
minio_system_memory_used_avg |
Average amount of physical RAM currently in use by the system in bytes Type: gauge |
server |
minio_system_memory_used_max |
Maximum amount of physical RAM currently in use by the system in bytes Type: gauge |
server |
minio_system_memory_used_perc_avg |
Average percentage of total physical RAM currently in use by the system Type: gauge |
server |
minio_system_memory_used_perc_max |
Maximum percentage of total physical RAM currently in use by the system Type: gauge |
server |
/system/cpu
| Name | Description | Labels |
|---|---|---|
minio_system_cpu_load |
System load average over the last 1 minute representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load_perc |
System load average over the last 1 minute expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_nice |
Percentage of CPU time spent running user processes with positive nice priority values Type: gauge |
server |
minio_system_cpu_steal |
Percentage of CPU time stolen by the hypervisor for other virtual machines in virtualized environments Type: gauge |
server |
minio_system_cpu_system |
Percentage of CPU time spent executing kernel system calls and routines Type: gauge |
server |
minio_system_cpu_user |
Percentage of CPU time spent executing user-space application code Type: gauge |
server |
minio_system_cpu_user_avg |
Average percentage of CPU time spent executing user-space application code Type: gauge |
server |
minio_system_cpu_user_max |
Maximum percentage of CPU time spent executing user-space application code Type: gauge |
server |
minio_system_cpu_system_avg |
Average percentage of CPU time spent executing kernel system calls and routines Type: gauge |
server |
minio_system_cpu_system_max |
Maximum percentage of CPU time spent executing kernel system calls and routines Type: gauge |
server |
minio_system_cpu_idle_avg |
Average percentage of CPU time spent idle (not processing any tasks) Type: gauge |
server |
minio_system_cpu_idle_max |
Maximum percentage of CPU time spent idle (not processing any tasks) Type: gauge |
server |
minio_system_cpu_iowait_avg |
Average percentage of CPU time spent waiting for I/O operations to complete Type: gauge |
server |
minio_system_cpu_iowait_max |
Maximum percentage of CPU time spent waiting for I/O operations to complete Type: gauge |
server |
minio_system_cpu_nice_avg |
Average percentage of CPU time spent running user processes with positive nice priority values Type: gauge |
server |
minio_system_cpu_nice_max |
Maximum percentage of CPU time spent running user processes with positive nice priority values Type: gauge |
server |
minio_system_cpu_steal_avg |
Average percentage of CPU time stolen by the hypervisor for other virtual machines in virtualized environments Type: gauge |
server |
minio_system_cpu_steal_max |
Maximum percentage of CPU time stolen by the hypervisor for other virtual machines in virtualized environments Type: gauge |
server |
minio_system_cpu_load_avg |
Average system load over the last 1 minute representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load_max |
Maximum system load over the last 1 minute representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load_perc_avg |
Average system load over the last 1 minute expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load_perc_max |
Maximum system load over the last 1 minute expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load5 |
System load average over the last 5 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load5_avg |
Average system load over the last 5 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load5_max |
Maximum system load over the last 5 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load5_perc |
System load average over the last 5 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load5_perc_avg |
Average system load over the last 5 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load5_perc_max |
Maximum system load over the last 5 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load15 |
System load average over the last 15 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load15_avg |
Average system load over the last 15 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load15_max |
Maximum system load over the last 15 minutes representing the average number of runnable processes Type: gauge |
server |
minio_system_cpu_load15_perc |
System load average over the last 15 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load15_perc_avg |
Average system load over the last 15 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
minio_system_cpu_load15_perc_max |
Maximum system load over the last 15 minutes expressed as a percentage of available CPU cores Type: gauge |
server |
/system/network/certificate
| Name | Description | Labels |
|---|---|---|
minio_system_network_certificate_expires_in |
Number of seconds until the certificate expires Type: gauge |
issuer, subject, server |
/system/network/interface
| Name | Description | Labels |
|---|---|---|
minio_system_network_interface_if_rx_bytes |
Bytes received on the interface in 60s Type: gauge |
interface, server |
minio_system_network_interface_if_rx_bytes_avg |
Bytes received on the interface in 60s (avg) since uptime Type: gauge |
interface, server |
minio_system_network_interface_if_rx_bytes_max |
Bytes received on the interface in 60s (max) since uptime Type: gauge |
interface, server |
minio_system_network_interface_if_rx_errors |
Receive errors in 60s Type: gauge |
interface, server |
minio_system_network_interface_if_rx_errors_avg |
Receive errors in 60s (avg) Type: gauge |
interface, server |
minio_system_network_interface_if_rx_errors_max |
Receive errors in 60s (max) Type: gauge |
interface, server |
minio_system_network_interface_if_tx_bytes |
Bytes transmitted in 60s Type: gauge |
interface, server |
minio_system_network_interface_if_tx_bytes_avg |
Bytes transmitted in 60s (avg) Type: gauge |
interface, server |
minio_system_network_interface_if_tx_bytes_max |
Bytes transmitted in 60s (max) Type: gauge |
interface, server |
minio_system_network_interface_if_tx_errors |
Transmit errors in 60s Type: gauge |
interface, server |
minio_system_network_interface_if_tx_errors_avg |
Transmit errors in 60s (avg) Type: gauge |
interface, server |
minio_system_network_interface_if_tx_errors_max |
Transmit errors in 60s (max) Type: gauge |
interface, server |
/system/network/internode
| Name | Description | Labels |
|---|---|---|
minio_system_network_internode_errors_total |
Total number of failed internode calls Type: counter |
server |
minio_system_network_internode_dial_errors_total |
Total number of internode TCP dial timeouts and errors Type: counter |
server |
minio_system_network_internode_dial_avg_time_nanos |
Average dial time of internode TCP calls in nanoseconds Type: gauge |
server |
minio_system_network_internode_sent_bytes_total |
Total number of bytes sent to other peer nodes Type: counter |
server |
minio_system_network_internode_recv_bytes_total |
Total number of bytes received from other peer nodes Type: counter |
server |
minio_system_network_internode_rtt_ms |
Last RTT in milliseconds to peer node Type: gauge |
peer, server |
minio_system_network_internode_reconnects_total |
Total number of reconnects to peer node Type: counter |
peer, server |
minio_system_network_internode_out_queue_length |
Outgoing message queue length for peer connection Type: gauge |
peer, server |
minio_system_network_internode_peers_connected |
Number of peer nodes this server is connected to Type: gauge |
server |
/system/network/internode/rdma
Metrics about internode RDMA network communication.
| Name | Description | Labels |
|---|---|---|
minio_system_network_internode_rdma_write_bytes_total |
Total bytes written via inter-node RDMA Type: counter |
server |
minio_system_network_internode_rdma_read_bytes_total |
Total bytes read via inter-node RDMA Type: counter |
server |
minio_system_network_internode_rdma_write_ops_total |
Total inter-node RDMA write operations Type: counter |
server |
minio_system_network_internode_rdma_read_ops_total |
Total inter-node RDMA read operations Type: counter |
server |
minio_system_network_internode_rdma_errors_total |
Total inter-node RDMA errors by category Type: counter |
category, server |
minio_system_network_internode_rdma_pool_fallbacks_total |
Total inter-node PUTs that fell back to TCP because the RDMA receive-buffer pool was busy (graceful backpressure, not an error) Type: counter |
server |
minio_system_network_internode_rdma_nic_writes_throttled_total |
Inter-node RDMA WRITEs throttled by the per-peer congestion window, per local NIC Type: counter |
nic, server |
minio_system_network_internode_rdma_nic_credit_waits_total |
Inter-node RDMA sends that blocked waiting on receiver credits, per local NIC Type: counter |
nic, server |
minio_system_network_internode_rdma_nic_mr_register_fallback_total |
Inter-node RDMA per-op memory-region registration fallbacks (unregistered buffers), per local NIC Type: counter |
nic, server |
minio_system_network_internode_rdma_nic_grant_send_timeouts_total |
Inter-node RDMA credit-grant sends that timed out, per local NIC Type: counter |
nic, server |
minio_system_network_internode_rdma_nic_recv_cq_errors_total |
Inter-node RDMA receive completion-queue errors, per local NIC Type: counter |
nic, server |
minio_system_network_internode_rdma_nic_inflight_writes |
Inter-node RDMA WRITE_WITH_IMM operations currently in flight, per local NIC Type: gauge |
nic, server |
/system/process
| Name | Description | Labels |
|---|---|---|
minio_system_process_cpu_total_seconds |
Total user and system CPU time spent in seconds Type: counter |
server |
minio_system_process_go_routine_total |
Total number of go routines running Type: gauge |
server |
minio_system_process_io_rchar_bytes |
Total bytes read by the process from the underlying storage system including cache, /proc/[pid]/io field rchar Type: counter |
server |
minio_system_process_io_read_bytes |
Total bytes read by the process from the underlying storage system, /proc/[pid]/io field read_bytes Type: counter |
server |
minio_system_process_io_wchar_bytes |
Total bytes written by the process to the underlying storage system including page cache, /proc/[pid]/io field wchar Type: counter |
server |
minio_system_process_io_write_bytes |
Total bytes written by the process to the underlying storage system, /proc/[pid]/io field write_bytes Type: counter |
server |
minio_system_process_start_time_seconds |
Start time for MinIO process in seconds since Unix epoch Type: gauge |
server |
minio_system_process_uptime_seconds |
Uptime for MinIO process in seconds Type: gauge |
server |
minio_system_process_file_descriptor_limit_total |
Limit on total number of open file descriptors for the MinIO Server process Type: gauge |
server |
minio_system_process_file_descriptor_open_total |
Total number of open file descriptors by the MinIO Server process Type: gauge |
server |
minio_system_process_syscall_read_total |
Total read SysCalls to the kernel. /proc/[pid]/io field syscr Type: counter |
server |
minio_system_process_syscall_write_total |
Total write SysCalls to the kernel. /proc/[pid]/io field syscw Type: counter |
server |
minio_system_process_resident_memory_bytes |
Resident memory size in bytes Type: gauge |
server |
minio_system_process_virtual_memory_bytes |
Virtual memory size in bytes Type: gauge |
server |
minio_system_process_virtual_memory_max_bytes |
Maximum virtual memory size in bytes Type: gauge |
server |
minio_system_process_threads_total |
Total number of OS threads Type: gauge |
server |
minio_system_process_threads_max |
Maximum number of OS threads allowed Type: gauge |
server |
minio_system_process_thread_pressure |
Thread pressure level (0=normal, 1=warning, 2=critical) Type: gauge |
server |
Tables metrics
Metrics for Tables (Apache Iceberg REST Catalog) operations.
| Path | Description |
|---|---|
/tables |
Metrics for Tables (Apache Iceberg REST Catalog) operations. |
/tables
| Name | Description | Labels |
|---|---|---|
minio_tables_warehouses_total |
Current number of warehouses Type: gauge |
server |
minio_tables_namespaces_total |
Current number of namespaces across all warehouses Type: gauge |
server |
minio_tables_tables_total |
Current number of tables across all warehouses Type: gauge |
server |
minio_tables_views_total |
Current number of views across all warehouses Type: gauge |
server |
minio_tables_staged_tables_total |
Current number of staged tables Type: gauge |
server |
minio_tables_transactions_active_current |
Currently total active transactions (pending) Type: gauge |
server |
minio_tables_recovery_zombie_detected_total |
Total zombie transactions detected Type: counter |
server |
minio_tables_recovery_operations_total |
Total recovery operations performed Type: counter |
server |
minio_tables_recovery_rollback_total |
Total transaction rollbacks Type: counter |
type, server |
minio_tables_inflight_total |
Current number of Tables API requests actively being processed Type: gauge |
name, type, server |
minio_tables_total |
Total number of Tables API requests processed since server start Type: counter |
name, type, server |
minio_tables_5xx_errors_total |
Total number of Tables API requests that resulted in 5xx server errors Type: counter |
name, type, server |
minio_tables_canceled_total |
Total number of Tables API requests canceled by client Type: counter |
name, type, server |
minio_tables_requests_ttfb_seconds_distribution |
Histogram distribution of time to first byte (TTFB) in seconds for Tables API requests Type: counter |
api, le, server |
minio_tables_maintenance_cycle_total |
Total number of completed maintenance cycles Type: counter |
type, server |
minio_tables_maintenance_running |
Whether a maintenance cycle is currently running (0 or 1) Type: gauge |
type, server |
minio_tables_maintenance_last_cycle_duration_seconds |
Duration of the last completed maintenance cycle in seconds Type: gauge |
type, server |
minio_tables_maintenance_last_run_timestamp |
Unix timestamp of the last completed maintenance cycle Type: gauge |
type, server |
minio_tables_maintenance_tables_processed_total |
Total tables successfully processed by maintenance Type: counter |
type, server |
minio_tables_maintenance_errors_total |
Total maintenance errors after exhausting retries Type: counter |
type, server |
minio_tables_maintenance_retries_total |
Total retry attempts during maintenance Type: counter |
type, server |
minio_tables_maintenance_configs_enabled_total |
Number of maintenance configs with status enabled Type: gauge |
type, server |
minio_tables_maintenance_snapshots_expired_total |
Total snapshots expired by snapshot expiration maintenance Type: counter |
server |
minio_tables_maintenance_orphan_files_marked_total |
Total orphan files marked for deletion by unreferenced file removal maintenance Type: counter |
server |
minio_tables_maintenance_configs_total |
Total number of registered maintenance configs Type: gauge |
server |
minio_tables_catalog_scanner_cycle_total |
Total number of completed catalog scanner cycles (leader only) Type: counter |
server |
minio_tables_catalog_scanner_running |
Whether a catalog scanner cycle is currently running (0 or 1, leader only) Type: gauge |
server |
minio_tables_catalog_scanner_last_cycle_duration_seconds |
Duration of the last completed catalog scanner cycle in seconds (leader only) Type: gauge |
server |
minio_tables_catalog_scanner_last_run_timestamp |
Unix timestamp of the last completed catalog scanner cycle (leader only) Type: gauge |
server |
minio_tables_catalog_scanner_cycle_errors_total |
Total number of catalog scanner cycles that failed with a non-cancellation error (leader only) Type: counter |
server |
minio_tables_catalog_scanner_actions_total |
Total catalog mutations applied by the scanner, by action (leader only) Type: counter |
action, server |
minio_tables_catalog_scanner_warehouses_last_cycle |
Number of warehouse buckets scanned in the last catalog scanner cycle (leader only) Type: gauge |
server |
minio_tables_compaction_tables_skipped_total |
Total tables skipped during compaction Type: counter |
server |
minio_tables_compaction_files_rewritten_total |
Total data files rewritten by compaction Type: counter |
server |
minio_tables_compaction_files_added_total |
Total data files created by compaction Type: counter |
server |
minio_tables_compaction_redistribute_groups_total |
Total compaction groups redistributed to a surviving peer after a peer’s stream failed Type: counter |
server |
minio_tables_compaction_format_unsupported_groups_total |
Total compaction groups skipped because the data file format is not supported by iceberg-go’s reader (ORC, Avro) Type: counter |
server |
minio_tables_compaction_peer_rpcs_total |
Total distributed-compaction RPCs this node handled as a peer, counted per node Type: counter |
server |
Delta Sharing metrics
Metrics for Delta Sharing API operations.
/delta-sharing
| Name | Description | Labels |
|---|---|---|
minio_delta_sharing_inflight_total |
Current number of Delta Sharing API requests actively being processed Type: gauge |
name, type, server |
minio_delta_sharing_total |
Total number of Delta Sharing API requests processed since server start Type: counter |
name, type, server |
minio_delta_sharing_errors_total |
Total number of Delta Sharing API requests that resulted in errors Type: counter |
name, type, server |
minio_delta_sharing_4xx_errors_total |
Total number of Delta Sharing API requests that resulted in 4xx client errors Type: counter |
name, type, server |
minio_delta_sharing_5xx_errors_total |
Total number of Delta Sharing API requests that resulted in 5xx server errors Type: counter |
name, type, server |
minio_delta_sharing_canceled_total |
Total number of Delta Sharing API requests canceled by client Type: counter |
name, type, server |
minio_delta_sharing_auth_success_total |
Total successful Delta Sharing authentications Type: counter |
server |
minio_delta_sharing_auth_failures_total |
Total failed Delta Sharing authentications Type: counter |
server |
minio_delta_sharing_oauth_tokens_issued_total |
Total OAuth tokens issued for Delta Sharing Type: counter |
server |
minio_delta_sharing_cache_hits_total |
Total Delta Sharing cache hits Type: counter |
cache_type, server |
minio_delta_sharing_cache_misses_total |
Total Delta Sharing cache misses Type: counter |
cache_type, server |
minio_delta_sharing_cache_size |
Current size of Delta Sharing cache Type: gauge |
cache_type, server |
minio_delta_sharing_rate_limited_total |
Total number of rate limited Delta Sharing requests Type: counter |
server |
minio_delta_sharing_requests_ttfb_seconds_distribution |
Histogram distribution of time to first byte (TTFB) in seconds for Delta Sharing API requests Type: counter |
api, le, server |
Tables and Delta Sharing observability
For guidance on monitoring AIStor Tables and AIStor Table Sharing (Delta Sharing), including the v2 latency histograms, audit-log behavior, and example alerting rules, see Tables and Delta Sharing Observability.