mirror of
https://github.com/VictoriaMetrics/VictoriaMetrics.git
synced 2024-11-21 14:44:00 +00:00
deployment: add new alert TooHighChurnRate24h
(#1154)
Alert `TooHighChurnRate24h` suppose to cover cases when churn rate is low but results in multiple times higher number than total number of active series.
This commit is contained in:
parent
b1e49bab52
commit
cfdb6762e6
1 changed files with 17 additions and 0 deletions
|
@ -106,6 +106,23 @@ groups:
|
||||||
High Churn Rate tightly connected with database performance and may
|
High Churn Rate tightly connected with database performance and may
|
||||||
result in unexpected OOM's or slow queries."
|
result in unexpected OOM's or slow queries."
|
||||||
|
|
||||||
|
- alert: TooHighChurnRate24h
|
||||||
|
expr: |
|
||||||
|
sum(increase(vm_new_timeseries_created_total[24h])) by(instance)
|
||||||
|
>
|
||||||
|
(sum(vm_cache_entries{type="storage/hour_metric_ids"}) by(instance) * 3)
|
||||||
|
for: 15m
|
||||||
|
labels:
|
||||||
|
severity: warning
|
||||||
|
annotations:
|
||||||
|
dashboard: "http://localhost:3000/d/wNf0q_kZk?viewPanel=66&var-instance={{ $labels.instance }}"
|
||||||
|
summary: "Too high number of new series on \"{{ $labels.instance }}\" created over last 24h"
|
||||||
|
description: "The number of created new time series over last 24h is 3x times higher than
|
||||||
|
current number of active series on \"{{ $labels.instance }}\".\n
|
||||||
|
This effect is known as Churn Rate.\n
|
||||||
|
High Churn Rate tightly connected with database performance and may
|
||||||
|
result in unexpected OOM's or slow queries."
|
||||||
|
|
||||||
- alert: TooHighSlowInsertsRate
|
- alert: TooHighSlowInsertsRate
|
||||||
expr: |
|
expr: |
|
||||||
(
|
(
|
||||||
|
|
Loading…
Reference in a new issue