VictoriaMetrics/docs/anomaly-detection/components
Fred Navruzov ae673e8b34
docs/vmanomaly - release 1.18.5 (#7684)
### Describe Your Changes

docs/vmanomaly - release 1.18.5 doc updates

### Checklist

The following checks are **mandatory**:

- [x] My change adheres [VictoriaMetrics contributing
guidelines](https://docs.victoriametrics.com/contributing/).
2024-11-28 13:50:02 +01:00
..
_index.md added _index.md for hugo, which point to README.md (#6686) 2024-07-25 12:20:40 +02:00
autotune.webp docs/vmanomaly: v1.12 updates & fixes (#6046) 2024-04-03 02:44:58 +03:00
model-lifecycle-multivariate.webp docs/vmanomaly: v1.12 updates & fixes (#6046) 2024-04-03 02:44:58 +03:00
model-lifecycle-univariate.webp docs/vmanomaly: v1.12 updates & fixes (#6046) 2024-04-03 02:44:58 +03:00
model-type-non-rolling.webp docs/vmanomaly: v1.12 updates & fixes (#6046) 2024-04-03 02:44:58 +03:00
model-type-rolling.webp docs/vmanomaly: v1.12 updates & fixes (#6046) 2024-04-03 02:44:58 +03:00
models.md docs/vmanomaly - release 1.18.5 (#7684) 2024-11-28 13:50:02 +01:00
monitoring.md docs/vmanomaly: add self-monitoring section (#7558) 2024-11-20 16:32:45 +01:00
reader.md docs: vmanomaly - release 1.18.1 (#7517) 2024-11-14 17:21:30 +01:00
README.md docs/vmanomaly:change links from relative to absolute (#6809) 2024-08-15 10:13:54 +02:00
scheduler.md docs/vmanomaly - release 1.18.5 (#7684) 2024-11-28 13:50:02 +01:00
schema_detection_direction=above_expected.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
schema_detection_direction=below_expected.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
schema_detection_direction=both.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
schema_min_dev_from_expected=0.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
schema_min_dev_from_expected=1.0.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
schema_min_dev_from_expected=5.0.webp docs/vmanomaly - release 1.13.0 preparation (#6436) 2024-06-11 17:05:07 +02:00
vmanomaly-components.webp - fix 404 links after renaming (#5653) 2024-01-22 01:14:54 +02:00
writer.md docs/vmanomaly: updates for v1.16.3 (#7203) 2024-10-11 14:25:19 +02:00

This chapter describes different components, that correspond to respective sections of a config to launch VictoriaMetrics Anomaly Detection (or simply vmanomaly) service:

Note

: starting from v1.7.0, once the service starts, automated config validation is performed. Please see container logs for errors that need to be fixed to create fully valid config, visiting sections above for examples and documentation.

Note

: starting from v1.13.0, components' class can be referenced by a short alias instead of a full class path - i.e. model.zscore.ZscoreModel becomes zscore, reader.vm.VmReader becomes vm, scheduler.periodic.PeriodicScheduler becomes periodic, etc. Please see according sections for the details.

Note: Starting from v1.13.0 preset modes are available for vmanomaly. Please find the guide here.

Below, you will find an example illustrating how the components of vmanomaly interact with each other and with a single-node VictoriaMetrics setup.

Note

: Reader and Writer also support multitenancy, so you can read/write from/to different locations - see tenant_id param description.

vmanomaly-components

Here's a minimalistic full config example, demonstrating many-to-many configuration (actual for latest version):

# how and when to run the models is defined by schedulers
# https://docs.victoriametrics.com/anomaly-detection/components/scheduler/
schedulers:
  periodic_1d:  # alias
    class: 'periodic' # scheduler class
    infer_every: "30s"
    fit_every: "10m"
    fit_window: "24h"
  periodic_1w:
    class: 'periodic'
    infer_every: "15m"
    fit_every: "1h"
    fit_window: "7d"

# what model types and with what hyperparams to run on your data
# https://docs.victoriametrics.com/anomaly-detection/components/models/
models:
  zscore:  # we can set up alias for model
    class: 'zscore'  # model class
    z_threshold: 3.5
    provide_series: ['anomaly_score']  # what series to produce
    queries: ['host_network_receive_errors']  # what queries to run particular model on
    schedulers: ['periodic_1d']  # will be attached to 1-day schedule, fit every 10m and infer every 30s
    min_dev_from_expected: 0.0  # turned off. if |y - yhat| < min_dev_from_expected, anomaly score will be 0
    detection_direction: 'above_expected' # detect anomalies only when y > yhat, "peaks"
  prophet: # we can set up alias for model
    class: 'prophet'
    provide_series: ['anomaly_score', 'yhat', 'yhat_lower', 'yhat_upper']
    queries: ['cpu_seconds_total']
    schedulers: ['periodic_1w']  # will be attached to 1-week schedule, fit every 1h and infer every 15m
    min_dev_from_expected: 0.01  # if |y - yhat| < 0.01, anomaly score will be 0
    detection_direction: 'above_expected'
    args:  # model-specific arguments
      interval_width: 0.98

# where to read data from
# https://docs.victoriametrics.com/anomaly-detection/components/reader/#vm-reader
reader:
  datasource_url: "https://play.victoriametrics.com/"
  tenant_id: "0:0"
  class: 'vm'
  sampling_period: "30s"  # what data resolution to fetch from VictoriaMetrics' /query_range endpoint
  latency_offset: '1ms'
  query_from_last_seen_timestamp: False
  queries:  # aliases to MetricsQL expressions
    cpu_seconds_total:
      expr: 'avg(rate(node_cpu_seconds_total[5m])) by (mode)' 
      # step: '30s'  # if not set, will be equal to sampling_period
      data_range: [0, 'inf']  # expected value range, anomaly_score > 1 if y (real value) is outside
    host_network_receive_errors:
      expr: 'rate(node_network_receive_errs_total[3m]) / rate(node_network_receive_packets_total[3m])'
      step: '15m'  # here we override per-query `sampling_period` to request way less data from VM TSDB
      data_range: [0, 'inf']

# where to write data to
# https://docs.victoriametrics.com/anomaly-detection/components/writer/
writer:
  datasource_url: "http://victoriametrics:8428/"

# enable self-monitoring in pull and/or push mode
# https://docs.victoriametrics.com/anomaly-detection/components/monitoring/
monitoring:
  pull: # Enable /metrics endpoint.
    addr: "0.0.0.0"
    port: 8490