VictoriaMetrics/docs/operator/high-availability.md

---
sort: 8
weight: 8
title: High Availability
menu:
  docs:
    parent: "operator"
    weight: 8
---

# High Availability

High availability is not only important for customer-facing software but if the monitoring infrastructure is not highly available, then there is a risk that operations people are not notified of alerts.
Therefore, high availability must be just as thought through for the monitoring stack, as for anything else.

## Components

VictoriaMetrics operator support high availability for each component of the monitoring stack:

- [VMAgent](./resources/vmagent.md#high-availability)
- [VMAlert](./resources/vmalert.md#high-availability)
- [VMAlertmanager](./resources/vmalertmanager.md#high-availability)
- [VMAuth](./resources/vmauth.md#high-availability)
- [VMCluster](./resources/vmcluster.md#high-availability)

More details you can find in the section **[High Availability for resources](./resources/README.md#high-availability)**.

## Operator

VictoriaMetrics operator can be safely scaled horizontally, but only one replica of the operator can 
process [the reconciliation](./README.md#reconciliation-cycle) at a time - 
it uses a leader election mechanism to ensure that only one replica is active at a time.

If one of replicas of the operator will be failed, then another replica will be elected as a leader and will continue to work -
operator replication affects how quickly this happens.

[CRD validation](./configuration.md#crd-validation) workload is fully 
distributed among the available operator replicas.

In addition, you can safely use for operator such features 
as [assigning and distributing to nodes](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/)
(like [node selector](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector), 
[affinity and anti-affinity](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#affinity-and-anti-affinity),
[topology spread constraints](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#pod-topology-spread-constraints),
[taints and tolerations](https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/), etc...)

In addition, don't forget about [monitoring for the operator](./monitoring.md).
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00			`---`
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`sort: 8`
			`weight: 8`
docs: prepare operator docs to migration Signed-off-by: Artem Navoiev <tenmozes@gmail.com> 2023-01-11 15:38:18 +00:00			`title: High Availability`
add hugo front matter for operator docs (#5122) Signed-off-by: Artem Navoiev <tenmozes@gmail.com> 2023-10-04 13:27:40 +00:00			`menu:`
			`docs:`
			`parent: "operator"`
			`weight: 8`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00			`---`

			`# High Availability`

Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`High availability is not only important for customer-facing software but if the monitoring infrastructure is not highly available, then there is a risk that operations people are not notified of alerts.`
			`Therefore, high availability must be just as thought through for the monitoring stack, as for anything else.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`## Components`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`VictoriaMetrics operator support high availability for each component of the monitoring stack:`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`- [VMAgent](./resources/vmagent.md#high-availability)`
			`- [VMAlert](./resources/vmalert.md#high-availability)`
			`- [VMAlertmanager](./resources/vmalertmanager.md#high-availability)`
			`- [VMAuth](./resources/vmauth.md#high-availability)`
			`- [VMCluster](./resources/vmcluster.md#high-availability)`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`More details you can find in the section [High Availability for resources](./resources/README.md#high-availability).`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`## Operator`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`VictoriaMetrics operator can be safely scaled horizontally, but only one replica of the operator can`
			`process [the reconciliation](./README.md#reconciliation-cycle) at a time -`
			`it uses a leader election mechanism to ensure that only one replica is active at a time.`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`If one of replicas of the operator will be failed, then another replica will be elected as a leader and will continue to work -`
			`operator replication affects how quickly this happens.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`[CRD validation](./configuration.md#crd-validation) workload is fully`
			`distributed among the available operator replicas.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`In addition, you can safely use for operator such features`
			`as [assigning and distributing to nodes](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/)`
			`(like [node selector](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector),`
			`[affinity and anti-affinity](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#affinity-and-anti-affinity),`
			`[topology spread constraints](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#pod-topology-spread-constraints),`
			`[taints and tolerations](https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/), etc...)`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`In addition, don't forget about [monitoring for the operator](./monitoring.md).`