VictoriaMetrics/docs/operator/high-availability.md

---
weight: 8
title: High Availability
menu:
  docs:
    parent: "operator"
    weight: 8
aliases:
  - /operator/high-availability/
  - /operator/high-availability/index.html
---
High availability is not only important for customer-facing software but if the monitoring infrastructure is not highly available, then there is a risk that operations people are not notified of alerts.
Therefore, high availability must be just as thought through for the monitoring stack, as for anything else.

## Components

VictoriaMetrics operator support high availability for each component of the monitoring stack:

- [VMAgent](https://docs.victoriametrics.com/operator/resources/vmagent/#high-availability)
- [VMAlert](https://docs.victoriametrics.com/operator/resources/vmalert/#high-availability)
- [VMAlertmanager](https://docs.victoriametrics.com/operator/resources/vmalertmanager/#high-availability)
- [VMAuth](https://docs.victoriametrics.com/operator/resources/vmauth/#high-availability)
- [VMCluster](https://docs.victoriametrics.com/operator/resources/vmcluster/#high-availability)

More details you can find in the section **[High Availability for resources](https://docs.victoriametrics.com/operator/resources/#high-availability)**.

## Operator

VictoriaMetrics operator can be safely scaled horizontally, but only one replica of the operator can 
process [the reconciliation](https://docs.victoriametrics.com/operator/#reconciliation-cycle) at a time -
it uses a leader election mechanism to ensure that only one replica is active at a time.

If one of replicas of the operator will be failed, then another replica will be elected as a leader and will continue to work -
operator replication affects how quickly this happens.

[CRD validation](https://docs.victoriametrics.com/operator/configuration#crd-validation) workload is fully 
distributed among the available operator replicas.

In addition, you can safely use for operator such features 
as [assigning and distributing to nodes](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/)
(like [node selector](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector), 
[affinity and anti-affinity](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#affinity-and-anti-affinity),
[topology spread constraints](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#pod-topology-spread-constraints),
[taints and tolerations](https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/), etc...)

In addition, don't forget about [monitoring for the operator](https://docs.victoriametrics.com/operator/monitoring/).
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00			`---`
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`weight: 8`
docs: prepare operator docs to migration Signed-off-by: Artem Navoiev <tenmozes@gmail.com> 2023-01-11 15:38:18 +00:00			`title: High Availability`
Automatic update operator docs from VictoriaMetrics/operator@26d1b3b (#5130) 2023-10-05 10:43:28 +00:00			`menu:`
			`docs:`
			`parent: "operator"`
			`weight: 8`
Automatic update operator docs from VictoriaMetrics/operator@b96131b (#5371) 2023-11-22 11:59:07 +00:00			`aliases:`
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`- /operator/high-availability/`
			`- /operator/high-availability/index.html`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00			`---`
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`High availability is not only important for customer-facing software but if the monitoring infrastructure is not highly available, then there is a risk that operations people are not notified of alerts.`
			`Therefore, high availability must be just as thought through for the monitoring stack, as for anything else.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`## Components`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`VictoriaMetrics operator support high availability for each component of the monitoring stack:`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`- [VMAgent](https://docs.victoriametrics.com/operator/resources/vmagent/#high-availability)`
			`- [VMAlert](https://docs.victoriametrics.com/operator/resources/vmalert/#high-availability)`
			`- [VMAlertmanager](https://docs.victoriametrics.com/operator/resources/vmalertmanager/#high-availability)`
			`- [VMAuth](https://docs.victoriametrics.com/operator/resources/vmauth/#high-availability)`
			`- [VMCluster](https://docs.victoriametrics.com/operator/resources/vmcluster/#high-availability)`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`More details you can find in the section [High Availability for resources](https://docs.victoriametrics.com/operator/resources/#high-availability).`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`## Operator`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`VictoriaMetrics operator can be safely scaled horizontally, but only one replica of the operator can`
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`process [the reconciliation](https://docs.victoriametrics.com/operator/#reconciliation-cycle) at a time -`
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`it uses a leader election mechanism to ensure that only one replica is active at a time.`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`If one of replicas of the operator will be failed, then another replica will be elected as a leader and will continue to work -`
			`operator replication affects how quickly this happens.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`[CRD validation](https://docs.victoriametrics.com/operator/configuration#crd-validation) workload is fully`
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`distributed among the available operator replicas.`
Created Operator folder in docs (#2034) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed 2022-01-21 10:05:58 +00:00
Automatic update operator docs from VictoriaMetrics/operator@c7125bd (#5102) 2023-10-02 12:50:08 +00:00			`In addition, you can safely use for operator such features`
			`as [assigning and distributing to nodes](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/)`
			`(like [node selector](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#nodeselector),`
			`[affinity and anti-affinity](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#affinity-and-anti-affinity),`
			`[topology spread constraints](https://kubernetes.io/docs/concepts/scheduling-eviction/assign-pod-node/#pod-topology-spread-constraints),`
			`[taints and tolerations](https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/), etc...)`
added doc for placeholder support in vmagent specification for operator (https://github.com/VictoriaMetrics/operator/issues/592) (#3916) 2023-03-06 10:58:31 +00:00
Automatic update operator docs from VictoriaMetrics/operator@64879fb (#6831) Automated changes by [create-pull-request](https://github.com/peter-evans/create-pull-request) GitHub action Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Signed-off-by: f41gh7 <nik@victoriametrics.com> 2024-08-16 14:32:25 +00:00			`In addition, don't forget about [monitoring for the operator](https://docs.victoriametrics.com/operator/monitoring/).`