VictoriaMetrics/app/vmagent/remotewrite
Nikolay 25ac2aac31
app/vmagent: allow to disabled on-disk persistence (#5088)
* app/vmagent: allow to disabled on-disk queue
Previously, it wasn't possible to build data processing pipeline with a
chain of vmagents. In case when remoteWrite for the last vmagent in the
chain wasn't accessible, it persisted data only when it has enough disk
capacity. If disk queue is full, it started to silently drop ingested
metrics.

New flags allows to disable on-disk persistent and immediatly return an
error if remoteWrite is not accessible anymore. It blocks any writes and
notify client, that data ingestion isn't possible.

Main use case for this feature - use external queue such as kafka for
data persistence.
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2110

* adds test, updates readme

* apply review suggestions

* update docs for vmagent

* makes linter happy

---------

Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2023-11-25 12:12:29 +02:00
..
client.go app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
pendingseries.go app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
pendingseries_test.go app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
pendingseries_timing_test.go app/vmagent/remotewrite: go fmt after 2b55d167d7 2022-09-19 15:14:03 +03:00
relabel.go app/vmagent/remotewrite: fix data race when extra labels are added to samples before sending them to multiple remote storage systems 2023-09-08 23:26:40 +02:00
relabel_test.go app/vmagent/remotewrite: fix data race when extra labels are added to samples before sending them to multiple remote storage systems 2023-09-08 23:26:40 +02:00
remotewrite.go app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
statconn.go Makefile: update golangci-lint from v1.51.2 to v1.54.2 2023-09-01 10:25:49 +02:00