VictoriaMetrics/app
Zakhar Bessarab 09df5b66fd
app/vlinsert: add support of loki push protocol (#4482)
* app/vlinsert: add support of loki push protocol

- implemented loki push protocol for both Protobuf and JSON formats
- added examples in documentation
- added example docker-compose

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert: move protobuf metric into its own file

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: update reference to docker image

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: make volume name unique

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: add license reference

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: fix volume name

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* docs/VictoriaLogs/data-ingestion: add stream fields for loki JSON ingestion example

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: move entities to places where those are used

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: refactor to use common components

- use CommonParameters from insertutils
- stop ingestion after first error similar to elasticsearch and jsonline

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: address review feedback

- add missing logstorage.PutLogRows calls
- refactor tenant ID parsing to use common function
- reduce number of allocations for parsing by reusing  logfields slices
- add tests and benchmarks for requests processing funcs

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-07-20 10:10:55 +02:00
..
victoria-logs app/vlselect: handle vmui at /select/vmui path instead of /vmui 2023-06-21 19:52:50 -07:00
victoria-metrics docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vlinsert app/vlinsert: add support of loki push protocol (#4482) 2023-07-20 10:10:55 +02:00
vlselect docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vlstorage docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vmagent all: replace atomic.Value with atomic.Pointer[T] 2023-07-19 17:42:06 -07:00
vmalert app/vmalert/README.md: sync with docs/vmalert.md after 54b7bd4564 2023-07-19 16:30:21 -07:00
vmauth docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vmbackup docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vmbackupmanager docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vmctl all: add support for or filters in series selectors 2023-07-16 00:06:33 -07:00
vmgateway docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vminsert all: replace atomic.Value with atomic.Pointer[T] 2023-07-19 17:42:06 -07:00
vmrestore docs: follow-up after aec4b5db81 (#4638) 2023-07-19 10:10:51 +02:00
vmselect all: replace atomic.Value with atomic.Pointer[T] 2023-07-19 17:42:06 -07:00
vmstorage lib/storage: switch from global to per-day index for MetricName -> TSID mapping 2023-07-13 16:07:30 -07:00
vmui feat: optimize vmui-log bundle size (#4602) 2023-07-19 16:49:38 -07:00