VictoriaMetrics/app
Zakhar Bessarab 5b3cbd4db1
app/vlinsert: add support of loki push protocol (#4482)
* app/vlinsert: add support of loki push protocol

- implemented loki push protocol for both Protobuf and JSON formats
- added examples in documentation
- added example docker-compose

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert: move protobuf metric into its own file

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: update reference to docker image

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: make volume name unique

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: add license reference

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/promtail: fix volume name

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* docs/VictoriaLogs/data-ingestion: add stream fields for loki JSON ingestion example

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: move entities to places where those are used

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: refactor to use common components

- use CommonParameters from insertutils
- stop ingestion after first error similar to elasticsearch and jsonline

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* app/vlinsert/loki: address review feedback

- add missing logstorage.PutLogRows calls
- refactor tenant ID parsing to use common function
- reduce number of allocations for parsing by reusing  logfields slices
- add tests and benchmarks for requests processing funcs

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-07-20 16:49:43 -07:00
..
victoria-logs app/vlselect: handle vmui at /select/vmui path instead of /vmui 2023-07-06 21:36:28 -07:00
vlinsert app/vlinsert: add support of loki push protocol (#4482) 2023-07-20 16:49:43 -07:00
vlselect docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vlstorage docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vmagent all: replace atomic.Value with atomic.Pointer[T] 2023-07-19 17:48:26 -07:00
vmalert app/vmalert/README.md: sync with docs/vmalert.md after 54b7bd4564 2023-07-19 16:31:30 -07:00
vmauth docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vmbackup docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vmbackupmanager docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vmctl all: add support for or filters in series selectors 2023-07-15 23:56:18 -07:00
vmgateway docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vminsert all: replace atomic.Value with atomic.Pointer[T] 2023-07-19 17:48:26 -07:00
vmrestore docs: follow-up after aec4b5db81 (#4638) 2023-07-19 14:48:17 -07:00
vmselect app/vmselect: rename promql.WriteActiveQueries() to promql.ActiveQueriesHandler() 2023-07-20 11:30:40 -07:00
vmstorage lib/storage: switch from global to per-day index for MetricName -> TSID mapping 2023-07-13 17:03:50 -07:00
vmui feat: optimize vmui-log bundle size (#4602) 2023-07-19 16:52:18 -07:00