VictoriaMetrics/deployment/docker/victorialogs/opentelemetry-collector/elasticsearch
Andrii Chubatiuk 01430a155c
vlinsert: added opentelemetry logs support
Commit adds the following changes:

* Adds support of OpenTelemetry logs for Victoria Logs with protobuf encoded messages

*  json encoding is not supported for the following reasons:
   - It brings a lot of fragile code, which works inefficiently.
   - json encoding is impossible to use with language SDK.

* splits metrics and logs structures at lib/protoparser/opentelemetry/pb package.

* adds docs with examples for opentelemetry logs.

---
Related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4839

Co-authored-by: AndrewChubatiuk <andrew.chubatiuk@gmail.com>
Co-authored-by: f41gh7 <nik@victoriametrics.com>
2024-09-03 20:12:05 +02:00
..
compose.yml vlinsert: added opentelemetry logs support 2024-09-03 20:12:05 +02:00
config.yaml vlinsert: added opentelemetry logs support 2024-09-03 20:12:05 +02:00
README.md vlinsert: added opentelemetry logs support 2024-09-03 20:12:05 +02:00
scrape.yml vlinsert: added opentelemetry logs support 2024-09-03 20:12:05 +02:00

Docker compose OpenTelemetry Elasticsearch integration with VictoriaLogs for docker

The folder contains the example of integration of OpenTelemetry collector with Victorialogs

To spin-up environment run the following command:

docker compose up -d 

To shut down the docker-compose environment run the following command:

docker compose down
docker compose rm -f

The docker compose file contains the following components:

  • collector - vector is configured to collect logs from the docker, you can find configuration in the config.yaml. It writes data in VictoriaLogs. It pushes metrics to VictoriaMetrics.
  • VictoriaLogs - the log database, it accepts the data from collector by elastic protocol
  • VictoriaMetrics - collects metrics from VictoriaLogs and VictoriaMetrics

Querying the data

  • vmui - a web UI is accessible by http://localhost:9428/select/vmui
  • for querying the data via command-line please check these docs

Please, note that _stream_fields parameter must follow recommended best practices to achieve better performance.