VictoriaMetrics/deployment/docker/victorialogs/fluentd
Andrii Chubatiuk e0930687f1
vlinsert: support datadog logs
This commit adds the following changes:

- Added support to push datadog logs with examples of how to ingest data
using Vector and Fluentbit
- Updated VictoriaLogs examples directory structure to have single
container image for victorialogs, agent (fluentbit, vector, etc) but
multiple configurations for different protocols

Related issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6632
2024-11-05 16:52:35 +01:00
..
datadog vlinsert: support datadog logs 2024-11-05 16:52:35 +01:00
elasticsearch deployment/victorialogs: rename not executable compose files (#7124) 2024-09-29 09:54:45 +02:00
jsonline deployment/victorialogs: rename not executable compose files (#7124) 2024-09-29 09:54:45 +02:00
loki deployment/victorialogs: rename not executable compose files (#7124) 2024-09-29 09:54:45 +02:00
syslog deployment/victorialogs: rename not executable compose files (#7124) 2024-09-29 09:54:45 +02:00
compose-base.yml deployment/victorialogs: rename not executable compose files (#7124) 2024-09-29 09:54:45 +02:00
Dockerfile docs/victorialogs: change fluentd input type in examples (#7123) 2024-09-27 15:09:36 +02:00
README.md vlinsert: support datadog logs 2024-11-05 16:52:35 +01:00

Docker compose Fluentd integration with VictoriaLogs

The folder contains examples of Fluentd integration with VictoriaLogs using protocols:

All required plugins, that should be installed in order to support protocols listed above can be found in a Dockerfile

To spin-up environment cd to any of listed above directories run the following command:

docker compose up -d 

To shut down the docker-compose environment run the following command:

docker compose down
docker compose rm -f

The docker compose file contains the following components:

  • fluentd - logs collection agent configured to collect and write data to victorialogs
  • victorialogs - logs database, receives data from fluentd agent
  • victoriametrics - metrics database, which collects metrics from victorialogs and fluentd for observability purposes

Querying the data

  • vmui - a web UI is accessible by http://localhost:9428/select/vmui
  • for querying the data via command-line please check these docs

Fluentd configuration example can be found below:

Please, note that _stream_fields parameter must follow recommended best practices to achieve better performance.