VictoriaMetrics/deployment/docker/victorialogs/fluentd
Andrii Chubatiuk 73afeaf510
deployment: restructure victorialogs examples (#6971)
### Describe Your Changes

- Use common compose.yaml file for all victorialogs setups to set
version in a single place and override it on demand for each agent and
protocol
- Replaced multiple victorialogs instances in HA setup with single setup
with `deploy.replica` parameter set
- Added fluentd setup

### Checklist

The following checks are **mandatory**:

- [ ] My change adheres [VictoriaMetrics contributing
guidelines](https://docs.victoriametrics.com/contributing/).

(cherry picked from commit e75ae1b274)
2024-09-25 18:39:43 +02:00
..
elasticsearch deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
jsonline deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
loki deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
compose.yml deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
Dockerfile deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
README.md deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00

Docker compose Fluentd integration with VictoriaLogs using given below protocols:

The folder contains the example of integration of fluentd with Victorialogs

To spin-up environment cd to any of listed above directories run the following command:

docker compose up -d 

To shut down the docker-compose environment run the following command:

docker compose down
docker compose rm -f

The docker compose file contains the following components:

  • fluentd - fluentd is configured to collect logs from the docker, you can find configuration in the fluent-bit.conf. It writes data in VictoriaLogs
  • VictoriaLogs - the log database, it accepts the data from fluentd by json line protocol

Querying the data

  • vmui - a web UI is accessible by http://localhost:9428/select/vmui
  • for querying the data via command-line please check these docs

Fluentd configuration example can be found below:

Please, note that _stream_fields parameter must follow recommended best practices to achieve better performance.