VictoriaMetrics/deployment/docker/victorialogs/logstash
Andrii Chubatiuk 6adb3f0dc2
victorialogs: marked fluentd support in roadmap, added syslog example (#7098)
### Describe Your Changes

Marked fluentd in victorialogs roadmap
Added fluentd syslog example setup

### Checklist

The following checks are **mandatory**:

- [ ] My change adheres [VictoriaMetrics contributing
guidelines](https://docs.victoriametrics.com/contributing/).

(cherry picked from commit 05a64a8c14)
2024-09-27 14:43:04 +02:00
..
elasticsearch deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
jsonline deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
jsonline-ha deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
loki deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
compose.yml deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
Dockerfile deployment: restructure victorialogs examples (#6971) 2024-09-25 18:39:43 +02:00
logstash.yml Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) 2023-07-06 21:25:31 -07:00
README.md victorialogs: marked fluentd support in roadmap, added syslog example (#7098) 2024-09-27 14:43:04 +02:00

Docker compose Logstash integration with VictoriaLogs

The folder contains examples of Logstash integration with VictoriaLogs using protocols:

All required plugins, that should be installed in order to support protocols listed above can be found in a Dockerfile

To spin-up environment cd to any of listed above directories run the following command:

docker compose up -d 

To shut down the docker-compose environment run the following command:

docker compose down
docker compose rm -f

The docker compose file contains the following components:

  • logstash - logs collection agent configured to collect and write data to victorialogs
  • victorialogs - logs database, receives data from logstash agent
  • victoriametrics - metrics database, which collects metrics from victorialogs and logstash for observability purposes

Querying the data

  • vmui - a web UI is accessible by http://localhost:9428/select/vmui
  • for querying the data via command-line please check these docs

Logstash configuration example can be found below:

Please, note that _stream_fields parameter must follow recommended best practices to achieve better performance.