github-mirrors/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-12-11 14:53:49 +00:00
Code Issues Projects Releases Packages Wiki Activity
VictoriaMetrics/deployment/docker/victorialogs/compose-base.yml

58 lines
1.4 KiB
YAML
Raw Normal View History

Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
services:
deployment: restructure victorialogs examples (#6971) ### Describe Your Changes - Use common compose.yaml file for all victorialogs setups to set version in a single place and override it on demand for each agent and protocol - Replaced multiple victorialogs instances in HA setup with single setup with `deploy.replica` parameter set - Added fluentd setup ### Checklist The following checks are **mandatory**: - [ ] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). (cherry picked from commit e75ae1b2740d1692f06907ec9aa38e1972e439b6)
2024-09-25 16:33:26 +00:00
# meta service will be ignored by compose
.victorialogs:
deployment/docker: update VictoriaLogs from v0.38.0-victorialogs to v0.39.0-victorialogs See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.39.0-victorialogs (cherry picked from commit 25bca94d04057f8036d677bfb1ab4dba7cace0ab)
2024-10-30 14:11:08 +00:00
image: docker.io/victoriametrics/victoria-logs:v0.39.0-victorialogs
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
command:
- -storageDataPath=/vlogs
- -loggerFormat=json
app/vlinsert: support getting _msg_field, _time_field, _stream_fields and _ignore_fields from headers * Many collectors don't support forwarding url query params to the remote system. It makes impossible to define stream fields for it. Workaround with proxy between VictoriaLogs and log shipper is too complicated solution. * This commit adds the following changes: * Adds fallback to to headers params, if query param is empty for: _msg_field -> VL-Msg-Field _stream_fields -> VL-Stream-Fields _ignore_fields -> VL-Ignore-Fields _time_field -> VL-Time-Field * removes deprecations from victorialogs compose files, added more output format examples for logstash, telegraf, fluent-bit related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5310
2024-09-03 15:43:26 +00:00
- -syslog.listenAddr.tcp=0.0.0.0:8094
app/vlinsert: adds journald ingestion support This commit allows to ingest logs with journald format. https://www.freedesktop.org/software/systemd/man/latest/systemd-journal-remote.service.html related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4618
2024-10-27 19:36:33 +00:00
- -journald.streamFields=_HOSTNAME,_SYSTEMD_UNIT,_PID
- -journald.ignoreFields=MESSAGE_ID,INVOCATION_ID,USER_INVOCATION_ID,
- -journald.ignoreFields=_BOOT_ID,_MACHINE_ID,_SYSTEMD_INVOCATION_ID,_STREAM_ID,_UID
deployment: restructure victorialogs examples (#6971) ### Describe Your Changes - Use common compose.yaml file for all victorialogs setups to set version in a single place and override it on demand for each agent and protocol - Replaced multiple victorialogs instances in HA setup with single setup with `deploy.replica` parameter set - Added fluentd setup ### Checklist The following checks are **mandatory**: - [ ] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). (cherry picked from commit e75ae1b2740d1692f06907ec9aa38e1972e439b6)
2024-09-25 16:33:26 +00:00
deploy:
replicas: 0
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
healthcheck:
app/vlinsert: support getting _msg_field, _time_field, _stream_fields and _ignore_fields from headers * Many collectors don't support forwarding url query params to the remote system. It makes impossible to define stream fields for it. Workaround with proxy between VictoriaLogs and log shipper is too complicated solution. * This commit adds the following changes: * Adds fallback to to headers params, if query param is empty for: _msg_field -> VL-Msg-Field _stream_fields -> VL-Stream-Fields _ignore_fields -> VL-Ignore-Fields _time_field -> VL-Time-Field * removes deprecations from victorialogs compose files, added more output format examples for logstash, telegraf, fluent-bit related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5310
2024-09-03 15:43:26 +00:00
test: ["CMD", "wget", "-qO-", "http://127.0.0.1:9428/health"]
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
interval: 1s
timeout: 1s
retries: 10
deployment: restructure victorialogs examples (#6971) ### Describe Your Changes - Use common compose.yaml file for all victorialogs setups to set version in a single place and override it on demand for each agent and protocol - Replaced multiple victorialogs instances in HA setup with single setup with `deploy.replica` parameter set - Added fluentd setup ### Checklist The following checks are **mandatory**: - [ ] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). (cherry picked from commit e75ae1b2740d1692f06907ec9aa38e1972e439b6)
2024-09-25 16:33:26 +00:00
victorialogs:
extends: .victorialogs
ports:
- '9428:9428'
volumes:
- victorialogs:/vlogs
deploy:
replicas: 1
# second replica is needed for HA setup and its replica count is set to 1 in compose-ha.yaml file
victorialogs-2:
extends: .victorialogs
ports:
- '9429:9428'
volumes:
- victorialogs-2:/vlogs
deploy:
replicas: 0
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
victoriametrics:
use latest image in example for VictoriaLogs and VictoriaMetrics to simplify the flow Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-21 12:15:42 +00:00
image: victoriametrics/victoria-metrics:latest
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
ports:
- '8428:8428'
command:
- -storageDataPath=/vmsingle
- -loggerFormat=json
volumes:
deployment: restructure victorialogs examples (#6971) ### Describe Your Changes - Use common compose.yaml file for all victorialogs setups to set version in a single place and override it on demand for each agent and protocol - Replaced multiple victorialogs instances in HA setup with single setup with `deploy.replica` parameter set - Added fluentd setup ### Checklist The following checks are **mandatory**: - [ ] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). (cherry picked from commit e75ae1b2740d1692f06907ec9aa38e1972e439b6)
2024-09-25 16:33:26 +00:00
- victoriametrics:/vmsingle
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
healthcheck:
app/vlinsert: support getting _msg_field, _time_field, _stream_fields and _ignore_fields from headers * Many collectors don't support forwarding url query params to the remote system. It makes impossible to define stream fields for it. Workaround with proxy between VictoriaLogs and log shipper is too complicated solution. * This commit adds the following changes: * Adds fallback to to headers params, if query param is empty for: _msg_field -> VL-Msg-Field _stream_fields -> VL-Stream-Fields _ignore_fields -> VL-Ignore-Fields _time_field -> VL-Time-Field * removes deprecations from victorialogs compose files, added more output format examples for logstash, telegraf, fluent-bit related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5310
2024-09-03 15:43:26 +00:00
test: ["CMD", "wget", "-qO-", "http://127.0.0.1:8428/health"]
Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 22:18:52 +00:00
interval: 1s
timeout: 1s
retries: 10
volumes:
deployment: restructure victorialogs examples (#6971) ### Describe Your Changes - Use common compose.yaml file for all victorialogs setups to set version in a single place and override it on demand for each agent and protocol - Replaced multiple victorialogs instances in HA setup with single setup with `deploy.replica` parameter set - Added fluentd setup ### Checklist The following checks are **mandatory**: - [ ] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). (cherry picked from commit e75ae1b2740d1692f06907ec9aa38e1972e439b6)
2024-09-25 16:33:26 +00:00
victorialogs:
victorialogs-2:
victoriametrics:
Reference in a new issue Copy permalink