github-mirrors/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00
Code Issues Projects Releases Packages Wiki Activity

deployment/docker: add VictoriaLogs (#4929)

Browse source 
* deployment/docker: add VictoriaLogs configuration

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs: remove outdated comment

It was added in order to indicate that it is required to build VictoriaLogs manually before starting it at the time there was no public release available.
Currently, there is a public tag and it is not required to build it from sources.

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker/victorialogs/fluentbit: include log path in stream configuration

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/docker: add reference to monitoring setup for VictoriaLogs

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
This commit is contained in:
Zakhar Bessarab 2023-09-01 12:45:43 +04:00 committed by GitHub
parent edee262ecc
commit 4e5a68ed08
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
10 changed files with 64 additions and 8 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

13
deployment/docker/README.md
View file

@ -128,3 +128,16 @@ of alerting rules is the following:
Please, also see [how to monitor](https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#monitoring)
VictoriaMetrics installations.
## VictoriaLogs server
VictoriaLogs will be accessible on the following port: `--httpListenAddr=:9428`
[Fluent Bit](https://docs.fluentbit.io/manual) is used to send logs to VictoriaLogs instance.
Fluent Bit is configured to send logs from running containers to VictoriaLogs instance.
Additionally, it is configured to listen for syslog logs on port `5140` and send them to VictoriaLogs instance.
To access VictoriaLogs UI use link [http://localhost:9428/select/vmui/](http://localhost:9428/select/vmui/).
Please, also see [how to monitor](https://docs.victoriametrics.com/VictoriaLogs/#monitoring)
VictoriaLogs installations.

18
deployment/docker/docker-compose.yml
View file

@ -92,9 +92,27 @@ services:
networks:
- vm_net
restart: always
fluentbit:
image: cr.fluentbit.io/fluent/fluent-bit:2.1.4
volumes:
- /var/lib/docker/containers:/var/lib/docker/containers:ro
- ./fluent-bit.conf:/fluent-bit/etc/fluent-bit.conf
depends_on: [victorialogs]
ports:
- "5140:5140"
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
command:
- "--storageDataPath=/vlogs"
- "--httpListenAddr=:9428"
volumes:
- victorialogs-fluentbit:/vlogs
ports:
- "9428:9428"
volumes:
vmagentdata: {}
vmdata: {}
grafanadata: {}
victorialogs-fluentbit: {}
networks:
vm_net:

30
deployment/docker/fluent-bit.conf Normal file
View file

@ -0,0 +1,30 @@
[INPUT]
name tail
path /var/lib/docker/containers/**/*.log
path_key path
multiline.parser docker, cri
Parser docker
Docker_Mode On
[INPUT]
Name syslog
Listen 0.0.0.0
Port 5140
Parser syslog-rfc3164
Mode tcp
[SERVICE]
Flush 1
Parsers_File parsers.conf
[Output]
Name http
Match *
host victorialogs
port 9428
compress gzip
uri /insert/jsonline?_stream_fields=stream,path&_msg_field=log&_time_field=date
format json_lines
json_date_format iso8601
header AccountID 0
header ProjectID 0

1
deployment/docker/victorialogs/filebeat-docker/docker-compose.yml
View file

@ -21,7 +21,6 @@ services:
command:
- -beat.uri=http://filebeat-victorialogs:5066
# Run `make package-victoria-logs` to build victoria-logs image
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes:

1
deployment/docker/victorialogs/filebeat-syslog/docker-compose.yml
View file

@ -12,7 +12,6 @@ services:
ports:
- "5140:5140"
# Run `make package-victoria-logs` to build victoria-logs image
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes:

1
deployment/docker/victorialogs/fluentbit-docker/docker-compose.yml
View file

@ -10,7 +10,6 @@ services:
ports:
- "5140:5140"
# Run `make package-victoria-logs` to build victoria-logs image
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes:

3
deployment/docker/victorialogs/fluentbit-docker/fluent-bit.conf
View file

@ -1,6 +1,7 @@
[INPUT]
name tail
path /var/lib/docker/containers/**/*.log
path_key path
multiline.parser docker, cri
Parser docker
Docker_Mode On
@ -22,7 +23,7 @@
host victorialogs
port 9428
compress gzip
uri /insert/jsonline?_stream_fields=stream&_msg_field=log&_time_field=date
uri /insert/jsonline?_stream_fields=stream,path&_msg_field=log&_time_field=date
format json_lines
json_date_format iso8601
header AccountID 0

1
deployment/docker/victorialogs/logstash/docker-compose.yml
View file

@ -13,7 +13,6 @@ services:
ports:
- "5140:5140"
# Run `make package-victoria-logs` to build victoria-logs image
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes:

1
deployment/docker/victorialogs/promtail/docker-compose.yml
View file

@ -11,7 +11,6 @@ services:
ports:
- "5140:5140"
# Run `make package-victoria-logs` to build victoria-logs image
vlogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes:

1
deployment/docker/victorialogs/vector-docker/docker-compose.yml
View file

@ -21,7 +21,6 @@ services:
victoriametrics:
condition: service_healthy
# Run `make package-victoria-logs` to build victoria-logs image
victorialogs:
image: docker.io/victoriametrics/victoria-logs:v0.3.0-victorialogs
volumes: