VictoriaMetrics/app/vminsert
Aliaksandr Valialkin 85fcefaa34
app/vmagent: code cleanup for Kafka and Google PubSub consumers / producers
- Add links to relevant docs into descriptions for every -kafka.* and -gcp.pubsub.* command-line flags.
- Wait until message processing goroutines are stopped before returning from gcppubsub.Stop().
- Prevent from multiple calls to Init() without Stop().
- Drop message if tenantID cannot be parsed properly.
- Take into account tenantID for all the supported message formats.
- Support gzip-compressed messages for graphite format.
- Use exponential backoff sleep when the message cannot be pushed to remote storage systems
  because of disabled on-disk persistence - https://docs.victoriametrics.com/vmagent.html#disabling-on-disk-persistence
- Unblock from sleep as soon as Stop() is called. Previously the sleep could take up to 2 seconds after Stop() is called.
- Remove unused globalCtx and initContext from app/vmagent/remotewrite/gcppubsub
- Mention Google PubSub support at docs/enterprise.md
- Make Google PubSub docs more clear at docs/vmagent.md

This is a follow-up for commits 115245924a5f096c5a3383d6cc8e8b6fbd421984
and e6eab781ce42285a6a1750dc01eba6801dd35516 .

Updates https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/717
Updates https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/713
2023-12-04 22:51:04 +02:00
..
clusternative lib/handshake: do not pollute logs with cannot read hello messages on TCP health checks 2023-05-18 10:37:59 -07:00
csvimport lib/protoparser/csvimport: extract stream parsing code into a separate stream package 2023-02-13 10:26:29 -08:00
datadog add datadog /api/v2/series and /api/beta/sketches support (#5094) 2023-12-01 13:55:32 +01:00
deployment Rootless docker images by default (#358) 2020-03-27 21:18:32 +02:00
graphite app/vmagent: code cleanup for Kafka and Google PubSub consumers / producers 2023-12-04 22:51:04 +02:00
influx fixed typos in documentation and commandline flags descriptions (#4275) 2023-05-10 02:22:06 -07:00
multiarch all: run apk update && apk upgrade in base Alpine Docker image in order to get all the recent security fixes 2023-02-09 14:03:02 -08:00
native lib/protoparser/native: extract stream parsing code into a separate stream package 2023-02-13 10:44:27 -08:00
netstorage app/vminsert: properly close vmstorage connection (#4935) 2023-09-01 17:56:41 +02:00
newrelic app/vminsert/newrelic: simplify the code a bit after 1fb8dc0092 2023-12-04 16:26:52 +02:00
opentelemetry opentelemetry: return human readable error for json encoding. (#4822) 2023-08-12 05:06:19 -07:00
opentsdb lib/protoparser/opentsdb: extract stream parsing code into a separate stream package 2023-02-13 10:04:14 -08:00
opentsdbhttp fixed ingestion via multitenant url for opentsdbhttp (#5061) (#5063) 2023-09-26 10:47:49 +02:00
prometheusimport lib/promscrape: make concurrency control optional (#5073) 2023-10-02 21:34:41 +02:00
promremotewrite app/vmagent: add support for VictoriaMetrics remote write protocol, which allows saving up to 10x on network bandwidth costs under high load 2023-02-20 18:40:40 -08:00
relabel lib/promrelabel: properly replace : char with _ in metric names when -usePromCompatibleNaming command-line flag is set 2023-08-14 16:18:17 +02:00
vmimport lib/protoparser/vmimport: extract stream parsing code into a separate stream package 2023-02-13 10:22:00 -08:00
main.go app/vminsert: fix newrelic ingestion in cluster version (#5421) 2023-12-04 09:38:32 +01:00
Makefile all: add Windows build for VictoriaMetrics 2023-03-19 23:28:26 -07:00
README.md all: add native format for data export and import 2020-09-27 17:36:38 +03:00

vminsert routes the ingested data to vmstorage.