VictoriaMetrics/lib/protoparser
Roman Khavronenko 0cf55ded34
lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364)
Tests showed that importing a single line with 70MB size takes 5.3GiB
RSS memory for VictoriaMetrics single-node.
In the scenario when user exports and imports data from one VM to another,
it could possibly lead to OOM exception for destination VM.

Importing a single line with 16MB size taks 1.3GiB RSS memory.
Hence, the limit for `import.maxLineLen` was decreased from 100MB to 10MB
to improve reliability of VictoriaMetrics during imports.

Signed-off-by: hagen1778 <roman@victoriametrics.com>
Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2023-11-24 12:53:04 +02:00
..
common lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364) 2023-11-24 12:53:04 +02:00
csvimport lib/protoparser/csvimport: properly parse the last empty column in CSV line 2023-05-12 15:51:41 -07:00
datadog all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-25 21:24:03 +02:00
graphite lib/protoparser/graphite: extract stream parsing code into a separate stream package 2023-02-13 10:32:36 -08:00
influx lib/promauth: follow-up for e16d3f5639 2023-10-25 23:19:37 +02:00
native/stream lib/protoparser/native: extract stream parsing code into a separate stream package 2023-02-13 10:43:05 -08:00
newrelic all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-25 21:24:03 +02:00
opentelemetry all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-25 21:24:03 +02:00
opentsdb lib/protoparser/opentsdb: extract stream parsing code into a separate stream package 2023-02-13 10:03:16 -08:00
opentsdbhttp lib/opentsdbhttp: fix a typo preventing from using writeconcurrencylimiter (#4208) 2023-04-27 09:22:42 +02:00
prometheus lib/promscrape: make concurrency control optional (#5073) 2023-10-02 21:32:11 +02:00
promremotewrite/stream lib/protoparser/promremotewrite: fall back to zstd decoding if Snappy-decoding fails (#5344) 2023-11-17 15:51:09 +01:00
vmimport lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364) 2023-11-24 12:53:04 +02:00