Commit graph

75 commits

Author SHA1 Message Date
Aliaksandr Valialkin
bc7cf4950b
lib/promscrape: use the standard net/http.Client instead of fasthttp.Client for scraping targets in non-streaming mode
While fasthttp.Client uses less CPU and RAM when scraping targets with small responses (up to 10K metrics),
it doesn't work well when scraping targets with big responses such as kube-state-metrics.
In this case it could use big amounts of additional memory comparing to net/http.Client,
since fasthttp.Client reads the full response in memory and then tries re-using the large buffer
for further scrapes.

Additionally, fasthttp.Client-based scraping had various issues with proxying, redirects
and scrape timeouts like the following ones:

- https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1945
- https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5425
- https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794
- https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1017

This should help reducing memory usage for the case when target returns big response
and this response is scraped by fasthttp.Client at first before switching to stream parsing mode
for subsequent scrapes. Now the switch to stream parsing mode is performed on the first scrape
after reading the response body in memory and noticing that its size exceeds the value passed
to -promscrape.minResponseSizeForStreamParse command-line flag.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5567

Overrides https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4931
2024-01-30 18:39:10 +02:00
Aliaksandr Valialkin
b7fb7c5f77
vendor: run make vendor-update 2023-11-13 18:50:16 +01:00
Aliaksandr Valialkin
0b66840520
vendor: run make vendor-update 2023-10-12 11:17:53 +02:00
Aliaksandr Valialkin
cf6fc2a6b7
vendor: run make vendor-update 2023-09-07 13:01:39 +02:00
Aliaksandr Valialkin
e8bcb17c8a
vendor: run make vendor-update 2023-08-11 07:16:25 -07:00
Aliaksandr Valialkin
1df3e548c1
vendor: run make vendor-update 2023-07-07 00:04:32 -07:00
Aliaksandr Valialkin
9eb1abdefe
vendor: make vendor-update 2023-05-09 23:13:50 -07:00
Aliaksandr Valialkin
b7cce552da
vendor: make vendor-update 2023-04-10 10:20:54 -07:00
Aliaksandr Valialkin
c28c25ed2e
vendor: make vendor-update 2023-03-12 03:13:53 -07:00
Aliaksandr Valialkin
1030be91ae
vendor: make vendor-update 2023-02-18 15:36:41 -08:00
Aliaksandr Valialkin
291c41978e
vendor: make vendor-update 2023-02-09 14:48:16 -08:00
Aliaksandr Valialkin
67ab49baa9
vendor: make vendor-update 2023-01-09 21:34:34 -08:00
Aliaksandr Valialkin
19f20c0f4e
vendor: make vendor-update 2022-12-10 21:46:16 -08:00
Aliaksandr Valialkin
06758650bf
vendor: make vendor-update 2022-12-05 23:28:14 -08:00
Aliaksandr Valialkin
2bcafbef25
vendor: make vendor-update 2022-11-10 13:46:33 +02:00
Aliaksandr Valialkin
0cea525456
vendor: make vendor-update 2022-10-07 01:01:21 +03:00
Aliaksandr Valialkin
366f04001b
vendor: make vendor-update 2022-10-01 17:20:11 +03:00
Aliaksandr Valialkin
dc4b87621f
vendor: make vendor-update 2022-09-21 11:54:32 +03:00
Dmytro Kozlov
6a794ec5d5
app/{vmctl,vmalert}: update progress bar library (make vendor-update) (#3138)
* app/{vmctl,vmalert}: update progress bar library (make vendor-update)

* app/{vmctl,vmalert}: make vendor-update
2022-09-21 11:08:33 +03:00
Aliaksandr Valialkin
523ff25077
vendor: make vendor-update 2022-09-13 16:44:44 +03:00
Aliaksandr Valialkin
7c2fa1bc48
vendor: make vendor-update 2022-09-08 18:51:49 +03:00
Aliaksandr Valialkin
308f29f674
vendor: make vendor-update 2022-08-15 00:53:41 +03:00
Aliaksandr Valialkin
ebd59e17df
vendor: make vendor-update 2022-08-07 22:38:01 +03:00
Aliaksandr Valialkin
f148cffc8a
vendor: make vendor-update 2022-07-25 10:49:33 +03:00
Aliaksandr Valialkin
418f40f7fa
vendor: make vendor-update 2022-06-20 14:30:23 +03:00
Aliaksandr Valialkin
b3b6cf345a
vendor: make vendor-update 2022-06-06 13:19:34 +03:00
Aliaksandr Valialkin
31c6cfe3fb
vendor: make vendor-update 2022-05-25 21:49:12 +03:00
Aliaksandr Valialkin
d87733fe1c
vendor: make vendor-update 2022-05-20 14:45:24 +03:00
Aliaksandr Valialkin
e0195558c9
vendor: make vendor-update 2022-04-26 15:24:27 +03:00
Aliaksandr Valialkin
8d0fb4d69d
vendor: make vendor-update 2022-04-21 16:00:47 +03:00
Aliaksandr Valialkin
ea349660cf
vendor: make vendor-update 2022-04-19 11:40:41 +03:00
Aliaksandr Valialkin
a91c2a4377
vendor: make vendor-update 2022-04-12 12:51:54 +03:00
Aliaksandr Valialkin
d4f14f4879
vendor: make vendor-update 2022-04-04 13:05:04 +03:00
Aliaksandr Valialkin
3f8ab2e4be
vendor: make vendor-update 2022-03-03 18:14:56 +02:00
Aliaksandr Valialkin
7749b47d6a
vendor: make vendor-update 2021-12-20 12:07:22 +02:00
Aliaksandr Valialkin
7d58f57a52
vendor: make vendor-update 2021-12-12 18:10:09 +02:00
Aliaksandr Valialkin
9c66848c32
vendor: make vendor-update 2021-12-02 12:42:35 +02:00
Aliaksandr Valialkin
e6a0c87c7e
vendor: make vendor-update 2021-11-29 12:35:40 +02:00
Aliaksandr Valialkin
4b660a7fc9
vendor: make vendor-update 2021-11-17 13:37:42 +02:00
Aliaksandr Valialkin
09b0641ccb
vendor: make vendor-update 2021-11-14 14:06:53 +02:00
Aliaksandr Valialkin
1be4838ca0
vendor: make vendor-update 2021-11-08 12:39:57 +02:00
Aliaksandr Valialkin
28b6456f3b
vendor: make vendor-update 2021-11-01 15:59:38 +02:00
Aliaksandr Valialkin
8124f202a4
vendor: make vendor-update 2021-10-22 19:27:06 +03:00
Aliaksandr Valialkin
dea8521ab9
vendor: make vendor-update 2021-10-18 15:25:11 +03:00
Aliaksandr Valialkin
6058edb0d1
vendor: make vendor-update 2021-10-08 16:04:56 +03:00
Aliaksandr Valialkin
ec3a87bb46
vendor: make vendor-update 2021-10-05 10:29:12 +03:00
Aliaksandr Valialkin
3dea9e02d0
vendor: make vendor-update 2021-09-30 17:52:02 +03:00
Aliaksandr Valialkin
80b0b92d2f
vendor: make vendor-update 2021-09-27 17:57:40 +03:00
Aliaksandr Valialkin
15ea4c6dae vendor: make vendor-update 2021-09-20 14:38:55 +03:00
Aliaksandr Valialkin
26cd0d36b4 vendor: make vendor-update 2021-09-15 18:22:59 +03:00