VictoriaMetrics/app
YuDong Tang cab3ef8294
app/vmselect:add command-line flag -search.inmemoryBufSizeBytes (#6869)
add command-line flag `-search.inmemoryBufSizeBytes` for configuring size of in-memory buffers used by vmselect during processing of vmstorage responses. A new summary metric `vm_tmp_blocks_inmemory_file_size_bytes` is exposed to show the size of the buffer during requests processing. 

The new setting can be used by experienced users to adjust memory usage by vmselect when processing
many small read requests. Instead of allocating 4MB buffers each time, vmselect can be instructed to lower
the buffer size via `-search.inmemoryBufSizeBytes`. To make the decision whether this flag needs to be adjusted
users can consult with `vm_tmp_blocks_inmemory_file_size_bytes` which shows the actual size of buffers used
during query processing.

----------

The detailed information of this PR can be found in
https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6851

### Checklist

The following checks are **mandatory**:

- [ ] My change adheres [VictoriaMetrics contributing
guidelines](https://docs.victoriametrics.com/contributing/).

---------

Co-authored-by: hagen1778 <roman@victoriametrics.com>
2024-08-26 14:37:45 +02:00
..
victoria-logs app/victoria-logs/Makefile: add make victoria-logs-linux-loong64 build rule 2024-07-12 23:13:19 +02:00
vlinsert app/vlinsert/elasticsearch: add fake response for logstash requests (#6742) 2024-08-06 16:30:11 +02:00
vlogsgenerator all: consistently use stringsutil.JSONString() for formatting JSON strings with fmt.* functions instead of using "%q" formatter 2024-07-17 14:01:37 +02:00
vlselect app/{vmselect,vlselect}: run make vmui-update vmui-logs-update after efd70b2c52 2024-07-27 13:51:02 +02:00
vlstorage vendor: update github.com/VictoriaMetrics/metrics from v1.34.1 to v1.35.0 2024-07-15 10:45:39 +02:00
vmagent app/vmagent: add remoteWrite.retryMinInterval and remoteWrite.retryMaxTime flags (#6289) 2024-08-23 15:28:44 +02:00
vmalert app/vmalert: update parsing for instant responses (#6859) 2024-08-22 23:56:11 +02:00
vmalert-tool deployment: build image for vmagent streamaggr benchmark (#6515) 2024-06-24 16:29:14 +02:00
vmauth app/vmauth: verify how backend response headers are propagated to vmauth client 2024-07-27 13:45:07 +02:00
vmbackup app: consistently use t.Fatal* instead of t.Error* (except of app/vmalert and app/vmctl - these packages will be processed in a separate commit) 2024-07-11 16:01:25 +02:00
vmbackupmanager all: replace old https://docs.victoriametrics.com/vmbackupmanager.html url with the new one - https://docs.victoriametrics.com/vmbackupmanager/ 2024-04-18 02:04:39 +02:00
vmctl lib/httputils: parse URL before creating HTTP transport (#6820) 2024-08-16 11:34:49 +02:00
vmgateway all: replace old https://docs.victoriametrics.com/vmgateway.html url with the new one - https://docs.victoriametrics.com/vmgateway/ 2024-04-18 02:08:53 +02:00
vminsert app/vminsert: returns back memory optimisation (#6794) 2024-08-13 10:49:09 -04:00
vmrestore deployment: build image for vmagent streamaggr benchmark (#6515) 2024-06-24 16:29:14 +02:00
vmselect app/vmselect:add command-line flag -search.inmemoryBufSizeBytes (#6869) 2024-08-26 14:37:45 +02:00
vmstorage all: consistently use stringsutil.JSONString() for formatting JSON strings with fmt.* functions instead of using "%q" formatter 2024-07-17 14:01:37 +02:00
vmui deployment/docker: update Go builder from Go1.22.5 to Go1.23.0 (#6861) 2024-08-22 23:56:12 +02:00