VictoriaMetrics/app
Zakhar Bessarab 71044221f6
app/vmselect/promql: use lock-less approach to gather results of parallel processing for evalRollup* funcs (#4004)
* vmselect/promql: refactor `evalRollupNoIncrementalAggregate` to use lock-less approach for parallel workers computation

Locking there is causing issues when running on highly multi-core system as it introduces lock contention during results merge.

New implementation uses lock less approach to store results per workerID and merges final result in the end, this is expected to significantly reduce lock contention and CPU usage for systems with high number of cores.

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* vmselect/promql: add pooling for `timeseriesWithPadding` to reduce allocations

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* vmselect/promql: refactor `evalRollupFuncWithSubquery` to avoid using locks

Uses same approach as `evalRollupNoIncrementalAggregate` to remove locking between workers and reduce lock contention.

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-03-25 01:24:20 -07:00
..
vmagent all: follow-up for 7a3e16e774 2023-03-12 01:19:55 -08:00
vmalert all: follow-up for 7a3e16e774 2023-03-12 01:19:55 -08:00
vmauth all: follow-up for 7a3e16e774 2023-03-12 01:19:55 -08:00
vmbackup app/vmbackup: simplify code a bit after 5ba347bd2c 2023-03-24 22:20:20 -07:00
vmbackupmanager doc: add vmbackupmanager monitoring section (#3605) 2023-01-05 16:49:59 -08:00
vmctl app/vmctl: skip series if measurement not found (#3869) 2023-02-27 12:04:48 -08:00
vmgateway docs: update command-line descriptions after 73256fe438 2023-01-27 00:01:14 -08:00
vminsert all: follow-up for 7a3e16e774 2023-03-12 01:19:55 -08:00
vmrestore all: run apk update && apk upgrade in base Alpine Docker image in order to get all the recent security fixes 2023-02-09 14:03:02 -08:00
vmselect app/vmselect/promql: use lock-less approach to gather results of parallel processing for evalRollup* funcs (#4004) 2023-03-25 01:24:20 -07:00
vmstorage all: follow-up for 7a3e16e774 2023-03-12 01:19:55 -08:00
vmui security: bump go version to 1.20.2 (#3935) 2023-03-12 01:38:51 -08:00