github-mirrors/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00
Code Issues Projects Releases Packages Wiki Activity
VictoriaMetrics/app/vmselect
History
Zakhar Bessarab 7205c79c5a
app/vmselect/promql: use lock-less approach to gather results of parallel processing for evalRollup* funcs (#4004) 
* vmselect/promql: refactor `evalRollupNoIncrementalAggregate` to use lock-less approach for parallel workers computation

Locking there is causing issues when running on highly multi-core system as it introduces lock contention during results merge.

New implementation uses lock less approach to store results per workerID and merges final result in the end, this is expected to significantly reduce lock contention and CPU usage for systems with high number of cores.

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* vmselect/promql: add pooling for `timeseriesWithPadding` to reduce allocations

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* vmselect/promql: refactor `evalRollupFuncWithSubquery` to avoid using locks

Uses same approach as `evalRollupNoIncrementalAggregate` to remove locking between workers and reduce lock contention.

Related: #3966
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-03-24 23:07:12 -07:00
..
bufferedwriter lib/netutil: move IsTrivialNetworkError() function there, since it is used in multiple places across the code 2023-01-27 13:24:30 -08:00
graphite all: use metricsql.CompileRegexp instead of regexp.Compile for compiling regexps used in graphite queries 2023-01-09 21:43:08 -08:00
graphiteql app,lib: fix typos in comments (#3804) 2023-02-13 13:27:13 +01:00
netstorage app/vmselect/netstorage: reduce the number of calls to runtime.Gosched() at timeseriesWorker() and unpackWorker() 2023-03-20 20:31:02 -07:00
prometheus app/vmselect: add -search.logQueryMemoryUsage command-line flag for logging queries, which take big amounts of memory 2023-02-23 18:47:08 -08:00
promql app/vmselect/promql: use lock-less approach to gather results of parallel processing for evalRollup* funcs (#4004) 2023-03-24 23:07:12 -07:00
querystats app/vmselect: do not track queries with less than 1ms execution time at /api/v1/status/top_queries 2021-07-15 16:44:28 +03:00
searchutils chore: Use http constants to replace numbers (#3846) 2023-02-22 18:53:05 -08:00
vmui app/vmselect/vmui: run make vmui-update after dc2c712a29 2023-03-24 18:01:39 -07:00
main.go app/vmselect: add -search.logQueryMemoryUsage command-line flag for logging queries, which take big amounts of memory 2023-02-23 18:47:08 -08:00
README.md app/vmui: move source code from https://github.com/VictoriaMetrics/vmui to app/vmui 2021-07-09 17:15:23 +03:00
vmui.go app/vmselect: follow-up after 820312a2b1 2023-01-11 23:28:00 -08:00

README.md

vmselect performs the incoming queries and fetches the required data from vmstorage.

The vmui directory contains static contents built from app/vmui package with make vmui-update command. The vmui page is available at http://<victoria-metrics>:8428/vmui/.