VictoriaMetrics/app
Aliaksandr Valialkin 53d871d0b1
app/vmselect/netstorage: reduce tail latency during query processing
Previously the selected time series were split evenly among available CPU cores
for further processing - e.g unpacking the data and applying the given rollup
function to the unpacked data.
Some time series could be processed slower than others.
This could result in uneven work distribution among available CPU cores,
e.g. some CPU cores could complete their work sooner than others.
This could slow down query execution.

The new algorithm allows stealing time series to process from other CPU cores
when all the local work is done. This should reduce the maximum time
needed for query execution (aka tail latency).

The new algorithm should also scale better on systems with many CPU cores,
since every CPU processes locally assigned time series without inter-CPU communications.

The inter-CPU communications are used only when all the local work is finished
and the pending work from other CPUs needs to be stealed.
2023-01-10 13:43:14 -08:00
..
victoria-metrics tests: attempt to fix flaky graphite test (#3567) 2022-12-29 11:48:47 -08:00
vmagent all: small improvements in error messages and command-line flag descriptions related to concurrency limiters 2023-01-07 00:11:44 -08:00
vmalert docs: update -help outputs for vm* tools 2023-01-03 23:27:06 -08:00
vmauth docs: update -help outputs for vm* tools 2023-01-03 23:27:06 -08:00
vmbackup docs: update -help outputs for vm* tools 2023-01-03 23:27:06 -08:00
vmbackupmanager doc: add vmbackupmanager monitoring section (#3605) 2023-01-05 16:03:06 +01:00
vmctl Fix vmctl command hint for vm-native-step-interval (#3575) 2023-01-03 10:54:53 +01:00
vmgateway docs: update -help outputs for vm* tools 2023-01-03 23:27:06 -08:00
vminsert app/{vminsert,vmstorage}: add comments on why storage.AddRows() is called without limiting the number of concurrent calls 2023-01-06 22:40:07 -08:00
vmrestore docs: update -help outputs for vm* tools 2023-01-03 23:27:06 -08:00
vmselect app/vmselect/netstorage: reduce tail latency during query processing 2023-01-10 13:43:14 -08:00
vmstorage app/{vminsert,vmstorage}: add comments on why storage.AddRows() is called without limiting the number of concurrent calls 2023-01-06 22:40:07 -08:00
vmui vmui: improve Explore metrics (#3598) 2023-01-05 02:23:04 -08:00