Aliaksandr Valialkin 10476738a8 lib/blockcache: increase the lifetime for rarely accessed blocks from 2 minutes to 5 minutes ... This should improve data ingestion speed if time series samples are ingested with interval bigger than 2 minutes. The actual interval could exceed 2 minutes if the original interval between samples doesn't exceed 2 minutes in the case of slow inserts. Slow inserts may appear in the following cases: * Big number of new time series are pushed to VictoriaMetrics, so they couldn't be registered in 2 minutes. * MetricName->tsid cache reset on indexdb rotation or due to unclean shutdown. In this case VictoriaMetrics needs to load MetricName->tsid entries for all the incoming series from IndexDB. IndexDB uses the block cache for increasing lookup performance. If the cache has no the needed block, then IndexDB reads and unpacks the block from disk. This requires an extra disk read IO and CPU. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007 This also should increase performance for periodically executed queries with intervals from 2 minutes to 5 minutes. See the previous similar commit - 43103be011 It is possible that the timeout can be increased further. Let's collect production numbers for this change so the timeout could be adjusted further.		2022-02-08 01:18:27 +02:00
..
auth	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:33:46 +03:00
backup	adds restore.lock (#1988)	2021-12-22 13:10:56 +02:00
blockcache	lib/blockcache: increase the lifetime for rarely accessed blocks from 2 minutes to 5 minutes	2022-02-08 01:18:27 +02:00
bloomfilter	lib/promscrape: add the ability to limit the number of unique series per each scrape target	2021-09-01 16:08:12 +03:00
buildinfo	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
bytesutil	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 11:20:20 +02:00
cgroup	lib/cgroup: fall back to runtime.NumCPU() when determining process_cpu_cores_available metric if it is impossible to determine cpu quota via cgroups	2022-01-31 20:31:12 +02:00
consts	all: open-sourcing cluster version	2019-05-23 00:25:38 +03:00
decimal	all: fix build issues and tests for Apple M1	2021-10-27 15:07:19 +03:00
encoding	lib/encoding: substitute 64-bits.LeadingZeros64() with bits.Len64()	2022-02-01 11:20:20 +02:00
envflag	lib/envflag: use flag.Set for setting the flags from env vars	2021-10-20 00:46:53 +03:00
envtemplate	all: support %{ENV_VAR} placeholders in yaml configs in all the vm* components	2020-08-13 17:17:06 +03:00
fastnum	Makefile: add build and test rules with enabled race detector. These rules have -race suffix	2020-03-05 12:05:16 +02:00
fasttime	lib: extract common code for returning fast unix timestamp into lib/fasttime	2020-05-14 23:06:50 +03:00
filestream	lib/fs: add vm_filestream_read_duration_seconds_total and vm_filestream_write_duration_seconds_total metrics	2021-12-02 09:13:20 +02:00
flagutil	lib/flagutil: do not expose sensitive info (passwords, keys and urls) at /flags page	2021-10-20 00:51:15 +03:00
fs	app: allow specifying http and https urls in the following command-line flags	2021-12-03 00:11:47 +02:00
handshake	all: substitute zeroTime with time.Time{}, since this generates more optimal binary code	2022-02-07 14:36:41 +02:00
httpserver	lib/httpserver: add missing 127.0.0.1 hostname to the logged address for http and pprof server if the address starts with ':'	2021-12-08 16:15:12 +02:00
influxutils	all: consistently return application/json content-type without charset=utf-8	2021-11-09 18:07:22 +02:00
ingestserver	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 11:20:20 +02:00
leveledbytebufferpool	lib/promscrape: an attempt to reduce memory usage when vmagent scrapes targets with varying number of metrics	2021-03-15 11:49:29 +02:00
logger	lib/logger: removed broken test after 746ee191e8	2022-01-24 12:15:11 +02:00
memory	all: add go:build lines for Go1.17	2021-07-26 15:50:46 +03:00
mergeset	lib/mergeset: pre-allocate data and items for inmemoryBlock in order to reduce memory allocations under high churn rate	2022-02-01 11:20:20 +02:00
metricsql	lib/metricsql: move it to a separate repository - github.com/VictoriaMetrics/metrics	2020-04-28 15:30:06 +03:00
netutil	lib/netutil: increase dial timeout from 1 second to 5 seconds	2022-02-07 12:33:40 +02:00
pacelimiter	lib/pacelimiter: increase scalability for multi-CPU system	2020-08-06 18:33:07 +03:00
persistentqueue	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 11:20:20 +02:00
procutil	all: add go:build lines for Go1.17	2021-07-26 15:50:46 +03:00
promauth	app: allow specifying http and https urls in the following command-line flags	2021-12-03 00:11:47 +02:00
prompb	app/vminsert: moved -maxInsertRequestSize command-line flag out of lib/prompb in order to prevent its inclusion in vmselect and vmstorage apps	2020-01-28 22:53:50 +02:00
prompbmarshal	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:33:46 +03:00
promrelabel	all: typo fix: unexected -> unexpected	2021-12-20 17:40:13 +02:00
promscrape	lib/promscrape: show the total number of scrapes and the total number of scrape errors per target at /targets page	2022-02-03 20:23:27 +02:00
protoparser	all: follow-up after 4bdd10ab90	2022-02-01 17:49:28 +02:00
proxy	lib/promscrape: properly show proxy_url option value at /config page	2021-10-26 21:24:22 +03:00
storage	all: follow-up after 4bdd10ab90	2022-02-01 17:49:28 +02:00
storagepacelimiter	lib/storage: remove prioritizing of merging small parts over merging big parts, since it doesn't work as expected	2020-07-30 20:02:22 +03:00
syncwg	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
tenantmetrics	app/vmselect: export per-tenant stats on the number of requests and the cumulative request duration	2021-02-16 23:30:29 +02:00
timerpool	lib/timerpool: use timer pool in concurrency limiters	2019-05-28 17:30:10 +03:00
uint64set	Revert "lib/uint64set: allow reusing bucket16 structs inside uint64set.Set via uint64set.Release method"	2021-07-06 18:26:56 +03:00
workingsetcache	lib/workingsetcache: use the original cache size limits when rotating caches	2022-02-08 01:18:27 +02:00
writeconcurrencylimiter	all: properly handle CPU limits set on the host system/container	2020-12-08 21:07:03 +02:00