Aliaksandr Valialkin 0ebfb91aba lib/storage: revert the migration from global to per-day index for (MetricName -> TSID) ... This reverts the following commits: - e0e16a2d36 - 2ce02a7fe6 The reason for revert: the updated logic breaks assumptions made when fixing https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698 . For example, if a time series stop receiving new samples during the first day after the indexdb rotation, there are chances that the time series won't be registered in the new indexdb. This is OK until the next indexdb rotation, since the time series is registered in the previous indexdb, so it can be found during queries. But the time series will become invisible for search after the next indexdb rotation, while its data is still there. There is also incompletely solved issue with the increased CPU and disk IO resource usage just after the indexdb rotation. There was an attempt to fix it, but it didn't fix it in full, while introducing the issue mentioned above. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 TODO: to find out the solution, which simultaneously solves the following issues: - increased memory usage for setups high churn rate and long retention (e.g. what the reverted commit does) - increased CPU and disk IO usage during indexdb rotation ( https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 ) - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698		2023-05-18 11:28:54 -07:00
..
appmetrics	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
auth	app/vminsert: allows parsing tenant id from labels (#3009)	2022-09-30 17:28:35 +03:00
awsapi	.golangci.yml: properly enable revive linter and fix all the warnings it detects	2023-02-26 12:19:58 -08:00
backup	backup metadata are written in separate file (#560)	2023-05-16 11:24:44 -07:00
blockcache	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package	2022-06-21 20:24:28 +03:00
bloomfilter	lib/promscrape: add the ability to limit the number of unique series per each scrape target	2021-09-01 16:08:12 +03:00
buildinfo	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
bytesutil	lib/bytesutil: go fmt after 2ec17bed2c	2023-05-10 20:29:15 -07:00
cgroup	all: use os.{Read|Write}File instead of ioutil.{Read|Write}File	2022-08-21 23:55:20 +03:00
consts	app/vminsert: reduce the max packet size, which vminsert can send to vmstorage	2022-04-05 15:39:58 +03:00
decimal	lib/decimal: use consistent randomizer in tests	2023-01-23 19:24:05 -08:00
encoding	lib/encoding: fix test after 4725549cb2	2023-04-05 21:38:48 -07:00
envflag	lib/envflag: small refactoring after 518c340ae3 and 02096e06d0	2022-10-29 02:29:19 +03:00
envtemplate	allowed using dashes and dots in environment variables names (#4009)	2023-03-24 17:57:19 -07:00
fastnum	Makefile: add build and test rules with enabled race detector. These rules have -race suffix	2020-03-05 12:05:16 +02:00
fasttime	lib: extract common code for returning fast unix timestamp into lib/fasttime	2020-05-14 23:06:50 +03:00
filestream	lib/filestream: change Create() to MustCreate()	2023-04-14 15:14:24 -07:00
flagutil	lib/flagutil: ArrayString: support commas inside quoted strings and inside [], {} and () braces	2023-03-28 21:25:07 -07:00
formatutil	app/vmbackupmanager: add metrics for better observability (#488)	2022-12-20 14:18:43 -08:00
fs	fixed typos in documentation and commandline flags descriptions (#4275)	2023-05-10 02:22:06 -07:00
handshake	lib/handshake: do not pollute logs with cannot read hello messages on TCP health checks	2023-05-18 10:37:59 -07:00
htmlcomponents	app/vmselect: remove dependency on lib/promscrape from app/vmselect	2023-01-03 23:27:36 -08:00
httpserver	fixed typos in documentation and commandline flags descriptions (#4275)	2023-05-10 02:22:06 -07:00
influxutils	lib/flagutil: rename Array to ArrayString	2022-10-01 18:28:19 +03:00
ingestserver	lib/netutil: init implimentation of proxy protocol (#3687)	2023-01-26 23:25:22 -08:00
leveledbytebufferpool	all: make fmt via the upcoming Go1.19	2022-07-11 19:23:25 +03:00
logger	add error handler for parsing prometheus text format to vmagent and v… (#3693)	2023-01-23 22:36:23 -08:00
lrucache	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package	2022-06-21 20:24:28 +03:00
memory	max value for memory.allowedPercent changed from 200 to 100 (#4171) (#4251)	2023-05-08 23:20:56 -07:00
mergeset	lib/mergeset: remove superflouos logging when opening and closing the Table	2023-05-16 15:32:35 -07:00
metricsql	all: make fmt via the upcoming Go1.19	2022-07-11 19:23:25 +03:00
netutil	fixed typos in documentation and commandline flags descriptions (#4275)	2023-05-10 02:22:06 -07:00
persistentqueue	app/vmagent,lib/persistentqueue: show warning message if --remoteWrite.maxDiskUsagePerURL flag lower than 500MB (#4196)	2023-05-08 15:45:21 -07:00
procutil	lib/procutil: stop immediately after receiving the second SIGINT or SIGTERM signal	2022-10-20 21:58:49 +03:00
promauth	chore: Use http constants to replace numbers (#3846)	2023-02-22 18:59:32 -08:00
prompb	app/vminsert: moved -maxInsertRequestSize command-line flag out of lib/prompb in order to prevent its inclusion in vmselect and vmstorage apps	2020-01-28 22:53:50 +02:00
prompbmarshal	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:33:46 +03:00
promrelabel	Revert "lib/promrelabel: show error message if labels not in prometheus exposition format (#4304)"	2023-05-12 17:01:23 -07:00
promscrape	fixed typos in documentation and commandline flags descriptions (#4275)	2023-05-10 02:22:06 -07:00
promutils	lib/promutils: add ParseTimeAt() function	2023-05-13 20:12:55 -07:00
protoparser	lib/promutils: properly return error when incorrect Prometheus label names are passed to NewLabelsFromString()	2023-05-12 17:02:06 -07:00
proxy	lib/promauth: add ability to send additional http headers in requests to scrape targets	2022-06-22 20:40:50 +03:00
pushmetrics	fixed typos in documentation and commandline flags descriptions (#4275)	2023-05-10 02:22:06 -07:00
querytracer	lib/querytracer: fix remaining tests after 49ebc48809	2022-12-08 18:18:50 -08:00
regexutil	app,lib: fix typos in comments (#3804)	2023-02-13 09:32:35 -08:00
snapshot	app/vmbackup: prevent password leaks (#3672)	2023-01-18 11:40:52 -08:00
storage	lib/storage: revert the migration from global to per-day index for (MetricName -> TSID)	2023-05-18 11:28:54 -07:00
streamaggr	Revert "lib/streamaggr: discard samples with timestamps outside of aggregation interval (#4199)"	2023-05-08 21:50:19 -07:00
syncwg	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
tenantmetrics	app/vminsert: allows parsing tenant id from labels (#3009)	2022-09-30 17:28:35 +03:00
timerpool	lib/timerpool: use timer pool in concurrency limiters	2019-05-28 17:30:10 +03:00
uint64set	lib/uint64set: use repeatable randomizer in tests	2023-01-23 19:24:05 -08:00
vmselectapi	lib/handshake: do not pollute logs with cannot read hello messages on TCP health checks	2023-05-18 10:37:59 -07:00
workingsetcache	lib/workingsetcache: expose -cacheExpireDuration command-line flag for fine-tuning of the cache expiration	2022-11-17 21:55:11 +02:00
writeconcurrencylimiter	lib/writeconcurrencylimiter: initialize concurrencyLimitCh before exporting vm_concurrent_insert_capacity and vm_concurrent_insert_current metrics	2023-02-07 11:08:39 -08:00