github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00

Author	SHA1	Message	Date
Aliaksandr Valialkin	5e43145031	docs: add docs for scrape_configs section	2022-08-07 00:04:55 +03:00
Aliaksandr Valialkin	ecbe1ddf1b	lib/promscrape/discovery/ec2: properly handle custom `endpoint` option in ec2_sd_configs This option was ignored since `d289ecded1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:52:37 +03:00
Aliaksandr Valialkin	8ddad31eef	lib/promscrape/discovery/yandexcloud: follow-up after `6e5ac32fba` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:28:21 +03:00
Igor Tiunov	0ba86fe87e	YC service discovery (#2923 ) * YC service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386 * Fixed linter suggestions * fixed golint errors	2022-08-04 22:28:20 +03:00
Aliaksandr Valialkin	dc58cb3fd8	app/vminsert/netstorage: pre-initialize the remaining throttled loggers This is a follow-up after `6c66804fd3`	2022-08-04 18:34:42 +03:00
Aliaksandr Valialkin	43185353bc	app/vmselect/netstorage: cleanup after `92630c1ab4` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896	2022-08-04 18:34:38 +03:00
Aliaksandr Valialkin	98caffcfc4	docs: fix the recommended url for -vmalert.proxyURL accroding to `8667307d73`	2022-08-04 18:03:24 +03:00
Aliaksandr Valialkin	a1e49606ed	app/{vmselect,vmalert}: properly generate http redirects if `-http.pathPrefix` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 13:01:13 +03:00
Aliaksandr Valialkin	c81d2b4c18	app/vmselect/netstorage: initializes tsw.rowsProcessed before calling tsw.f, since tsw.f can modify r.Timestamps and r.Values lengths	2022-07-30 00:39:14 +03:00
Aliaksandr Valialkin	5ddae2e293	app/vmselect/netstorage: re-use random generator used for series shuffle in Result.RunParallel This should reduce CPU usage needed for rand.Rand initialization	2022-07-30 00:31:00 +03:00
Dmytro Kozlov	ab645b5fab	vmselect/promql: add tests for vmrangeBucketsToLE (#2907 ) * vmselect/promql: add tests for vmrangeBucketsToLE * vmselect/promql: cleanup * vmselect/promql: cleanup * vmselect/promql: fix panic tests want result * vmselect/promql: cleanup * vmselect/promql: update test name * vmselect/promql: fix linter error * vmselect/promql: refactor testcases * vmselect/promql: cleanup * vmselect/promql: remove unused reassign to workers, fix typo * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-26 20:43:43 +03:00
Aliaksandr Valialkin	9f1e558c58	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:25:26 +03:00
Aliaksandr Valialkin	8a83c59956	app/vmselect/promql: reduce the diff for `f148cffc8a` This is a follow-up for `c826f06366`	2022-07-26 19:21:16 +03:00
Alan Liang	f97de473f4	vmselect: fix vmrangeBucketsToLE func may panic when ts value equal zero (#2902 ) Co-authored-by: alanwzliang <alanwzliang@tencent.com>	2022-07-25 10:49:48 +03:00
Aliaksandr Valialkin	764fc04756	app/vmalert: fix after `da10962d4c`	2022-07-25 09:48:41 +03:00
Roman Khavronenko	da10962d4c	vmselect: cover special cases for vmalert's routing in single-node version (#2845 ) * vmselect: cover special cases for vmalert's routing in single-node version * remove trailing `/` from requests * redirect to vmalert's home page when `/vmalert` is requested. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmselect/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-25 09:43:44 +03:00
Aliaksandr Valialkin	5d62f5a324	app/vmalert/config: add missing docs for ValidateTplFn	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	3d4c312ba2	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on `b596ac3745` Thanks to @zqyzyq for the idea.	2022-07-25 09:22:28 +03:00
Roman Khavronenko	970f36de17	vmalert: remove `notifier` dependency from `config` (#2906 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	c0c9f30870	lib/pushmetrics: properly handle errors when initializing pushmetrics	2022-07-22 13:38:25 +03:00
Roman Khavronenko	01755fac38	vmalert: remove dependency on datasource pkg from config (#2905 ) * vmalert: remove dependency on datasource pkg from config Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-22 13:38:25 +03:00
Aliaksandr Valialkin	b1129fda0c	docs/vmgateway: typo fix in regexp filter: `~=` is substituted with `=~`	2022-07-21 22:37:42 +03:00
Aliaksandr Valialkin	59bb42be06	app/vmselect/vmui: `make vmui-update` after `edecd2493c`	2022-07-21 21:00:36 +03:00
Aliaksandr Valialkin	b49fc2f9f3	app/vmalert/utils: add missing docs to WithHeaders func added at `70a822f3a0`	2022-07-21 20:49:38 +03:00
Roman Khavronenko	d0abdc2b5b	vmalert: allow configuring custom headers per group (#2901 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:48:05 +03:00
Roman Khavronenko	356d8b99e0	vmalert: allow configuring custom headers for URLs (#2897 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:45:12 +03:00
dependabot[bot]	272f207afc	build(deps): bump terser in /app/vmui/packages/vmui (#2895 ) Bumps [terser](https://github.com/terser/terser) from 5.13.1 to 5.14.2. - [Release notes](https://github.com/terser/terser/releases) - [Changelog](https://github.com/terser/terser/blob/master/CHANGELOG.md) - [Commits](https://github.com/terser/terser/commits) --- updated-dependencies: - dependency-name: terser dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2022-07-21 20:42:01 +03:00
Yury Molodov	d1b88f3b5d	fix: change the z-index of the datepicker (#2891 )	2022-07-21 20:41:16 +03:00
Roman Khavronenko	04c4f8bafd	vmselect: return correct error for second part of expression (#2893 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:40:47 +03:00
Aliaksandr Valialkin	fe68bb3ba7	all: follow-up after `46f803fa7a` Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:18:25 +03:00
Aliaksandr Valialkin	f00a6bf837	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
Aliaksandr Valialkin	536ee9fc18	deployment/docker: update alpine base image from 3.16.0 to 3.16.1 See https://alpinelinux.org/posts/Alpine-3.16.1-released.html	2022-07-19 19:51:36 +03:00
Aliaksandr Valialkin	7a06ee11fd	docs/vmauth.md: mention that multiple recrods for the same username are supported This is a follow-up for `88029c521c`	2022-07-19 19:43:20 +03:00
Nikolay	0102eb3869	app/vmauth: allow duplicate usernames (#2888 ) Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:35:28 +03:00
Aliaksandr Valialkin	f992f96a88	app/vmselect/promql: execute `q1` and `q2` from `q1 op q2` in parallel if labels pushdown cannot be applied This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:29:41 +03:00
Roman Khavronenko	23e85e0fc5	vmagent: expose metric `vmagent_remotewrite_queues` (#2871 ) The new metric `vmagent_remotewrite_queues` exports a static value of number of configured remote write queus. This metric is useful to calculate total saturation per each configured URL with given number of queues. See corresponding changes to vmagent alerts and dashboard. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-18 14:41:04 +03:00
Aliaksandr Valialkin	d920b0afec	app/vmselect/promql: properly return `q1` series from `q1 ifnot q2` when `q2` returns nothing	2022-07-18 14:24:23 +03:00
Aliaksandr Valialkin	f933d5f142	app/vmselect/promql/transform.go: reuse evalNumber() function for constructing timezone_offset() results	2022-07-18 14:24:22 +03:00
cui fliter	e0d30f6ec5	fix some typos (#2882 ) Signed-off-by: cui fliter <imcusg@gmail.com>	2022-07-18 12:10:40 +03:00
Roman Khavronenko	80de6face8	vmalert: drop support of deprecated `extra_filter_labels` param (#2870 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 16:10:46 +03:00
Aliaksandr Valialkin	70b9925bf7	app: fix `make publish-*` after `ed93330e66` Add missing `-linux` substring to built binary names for copying into Docker images	2022-07-14 11:01:34 +03:00
Aliaksandr Valialkin	e6ee940daf	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:44 +03:00
Yury Molodov	1ca20caa4b	vmui: optimize table view (#2867 ) * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:16:57 +03:00
Dmytro Kozlov	99402541fb	vmui: update time picker behavior (#2847 ) * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:06:22 +03:00
Yury Molodov	23c3b5f8c7	vmui: change selection from autocomplete (#2862 ) * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:56:04 +03:00
Nikolay	c007b129cb	lib/promscrape: adds azure service discovery (#2743 ) * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:45:43 +03:00
Boris Petersen	cbf01ee4ae	fix typo introduced in pr #2604 (#2866 ) Signed-off-by: Boris Petersen <boris.petersen@idealo.de>	2022-07-13 23:45:42 +03:00
Aliaksandr Valialkin	83221bc480	deployment/docker: update Go builder from go1.18.3 to go1.18.4 See https://github.com/golang/go/issues?q=milestone%3AGo1.18.4+label%3ACherryPickApproved	2022-07-13 20:31:54 +03:00
Aliaksandr Valialkin	da6c85a2f6	all: follow-up for `d99ba3481b`	2022-07-13 17:17:08 +03:00
Dmytro Kozlov	4e4def9df8	Rename release packages (#2810 ) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 17:11:01 +03:00
guidao	f2d24a660b	add next retention metric (#2863 ) Co-authored-by: wangfeng <wangfeng@zhihu.com>	2022-07-13 12:41:22 +03:00
Aliaksandr Valialkin	919939ee9f	app/vmselect/promql: consistency update after `93fbd0c54b`	2022-07-13 12:34:28 +03:00
Roman Khavronenko	214e01499c	promql: return `step` as scrapeInterval when it can't be calculated (#2865 ) The change allows to specify default value for `getScrapeInterval` function when actual interval can't be calculated. Before the change, function were returning `maxSilenceInterval` (5m) in such cases, which may be not correct for instant queries processing. The specific scenario where using `maxSilenceInterval` caused issues is the following: 1. Series becomes stale; 2. Client (in this case vmalert) continues to request series every 15s; 3. Database returns empty results as expected; 4. But at some specific moment of time database returns datapoints from `now()-5m`, because lookback window was extended to `maxSilenceInterval`. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-13 12:34:28 +03:00
Aliaksandr Valialkin	5867708b3d	app/vmselect/promql: validate function name before evaluating its arguments This avoids unneeded evaluation of args for unknown functions	2022-07-12 19:49:54 +03:00
Aliaksandr Valialkin	fbb403b5c0	app/vmselect/netstorage: optimize mergeSortBlocks() for the worst case when blocks contain interleaved samples	2022-07-12 12:30:24 +03:00
Aliaksandr Valialkin	aee08117e9	app/vmselect/netstorage: add mergeSortBlocks benchmark for the worstcase	2022-07-12 12:26:27 +03:00
Dmytro Kozlov	6734d77d97	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851 ) * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:37:20 +03:00
Aliaksandr Valialkin	ed2126aec3	app/vmselect: follow-up after `6dda254e01`	2022-07-11 19:48:18 +03:00
Roman Khavronenko	6dda254e01	vmselect: cover special cases for vmalert's routing in cluster version (#2844 ) * vmselect: cover special cases for vmalert's routing * remove trailing `/` from requests * redirect to vmalert's home page when `/vmalert` is requested. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmselect: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmselect/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-11 19:33:33 +03:00
Aliaksandr Valialkin	eab8ebbe11	all: `make fmt` via the upcoming Go1.19	2022-07-11 19:23:25 +03:00
Aliaksandr Valialkin	3662ce8323	docs: make more clear the relation between replication and deduplication This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:23:24 +03:00
Aliaksandr Valialkin	c0af52228a	app/vmselect/netstorage: add benchmarks for mergeSortBlocks This is a follow-up for `743ff84863`	2022-07-11 12:53:46 +03:00
Aliaksandr Valialkin	d442ee4610	app/vmselect/netstorage: optimize mergeSortBlocks function - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:35:38 +03:00
Roman Khavronenko	78da074ad3	metricsql: properly evaluate `timezone_offset` over time interval (#2842 ) * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:04:40 +03:00
Aliaksandr Valialkin	64419aa97c	app/vmalert/utils/links.go: document Prefix function, which has been added in `b29fafa86b`	2022-07-08 13:25:23 +03:00
Aliaksandr Valialkin	decbf84e55	app/vmselect/vmui: follow-up after `0bf6841140` * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:22:57 +03:00
Dmytro Kozlov	5afe15f53a	vmui: fix query for json and table tabs (#2846 ) * vmui: fix query for json and table * vmui: add step param	2022-07-08 13:22:55 +03:00
Roman Khavronenko	b29fafa86b	vmalert: deprecate alert's status link (#2840 ) * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	69718a6c16	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:22:02 +03:00
Aliaksandr Valialkin	2a53b8961e	docs/vmagent.md: typo fixes after `ef2eeeb642`	2022-07-07 21:17:13 +03:00
Aliaksandr Valialkin	372ecc5c0e	docs/vmagent.md: actualize docs	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	95add1e8e4	app/{vmagent,vminsert}: follow-up after `d19e46de55` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:32:11 +03:00
Pedro Gonçalves	af5f967307	app/vminsert: allow to ingest datadog metrics with simpler tags - not enforcing key:value (#2839 )	2022-07-07 01:32:10 +03:00
Roman Khavronenko	218dfe7956	docs: mention deduplication issue for HA vmalert topology (#2838 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-07 01:13:56 +03:00
Aliaksandr Valialkin	6bb4bcd30c	app/vmui: tune visual presentation of trace view	2022-07-06 14:16:24 +03:00
Aliaksandr Valialkin	eee384c9c9	app/vmselect: add `-clusternative.tls*` options for mTLS setup in multi-level clusters	2022-07-06 13:48:21 +03:00
Aliaksandr Valialkin	195dccf678	app/vmselect: add ability to query `vmselect` from another `vmselect`	2022-07-06 13:19:45 +03:00
Aliaksandr Valialkin	714958deab	all: follow-up after `ed89106274`	2022-07-06 12:48:52 +03:00
Roman Khavronenko	56f4058fe3	vmalert: make UI and assets links relative (#2831 ) * make all links in vmalert relative, so links continue to work even if vmalert sits behind the proxy; * update vmalert's routing to always have component-unique path prefix, e.g. /vmalert; See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 12:47:53 +03:00
Aliaksandr Valialkin	cdd89d9cc2	app/vmselect: properly generate response for /api/v1/series The response has been broken in `7d5d33fd71`	2022-07-06 12:46:23 +03:00
Aliaksandr Valialkin	1ec4dfd678	lib/vmselectapi: pass storage.SearchQuery to API calls instead of []*storage.TagFilters + storage.TimeRange + maxMetrics This reduces the number of args to vmselectapi calls	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	2e721f7d16	lib/vmselectapi: rename Server.MustClose to more clear Server.MustStop	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	270e555f47	lib/vmselectapi: pass maxSuffixes arg to tagValueSuffixes RPC call	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	f4df43f7cc	app/vmselect/netstorage: remove unused auth.Token arg	2022-07-06 12:46:21 +03:00
Aliaksandr Valialkin	78eeca6f0d	lib/vmselectapi: rename deleteMetrics to more correct deleteSeries	2022-07-06 12:46:21 +03:00
Aliaksandr Valialkin	5afa54e845	lib/vmselectapi: use string type for tagKey and tagValuePrefix args at TagValueSuffixes() This improves the API consistency	2022-07-06 12:46:21 +03:00
Roman Khavronenko	f51bc07d97	vmselect: allow proxying requests to vmalert (#2833 ) The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:51 +02:00
Aliaksandr Valialkin	10c63f5853	app/vmselect: `make fmt` after `f3ece83e67`	2022-07-05 14:56:53 +03:00
Aliaksandr Valialkin	8516670582	app/vmselect/promql: properly calculate histogram_quantile over unexpected `le` buckets See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:20:41 +03:00
Aliaksandr Valialkin	ecc11dc32d	lib/promauth: refactor NewConfig in order to improve maintainability 1. Split NewConfig into smaller functions 2. Introduce Options struct for simplifying construction of the Config with various options This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2684	2022-07-04 14:31:43 +03:00
Dmytro Kozlov	7389fc9adf	vmui: disable ripple on nested component, enable copy text on button (#2808 )	2022-07-04 11:47:39 +03:00
Aliaksandr Valialkin	fa08220d27	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2787	2022-06-30 22:40:26 +03:00
Aliaksandr Valialkin	1e6b0a1f54	app/vmagent/remotewrite: do not shadow `headers` global variable in getAuthConfig	2022-06-30 20:18:43 +03:00
Aliaksandr Valialkin	0f6c17ed06	app/vmagent/remotewrite: clarify descriptions for `-remoteWrite.*` options, which must be set per each `-remoteWrite.url`	2022-06-30 20:18:42 +03:00
Aliaksandr Valialkin	7fc03a1deb	app/vmagent/remotewrite: add `-remoteWrite.header` command-line flag for setting additional http headers to send to -remoteWrite.url Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:59 +03:00
Aliaksandr Valialkin	4fb0f15322	all: readability improvements for query traces - show dates in human-readable format, e.g. 2022-05-07, instead of a numeric value - limit the maximum length of queries and filters shown in trace messages	2022-06-30 18:19:43 +03:00
Dmytro Kozlov	67753cc6f0	vmui: update render logic for nested component (#2795 ) * vmui: update render logic for nested component, avoid rerender, remove local storage usage for tracing flag * docs/url-examples.md: fix various documentation issues there * docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics. * docs/Troubleshooting.md: add troubleshooting guide for cluster instability * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-30 15:48:22 +03:00
Aliaksandr Valialkin	92e6c55b75	docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	daefb64f38	app/vmselect: expose additional histograms at `/metrics` page, which may help get more insights for the query workload This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:31 +03:00
Aliaksandr Valialkin	9adff0b686	app/vmselect/promql: show the number of scanned samples in the query trace	2022-06-28 19:32:03 +03:00
Aliaksandr Valialkin	c21f5a508f	app/vmselect/prometheus: reduce the default value for -search.maxSeries from 100k to 30k Production experience shows that 100k is too big for /api/v1/series . It leads to increased CPU usage when Grafana queries /api/v1/series over VictoriaMetrics with big number of time series during auto-completion and when modifying template variables.	2022-06-28 18:22:24 +03:00
Aliaksandr Valialkin	7d5d33fd71	lib/storage: return marshaled metric names from SearchMetricNames Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:16:32 +03:00
Aliaksandr Valialkin	36edb1912b	app/vmstorage: rename "transport" package to "servers" package for better clarity	2022-06-28 14:04:14 +03:00
Aliaksandr Valialkin	399d4c36ae	app/vmselect: optimize /api/v1/series a bit for time ranges smaller than one day	2022-06-28 12:55:20 +03:00
Aliaksandr Valialkin	64505e924d	app/vmstorage: extract vmselect api server into a separate package - lib/vmselectapi This opens doors for implementing vmselect api server at vmselect level, so top-level vmselect could query lower-level vmselect nodes in the same way as it queries vmstorage nodes. This will create the ability to create highly available querying architecture when multiple independent VictoriaMetrics clusters with the same data are located in distinct availability zones. In this case we can use top-level vmselect instead of Promxy for simultaneous querying of all the clusters in all the AZs.	2022-06-27 14:20:41 +03:00
Aliaksandr Valialkin	a667d339be	app/vmselect/netstorage/netstorage.go: group metrics in order to improve readability a bit	2022-06-27 14:00:24 +03:00
Roman Khavronenko	50c0eb4c4e	vmalert: make `__name__` available for templating in alerts (#2783 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-27 13:53:55 +03:00
Aliaksandr Valialkin	6386f117c8	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:42:57 +03:00
Aliaksandr Valialkin	4b41a05ca7	app/vmalert: load static js and css from proper paths if `-http.pathPrefix` command-line flag is set This is a follow-up for `b104f67beb`	2022-06-27 13:12:57 +03:00
Aliaksandr Valialkin	926fccbb8d	lib/storage: add querytracer to more contexts querytracer has been added to the following storage.Storage methods: - RegisterMetricNames - DeleteMetrics - SearchTagValueSuffixes - SearchGraphitePaths	2022-06-27 12:53:49 +03:00
Aliaksandr Valialkin	6c66804fd3	all: locate throttled loggers via logger.WithThrottler() only once and then use them This reduces the contention on logThrottlerRegistryMu mutex when logger.WithThrottler() is called frequently from concurrent goroutines.	2022-06-27 12:34:30 +03:00
Aliaksandr Valialkin	08de733924	app/vmselect/netstorage: assume the response is full if up to -replicationFactor-1 vmstorage nodes are unavailable This is a follow-up for `ee5c502446` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1767	2022-06-27 12:21:26 +03:00
Roman Khavronenko	572db17857	vmalert: use absolute path for assets (#2784 ) Using relative path breaks assets loading on alert view page. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-27 00:47:36 +03:00
Aliaksandr Valialkin	bc9d704ef4	app/vmselect/netstorage: remove Get prefix from netstorage functions This makes these function names more consistent with the server side	2022-06-27 00:37:49 +03:00
hagen1778	e40d015e9a	vmselect: make `vm_partial_results_total` consistent Metrics `vm_partial_results_total` and `vm_requests_total` serving the similar purpose, but contain inconsistent set of labels. This change updates `vm_partial_results_total` labels to be consistent with `vm_requests_total`. The change breaks backward compatibility with assumption that `vm_partial_results_total` wasn't widely used, since it is not documented and absent in the alerts and dashboards. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-24 13:50:26 +02:00
Dmytro Kozlov	f28cbcc7b5	vmui: added query tracing (#2748 ) * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 23:00:45 +03:00
Nikolay	ee5c502446	app/vmselect: fixes partial response with replicationFactor (#2777 ) * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:17:24 +03:00
Aliaksandr Valialkin	e0ce6c0ff8	app/vmstorage/transport: refactoring: split Server into VMInsertServer and VMStorageServer This makes the code more clear	2022-06-23 19:20:09 +03:00
Aliaksandr Valialkin	3ae6300497	lib/promauth: add ability to send additional http headers in requests to scrape targets This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:40:50 +03:00
Aliaksandr Valialkin	7429dfbe9e	app/vmselect: add `-search.setLookbackToStep` command-line flag for making the gap filling algorithm similar to InfluxDB data model This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:20:02 +03:00
Aliaksandr Valialkin	4f64da874d	app/vmselect: typo fix in the exported metric name: vm_http_request_total -> vm_http_requests_total	2022-06-22 13:18:03 +03:00
Roman Khavronenko	54f0f2d384	docs: follow-up for `197d3cdd74` (#2766 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 13:18:03 +03:00
云原生驿站	67e5833ced	docs: supplement vmalert downsampling docs (#2765 ) Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 13:18:03 +03:00
Aliaksandr Valialkin	dceca7e864	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package This is a follow-up for `fe2269b999`	2022-06-21 20:27:30 +03:00
Aliaksandr Valialkin	fe2269b999	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package This package already has the same name, so there is no need in explicit name	2022-06-21 20:24:28 +03:00
Aliaksandr Valialkin	9362da2e7f	docs: update `-help` output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:26 +03:00
Aliaksandr Valialkin	597bce4f55	docs: update docs after `e4d6b750f6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:25 +03:00
Nikolay	15662c0f29	lib/httpserver: adds flagsAuthKey command-line flag (#2758 ) * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:15:51 +03:00
Aliaksandr Valialkin	b28c6febf9	app/{vminsert,vmselect}: add `-vmstorageDialTimeout` command-line flag for tuning the maximum time needed for establishing connections to vmstorage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2022-06-20 15:17:34 +03:00
Aliaksandr Valialkin	079fdd3158	all: update Go builder for production builds from 1.18.2 to 1.18.3 See https://github.com/golang/go/issues?q=milestone%3AGo1.18.3+label%3ACherryPickApproved	2022-06-20 14:30:48 +03:00
Aliaksandr Valialkin	b2cfb8faf7	app/vmstorage/transport: call vmselectRequestCtx.readSearchQuery() in processVMSelectDeleteMetrics Previously the processVMSelectDeleteMetrics was calling separate functions from readSearchQuery(). It is better from readability and maintenance PoV to substitute it with readSearchQuery call.	2022-06-20 14:23:17 +03:00
Roman Khavronenko	3ada676879	docs: reference links from key concepts (#2745 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:14:30 +03:00
Aliaksandr Valialkin	fe9f59fcd6	all: replace `bash` with `console` blocks in all the *.md files This is a follow-up for `954a7a6fc6`	2022-06-19 23:02:02 +03:00
Roman Khavronenko	3e45e1ff63	Vmalert notifiers (#2744 ) * vmalert: remove head of line blocking for sending alerts This change makes sending alerts to notifiers concurrent instead of sequential. This eliminates head of line blocking, where first faulty notifier address prevents the rest of notifiers from receiving notifications. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: make default timeout for sending alerts 10s Previous value of 1m was too high and was inconsistent with default timeout defined for notifiers via configuration file. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: linter checks fix Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-19 22:49:10 +03:00
Dmytro Kozlov	5bc13e2fe8	vmui: added focusLabel, enable cardinality app configuratior (#2736 ) * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:04:09 +03:00
Roman Khavronenko	cbe39bbb8d	vmselect: limit `end` param max value by 2d in future (#2729 ) * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	cda3ce09e5	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	450aa0ae5a	lib/promrelabel: support `action: graphite` relabeling Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:25:49 +03:00
Roman Khavronenko	ba7ece02c4	docs: add multiple-remote-writes topology to vmalert (#2738 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:21:12 +03:00
Aliaksandr Valialkin	da1d1e83df	app/{vmselect,vmstorage}: properly pass seriesCountByLabelName and seriesCountByFocusLabelValue entries from vmstorage to vmselect	2022-06-16 10:44:29 +03:00
Aliaksandr Valialkin	ee9954082f	app/vmselect/netstorage: properly aggregate seriesCountByLabelName and seriesCountByFocusLabelValue obtained from multiple vmselect nodes at /api/v1/status/tsdb	2022-06-15 16:48:40 +03:00
Aliaksandr Valialkin	45fa9d798d	app/vmselect: accept `focusLabel` query arg at /api/v1/status/tsdb	2022-06-14 18:39:00 +03:00
Aliaksandr Valialkin	fb77843639	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:34:13 +03:00
Dmytro Kozlov	ed9b4c6f6d	vmui: refactor Cardinality panel (#2726 ) * vmui: refactor Cardinality panel * vmui: change width of the search panel * vmui: code cleanup * vmui: code cleanup * vmui: fixed vulnerability (npm audit fix) * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-14 14:40:44 +03:00
Aliaksandr Valialkin	ce953d5e95	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:23 +03:00
Wataru Manji	0cd750fa5e	Add remote-write headers (#2701 ) Co-authored-by: Wataru Manji <wataru.manji@linecorp.com>	2022-06-13 10:07:19 +03:00
Aliaksandr Valialkin	8128c6db6b	app/vmagent: follow-up after `4583ed23a8`	2022-06-13 09:56:27 +03:00
Dmytro Kozlov	f0cb3c4999	Added a stub for datadog endpoint (#2710 ) * Added a stub for datadog endpoint * Update app/vmagent/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:56:26 +03:00
Yury Molodov	65107a4585	vmui: enhancements (#2638 ) (#2717 ) * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:49:58 +03:00
Yury Molodov	7a3b377ac0	vmui: fix relative time and query params (#2716 ) * fix: correct update query params * fix: change select relative time	2022-06-13 09:34:06 +03:00
Aliaksandr Valialkin	61e03f172b	app/vmselect: optimize `/api/v1/labels` and `/api/v1/label/.../values` handlers when `match[]` query arg is passed to them	2022-06-12 14:06:24 +03:00
Aliaksandr Valialkin	4a94cd81ce	app/vmselect: add optional `limit` query arg to `/api/v1/labels` and `/api/v1/label_values` endpoints This arg allows limiting the number of sample values returned from these APIs	2022-06-10 10:24:07 +03:00
Aliaksandr Valialkin	1335698ba7	app/vmselect/prometheus: extract common code for obtaining common query args into getCommonParams() function	2022-06-09 20:33:36 +03:00
Aliaksandr Valialkin	cb39eada77	all: improve query tracing coverage for indexdb search Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-09 20:04:02 +03:00
Aliaksandr Valialkin	ad44eadd94	app/vmselect/graphite: remove additional redundant Request.ParseForm() calls after `38c785b851`	2022-06-09 13:22:23 +03:00
Roman Khavronenko	3c09d25039	vmalert: followup for `76f05f8670` (#2706 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 13:15:35 +03:00
Howie	4afd7aa695	feat: rule limit (#2676 ) vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 13:15:33 +03:00
Aliaksandr Valialkin	7fe60dad10	app/vmselect: remove redundant calls to Request.ParseForm() Request.ParseForm() is implicitly called by the first call to Request.FormValue()	2022-06-09 13:09:52 +03:00
Aliaksandr Valialkin	a9ea3fee38	lib/querytracer: make it easier to use by passing trace context message to New and NewChild The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:16:12 +03:00
Aliaksandr Valialkin	2b343d8bd0	app: properly collect and merge /api/v1/status/tsdb info from vmstorage nodes The collection has been broken in `f2754c3e90` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:26:09 +03:00
Dmytro Kozlov	f2754c3e90	Cardinality explorer (#2625 ) * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:54:27 +03:00
Aliaksandr Valialkin	d830f43608	app/vminsert/main.go: add missing `strings` import after `0c5e199469`	2022-06-07 15:42:23 +03:00
Aliaksandr Valialkin	c07f99cd4f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:53 +03:00
Wataru Manji	64f7095c3a	add Content-Encoding Header (#2685 ) Co-authored-by: Wataru Manji <wataru.manji@linecorp.com>	2022-06-07 15:34:25 +03:00
Aliaksandr Valialkin	2b72d21840	docs/CHANGELOG.md: document `e755d0ec3f`	2022-06-07 15:21:10 +03:00
elProxy	0c5e199469	Support legacy datadog agent (#2670 ) dd-agent v5 can issue some requests with trailing slashes. (e.g. `526559be73/ddagent.py (L303)`) Trim trailing slashes for request on /datadog/ paths to accomodate for that. Co-authored-by: Pierre Rossi <pierre.rossi@schibsted.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 15:21:09 +03:00
Aliaksandr Valialkin	68b6ddfb14	all: follow-up after `8edb390e21` - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 01:05:53 +03:00
Aliaksandr Valialkin	6c2fb9d8c4	lib/promscrape: add `-promscrape.cluster.name` command-line flag This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 01:11:23 +03:00
Dmytro Kozlov	ce8aade80e	lib/promscrape: adds service discovery visualization for /targets page(#2675 ) * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-04 01:11:23 +03:00
Roman Khavronenko	e9ee043879	lib/storage: make `indexdb/tagFilters` cache size configurable (#2667 ) The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	c92bc5394f	app/vmselect/netstorage: properly read trace from vmstorage when it returns error message to vmselect	2022-06-01 14:35:00 +03:00
Aliaksandr Valialkin	f133756f02	deployment/docker: update base image from alpine:3.15.4 to alpine:3.16.0	2022-06-01 02:54:53 +03:00
Aliaksandr Valialkin	afced37c0b	all: add initial support for query tracing See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:31:44 +03:00
Dima Lazerka	264b98192e	Fix nth-check version for css-select dep (#2666 ) Fixes security vulnerability in nth-check version <=1.0.2 My previous version pin was insufficient, as it was imported again through a different (svgo -> css-select).	2022-06-01 01:43:24 +03:00
Aliaksandr Valialkin	e83b96366f	docs/CHANGELOG.md: follow-up after `11f91532c5` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Dmytro Kozlov	cd1fa2e4cd	issue-2594: use embedded for static files (#2650 ) embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Howie	09fed19ba5	chore: remove duplicated code (#2657 ) Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-05-30 12:27:47 +03:00
Howie	9c5f998438	fix: docs (#2658 ) Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-05-30 12:27:19 +03:00
Aliaksandr Valialkin	f0ab5ca61f	app/vmselect/vmui: `make vmui-update` after `492a615a88`	2022-05-26 09:43:30 +03:00
Yury Molodov	b9ef9ddbfd	vmui: import dashboards (#2642 ) * fix: switch dashboards import to fetch * make vmui-update	2022-05-26 09:43:29 +03:00
Aliaksandr Valialkin	38beb9fe04	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag This is a follow-up for `0fbf59199a` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:07:14 +03:00
Roman Khavronenko	cd8e58d0ae	docs: mention guide for migrating from inlfux in vmctl readme (#2640 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 15:05:12 +03:00
spectvtor	c5df5c9a95	fix alert relabeling (#2633 )	2022-05-25 15:05:10 +03:00
Aliaksandr Valialkin	df9ffa6854	app: expose `/api/v1/status/config` endpoint in the same way as Prometheus does This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 10:00:00 +03:00
Aliaksandr Valialkin	fe631850ee	deployment/docker: update Go builder from 1.18.1 to 1.18.2 See https://github.com/golang/go/issues?q=milestone%3AGo1.18.2+label%3ACherryPickApproved	2022-05-23 10:58:38 +03:00
Roman Khavronenko	d597cdd06f	vmalert: mention how to build a custom image (#2626 ) Thanks to @f41gh7 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-23 10:55:42 +03:00
Roman Khavronenko	88c4c6f465	vmalert: add new metric `vmalert_iteration_interval_seconds` (#2623 ) The new metric shows the configured evaluation interval per group. Metric updates its value when group's interval is changed during hot reload. The new metric can be used to estimate how close group is to start missing evaluation rounds. The following query will show the % of used time by the group to evaluate all rules before the next round: ``` (max(vmalert_iteration_duration_seconds{quantile="0.99"}) / vmalert_iteration_interval_seconds) * 100 ``` https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2618 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-21 01:13:01 +03:00
Aliaksandr Valialkin	aba00b8cb2	docs: update the description for command-line flags according to recent changes	2022-05-20 15:11:37 +03:00
Aliaksandr Valialkin	4409b9f376	app/vmselect/vmui: `make vmui-update`	2022-05-20 14:56:25 +03:00
Boris Petersen	3a8b4fab97	Add ability to sign requests for all AWS services (#2604 ) This adds the ability to utilize sigv4 signing for all AWS services not just "aps". When the newly introduced property "service" is not set it will default to "aps". Signed-off-by: Boris Petersen <boris.petersen@idealo.de>	2022-05-20 14:20:00 +03:00
Roman Khavronenko	d814c83b21	vmalert: remove a line added for debug (#2611 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:08:57 +03:00
Roman Khavronenko	2aeb00f98f	vmalert: support `scalar` type in response (#2610 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:08:19 +03:00
Roman Khavronenko	a07ddf9b65	vmalert: support strings in `humanize.*` templates (#2606 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:05:53 +03:00
Yurii Kravets	40c614dc4e	Update vmalert.md (#2580 ) docs: update vmalert/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-20 14:02:34 +03:00
Yurii Bychenok	05f80798a5	Updated vmctl documentation, migration from OpenTSDB section (#2595 ) Co-authored-by: Yurii Bychenok <ipeacocks@pm.me>	2022-05-20 13:59:09 +03:00
Yury Molodov	1e7a6683f8	vmui: optimize data fetching (#2584 )	2022-05-20 13:54:45 +03:00
Yury Molodov	8739fb8a91	vmui: add option to customize url params for individual pages (#2582 )	2022-05-20 13:53:57 +03:00
Roman Khavronenko	87e4e76537	vmalert: support `/rules` path for Grafana's ngalert requests (#2593 ) Unexpectedly, Grafana makes an extra request to `/rules` handler in addition to `/api/v1/rules` calls in alerts UI. This happens only for Grafana versions older than 8.5.*. Apparently, this is related to support of other monitoring systems. Prometheus responds with `text/html` content for UI page `/rules` to such requests. Actually, returning just a blank page with SC=200 works as well. Returning actual response of `/api/v1/rules` results in error in Grafana since it expects a `yaml` (?) in response. So we add a placeholder to `vmalert`. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2583 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:53:55 +03:00
Yury Molodov	c8eca88f12	fix: change get display type (#2553 )	2022-05-20 13:47:44 +03:00
Yury Molodov	d13437afd0	vmui: setup predefined dashboards without build (#2541 ) vmui: support predefined dashboards in json format See https://github.com/VictoriaMetrics/VictoriaMetrics/tree/master/app/vmselect/vmui/dashboards	2022-05-20 13:46:19 +03:00
Roman Khavronenko	ee1f8bae2e	docs: fix liquid syntax errors (#2592 ) For liquid text processor double braces `{{` `}}` are special chars for templating. Since we use them in some of our docs with different purpose, we must escape them to avoid syntax errors from liquid. For escaping curly braces we use bult-in plugin which helps to enclose sections of text via `{% raw %}` and `{% endraw %}`. This approach prevents liquid syntax errors and makes render correct. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:42:47 +03:00
Dima Lazerka	6928e5a6d7	Force up nth-check version	2022-05-20 13:41:27 +03:00
Roman Khavronenko	6e5ba1921d	vmalert: fix readme formatting (#2587 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:40:41 +03:00
Roman Khavronenko	0790ba5e26	vmalert: follow-up after `0ac1cdfff5` (#2586 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 12:25:13 +03:00
Andrii Chubatiuk	7789c47e41	added reusable templates support (#2532 ) Signed-off-by: Andrii Chubatiuk <andrew.chubatiuk@gmail.com>	2022-05-20 12:25:11 +03:00
Aliaksandr Valialkin	83ff4c411d	app/vmalert: apply `-remoteRead.disablePathAppend` to `-datasource.url` in the same way as for the `-remoteRead.url` This is a follow-up for `0e2486df56` The related pull requests: - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1536 - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1712	2022-05-13 16:59:16 +03:00
Roman Khavronenko	2ea625d5bf	vmalert: properly cleanup stale series tracker on rules update (#2577 ) Rules executor within group tracks series sent to remote write in order to mark them as stale if they had disappeared in next evaluation round. The executor uses rules ID as a key to identifies series which belong to rule. On config reload, executor remains active but the set of rules could change. Hence, we need to properly cleanup the tracker for rules which has been disappeared on config reload. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-13 16:59:16 +03:00
Roman Khavronenko	1aa5a19717	vmctl: make linter happy (#2578 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	de143323d0	app/{vmagent,vminsert}: mention port 8089 instead of 8189 in the description for -influxListenAddr flag InfluxDB uses 8089 port for sending plain Influx line protocol data over TCP and UDP. See https://docs.influxdata.com/influxdb/v1.8/administration/ports/ This is a follow-up for `20cef877a1`	2022-05-13 16:59:16 +03:00
Yurii Kravets	d55791f59f	Update docs (#2566 ) * deployment/docker: pass `-buildvs=false` to `go build` for production builds This should resolve the `error obtaining VCS status: exit status 128` error when the environment contains incorrect version of git or has incorrect access rights to the directory with VictoriaMetrics source code. See the following links for additional info: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508#issuecomment-1117126702 , - https://github.com/google/ko/issues/672 - https://github.com/golang/go/issues/49004 * lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552 * docs/CHANGELOG.md: document `c8af625bcc` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146 * docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by` * docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits * docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect * Update root Readme and root vmagent readme Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	116c0b8f2e	docs/vmagent.md: typo fix in the description for `-promscrape.cluster.replicationFactor` command-line flag	2022-05-12 18:51:20 +03:00
Dmytro Kozlov	1a8a24bcb3	vmctl: fix build for solaris os (#2555 ) * vmctl: fix build for solaris os * vmctl: updated dependency (using Syscall instead of Syscall6) * vmctl: updated dependency * vmctl: updated dependency	2022-05-11 14:30:45 +03:00
Aliaksandr Valialkin	68bfa05437	app/vmselect/promql: do not return values from `label_value()` if the original time series has no values at the selected timestamps	2022-05-09 17:58:39 +03:00
Roman Khavronenko	c9b5e6e8ca	Code check (#2558 ) * vmstorage: make gofmt happy Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: make linter happy Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-09 15:29:25 +03:00
Roman Khavronenko	ee93d003d3	Vmalert fix bugs in alerting evaluation (#2557 ) * vmalert: calculate time for firing alert based on the given timestamp Previously, current time was used for checking the `firing` threshold. This is not correct, since alerts are evaluated at specific timestamps. Hence, this specific timestamp supposed to be used in the calculation. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: properly calculate evaluation timestamp for rules Timestamp for rules evaluation should be calculated after the artifical delay for groups start. Otherwise, evaluation timestamp can fall back too far in time. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-09 15:28:30 +03:00
Artem Navoiev	7197de0c8c	docs: add flags list to vmbackupmanager (#2554 ) docs: add flags list to vmbackupmanager docs Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: tenmozes <artem@victoriametrics.com>	2022-05-09 15:26:24 +03:00
Marc Hörsken	1580f751d6	app/vmctl: add flag to handle Prometheus remote_write to InfluxDB (#2545 ) Make it possible to migrate timeseries while restoring the original timeseries name previously written from Prometheus to InfluxDB v1 via remote_write. Fixes: https://github.com/VictoriaMetrics/vmctl/issues/8	2022-05-09 15:25:41 +03:00
Aliaksandr Valialkin	e613ca9ba8	app/vminsert/netstorage: re-route samples from readonly vmstorage nodes to healthy nodes if `-dropSamplesOnOverload` command-line flag is set	2022-05-07 01:40:02 +03:00
Aliaksandr Valialkin	e961aec551	app/vmstorage: do not allow to set -retentionPeriod smaller than one day VictoriaMetrics doesn't support retention periods smaller than one day, so do not allow to set it to small values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2496	2022-05-07 00:54:42 +03:00
Marc Hörsken	bc28589718	app/vmctl: add flag to skip adding the InfluxDB 'db' label (#2544 ) Make it possible to migrate timeseries without changing labels at all, including not adding the now optional 'db' label.	2022-05-06 18:11:15 +03:00
Dmytro Kozlov	8b5a819266	vmbackup: Prevent save backups to the same folder where TSDB data is (#2547 ) * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip * vmbackup: Prevent save backups to the same folder where TSDB data is * Apply suggestions from code review * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-06 18:04:58 +03:00
Roman Khavronenko	fe697a9253	vmctl: add tip about safety flags during for native data export (#2540 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-06 16:28:24 +03:00
Aliaksandr Valialkin	925fa9a7de	docs/Cluster-VictoriaMetrics.md: make the description for `-rpc.disableCompression` command-line flag more clear	2022-05-06 16:24:56 +03:00
Aliaksandr Valialkin	983b465757	app/vmagent: add missing `_total` suffix to `vmagent_remotewrite_global_rows_pushed_before_relabel_total` counter This is a follow up for `c536139d0b`	2022-05-06 15:51:34 +03:00
Aliaksandr Valialkin	2baa9e8f48	app/vmagent: expose `vmagent_remotewrite_global_rows_pushed_before_relabel` and `vmagent_remotewrite_rows_pushed_after_relabel_total` metrics	2022-05-06 15:30:10 +03:00
Aliaksandr Valialkin	9c89ea1c90	app/vmagent: rename `vmagent_remote_write_rate_limit_reached_total` to `vmagent_remotewrite_rate_limit_reached_total` for the sake of consistency with other `vmagent_remotewrite_` metrics	2022-05-06 15:02:18 +03:00
Aliaksandr Valialkin	8babb4aebc	app/vmselect/vmui: `make vmui-update` after `450d879eaa`	2022-05-05 22:11:41 +03:00
Yury Molodov	7b37662a80	vmui: prevent reset relative time (#2543 ) * fix: prevent time picker reset to previous time * fix: add default display type	2022-05-05 21:21:48 +03:00
Yury Molodov	eba02163fe	fix: remove react @types (#2539 )	2022-05-05 21:19:02 +03:00
Roman Khavronenko	c41ae2db2c	vmstorage: switch to rich duration parser for flag `snapshotsMaxAge` (#2542 ) The switch suppose to allow setting `d`, `w`, `y` duration units. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-05 21:13:55 +03:00
Marc Hörsken	68ca7e3e56	app/vmctl: fix empty/skipped labels after db label (#2536 ) Do not assume the db label to be the last one and also make sure we are not skipping it and everything afterwards. Breaking the loop would cause following labels to be empty.	2022-05-05 13:38:43 +03:00
Aliaksandr Valialkin	873f55bac5	lib/awsapi: pass `filtersQueryString` arg to GetEC2APIResponse() function, so the caller could decide whether to use the filters during the AWS API query The filters shouldn't be passed to DescribeAvailabilityZones API call. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1626 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 Related commits: `0e09fdb8b0` `d289ecded1`	2022-05-05 10:29:47 +03:00
Aliaksandr Valialkin	3fee369997	app/vmselect: follow-up after `8639e79d38`	2022-05-04 23:41:00 +03:00
Aliaksandr Valialkin	2213eef6b7	docs/vmbackup.md: added missing -storageDataPath argument in the command for creating daily backups	2022-05-04 22:50:18 +03:00
Aliaksandr Valialkin	4ae1a8514a	docs/vmbackup.md: acutalize docs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2503	2022-05-04 22:44:40 +03:00
Dmytro Kozlov	4f40dc9829	{vmbackup, vmbackup/snapshot}: fixed problem with snapshot backup in another snapshot folder (#2535 ) * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 22:12:48 +03:00
Aliaksandr Valialkin	9fea63d1c8	app/vmagent: rename -remoteWrite.useSigv4 command-line flag to -remoteWrite.aws.useSigv4, so its name is consistent with the other -remoteWrite.aws.* command-line flags	2022-05-04 20:41:45 +03:00
Aliaksandr Valialkin	358fa99af2	app/vmalert: run `make quicktemplate-gen` from the root directory after the commit `f6dcfbcdd6`	2022-05-04 20:28:37 +03:00
Nikolay	7e58cba6cf	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458 ) * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:28:37 +03:00
Dmytro Kozlov	0aeefeb5f1	vmalert/tpl: fixed truncating alerts expression in table (#2494 ) vmalert: improve `/groups` UI visual The change also fixes truncated rules expressions in UI https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2484	2022-05-04 20:28:37 +03:00
Nikolay	48041305a2	app/vmselect: adds proxy for rules API (#2516 ) * app/vmselect: adds proxy for rules and alerts API It allows to visualization for rules at grafana https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1739 * Update app/vmselect/main.go Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-04 10:12:15 +03:00
Dima Lazerka	b5fce4190c	Code cleanup (#343 ) * Small code cleanup: remove Request from params * Extract common params to all export handlers * Renamed ExportParams -> exportParams * wip Co-authored-by: Dzmitry Lazerka <dlazerka@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-03 15:53:58 +03:00
Aliaksandr Valialkin	4fa3cd701c	docs/Cluster-VictoriaMetrics.md: typo fix: serparated -> separated	2022-05-03 15:20:11 +03:00
Aliaksandr Valialkin	75bd7f1539	app/vmui: fix up/down arrow keys on multi-line query after `a186434b50`	2022-05-03 10:51:08 +03:00
Dmytro Kozlov	b9ff61811d	vmctl: fixed blocking when aborting import process (#2509 ) vmctl: fix vmctl blocking on process interrupt This change prevents vmctl from indefinite blocking on receiving the interrupt signal. The update touches all import modes and suppose to improve tool reliability. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2491	2022-05-03 10:51:06 +03:00
Gard Rimestad	ceadcb7f8e	app/vmagent add metric for rate limit (#2521 ) This adds a metric for the rate limit. The limit is present as a flag currently: `flag{name="remoteWrite.rateLimit", value="500000", is_set="true"} 1` We are running many instances of vmagent and when creating alerts it is harder than it needs to be when extracting the value from the flag. With this change it should be easier to monitor how close to the limit we are. `((100/vmagent_remotewrite_rate_limit{account="account"})*sum (rate(vmagent_remotewrite_conn_bytes_written_total{account="account"}))) and ON (account) flag{name="remoteWrite.rateLimit"} == 1`	2022-05-02 22:25:47 +03:00
Aliaksandr Valialkin	361b08c30e	lib/storage: leave the last sample per each discrete interval during the deduplicaton This aligns better with staleness logic in Prometheus - https://prometheus.io/docs/prometheus/latest/querying/basics/#staleness	2022-05-02 21:59:31 +03:00
Aliaksandr Valialkin	7ca32c21c8	app/vmui: execute query by pressing `enter` in the same way as Prometheus does Multi-line query can be entered via `shift-enter` in the query input field	2022-05-02 20:24:43 +03:00
Yury Molodov	6292185abf	vmui: support node v.18 (#2529 ) * fix: add support vmui node18 * fix: remove @mui/styles (legacy styling solution) * Update app/vmui/Dockerfile-build * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-02 20:24:42 +03:00
Aliaksandr Valialkin	725cb64e81	app/vmalert: run `make quicktemplate-gen` from the repository root This is a follow-up after `b2294d1cf1`	2022-05-02 15:37:54 +03:00

... 3 4 5 6 7 ...

2116 commits