2000 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	5d62f5a324	app/vmalert/config: add missing docs for ValidateTplFn	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	3d4c312ba2	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system ... Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on b596ac3745 Thanks to @zqyzyq for the idea.	2022-07-25 09:22:28 +03:00
Roman Khavronenko	970f36de17	vmalert: remove notifier dependency from config (#2906) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	c0c9f30870	lib/pushmetrics: properly handle errors when initializing pushmetrics	2022-07-22 13:38:25 +03:00
Roman Khavronenko	01755fac38	vmalert: remove dependency on datasource pkg from config (#2905) ... * vmalert: remove dependency on datasource pkg from config Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-22 13:38:25 +03:00
Aliaksandr Valialkin	b1129fda0c	docs/vmgateway: typo fix in regexp filter: ~= is substituted with =~	2022-07-21 22:37:42 +03:00
Aliaksandr Valialkin	59bb42be06	app/vmselect/vmui: make vmui-update after edecd2493c	2022-07-21 21:00:36 +03:00
Aliaksandr Valialkin	b49fc2f9f3	app/vmalert/utils: add missing docs to WithHeaders func added at 70a822f3a0	2022-07-21 20:49:38 +03:00
Roman Khavronenko	d0abdc2b5b	vmalert: allow configuring custom headers per group (#2901) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:48:05 +03:00
Roman Khavronenko	356d8b99e0	vmalert: allow configuring custom headers for URLs (#2897) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:45:12 +03:00
dependabot[bot]	272f207afc	build(deps): bump terser in /app/vmui/packages/vmui (#2895) ... Bumps [terser](https://github.com/terser/terser) from 5.13.1 to 5.14.2. - [Release notes](https://github.com/terser/terser/releases) - [Changelog](https://github.com/terser/terser/blob/master/CHANGELOG.md) - [Commits](https://github.com/terser/terser/commits) --- updated-dependencies: - dependency-name: terser dependency-type: indirect ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	2022-07-21 20:42:01 +03:00
Yury Molodov	d1b88f3b5d	fix: change the z-index of the datepicker (#2891)	2022-07-21 20:41:16 +03:00
Roman Khavronenko	04c4f8bafd	vmselect: return correct error for second part of expression (#2893) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:40:47 +03:00
Aliaksandr Valialkin	fe68bb3ba7	all: follow-up after 46f803fa7a ... Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:18:25 +03:00
Aliaksandr Valialkin	f00a6bf837	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
Aliaksandr Valialkin	536ee9fc18	deployment/docker: update alpine base image from 3.16.0 to 3.16.1 ... See https://alpinelinux.org/posts/Alpine-3.16.1-released.html	2022-07-19 19:51:36 +03:00
Aliaksandr Valialkin	7a06ee11fd	docs/vmauth.md: mention that multiple recrods for the same username are supported ... This is a follow-up for 88029c521c	2022-07-19 19:43:20 +03:00
Nikolay	0102eb3869	app/vmauth: allow duplicate usernames (#2888) ... Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:35:28 +03:00
Aliaksandr Valialkin	f992f96a88	app/vmselect/promql: execute q1 and q2 from q1 op q2 in parallel if labels pushdown cannot be applied ... This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:29:41 +03:00
Roman Khavronenko	23e85e0fc5	vmagent: expose metric vmagent_remotewrite_queues (#2871) ... The new metric `vmagent_remotewrite_queues` exports a static value of number of configured remote write queus. This metric is useful to calculate total saturation per each configured URL with given number of queues. See corresponding changes to vmagent alerts and dashboard. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-18 14:41:04 +03:00
Aliaksandr Valialkin	d920b0afec	app/vmselect/promql: properly return q1 series from q1 ifnot q2 when q2 returns nothing	2022-07-18 14:24:23 +03:00
Aliaksandr Valialkin	f933d5f142	app/vmselect/promql/transform.go: reuse evalNumber() function for constructing timezone_offset() results	2022-07-18 14:24:22 +03:00
cui fliter	e0d30f6ec5	fix some typos (#2882) ... Signed-off-by: cui fliter <imcusg@gmail.com>	2022-07-18 12:10:40 +03:00
Roman Khavronenko	80de6face8	vmalert: drop support of deprecated extra_filter_labels param (#2870) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 16:10:46 +03:00
Aliaksandr Valialkin	70b9925bf7	app: fix make publish-* after ed93330e66 ... Add missing `-linux` substring to built binary names for copying into Docker images	2022-07-14 11:01:34 +03:00
Aliaksandr Valialkin	e6ee940daf	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:44 +03:00
Yury Molodov	1ca20caa4b	vmui: optimize table view (#2867) ... * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:16:57 +03:00
Dmytro Kozlov	99402541fb	vmui: update time picker behavior (#2847) ... * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:06:22 +03:00
Yury Molodov	23c3b5f8c7	vmui: change selection from autocomplete (#2862) ... * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:56:04 +03:00
Nikolay	c007b129cb	lib/promscrape: adds azure service discovery (#2743) ... * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:45:43 +03:00
Boris Petersen	cbf01ee4ae	fix typo introduced in pr #2604 (#2866) ... Signed-off-by: Boris Petersen <boris.petersen@idealo.de>	2022-07-13 23:45:42 +03:00
Aliaksandr Valialkin	83221bc480	deployment/docker: update Go builder from go1.18.3 to go1.18.4 ... See https://github.com/golang/go/issues?q=milestone%3AGo1.18.4+label%3ACherryPickApproved	2022-07-13 20:31:54 +03:00
Aliaksandr Valialkin	da6c85a2f6	all: follow-up for d99ba3481b	2022-07-13 17:17:08 +03:00
Dmytro Kozlov	4e4def9df8	Rename release packages (#2810) ... * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 17:11:01 +03:00
guidao	f2d24a660b	add next retention metric (#2863) ... Co-authored-by: wangfeng <wangfeng@zhihu.com>	2022-07-13 12:41:22 +03:00
Aliaksandr Valialkin	919939ee9f	app/vmselect/promql: consistency update after 93fbd0c54b	2022-07-13 12:34:28 +03:00
Roman Khavronenko	214e01499c	promql: return step as scrapeInterval when it can't be calculated (#2865) ... The change allows to specify default value for `getScrapeInterval` function when actual interval can't be calculated. Before the change, function were returning `maxSilenceInterval` (5m) in such cases, which may be not correct for instant queries processing. The specific scenario where using `maxSilenceInterval` caused issues is the following: 1. Series becomes stale; 2. Client (in this case vmalert) continues to request series every 15s; 3. Database returns empty results as expected; 4. But at some specific moment of time database returns datapoints from `now()-5m`, because lookback window was extended to `maxSilenceInterval`. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-13 12:34:28 +03:00
Aliaksandr Valialkin	5867708b3d	app/vmselect/promql: validate function name before evaluating its arguments ... This avoids unneeded evaluation of args for unknown functions	2022-07-12 19:49:54 +03:00
Aliaksandr Valialkin	fbb403b5c0	app/vmselect/netstorage: optimize mergeSortBlocks() for the worst case when blocks contain interleaved samples	2022-07-12 12:30:24 +03:00
Aliaksandr Valialkin	aee08117e9	app/vmselect/netstorage: add mergeSortBlocks benchmark for the worstcase	2022-07-12 12:26:27 +03:00
Dmytro Kozlov	6734d77d97	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851) ... * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:37:20 +03:00
Aliaksandr Valialkin	ed2126aec3	app/vmselect: follow-up after 6dda254e01	2022-07-11 19:48:18 +03:00
Roman Khavronenko	6dda254e01	vmselect: cover special cases for vmalert's routing in cluster version (#2844) ... * vmselect: cover special cases for vmalert's routing * remove trailing `/` from requests * redirect to vmalert's home page when `/vmalert` is requested. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmselect: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmselect/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-11 19:33:33 +03:00
Aliaksandr Valialkin	eab8ebbe11	all: make fmt via the upcoming Go1.19	2022-07-11 19:23:25 +03:00
Aliaksandr Valialkin	3662ce8323	docs: make more clear the relation between replication and deduplication ... This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:23:24 +03:00
Aliaksandr Valialkin	c0af52228a	app/vmselect/netstorage: add benchmarks for mergeSortBlocks ... This is a follow-up for 743ff84863	2022-07-11 12:53:46 +03:00
Aliaksandr Valialkin	d442ee4610	app/vmselect/netstorage: optimize mergeSortBlocks function ... - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:35:38 +03:00
Roman Khavronenko	78da074ad3	metricsql: properly evaluate timezone_offset over time interval (#2842) ... * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:04:40 +03:00
Aliaksandr Valialkin	64419aa97c	app/vmalert/utils/links.go: document Prefix function, which has been added in b29fafa86b	2022-07-08 13:25:23 +03:00
Aliaksandr Valialkin	decbf84e55	app/vmselect/vmui: follow-up after 0bf6841140 ... * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:22:57 +03:00
Dmytro Kozlov	5afe15f53a	vmui: fix query for json and table tabs (#2846) ... * vmui: fix query for json and table * vmui: add step param	2022-07-08 13:22:55 +03:00
Roman Khavronenko	b29fafa86b	vmalert: deprecate alert's status link (#2840) ... * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	69718a6c16	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:22:02 +03:00
Aliaksandr Valialkin	2a53b8961e	docs/vmagent.md: typo fixes after ef2eeeb642	2022-07-07 21:17:13 +03:00
Aliaksandr Valialkin	372ecc5c0e	docs/vmagent.md: actualize docs	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	95add1e8e4	app/{vmagent,vminsert}: follow-up after d19e46de55 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:32:11 +03:00
Pedro Gonçalves	af5f967307	app/vminsert: allow to ingest datadog metrics with simpler tags - not enforcing key:value (#2839)	2022-07-07 01:32:10 +03:00
Roman Khavronenko	218dfe7956	docs: mention deduplication issue for HA vmalert topology (#2838) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-07 01:13:56 +03:00
Aliaksandr Valialkin	6bb4bcd30c	app/vmui: tune visual presentation of trace view	2022-07-06 14:16:24 +03:00
Aliaksandr Valialkin	eee384c9c9	app/vmselect: add -clusternative.tls* options for mTLS setup in multi-level clusters	2022-07-06 13:48:21 +03:00
Aliaksandr Valialkin	195dccf678	app/vmselect: add ability to query vmselect from another vmselect	2022-07-06 13:19:45 +03:00
Aliaksandr Valialkin	714958deab	all: follow-up after ed89106274	2022-07-06 12:48:52 +03:00
Roman Khavronenko	56f4058fe3	vmalert: make UI and assets links relative (#2831) ... * make all links in vmalert relative, so links continue to work even if vmalert sits behind the proxy; * update vmalert's routing to always have component-unique path prefix, e.g. /vmalert; See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 12:47:53 +03:00
Aliaksandr Valialkin	cdd89d9cc2	app/vmselect: properly generate response for /api/v1/series ... The response has been broken in 7d5d33fd71	2022-07-06 12:46:23 +03:00
Aliaksandr Valialkin	1ec4dfd678	lib/vmselectapi: pass storage.SearchQuery to API calls instead of []*storage.TagFilters + storage.TimeRange + maxMetrics ... This reduces the number of args to vmselectapi calls	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	2e721f7d16	lib/vmselectapi: rename Server.MustClose to more clear Server.MustStop	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	270e555f47	lib/vmselectapi: pass maxSuffixes arg to tagValueSuffixes RPC call	2022-07-06 12:46:22 +03:00
Aliaksandr Valialkin	f4df43f7cc	app/vmselect/netstorage: remove unused auth.Token arg	2022-07-06 12:46:21 +03:00
Aliaksandr Valialkin	78eeca6f0d	lib/vmselectapi: rename deleteMetrics to more correct deleteSeries	2022-07-06 12:46:21 +03:00
Aliaksandr Valialkin	5afa54e845	lib/vmselectapi: use string type for tagKey and tagValuePrefix args at TagValueSuffixes() ... This improves the API consistency	2022-07-06 12:46:21 +03:00
Roman Khavronenko	f51bc07d97	vmselect: allow proxying requests to vmalert (#2833) ... The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:51 +02:00
Aliaksandr Valialkin	10c63f5853	app/vmselect: make fmt after f3ece83e67	2022-07-05 14:56:53 +03:00
Aliaksandr Valialkin	8516670582	app/vmselect/promql: properly calculate histogram_quantile over unexpected le buckets ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:20:41 +03:00
Aliaksandr Valialkin	ecc11dc32d	lib/promauth: refactor NewConfig in order to improve maintainability ... 1. Split NewConfig into smaller functions 2. Introduce Options struct for simplifying construction of the Config with various options This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2684	2022-07-04 14:31:43 +03:00
Dmytro Kozlov	7389fc9adf	vmui: disable ripple on nested component, enable copy text on button (#2808)	2022-07-04 11:47:39 +03:00
Aliaksandr Valialkin	fa08220d27	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2787	2022-06-30 22:40:26 +03:00
Aliaksandr Valialkin	1e6b0a1f54	app/vmagent/remotewrite: do not shadow headers global variable in getAuthConfig	2022-06-30 20:18:43 +03:00
Aliaksandr Valialkin	0f6c17ed06	app/vmagent/remotewrite: clarify descriptions for -remoteWrite.* options, which must be set per each -remoteWrite.url	2022-06-30 20:18:42 +03:00
Aliaksandr Valialkin	7fc03a1deb	app/vmagent/remotewrite: add -remoteWrite.header command-line flag for setting additional http headers to send to -remoteWrite.url ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:59 +03:00
Aliaksandr Valialkin	4fb0f15322	all: readability improvements for query traces ... - show dates in human-readable format, e.g. 2022-05-07, instead of a numeric value - limit the maximum length of queries and filters shown in trace messages	2022-06-30 18:19:43 +03:00
Dmytro Kozlov	67753cc6f0	vmui: update render logic for nested component (#2795) ... * vmui: update render logic for nested component, avoid rerender, remove local storage usage for tracing flag * docs/url-examples.md: fix various documentation issues there * docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics. * docs/Troubleshooting.md: add troubleshooting guide for cluster instability * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-30 15:48:22 +03:00
Aliaksandr Valialkin	92e6c55b75	docs: add Troubleshooting doc ... This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	daefb64f38	app/vmselect: expose additional histograms at /metrics page, which may help get more insights for the query workload ... This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:31 +03:00
Aliaksandr Valialkin	9adff0b686	app/vmselect/promql: show the number of scanned samples in the query trace	2022-06-28 19:32:03 +03:00
Aliaksandr Valialkin	c21f5a508f	app/vmselect/prometheus: reduce the default value for -search.maxSeries from 100k to 30k ... Production experience shows that 100k is too big for /api/v1/series . It leads to increased CPU usage when Grafana queries /api/v1/series over VictoriaMetrics with big number of time series during auto-completion and when modifying template variables.	2022-06-28 18:22:24 +03:00
Aliaksandr Valialkin	7d5d33fd71	lib/storage: return marshaled metric names from SearchMetricNames ... Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:16:32 +03:00
Aliaksandr Valialkin	36edb1912b	app/vmstorage: rename "transport" package to "servers" package for better clarity	2022-06-28 14:04:14 +03:00
Aliaksandr Valialkin	399d4c36ae	app/vmselect: optimize /api/v1/series a bit for time ranges smaller than one day	2022-06-28 12:55:20 +03:00
Aliaksandr Valialkin	64505e924d	app/vmstorage: extract vmselect api server into a separate package - lib/vmselectapi ... This opens doors for implementing vmselect api server at vmselect level, so top-level vmselect could query lower-level vmselect nodes in the same way as it queries vmstorage nodes. This will create the ability to create highly available querying architecture when multiple independent VictoriaMetrics clusters with the same data are located in distinct availability zones. In this case we can use top-level vmselect instead of Promxy for simultaneous querying of all the clusters in all the AZs.	2022-06-27 14:20:41 +03:00
Aliaksandr Valialkin	a667d339be	app/vmselect/netstorage/netstorage.go: group metrics in order to improve readability a bit	2022-06-27 14:00:24 +03:00
Roman Khavronenko	50c0eb4c4e	vmalert: make __name__ available for templating in alerts (#2783) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-27 13:53:55 +03:00
Aliaksandr Valialkin	6386f117c8	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:42:57 +03:00
Aliaksandr Valialkin	4b41a05ca7	app/vmalert: load static js and css from proper paths if -http.pathPrefix command-line flag is set ... This is a follow-up for b104f67beb	2022-06-27 13:12:57 +03:00
Aliaksandr Valialkin	926fccbb8d	lib/storage: add querytracer to more contexts ... querytracer has been added to the following storage.Storage methods: - RegisterMetricNames - DeleteMetrics - SearchTagValueSuffixes - SearchGraphitePaths	2022-06-27 12:53:49 +03:00
Aliaksandr Valialkin	6c66804fd3	all: locate throttled loggers via logger.WithThrottler() only once and then use them ... This reduces the contention on logThrottlerRegistryMu mutex when logger.WithThrottler() is called frequently from concurrent goroutines.	2022-06-27 12:34:30 +03:00
Aliaksandr Valialkin	08de733924	app/vmselect/netstorage: assume the response is full if up to -replicationFactor-1 vmstorage nodes are unavailable ... This is a follow-up for ee5c502446 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1767	2022-06-27 12:21:26 +03:00
Roman Khavronenko	572db17857	vmalert: use absolute path for assets (#2784) ... Using relative path breaks assets loading on alert view page. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-27 00:47:36 +03:00
Aliaksandr Valialkin	bc9d704ef4	app/vmselect/netstorage: remove Get prefix from netstorage functions ... This makes these function names more consistent with the server side	2022-06-27 00:37:49 +03:00
hagen1778	e40d015e9a	vmselect: make vm_partial_results_total consistent ... Metrics `vm_partial_results_total` and `vm_requests_total` serving the similar purpose, but contain inconsistent set of labels. This change updates `vm_partial_results_total` labels to be consistent with `vm_requests_total`. The change breaks backward compatibility with assumption that `vm_partial_results_total` wasn't widely used, since it is not documented and absent in the alerts and dashboards. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-24 13:50:26 +02:00
Dmytro Kozlov	f28cbcc7b5	vmui: added query tracing (#2748) ... * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 23:00:45 +03:00
Nikolay	ee5c502446	app/vmselect: fixes partial response with replicationFactor (#2777) ... * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:17:24 +03:00
Aliaksandr Valialkin	e0ce6c0ff8	app/vmstorage/transport: refactoring: split Server into VMInsertServer and VMStorageServer ... This makes the code more clear	2022-06-23 19:20:09 +03:00
Aliaksandr Valialkin	3ae6300497	lib/promauth: add ability to send additional http headers in requests to scrape targets ... This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:40:50 +03:00
Aliaksandr Valialkin	7429dfbe9e	app/vmselect: add -search.setLookbackToStep command-line flag for making the gap filling algorithm similar to InfluxDB data model ... This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:20:02 +03:00
Aliaksandr Valialkin	4f64da874d	app/vmselect: typo fix in the exported metric name: vm_http_request_total -> vm_http_requests_total	2022-06-22 13:18:03 +03:00
Roman Khavronenko	54f0f2d384	docs: follow-up for 197d3cdd74 (#2766) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 13:18:03 +03:00
云原生驿站	67e5833ced	docs: supplement vmalert downsampling docs (#2765) ... Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 13:18:03 +03:00
Aliaksandr Valialkin	dceca7e864	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package ... This is a follow-up for fe2269b999	2022-06-21 20:27:30 +03:00
Aliaksandr Valialkin	fe2269b999	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package ... This package already has the same name, so there is no need in explicit name	2022-06-21 20:24:28 +03:00
Aliaksandr Valialkin	9362da2e7f	docs: update -help output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:26 +03:00
Aliaksandr Valialkin	597bce4f55	docs: update docs after e4d6b750f6 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:25 +03:00
Nikolay	15662c0f29	lib/httpserver: adds flagsAuthKey command-line flag (#2758) ... * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:15:51 +03:00
Aliaksandr Valialkin	b28c6febf9	app/{vminsert,vmselect}: add -vmstorageDialTimeout command-line flag for tuning the maximum time needed for establishing connections to vmstorage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2022-06-20 15:17:34 +03:00
Aliaksandr Valialkin	079fdd3158	all: update Go builder for production builds from 1.18.2 to 1.18.3 ... See https://github.com/golang/go/issues?q=milestone%3AGo1.18.3+label%3ACherryPickApproved	2022-06-20 14:30:48 +03:00
Aliaksandr Valialkin	b2cfb8faf7	app/vmstorage/transport: call vmselectRequestCtx.readSearchQuery() in processVMSelectDeleteMetrics ... Previously the processVMSelectDeleteMetrics was calling separate functions from readSearchQuery(). It is better from readability and maintenance PoV to substitute it with readSearchQuery call.	2022-06-20 14:23:17 +03:00
Roman Khavronenko	3ada676879	docs: reference links from key concepts (#2745) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:14:30 +03:00
Aliaksandr Valialkin	fe9f59fcd6	all: replace bash with console blocks in all the *.md files ... This is a follow-up for 954a7a6fc6	2022-06-19 23:02:02 +03:00
Roman Khavronenko	3e45e1ff63	Vmalert notifiers (#2744) ... * vmalert: remove head of line blocking for sending alerts This change makes sending alerts to notifiers concurrent instead of sequential. This eliminates head of line blocking, where first faulty notifier address prevents the rest of notifiers from receiving notifications. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: make default timeout for sending alerts 10s Previous value of 1m was too high and was inconsistent with default timeout defined for notifiers via configuration file. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: linter checks fix Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-19 22:49:10 +03:00
Dmytro Kozlov	5bc13e2fe8	vmui: added focusLabel, enable cardinality app configuratior (#2736) ... * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:04:09 +03:00
Roman Khavronenko	cbe39bbb8d	vmselect: limit end param max value by 2d in future (#2729) ... * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	cda3ce09e5	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	450aa0ae5a	lib/promrelabel: support action: graphite relabeling ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:25:49 +03:00
Roman Khavronenko	ba7ece02c4	docs: add multiple-remote-writes topology to vmalert (#2738) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:21:12 +03:00
Aliaksandr Valialkin	da1d1e83df	app/{vmselect,vmstorage}: properly pass seriesCountByLabelName and seriesCountByFocusLabelValue entries from vmstorage to vmselect	2022-06-16 10:44:29 +03:00
Aliaksandr Valialkin	ee9954082f	app/vmselect/netstorage: properly aggregate seriesCountByLabelName and seriesCountByFocusLabelValue obtained from multiple vmselect nodes at /api/v1/status/tsdb	2022-06-15 16:48:40 +03:00
Aliaksandr Valialkin	45fa9d798d	app/vmselect: accept focusLabel query arg at /api/v1/status/tsdb	2022-06-14 18:39:00 +03:00
Aliaksandr Valialkin	fb77843639	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:34:13 +03:00
Dmytro Kozlov	ed9b4c6f6d	vmui: refactor Cardinality panel (#2726) ... * vmui: refactor Cardinality panel * vmui: change width of the search panel * vmui: code cleanup * vmui: code cleanup * vmui: fixed vulnerability (npm audit fix) * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-14 14:40:44 +03:00
Aliaksandr Valialkin	ce953d5e95	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:23 +03:00
Wataru Manji	0cd750fa5e	Add remote-write headers (#2701) ... Co-authored-by: Wataru Manji <wataru.manji@linecorp.com>	2022-06-13 10:07:19 +03:00
Aliaksandr Valialkin	8128c6db6b	app/vmagent: follow-up after 4583ed23a8	2022-06-13 09:56:27 +03:00
Dmytro Kozlov	f0cb3c4999	Added a stub for datadog endpoint (#2710) ... * Added a stub for datadog endpoint * Update app/vmagent/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:56:26 +03:00
Yury Molodov	65107a4585	vmui: enhancements (#2638) (#2717) ... * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:49:58 +03:00
Yury Molodov	7a3b377ac0	vmui: fix relative time and query params (#2716) ... * fix: correct update query params * fix: change select relative time	2022-06-13 09:34:06 +03:00
Aliaksandr Valialkin	61e03f172b	app/vmselect: optimize /api/v1/labels and /api/v1/label/.../values handlers when match[] query arg is passed to them	2022-06-12 14:06:24 +03:00
Aliaksandr Valialkin	4a94cd81ce	app/vmselect: add optional limit query arg to /api/v1/labels and /api/v1/label_values endpoints ... This arg allows limiting the number of sample values returned from these APIs	2022-06-10 10:24:07 +03:00
Aliaksandr Valialkin	1335698ba7	app/vmselect/prometheus: extract common code for obtaining common query args into getCommonParams() function	2022-06-09 20:33:36 +03:00
Aliaksandr Valialkin	cb39eada77	all: improve query tracing coverage for indexdb search ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-09 20:04:02 +03:00
Aliaksandr Valialkin	ad44eadd94	app/vmselect/graphite: remove additional redundant Request.ParseForm() calls after 38c785b851	2022-06-09 13:22:23 +03:00
Roman Khavronenko	3c09d25039	vmalert: followup for 76f05f8670 (#2706) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 13:15:35 +03:00
Howie	4afd7aa695	feat: rule limit (#2676) ... vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 13:15:33 +03:00
Aliaksandr Valialkin	7fe60dad10	app/vmselect: remove redundant calls to Request.ParseForm() ... Request.ParseForm() is implicitly called by the first call to Request.FormValue()	2022-06-09 13:09:52 +03:00
Aliaksandr Valialkin	a9ea3fee38	lib/querytracer: make it easier to use by passing trace context message to New and NewChild ... The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:16:12 +03:00
Aliaksandr Valialkin	2b343d8bd0	app: properly collect and merge /api/v1/status/tsdb info from vmstorage nodes ... The collection has been broken in f2754c3e90 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:26:09 +03:00
Dmytro Kozlov	f2754c3e90	Cardinality explorer (#2625) ... * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:54:27 +03:00
Aliaksandr Valialkin	d830f43608	app/vminsert/main.go: add missing strings import after 0c5e199469	2022-06-07 15:42:23 +03:00
Aliaksandr Valialkin	c07f99cd4f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:53 +03:00
Wataru Manji	64f7095c3a	add Content-Encoding Header (#2685) ... Co-authored-by: Wataru Manji <wataru.manji@linecorp.com>	2022-06-07 15:34:25 +03:00
Aliaksandr Valialkin	2b72d21840	docs/CHANGELOG.md: document e755d0ec3f	2022-06-07 15:21:10 +03:00
elProxy	0c5e199469	Support legacy datadog agent (#2670) ... dd-agent v5 can issue some requests with trailing slashes. (e.g. 526559be73/ddagent.py (L303)) Trim trailing slashes for request on /datadog/ paths to accomodate for that. Co-authored-by: Pierre Rossi <pierre.rossi@schibsted.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 15:21:09 +03:00