1168 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	594a4ab345	docs/vmalert.md: follow-up for 0c95f928ae ... - Clarify the description for -datasource.queryStep command-line flag - Consistently use a single dash in front of -datasource.queryStep command-line flag - Update -help output at docs/vmalert.md	2022-09-26 08:49:47 +03:00
Roman Khavronenko	cffceba0f5	vmalert: set default value for datasource.queryStep to 5m (#3149) ... Change default value for command-line flag `datasource.queryStep` from `0s` to `5m`. Param `step` is added by vmalert to every rule evaluation request sent to datasource. Before this change, `step` was equal to group's evaluation interval by default. Param `step` for instant queries defines how far VM can look back for the last written data point. The change supposed to improve reliability of the rules evaluation when evaluation interval is lower than scraping interval. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 08:40:17 +03:00
Aliaksandr Valialkin	19dc29abd7	docs/CHANGELOG.md: clarify the change at 622bbedbe1 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3119	2022-09-19 15:04:37 +03:00
Roman Khavronenko	360b022603	vmalert: always re-evaluate Annotations (#3119) ... * vmalert: always re-evaluate Annotations Previously, Annotations were evaluated only: 1. On alert creating. 2. On alert's value change. This is premature optimization. It was assumed that since annotations could contain only text with alert's labels or value - there is no need in spending resources to re-compile Annotations. Later, template function `query` was added, which can execute arbitrary queries and return different results on every evaluation. So if it was used in annotations, it would be executed only on init or value change. Another case when optimization caused an issue - annotations hot reload. In this case, annotations of the active alert won't change even if Rule's annotations were changed. This fix enables Annotations re-evaluation on each iteration to resolve issues above. It would have some impact on performance, but it is unlikely it will be noticeable. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: add tp Changelog Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-19 15:04:37 +03:00
Dmytro Kozlov	36ea8537d9	vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) (#2982) ... * vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) * vmselect/promql: fix tests, add documentation * vmselect/promql: update test * vmselect/promql: update for alphanumeric sorting, fix tests * vmselect/promql: remove comments * vmselect/promql: cleanup * vmselect/promql: avoid memory allocations, update functions descriptions * vmselect/promql: make linter happy (remove ineffectual assigment) * vmselect/promql: add test case, fix behavior when strings are equal * vendor: update github.com/VictoriaMetrics/metricsql from v0.44.1 to v0.45.0 this adds support for sort_by_label_numeric and sort_by_label_numeric_desc functions * wip * lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage. * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-14 17:42:07 +03:00
Roman Khavronenko	6ae4f3526b	vmalert: add experimental feature of storing Rule's evaluation state (#3106) ... vmalert: add experimental feature of storing Rule's evaluation state The new feature keeps last 20 state changes of each Rule in memory. The state are available for view on the Rule's view page. The page can be opened by clicking on `Details` link next to Rule's name on the `/groups` page. States change suppose to help in investigating cases when Rule doesn't generate alerts or records. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 15:08:40 +03:00
Aliaksandr Valialkin	2351468bc4	lib/promscrape: read response body into memory in stream parsing mode before parsing it ... This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage.	2022-09-14 13:29:39 +03:00
Aliaksandr Valialkin	20834c1757	app/vmalert: follow-up after 8441375da2 ... - Rename logDebug() to logDebugf() and pass format string together with format args directly to logDebugf(). This eliminates fmt.Sprintf() overhead at logDebug() call site when debugging is disabled. - Format labels in debug message in Prometheus format, e.g. {label1="value1",...labelN="valueN"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025	2022-09-13 16:36:31 +03:00
Roman Khavronenko	a887c1bc07	vmalert: add debug mode for alerting rules (#3055) ... * vmalert: add `debug` mode for alerting rules Debug information includes alerts state changes and requests sent to the datasource. Debug can be enabled only on rule's level. It might be useful for debugging unexpected behaviour of alerting rule. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: review fixes Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmalert/alerting.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> * vmalert: go fmt Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-13 16:36:30 +03:00
Aliaksandr Valialkin	6a44e1bc06	docs/CHANGELOG.md: document atomic directory deletion ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3038	2022-09-13 16:16:12 +03:00
Yury Molodov	465894d720	vmui: fix data processing (#3092) ... * fix: change data processing * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-12 10:56:39 +03:00
Yury Molodov	c8de98e03f	vmui: add lists of top queries (#3065) ... * feat: add lists of top queries * fix: change the field label * refactor: add handlers for readability * app/vmselect: `make vmui-update` * docs: document `top queries` tab Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-08 21:44:43 +03:00
Aliaksandr Valialkin	052b527b39	docs/CHANGELOG.md: document ec273eafef ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3076	2022-09-08 21:21:26 +03:00
Aliaksandr Valialkin	f0eea5b02d	app/vmselect/netstorage: fix a typo, which leads to incorrect query results in VictoriaMetrics cluster ... The typo has been introduced in the commit 1a254ea20c Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3067	2022-09-08 13:46:40 +03:00
Aliaksandr Valialkin	f6990871a3	docs/vmctl.md: make docs-sync after c5261d5f56 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:20:16 +03:00
Zakhar Bessarab	ef01f01b6c	vmctl: implement support of chunking data for vm-native export (#3044) ... vmctl: implement support of chunking data for vm-native export process See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:14:48 +03:00
Aliaksandr Valialkin	051e722112	lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block ... This should reduce chances of unnoticed on-disk data corruption. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011 This change modifies the format for data exported via /api/v1/export/native - now this data contains MaxTimestamp and PrecisionBits fields from blockHeader. This is OK, since the native export format is undocumented.	2022-09-06 13:07:49 +03:00
Aliaksandr Valialkin	b7f3569522	app/vmselect/prometheus: follow-up after 50e2524bc2 ... - Add getCommonParamsWithDefaultDuration function and use it at /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the default behaviour for setting 5 minutes time range if start arg isn't passed to /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the change at docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3052	2022-09-05 11:57:08 +03:00
Aliaksandr Valialkin	c6b74148cf	app/vmselect/promql: consistently calculate rate_over_sum(m[d]) as sum_over_time(m[d])/d ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3045	2022-09-02 23:19:05 +03:00
Aliaksandr Valialkin	569843c0dd	docs/CHANGELOG.md: cut v1.81.1	2022-09-02 22:00:34 +03:00
Aliaksandr Valialkin	9cca3a0a1b	app/vmselect/netstorage: fix potential panic under high load ... The panic may trigger during data blocks' processing received from vmstorage nodes when some of vmstorage nodes return an error or when `-replicationFactor` is set to values higher than 2 at `vmselect`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3058	2022-09-02 21:36:15 +03:00
Aliaksandr Valialkin	024e2f18da	app/vmselect/promql: evaluate union() args in parallel in order to increase query performance ... Note that the parallel execution of `union()` args may take more memory and CPU time than the sequential execution if args contain heavy queries, which may load all the available CPU, disk and memory resources and vmselect and vmstorage levels.	2022-09-02 21:01:04 +03:00
Aliaksandr Valialkin	a11eae3a76	docs/CHANGELOG.md: cut v1.81.0	2022-08-31 02:33:36 +03:00
Aliaksandr Valialkin	30a1d0c622	docs/CHANGELOG.md: add missing link to vmagent	2022-08-31 02:22:52 +03:00
Aliaksandr Valialkin	cdb22c5ca3	docs/CHANGELOG.md: document v1.79.3 LTS release	2022-08-31 00:15:26 +03:00
Aliaksandr Valialkin	529bcc0761	docs/CHANGELOG.md: document the 044d51b668	2022-08-30 09:42:51 +03:00
Aliaksandr Valialkin	8aaaf221cc	app/vmselect/promql: follow-up after 2d71b4859c ... - Use getScalar() function for obtaining the expected scalar from phi arg - Reduce the error message returned to the user when incorrect phi is passed to histogram_quantiles - Improve the description of this bugfix in the docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3026	2022-08-27 01:38:17 +03:00
Dmytro Kozlov	2cf29cc4d1	vmselect/promql: fix panic in histogram_quantiles function (#3029) ... * vmselect/promql: fix panic in histogram_quantiles function * Update docs/MetricsQL.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-08-27 01:34:54 +03:00
Aliaksandr Valialkin	86394b4179	lib/promscrape: optimize discoveryutils.SanitizeLabelName() ... Cache sanitized label names and return them next time. This reduces the number of allocations and speeds up the SanitizeLabelName() function for common case when the number of unique label names is smaller than 100k	2022-08-27 00:18:19 +03:00
Aliaksandr Valialkin	e1bd38fa97	lib/promrelabel: optimize matching for commonly used regex patterns in if option ... The following regex patterns are optimized: - literal string match, e.g. "foo" - prefix match, e.g. "foo.*" and "foo.+" - substring match, e.g. ".*foo.*" and ".+foo.+" - alternate values match, e.g. "foo|bar|baz"	2022-08-26 14:55:13 +03:00
Aliaksandr Valialkin	d60654eb0a	lib/promrelabel: optimize action: {labeldrop,labelkeep,keep,drop} with regex containing alternate values ... For example, the following relabeling rule must work much faster now: - action: labeldrop regex: "foo|bar|baz"	2022-08-24 17:55:54 +03:00
Aliaksandr Valialkin	d4cf52f092	app/vmagent: follow-up after 2b22aa1537 ... - Document the change at docs/CHANGELOG.md - Move auth token parsing from app/vmagent/opentsdbhttp/ to app/vmagent/main.go, since it must be parsed only when multitenancy support is enabled at vmagent side. See https://docs.victoriametrics.com/vmagent.html#multitenancy	2022-08-24 16:21:23 +03:00
Dmytro Kozlov	d32a6359b0	vmselect/promql: enable search.maxPointsSubqueryPerTimeseries for sub-queries (#2963) ... * vmselect/promql: enable search.maxPointsPerTimeSeriesSubquery for sub-queries * vmselect/promql: cleanup * vmselect/promql: rename config flag * vmselect/promql: add tests * vmselect/promql: use test object instead of log * vmselect/promql: fix posible panic is subquery has more points. add description * vmselect/promql: update tests descriptions * vmselect/promql: update doInternal validation * vmselect/promql: fix linter * vmselect/promql: fix linter * vmselect/promql: update documentation and release notes * wip - Properly apply -search.maxPointsSubqueryPerTimeseries limit to subqueries. Previously the -search.maxPointsPerTimeseries limit was unexpectedly applied to subqueries if it was smaller than the -search.maxPointsSubqueryPerTimeseries . - Clarify docs for -search.maxPointsSubqueryPerTimeseries command-line flag . - Document -search.maxPointsPerTimeseries and -search.maxPointsSubqueryPerTimeseries flags at https://docs.victoriametrics.com/#resource-usage-limits . - Update docs/CHANGELOG.md . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2922 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-24 15:27:41 +03:00
Aliaksandr Valialkin	7b9ba456ff	app/vmstorage: expose vm_{hourly,daily}_series_limit_{max,current}_series metrics if -storage.max{Hourly,Daily}Series limits are set ... These metrics allow alerting when the number of unique series approach the limit. For example, the following query alerts when the number of series reaches 90% of the configured limit: vm_hourly_series_limit_current_series / vm_hourly_series_limit_max_series > 0.9	2022-08-24 13:41:57 +03:00
Roman Khavronenko	555a202d80	docs: follow-up after 88425bb285 (#3007) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-24 01:23:37 +03:00
Aliaksandr Valialkin	c5325f2db5	docs/CHANGELOG.md: document d59d829cdb ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2673	2022-08-21 23:37:15 +03:00
Aliaksandr Valialkin	1c7f402598	app/vmagent: add ability to construct a label from multiple existing labels by referring them in the replacement field during relabeling ... For example: - target_label: composite-label replacement: {{source_label1}}-{{source_label2}}	2022-08-21 22:49:24 +03:00
Aliaksandr Valialkin	ecd8a03b28	docs: change links to Prometheus docs about instant and range queries to links to VictoriaMetrics docs	2022-08-21 19:02:46 +03:00
Aliaksandr Valialkin	76844e519b	docs/CHANGELOG.md: document 10402459d8	2022-08-19 11:44:29 +03:00
Roman Khavronenko	2256d51418	docs: fix docs formatting related to vmalert (#2994) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-19 11:05:08 +03:00
Aliaksandr Valialkin	bbfa52bd75	docs: follow-up after 68e56b6fc5	2022-08-17 21:27:24 +03:00
Roman Khavronenko	cfcb5ab15b	vmalert: set alert's source link to UI instead of JSON source (#2986) ... We switch default alert's source link to redirect user to vmalert's UI instead of previous JSON object. While it breaks compatibility, it also supposed to improve user's experience. The old behavior can be achieved by updating `-external.alert.source` command-line flag. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 21:27:24 +03:00
Aliaksandr Valialkin	1812d33a2d	lib/promscrape: automatically generate additional per-target labels for targets with non-zero series limit ... The following metrics are generated: - scrape_series_limit - scrape_series_current - scrape_series_limit_samples_dropped These metrics simplify alerting on targets, which expose too many time series See https://docs.victoriametrics.com/vmagent.html#automatically-generated-metrics and https://docs.victoriametrics.com/vmagent.html#cardinality-limiter for more details	2022-08-17 13:22:02 +03:00
Aliaksandr Valialkin	e5c61cac22	docs/CHANGELOG.md: group vmalert features closer to each other	2022-08-17 11:49:53 +03:00
Aliaksandr Valialkin	aa37e6b438	lib/promscrape: retry http requests if the server returns 429 status code ... The 429 status code means that the server is overwhelmed with requests. The client can retry the request after some wait time. Implement this strategy for service discovery and scrape requests. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-16 14:57:26 +03:00
Aliaksandr Valialkin	dc929e0d16	lib/storage: improve performance for /api/v1/labels and /api/v1/label/.../values endpoints when match[] filter matches small number of time series ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2978	2022-08-16 13:34:23 +03:00
Roman Khavronenko	436b4d90af	docs: update vmalert docs (#2987) ... * mention recently added `$alertID` and `$groupID` variables in the changelog * properly escape template examples in the vmalert's README Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 12:10:08 +03:00
Aliaksandr Valialkin	7d7cf2b6fd	app/vmselect: follow-up after 63e0f16062 ... * Explicitly store a pointer to UserReadableError in the error interface. Previously Go automatically converted the value to a pointer before storing in the error interface. * Add Unwrap() method to UserReadableError, so it can be used transparently with the other code, which calls errors.Is() and errors.As(). * Document the change in docs/CHANGELOG.md	2022-08-15 13:53:19 +03:00
Roman Khavronenko	79e396dac9	docs: mention default vmalert's behavior change in Update notes (#2981) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-15 13:31:59 +03:00
Yury Molodov	dc52b283a3	vmui: shortcut keys legend (#2971) ... * feat: add shortcut modal * feat: add shortcut descriptions * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-15 12:04:30 +03:00
Aliaksandr Valialkin	c27bd63f6c	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:48 +03:00
Aliaksandr Valialkin	1a00c9ef03	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_pod_container_image label in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:57 +03:00
Aliaksandr Valialkin	2fb63dda83	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_service_port_number label to role: service in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:07:19 +03:00
Aliaksandr Valialkin	198d8eeeaa	app/vmalert/templates: add toTime() template function in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:52 +03:00
Aliaksandr Valialkin	2b58bd9876	lib/promscrape/discovery/dns: add support for resolving MX records ... See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:33:06 +03:00
Aliaksandr Valialkin	78f584fb0b	docs/CHANGELOG.md: clarify the change at 28441711e6	2022-08-11 23:53:32 +03:00
Roman Khavronenko	36660bcfe2	vmalert: follow-up after 28441711e6 (#2972) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 23:52:18 +03:00
Aliaksandr Valialkin	ec3df0b913	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores ... Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 21:37:24 +03:00
Roman Khavronenko	f42853275f	lib/storage: prevent excessive loops when storage is in RO (#2962) ... * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:47 +03:00
Aliaksandr Valialkin	91d0b45537	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:59:02 +03:00
Aliaksandr Valialkin	7e892d3322	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:38 +03:00
Aliaksandr Valialkin	b8877da35b	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:39 +03:00
Aliaksandr Valialkin	310779d8b5	lib/promscrape: follow-up after 2c553d5a2f ... - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:49:16 +03:00
Aliaksandr Valialkin	1996e36cf0	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function ... This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:32:44 +03:00
Aliaksandr Valialkin	12f4c89ff7	docs/CHANGELOG.md: link to the issue with improper handling of enpoint option at ec2_sd_configs ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:33:17 +03:00
Aliaksandr Valialkin	9039f23bd1	lib/promrelabel: do not split regex into multiple lines if it contains groups ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:16:15 +03:00
Aliaksandr Valialkin	23b7fa897a	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul ... This is a follow-up for 68de1f4e4a Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:23:01 +03:00
Yury Molodov	a2ecf311b8	vmui: graph action on moush hold and move (#2915) ... * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:56:08 +03:00
Aliaksandr Valialkin	573f6c8d6c	Makefile: remove redundant -mod=vendor option when running Go tools ... The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:40:41 +03:00
Aliaksandr Valialkin	5e43145031	docs: add docs for scrape_configs section	2022-08-07 00:04:55 +03:00
Aliaksandr Valialkin	77bd4e37cc	lib/promscrape/discovery/kubernetes: add missing __meta_kubernetes_ingress_class_name label for role: ingress ... See 7e65ad3e43 and 7e1111ff14	2022-08-06 22:39:14 +03:00
Aliaksandr Valialkin	ecbe1ddf1b	lib/promscrape/discovery/ec2: properly handle custom endpoint option in ec2_sd_configs ... This option was ignored since d289ecded1 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:52:37 +03:00
Aliaksandr Valialkin	80ecfcf759	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels ... See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:20:29 +03:00
Aliaksandr Valialkin	85b04732ed	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default ... This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 15:04:05 +03:00
Aliaksandr Valialkin	df34f8c5b8	docs: fixes after 83a4abda3f	2022-08-05 10:15:28 +03:00
Aliaksandr Valialkin	8ddad31eef	lib/promscrape/discovery/yandexcloud: follow-up after 6e5ac32fba ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:28:21 +03:00
Aliaksandr Valialkin	64183d4416	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:31:14 +03:00
Aliaksandr Valialkin	a1e49606ed	app/{vmselect,vmalert}: properly generate http redirects if -http.pathPrefix command-line flag is set ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 13:01:13 +03:00
Aliaksandr Valialkin	962ed46583	lib/mergeset: optimize mergeInmemoryBlocks() function ... Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-28 00:05:45 +03:00
Aliaksandr Valialkin	8722342819	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for vmauth with identical username and different password values	2022-07-26 19:39:00 +03:00
Aliaksandr Valialkin	3d4c312ba2	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system ... Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on b596ac3745 Thanks to @zqyzyq for the idea.	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	1b5799f894	lib/promscrape: set up=0 for partially failed scrape in stream parsing mode ... This behaviour aligns with Prometheus behavior	2022-07-22 13:38:25 +03:00
Aliaksandr Valialkin	aae522e501	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 ... This is a follow-up for edecd2493c	2022-07-21 21:00:34 +03:00
Aliaksandr Valialkin	3cbe232186	docs/CHANGELOG.md: follow-up after 88edb3f6cf	2022-07-21 20:53:24 +03:00
Roman Khavronenko	d0abdc2b5b	vmalert: allow configuring custom headers per group (#2901) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:48:05 +03:00
Roman Khavronenko	356d8b99e0	vmalert: allow configuring custom headers for URLs (#2897) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:45:12 +03:00
Aliaksandr Valialkin	f00a6bf837	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
Nikolay	0102eb3869	app/vmauth: allow duplicate usernames (#2888) ... Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:35:28 +03:00
Aliaksandr Valialkin	f992f96a88	app/vmselect/promql: execute q1 and q2 from q1 op q2 in parallel if labels pushdown cannot be applied ... This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:29:41 +03:00
Aliaksandr Valialkin	2d1366353c	lib/promscrape: reload all the scrape configs when the global section is changed inside -promscrape.config ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:42 +03:00
Aliaksandr Valialkin	d920b0afec	app/vmselect/promql: properly return q1 series from q1 ifnot q2 when q2 returns nothing	2022-07-18 14:24:23 +03:00
Aliaksandr Valialkin	83fef7daf5	docs/CHANGELOG.md: document 2f9668eba5	2022-07-18 12:37:34 +03:00
Aliaksandr Valialkin	b2d9379bd0	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to $(APP_NAME)-$(GOOS)-$(GOARCH)... naming	2022-07-18 12:00:45 +03:00
Aliaksandr Valialkin	a87f143e92	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:35 +03:00
Roman Khavronenko	80de6face8	vmalert: drop support of deprecated extra_filter_labels param (#2870) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 16:10:46 +03:00
Aliaksandr Valialkin	36062d27c5	docs/CHANGELOG.md: formatting fixes for update notes	2022-07-14 12:48:17 +03:00
Yury Molodov	1ca20caa4b	vmui: optimize table view (#2867) ... * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:16:57 +03:00
Dmytro Kozlov	99402541fb	vmui: update time picker behavior (#2847) ... * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:06:22 +03:00
Yury Molodov	23c3b5f8c7	vmui: change selection from autocomplete (#2862) ... * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:56:04 +03:00
Nikolay	c007b129cb	lib/promscrape: adds azure service discovery (#2743) ... * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:45:43 +03:00
Aliaksandr Valialkin	da6c85a2f6	all: follow-up for d99ba3481b	2022-07-13 17:17:08 +03:00
Aliaksandr Valialkin	be5fb139d6	docs/CHANGELOG.md: document 91faa152a5	2022-07-13 12:41:25 +03:00
Aliaksandr Valialkin	205c2a468a	docs/CHANGELOG.md: mention that the communication protocol between vmselect and vmstorage nodes is updated in the new release	2022-07-13 12:16:59 +03:00
Aliaksandr Valialkin	dd2b1f9ec4	app/vmselect/prometheus: follow-up after 3efe33b917	2022-07-11 20:37:21 +03:00
Dmytro Kozlov	6734d77d97	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851) ... * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:37:20 +03:00
Aliaksandr Valialkin	d442ee4610	app/vmselect/netstorage: optimize mergeSortBlocks function ... - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:35:38 +03:00
Roman Khavronenko	78da074ad3	metricsql: properly evaluate timezone_offset over time interval (#2842) ... * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:04:40 +03:00
Aliaksandr Valialkin	decbf84e55	app/vmselect/vmui: follow-up after 0bf6841140 ... * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:22:57 +03:00
Aliaksandr Valialkin	d0a943c487	docs/CHANGELOG.md: clarifications after e9b977859b	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	a5588bc6f4	docs/CHANGELOG.md: recommend clearing caches after the upgrade from v1.78.0 to v1.78.1	2022-07-08 13:05:11 +03:00
Roman Khavronenko	b29fafa86b	vmalert: deprecate alert's status link (#2840) ... * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	9ccae66337	docs/CHANGELOG.md: link to the issue related to multi-level vmselect	2022-07-08 05:23:51 +03:00
Aliaksandr Valialkin	e855744871	docs/CHANGELOG.md: recommend upgrading from v1.78.0 to v1.78.1 because of the bug in v1.78.0	2022-07-08 03:45:06 +03:00
Aliaksandr Valialkin	5a5c8534d1	docs/CHANGELOG.md: cut v1.78.1	2022-07-08 01:03:04 +03:00
Aliaksandr Valialkin	d8483f599e	docs/CHANGELOG.md: typo fixes	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	f03d4b2aa2	docs/CHANGELOG.md: link another bugreport related to the bug with per-day inverted index in v1.78.0	2022-07-07 02:35:35 +03:00
Aliaksandr Valialkin	5794886662	lib/promscrape: properly set Host header when sending requests via http proxy ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794	2022-07-07 02:28:47 +03:00
Aliaksandr Valialkin	9dd5d3a431	docs/CHANGELOG.md: link to the issue about incorrect per-day index handling in v1.78.0	2022-07-07 02:00:58 +03:00
Aliaksandr Valialkin	95add1e8e4	app/{vmagent,vminsert}: follow-up after d19e46de55 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:32:11 +03:00
Aliaksandr Valialkin	4d03ac90fc	lib/promscrape/discovery/kubernetes: properly populate service-level labels for role: endpointslice targets ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2823	2022-07-07 00:36:25 +03:00
Aliaksandr Valialkin	c4cc45d7f8	lib/promscrape/discovery/kubernetes: allow attaching node-level labels to role: endpoints and role: endpointlice targets in the same way as Prometheus does ... See https://github.com/prometheus/prometheus/pull/10759	2022-07-07 00:36:24 +03:00
Aliaksandr Valialkin	195dccf678	app/vmselect: add ability to query vmselect from another vmselect	2022-07-06 13:19:45 +03:00
Aliaksandr Valialkin	714958deab	all: follow-up after ed89106274	2022-07-06 12:48:52 +03:00
Aliaksandr Valialkin	498c6d6e72	lib/promscrape: push scrape_samples_limit metric to remote storage if sample_limit option is set in scrape_config for this target ... See https://github.com/VictoriaMetrics/operator/issues/497	2022-07-06 12:46:23 +03:00
Roman Khavronenko	f51bc07d97	vmselect: allow proxying requests to vmalert (#2833) ... The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:51 +02:00
Aliaksandr Valialkin	78f9a8aafd	lib/storage: put the (date, metricID) entry in dateMetricIDCache just after the corresponding series is registered in the per-day inverted index ... Previously the time series could be put into dateMetricIDCache without registering in the per-day inverted index if GetOrCreateTSIDByName finds TSID entry in the global index. This could lead to missing series in query results. The issue has been introduced in the commit 55e7afae3a, which has been included in VictoriaMetrics v1.78.0	2022-07-05 14:56:55 +03:00
Aliaksandr Valialkin	8516670582	app/vmselect/promql: properly calculate histogram_quantile over unexpected le buckets ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:20:41 +03:00
Roman Khavronenko	78da4b5f5e	docs: warn about potential issue with read queries for 1.78.0 (#2818) ... * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:47:41 +03:00
Aliaksandr Valialkin	fa08220d27	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2787	2022-06-30 22:40:26 +03:00
Aliaksandr Valialkin	7fc03a1deb	app/vmagent/remotewrite: add -remoteWrite.header command-line flag for setting additional http headers to send to -remoteWrite.url ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:59 +03:00
Aliaksandr Valialkin	da3179667e	docs/CHANGELOG.md: document bdf9f4669a	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	92e6c55b75	docs: add Troubleshooting doc ... This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	daefb64f38	app/vmselect: expose additional histograms at /metrics page, which may help get more insights for the query workload ... This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:31 +03:00
Aliaksandr Valialkin	7d5d33fd71	lib/storage: return marshaled metric names from SearchMetricNames ... Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:16:32 +03:00
Aliaksandr Valialkin	a38568ddfe	docs/CHANGELOG.md: document 45f20ad1aa	2022-06-27 13:53:26 +03:00
Aliaksandr Valialkin	6386f117c8	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:42:57 +03:00
Aliaksandr Valialkin	ea2aa617e5	docs/CHANGELOG.md: update after e40d015e9a	2022-06-24 18:03:56 +03:00
Aliaksandr Valialkin	94b81165d0	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries ... Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:58:47 +03:00
hagen1778	e40d015e9a	vmselect: make vm_partial_results_total consistent ... Metrics `vm_partial_results_total` and `vm_requests_total` serving the similar purpose, but contain inconsistent set of labels. This change updates `vm_partial_results_total` labels to be consistent with `vm_requests_total`. The change breaks backward compatibility with assumption that `vm_partial_results_total` wasn't widely used, since it is not documented and absent in the alerts and dashboards. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-24 13:50:26 +02:00
Dmytro Kozlov	f28cbcc7b5	vmui: added query tracing (#2748) ... * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 23:00:45 +03:00
Nikolay	ee5c502446	app/vmselect: fixes partial response with replicationFactor (#2777) ... * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:17:24 +03:00
Yurii Kravets	f0c1edb175	docs: Update CHANGELOG Update notes (#2776) ... * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 19:40:20 +03:00
Aliaksandr Valialkin	71b0dfdefa	lib/promscrape: always send stale markers with the real scrape timestamp ... This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:49:13 +03:00
Aliaksandr Valialkin	3ae6300497	lib/promauth: add ability to send additional http headers in requests to scrape targets ... This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:40:50 +03:00
Aliaksandr Valialkin	7429dfbe9e	app/vmselect: add -search.setLookbackToStep command-line flag for making the gap filling algorithm similar to InfluxDB data model ... This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:20:02 +03:00
Aliaksandr Valialkin	24097f2417	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:11:04 +03:00
Aliaksandr Valialkin	a1629bd3be	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful ... If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:33:54 +03:00
Aliaksandr Valialkin	45e9732764	docs: follow-up after e4d6b750f6	2022-06-20 17:15:52 +03:00
Nikolay	15662c0f29	lib/httpserver: adds flagsAuthKey command-line flag (#2758) ... * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:15:51 +03:00
Artem Navoiev	42c69ae74e	docs: replace bash code block type with console (#2746)	2022-06-19 23:02:00 +03:00
Aliaksandr Valialkin	4ae1c5655f	docs/CHANGELOG.md: document ef7f52e0e6	2022-06-19 22:49:11 +03:00
Aliaksandr Valialkin	88e1221b35	lib/storage: do not register new series if -storage.maxHourlySeries or -storage.maxDailySeries limits are exceeded ... Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:03:02 +03:00
Aliaksandr Valialkin	c5ac176153	lib/storage: reset metric id caches for the previous and the current hour ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:02:51 +03:00
Dmytro Kozlov	5bc13e2fe8	vmui: added focusLabel, enable cardinality app configuratior (#2736) ... * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:04:09 +03:00
Roman Khavronenko	cbe39bbb8d	vmselect: limit end param max value by 2d in future (#2729) ... * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	450aa0ae5a	lib/promrelabel: support action: graphite relabeling ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:25:49 +03:00
Aliaksandr Valialkin	b4e75a0b89	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:41:26 +03:00
Aliaksandr Valialkin	14ce7b0e25	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:23 +03:00
Aliaksandr Valialkin	c846d0db01	docs/CHANGELOG.md: document 99dbe7f9d4	2022-06-13 10:07:19 +03:00
Yury Molodov	65107a4585	vmui: enhancements (#2638) (#2717) ... * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:49:58 +03:00
Aliaksandr Valialkin	9d8c37d280	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added ... The optimization has been added in 374beb350e Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:57 +03:00
Aliaksandr Valialkin	61e03f172b	app/vmselect: optimize /api/v1/labels and /api/v1/label/.../values handlers when match[] query arg is passed to them	2022-06-12 14:06:24 +03:00
Aliaksandr Valialkin	4a94cd81ce	app/vmselect: add optional limit query arg to /api/v1/labels and /api/v1/label_values endpoints ... This arg allows limiting the number of sample values returned from these APIs	2022-06-10 10:24:07 +03:00
Roman Khavronenko	3c09d25039	vmalert: followup for 76f05f8670 (#2706) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 13:15:35 +03:00
Aliaksandr Valialkin	2520b8efb8	docs: add a link to cardinality explorer playground	2022-06-08 19:40:12 +03:00
Dmytro Kozlov	f2754c3e90	Cardinality explorer (#2625) ... * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:54:27 +03:00
Aliaksandr Valialkin	ba406ff28c	docs/CHANGELOG.md: document 63b538ecd1	2022-06-07 15:53:08 +03:00
Aliaksandr Valialkin	c07f99cd4f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:53 +03:00
Aliaksandr Valialkin	c7ff4505d2	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage ... The changes are related to the added query tracing in afced37c0b See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:58 +03:00
Aliaksandr Valialkin	2b72d21840	docs/CHANGELOG.md: document e755d0ec3f	2022-06-07 15:21:10 +03:00
Aliaksandr Valialkin	0b4f767c53	docs/CHANGELOG.md: document 1ee1e986da	2022-06-07 15:02:57 +03:00
Aliaksandr Valialkin	68b6ddfb14	all: follow-up after 8edb390e21 ... - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 01:05:53 +03:00
Aliaksandr Valialkin	3dbb19d624	lib/promscrape/discovery/kubernetes: follow-up after 006b8c7534 ... - make more clear error logs - simplify testing for newKubeConfig by passing only the path to kube_config file instead of SDConfig struct	2022-06-06 14:41:28 +03:00
Aliaksandr Valialkin	6c2fb9d8c4	lib/promscrape: add -promscrape.cluster.name command-line flag ... This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 01:11:23 +03:00
Dmytro Kozlov	ce8aade80e	lib/promscrape: adds service discovery visualization for /targets page(#2675) ... * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-04 01:11:23 +03:00
Nikolay	72e43ef2fe	lib/promscrape/discovery/kubernetes: follow-up after 0b5c874911 (#2672)	2022-06-04 01:11:23 +03:00
Aliaksandr Valialkin	cc226e6ebe	docs/CHANGELOG.md: follow-up after 2177089f94	2022-06-01 14:57:39 +03:00
Roman Khavronenko	e9ee043879	lib/storage: make indexdb/tagFilters cache size configurable (#2667) ... The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Roman Khavronenko	bca90d7148	promrelabel: add support of lowercase and uppercase relabeling actions (#2665) ... * promrelabel: add support of `lowercase` and `uppercase` relabeling actions https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2664 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/storage: make golangci-lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	fedfc9e686	lib/storage: stop background merge when storage enters read-only mode ... This should prevent from `no space left on device` errors when VictoriaMetrics under-estimates the additional disk space needed for background merge. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2603	2022-06-01 14:22:12 +03:00
Aliaksandr Valialkin	afced37c0b	all: add initial support for query tracing ... See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:31:44 +03:00
Aliaksandr Valialkin	e83b96366f	docs/CHANGELOG.md: follow-up after 11f91532c5 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Dmytro Kozlov	cd1fa2e4cd	issue-2594: use embedded for static files (#2650) ... embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Aliaksandr Valialkin	f149d56ac2	lib/promscrape: add -promscrape.suppressScrapeErrorsDelay command-line flag ... This flag can be used for reducing the amounts of logs when scraping unreliable scrape targets. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2575 The patch is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2576 . Thanks to @jelmd .	2022-05-25 23:00:30 +03:00
Aliaksandr Valialkin	38beb9fe04	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag ... This is a follow-up for 0fbf59199a See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:07:14 +03:00
Aliaksandr Valialkin	05e47482a5	docs/CHANGELOG.md: document 9e343faa41	2022-05-25 15:05:42 +03:00
Aliaksandr Valialkin	df9ffa6854	app: expose /api/v1/status/config endpoint in the same way as Prometheus does ... This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 10:00:00 +03:00
Aliaksandr Valialkin	513f9537a9	docs/CHANGELOG.md: cut v1.77.2	2022-05-21 02:26:29 +03:00
Aliaksandr Valialkin	cdbee6f470	docs/CHANGELOG.md: group vmalert features together	2022-05-21 01:52:13 +03:00
Aliaksandr Valialkin	35ed63f32e	docs/CHANGELOG.md: document 2cf586da78	2022-05-21 01:17:49 +03:00
Roman Khavronenko	7406665fc3	lib/promscrape/discovery/kubernetes: fixes kubernetes service discovery (#2615) ... * lib/promscrape/discovery/kubernetes: properly updates discovered scrape works previously, added or updated scrapeworks may override previuosly discovered. it happens because swosByKey may contain small subset of kubernetes objects with it's labels. It happens for objectsUpdated and objectsAdded maps, which include only changed elements * Properly calculate vm_promscrape_discovery_kubernetes_scrape_works Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-21 01:17:21 +03:00
Aliaksandr Valialkin	4ca5d97459	docs/CHANGELOG.md: document 3df8caca15	2022-05-20 14:24:36 +03:00
Aliaksandr Valialkin	386ef69124	docs/CHANGELOG.md: formatting fixes	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	98123e95dd	docs/CHANGELOG.md: formatting fix for the issue url https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	c5765dd6ad	docs/CHANGELOG.md: link to the feature request about reusable templates in vmalert ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2510	2022-05-20 14:21:35 +03:00
Roman Khavronenko	2aeb00f98f	vmalert: support scalar type in response (#2610) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:08:19 +03:00
Roman Khavronenko	a07ddf9b65	vmalert: support strings in humanize.* templates (#2606) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:05:53 +03:00
Roman Khavronenko	87e4e76537	vmalert: support /rules path for Grafana's ngalert requests (#2593) ... Unexpectedly, Grafana makes an extra request to `/rules` handler in addition to `/api/v1/rules` calls in alerts UI. This happens only for Grafana versions older than 8.5.*. Apparently, this is related to support of other monitoring systems. Prometheus responds with `text/html` content for UI page `/rules` to such requests. Actually, returning just a blank page with SC=200 works as well. Returning actual response of `/api/v1/rules` results in error in Grafana since it expects a `yaml` (?) in response. So we add a placeholder to `vmalert`. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2583 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:53:55 +03:00
Roman Khavronenko	0790ba5e26	vmalert: follow-up after 0ac1cdfff5 (#2586) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 12:25:13 +03:00
Aliaksandr Valialkin	83ff4c411d	app/vmalert: apply -remoteRead.disablePathAppend to -datasource.url in the same way as for the -remoteRead.url ... This is a follow-up for 0e2486df56 The related pull requests: - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1536 - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1712	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	c1dd458f56	docs/CHANGELOG.md: document 3f0ecee128 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2577	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	e35e488220	docs/CHANGELOG.md: document c8af625bcc ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146	2022-05-11 14:33:06 +03:00
Denys Holius	f3ac421413	docs: fixed typos in CHANGELOG.md (#2565)	2022-05-11 14:30:45 +03:00
Aliaksandr Valialkin	d8a276fbe4	lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() ... This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552	2022-05-11 14:11:06 +03:00
Aliaksandr Valialkin	68bfa05437	app/vmselect/promql: do not return values from label_value() if the original time series has no values at the selected timestamps	2022-05-09 17:58:39 +03:00
Aliaksandr Valialkin	d5efd3949b	docs/CHANGELOG.md: document 8f4f5f1d68	2022-05-09 17:33:04 +03:00
Aliaksandr Valialkin	e3819d3e8d	docs/CHANGELOG.md: cut v1.77.1	2022-05-07 01:49:21 +03:00
Aliaksandr Valialkin	e613ca9ba8	app/vminsert/netstorage: re-route samples from readonly vmstorage nodes to healthy nodes if -dropSamplesOnOverload command-line flag is set	2022-05-07 01:40:02 +03:00
Aliaksandr Valialkin	e961aec551	app/vmstorage: do not allow to set -retentionPeriod smaller than one day ... VictoriaMetrics doesn't support retention periods smaller than one day, so do not allow to set it to small values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2496	2022-05-07 00:54:42 +03:00
Aliaksandr Valialkin	810dd74fb9	lib/promscrape: properly implement ScrapeConfig.clone() ... Previously ScrapeConfig.clone() was improperly copying promauth.Secret fields - their contents was replaced with `<secret>` value. This led to inability to use passwords and secrets in `-promscrape.config` file. The bug has been introduced in v1.77.0 in the commit 67b10896d2 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2551	2022-05-07 00:06:19 +03:00
Aliaksandr Valialkin	994c06cb84	docs/CHANGELOG.md: document e726340914	2022-05-06 18:11:16 +03:00
Dmytro Kozlov	8b5a819266	vmbackup: Prevent save backups to the same folder where TSDB data is (#2547) ... * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip * vmbackup: Prevent save backups to the same folder where TSDB data is * Apply suggestions from code review * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-06 18:04:58 +03:00
Aliaksandr Valialkin	983b465757	app/vmagent: add missing _total suffix to vmagent_remotewrite_global_rows_pushed_before_relabel_total counter ... This is a follow up for c536139d0b	2022-05-06 15:51:34 +03:00
Aliaksandr Valialkin	af0da45d3e	lib/promscrape: rename promscrape_stale_samples_created_total metric to vm_promscrape_stale_samples_created_total, so its name is consistent with the rest of vm_promscrape_ metrics	2022-05-06 15:33:43 +03:00
Aliaksandr Valialkin	2baa9e8f48	app/vmagent: expose vmagent_remotewrite_global_rows_pushed_before_relabel and vmagent_remotewrite_rows_pushed_after_relabel_total metrics	2022-05-06 15:30:10 +03:00
Aliaksandr Valialkin	9c89ea1c90	app/vmagent: rename vmagent_remote_write_rate_limit_reached_total to vmagent_remotewrite_rate_limit_reached_total for the sake of consistency with other vmagent_remotewrite_ metrics	2022-05-06 15:02:18 +03:00
Aliaksandr Valialkin	9d40bb7137	lib/promscrape/discovery/ec2: add ability to filter Availability Zones in ec2_sd_config via az_filters section	2022-05-06 12:44:01 +03:00
Aliaksandr Valialkin	8babb4aebc	app/vmselect/vmui: make vmui-update after 450d879eaa	2022-05-05 22:11:41 +03:00
Aliaksandr Valialkin	0634a894a9	docs/CHANGELOG.md: document bf5e3774cc	2022-05-05 13:38:44 +03:00
Aliaksandr Valialkin	0ad5b64930	docs/CHANGELOG.md: cut v1.77.0	2022-05-05 00:16:31 +03:00
Aliaksandr Valialkin	358fa99af2	app/vmalert: run make quicktemplate-gen from the root directory after the commit f6dcfbcdd6	2022-05-04 20:28:37 +03:00
Nikolay	7e58cba6cf	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458) ... * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:28:37 +03:00
Dmytro Kozlov	0aeefeb5f1	vmalert/tpl: fixed truncating alerts expression in table (#2494) ... vmalert: improve `/groups` UI visual The change also fixes truncated rules expressions in UI https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2484	2022-05-04 20:28:37 +03:00
Aliaksandr Valialkin	9dc9e03a14	docs/CHANGELOG.md: yet another typo fix: present -> pressed	2022-05-04 18:20:58 +03:00
Aliaksandr Valialkin	c2610e4186	docs/CHANGELOG.md: typo fixes	2022-05-04 18:19:05 +03:00
Aliaksandr Valialkin	47010a9875	docs/CHANGELOG.md: document 8639e79d38	2022-05-04 10:46:32 +03:00
Aliaksandr Valialkin	25266d2194	docs/CHANGELOG.md: document 3575aabeaf	2022-05-03 14:01:58 +03:00
Aliaksandr Valialkin	ec3a37896f	all: add -cluster.tlsInsecureSkipVerify command-line option to vminsert, vmselect and vmstorage components in order to be able to disable TLS certificate verification in mTLS mode ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2490	2022-05-03 13:13:43 +03:00
Aliaksandr Valialkin	ccf44e810c	docs/CHANGELOG.md: document 488c34f5e1	2022-05-03 11:01:27 +03:00
Aliaksandr Valialkin	d384997657	docs/CHANGELOG.md: document d0706c8c95	2022-05-02 22:25:47 +03:00
Aliaksandr Valialkin	361b08c30e	lib/storage: leave the last sample per each discrete interval during the deduplicaton ... This aligns better with staleness logic in Prometheus - https://prometheus.io/docs/prometheus/latest/querying/basics/#staleness	2022-05-02 21:59:31 +03:00
Aliaksandr Valialkin	7ca32c21c8	app/vmui: execute query by pressing enter in the same way as Prometheus does ... Multi-line query can be entered via `shift-enter` in the query input field	2022-05-02 20:24:43 +03:00
Aliaksandr Valialkin	a70ac35ac7	docs/CHANGELOG.md: document 3616337812 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2514	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	75f4adab40	docs/CHANGELOG.md: document 32a6b67e6c ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1761	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	693e1838b3	docs/CHANGELOG.md: document b2294d1cf1	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	190c8b463c	lib/netutil: close connections in ConnPool if they are idle for more than 30 seconds ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508	2022-05-02 15:01:52 +03:00
Artem Navoiev	11db05a4ff	lib/{storage,flagutil} - Add option for snapshot autoremoval (#2487) ... * lib/{storage,flagutil} - Add option for snapshot autoremoval - add prometheus-like duration as command flag - add option to delete stale snapshots - update duration.go flag to re-use own code * wip * lib/flagutil: re-use Duration.Set() call in NewDuration * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-02 11:24:12 +03:00
Aliaksandr Valialkin	eaae544238	docs/CHANGELOG.md: document c7aad8d441	2022-04-29 13:02:43 +03:00
Dima Lazerka	e6ee235707	Export "null" in jsonl instead of NaN (#2518) ... * Export "null" in jsonl instead of NaN The NaN appeared because of staleness markers that were added for compatibility. I think it's better to use json `null`, implemented here. Also maybe it also makes sense to add a flag like `?skip-staleness-markers=true` to `/export`, to skip nulls at all? * Update app/vmselect/prometheus/export.qtpl * app/vmselect/prometheus/export.qtpl.go: `make quicktemplate-gen` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-29 12:51:03 +03:00
Aliaksandr Valialkin	6eb1580158	app/vmselect/promql: add tlast_change_over_time(m[d]) function, which returns the timestamp for the last change of m on the given lookbehind window d	2022-04-27 10:58:40 +03:00
Yury Molodov	eae6f68be2	vmui: add support relative time (#2504) ... * feat: add support relative time * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-26 15:46:47 +03:00
Aliaksandr Valialkin	cd4d1599cb	docs/CHANGELOG.md: document 4c1fbcd6b0 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2368	2022-04-26 15:09:57 +03:00
Aliaksandr Valialkin	374212333f	docs/CHANGELOG.md: typo fix: may result -> could result	2022-04-23 00:31:47 +03:00
Aliaksandr Valialkin	4c3cd96db5	lib/promauth: add support for min_version option at tls_config section in the same way as Prometheus does	2022-04-23 00:24:11 +03:00
Aliaksandr Valialkin	808a2f3b61	lib/promauth: add support for proxy_url option at oauth2 section in the same way as Prometheus does	2022-04-23 00:01:53 +03:00
Aliaksandr Valialkin	4ade8511e2	lib/promauth: add support for tls_config section at oauth2 config in the same way as Prometheus does	2022-04-23 00:01:52 +03:00
Aliaksandr Valialkin	a89e31b304	lib/promscrape/discovery/kubernetes: allow attaching node-level labels and annotations to discovered pod targets in the same way as Prometheus 2.35 does ... See https://github.com/prometheus/prometheus/issues/9510 and https://github.com/prometheus/prometheus/pull/10080	2022-04-22 20:15:34 +03:00
Aliaksandr Valialkin	dac24aa342	app/vmselect/promql: properly handle scalar default vector, scalar if vector and scalar ifnot vector queries ... Previously `vector` time series could be unexpectedly returned from such queries	2022-04-21 15:34:14 +03:00
Aliaksandr Valialkin	a5cfe5d13e	app/vmselect/promql: add drop_common_labels() function	2022-04-21 14:20:36 +03:00
Aliaksandr Valialkin	ed1b394a1a	app/vmstorage: expose vm_indexdb_items_added_total and vm_indexdb_items_added_size_bytes_total counters at /metrics page ... These counters can be used for monitoring the rate of addition of new entries in indexdb (aka inverted index). See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2471	2022-04-21 13:19:42 +03:00
Aliaksandr Valialkin	25b841c6ed	app/vmselect/promql: fix duplicate time series error on joins against time series filtered by values ... This should prevent from `duplicate time series` errors when executing the following query: kube_pod_container_resource_requests{resource="cpu"} * on (namespace,pod) group_left() (kube_pod_status_phase{phase=~"Pending|Running"}==1) where `kube_pod_status_phase{phase=~"Pending|Running"}==1` filters out diplicate time series	2022-04-20 22:21:20 +03:00
Aliaksandr Valialkin	90db923662	docs/CHANGELOG.md: document that the service discovery speed now scales with the number of CPU cores	2022-04-20 16:22:50 +03:00
Aliaksandr Valialkin	45385a5dc6	lib/promscrape: optimize getScrapeWork() function ... Reduce the number of memory allocations in this function. This improves its performance by up to 50%. This should improve service discovery speed when big number of potential targets with big number of meta-labels are generated by service discovery. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2270	2022-04-20 15:34:18 +03:00
Aliaksandr Valialkin	d0bac8e224	all: typo fix: Kuberntes -> Kubernetes	2022-04-20 10:51:41 +03:00
Dmytro Kozlov	17552dba8b	lib/promscrape: Enable filters for endpoint and labels (#2466) ... * lib/promscrape: Enable filters for endpoint and labels * lib/promscrape: cleanup * lib/promscrape: update template * lib/promscrape: move logic filter logic to backend * lib/promscrape: updated placeholder * lib/promscrape: updated placeholder * lib/promscrape: use two different fields for filters, updated form, added error on parsing queries * lib/promscrape: rename functions * lib/promscrape: removed unused values * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-19 18:27:44 +03:00
Nikolay	628905f080	lib/promscrape: adds job restart method (#2455) ... * lib/promscrape: adds job restart method it must restart only ScrapeConfig with changed content this change greatly reduce time, that needed for job restart and it should decrease possible data loss when config frequently changed at kubernetes based deployments Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 20:29:33 +03:00
Yury Molodov	60c4e0022a	fix: prevent graph hiding without data (#2456) ... * fix: prevent graph hiding without data * fix: add yaxis labels default * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 17:16:17 +03:00
Aliaksandr Valialkin	a7689e1b0c	app/vmstorage: add support for mTLS cipher suites via -cluster.tlsCipherSuites command-line flag ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2404	2022-04-16 16:36:38 +03:00
Aliaksandr Valialkin	27e74f25d6	lib/httpserver: follow up after def0032c7d	2022-04-16 15:52:44 +03:00
Aliaksandr Valialkin	c50e48a74c	lib/promscrape: follow-up after baa1c24b36	2022-04-16 14:26:38 +03:00
Aliaksandr Valialkin	564996da14	docs/CHANGELOG.md: document 45fcaa33e8	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	951b2a0067	docs/CHANGELOG.md: document f7e4c5a628	2022-04-13 14:14:25 +03:00
Anton Bystrov	af96e6594c	Update CHANGELOG.md (#2463) ... May be mispint here?	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	4a6b56e5be	docs/CHANGELOG.md: cut v1.76.1	2022-04-12 16:21:06 +03:00
Aliaksandr Valialkin	3e2a4c07cd	app/vmui: further improvements for number display on graphs ... This is a follow-up for c4d2cd8336 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2409	2022-04-12 16:02:37 +03:00
Aliaksandr Valialkin	50a6354a03	docs/CHANGELOG.md: link to the bug related to improper handling of maxSeries limit passed from vmselect to vmstorage	2022-04-12 16:02:37 +03:00
Aliaksandr Valialkin	70ad171070	lib/promscrape: follow-up after 7e79adfb55	2022-04-12 12:37:03 +03:00
Aliaksandr Valialkin	81b7a31cb1	app/vmstorage: properly handle maxSeries limit passed from vmselect to vmstorage	2022-04-12 11:19:07 +03:00
Aliaksandr Valialkin	e3bf464f11	lib/protoparser/native: follow-up after fe01f4803d	2022-04-11 19:27:53 +03:00
Aliaksandr Valialkin	b3a3e9990f	vendor: update github.com/VictoriaMetrics/metricsql from v0.40.0 to v0.41.0 ... This allows using built-in function names as with template names	2022-04-11 18:32:18 +03:00
Aliaksandr Valialkin	3c27bde77e	docs/CHANGELOG.md: document ed364a42e3	2022-04-11 12:12:07 +03:00
Aliaksandr Valialkin	ce02d086d0	docs/CHANGELOG.md: document backwards-incompatible changes in cluster version of v1.76.0	2022-04-08 12:06:49 +03:00
Aliaksandr Valialkin	d7557b12ab	docs/CHANGELOG.md: document the bugfix in hitCount function	2022-04-08 11:48:36 +03:00
Aliaksandr Valialkin	949bf25a87	docs/CHANGELOG.md: typo fix	2022-04-07 17:20:20 +03:00
Aliaksandr Valialkin	e59019d088	docs/CHANGELOG.md: cut v1.76.0	2022-04-07 15:34:12 +03:00
Aliaksandr Valialkin	f082e64e0c	app/vmagent: reduce the probability of TLS handshake timeout when dialing the remote storage ... The following actions are taken: - Increase the TLS hashdshake timeout from 5 seconds to 10 seconds - Increase dial timeout from 5 seconds to 30 seconds - Specify DialContext instead of Dial in http.Transport. This allows properly handling the Context arg during dialing the remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1699	2022-04-06 12:35:14 +03:00
Aliaksandr Valialkin	c24c5b8926	docs/CHANGELOG.md: document 0c0efc7781	2022-04-05 19:22:08 +03:00
Aliaksandr Valialkin	8752cce157	app/vminsert: reduce the max packet size, which vminsert can send to vmstorage ... This reduces the max memory usage for vminsert and vmstorage under heavy ingestion rate by up to 50% on production workload	2022-04-05 15:39:58 +03:00
Aliaksandr Valialkin	816085a652	docs/CHANGELOG.md: document 70bb0d2708	2022-04-04 13:02:41 +03:00
Aliaksandr Valialkin	676c1f4fd7	docs/CHANGELOG.md: document 173073364e1bb1e0259ddc873dbd96ce62b07543	2022-04-04 12:56:11 +03:00
Aliaksandr Valialkin	157555b022	docs/CHANGELOG.md: document a57e3807537914396ee3eb378648a464fa9e1b97	2022-04-01 12:25:54 +03:00
Aliaksandr Valialkin	151a00189e	docs/CHANGELOG.md: document 0989649ad0	2022-04-01 12:03:41 +03:00
Aliaksandr Valialkin	7c81ce296d	docs/CHANGELOG.md: cut v1.75.1	2022-03-28 12:28:27 +03:00
Yury Molodov	7cbf19812d	vmui: predefined panels (#2243) ... * feat: add basic components for predefined dashboards * fix: change display alert * feat: add autosize and unit for axes * feat: add component for CircularProgress * feat: change layout for predefined dashboards * feat: add override step for predefined panels * feat: add override step for predefined panels * feat: change yaxis limits for predefined panels * fix: rename flag for hide legend * feat: add formatted panel description * feat: add README.md for dashboard setup * feat: validate dashboard settings * feat: add unit for y-ticks * fix: correct display error for dashboards * fix: disable auto refresh after route change * update package-lock.json * fix: add basename for BrowserRouter * fix: add dynamic basename for routing * update packages * feat: add a pre-defined dashboard "per-job resource usage" * feat: display unit in the hover-tooltip * fix: change routing and home layout * fix: change axis width calc * updated packages * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-26 13:05:21 +02:00
Aliaksandr Valialkin	b843f0e229	app/vmselect: add fine-grained limits for the number of returned/scanned time series for various APIs	2022-03-26 11:28:14 +02:00
Dima Lazerka	6e8e385375	VMAnomaly docs fixes (#2361) ... * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Squeeze vmanomaly after vmbackupmanager before Case Studies Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-25 12:09:05 +02:00
Aliaksandr Valialkin	b7b06fb50e	Revert "docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0" ... This reverts commit 1e18c1c1ae. The bugfix has been alread mentioned in the commit 9290605891	2022-03-24 19:21:15 +02:00
Aliaksandr Valialkin	1e18c1c1ae	docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0	2022-03-24 19:20:42 +02:00
Arash Hatami	2e01691d5d	A good change for MD files (#2353) ... * Lint YAML * Remove extra comment * Fix command problem * Format MD files * Format & fix problem of MD files for docs * Another fix for MD files	2022-03-22 14:01:04 +02:00
Roman Khavronenko	bb594b34b8	docs: update release notes (#2349) ... Warn about memory issue introduced in releases 1.73 - 1.74	2022-03-21 15:41:25 +02:00
Aliaksandr Valialkin	84b3234f3d	docs/CHANGELOG.md: document a1e17e91f8	2022-03-21 15:37:03 +02:00
hagen1778	7c7436b584	docs: add update note to v1.75.0 release note ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-21 15:37:01 +02:00
Aliaksandr Valialkin	7e67d61fdf	docs/CHANGELOG.md: cut v1.75.0	2022-03-18 19:54:13 +02:00
Aliaksandr Valialkin	85695faa94	app/vmselect/bufferedwriter: suppress trivial network errors, which can be generated by remote side ... These errors include `broken pipe` and `reset by peer`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2334	2022-03-18 19:27:33 +02:00
Aliaksandr Valialkin	9d91ad7124	app/vmagent/remotewrite: prevent from infinite recursion panic when pushing a time series with big number of samples to remote storage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2335	2022-03-18 19:07:27 +02:00
Aliaksandr Valialkin	ab966f8a7a	docs: document 20bb5e703c	2022-03-18 18:42:09 +02:00
Aliaksandr Valialkin	e35c9124b7	lib/storage: reduce the interval for checking for free disk space from 30 seconds to 1 second ... This should reduce the probability of out of disk space panics when -storage.minFreeDiskSpaceBytes is set to low values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2305	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	7c92aaeaa4	lib/blockcache: properly release memory occupied by deleted entries ... Proviously the deleted entries could remain referenced via lastAccessHeap for long time. This could lead to increased memory usage for the following caches starting from v1.73.0: * indexdb/indexBlocks * indexdb/dataBlocks * storage/indexBlocks Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2242 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	85a4b805e1	docs/CHANGELOG.md: document e5868b9c29 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/546 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2255	2022-03-18 13:08:56 +02:00
Aliaksandr Valialkin	e1f70af14e	docs/CHANGELOG.md: document 11ae1ae924	2022-03-17 20:09:18 +02:00