github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00

Author	SHA1	Message	Date
Roman Khavronenko	238401e3ed	docs: udpate Datadog section (#3190 ) The `docs-sync` command was updated to modify images path for assets in `docs/` folder. The change allows to refer images from `docs` without copying them to the root folder. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-05 22:36:35 +03:00
Yurii Kravets	39b85119f2	docs: Update How to send data from DataDog agent (#3168 ) docs: Update How to send data from DataDog agent	2022-10-05 22:24:42 +03:00
Aliaksandr Valialkin	43bdd96a6e	app/vmselect: improve performance scalability on multi-CPU systems for `/api/v1/export/...` endpoints	2022-10-01 22:16:07 +03:00
Aliaksandr Valialkin	ae6c7edf04	app/vmselect: do not export NaN values for stale metrics at /federate endpoint Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3185	2022-10-01 19:48:21 +03:00
Aliaksandr Valialkin	e6ee725bae	docs/Cluster-VictoriaMetrics.md: add a security note for multitenant support via labels	2022-10-01 18:56:56 +03:00
Aliaksandr Valialkin	e9f1213cc9	docs/vmagent.md: fix incorrect url for multitenant writes to VictoriaMetrics cluster	2022-10-01 18:51:57 +03:00
Aliaksandr Valialkin	b857365b84	app/vmagent/remotewrite: allow specifying per-`-remoteWrite.url` disk limits for persistent queue with pending data This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3071 Related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2970	2022-10-01 18:41:21 +03:00
Aliaksandr Valialkin	e03a924236	app/vmauth: do not remove trailing slash from the proxied path This should fix the issue with opening VMUI at /vmui/ page. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1752	2022-10-01 16:56:42 +03:00
Aliaksandr Valialkin	735de9ee54	lib/promscrape: add `external_labels` from `global` section of `-promscrape.config` after the relabeling is applied to the scraped metrics This aligns with Prometheus behaviour. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3137	2022-10-01 16:15:00 +03:00
Aliaksandr Valialkin	d81285c814	app/vmagent: accept requests with `/prometheus` and `/influx` path prefixes in the same way as VictoriaMetrics does This allows using vmagent as a drop-in replacement for VictoriaMetrics for push protocols.	2022-10-01 14:11:09 +03:00
Aliaksandr Valialkin	b5fe42514d	docs/vmagent.md: formatting fixes	2022-10-01 13:36:48 +03:00
lionelee	f9843442f2	docs/vmagent.md: fix typo (#3186 )	2022-10-01 12:31:41 +03:00
Aliaksandr Valialkin	b96fe2e265	lib/storage: optimize matching speed for non-trivial regexp filters Wrap re.Match into bytesutil.FastStringMatcher. This increases performance for `{foo=~"complex_regex_here"}` filters by up to 4x.	2022-10-01 12:07:18 +03:00
Aliaksandr Valialkin	72d8653233	docs/CHANGELOG.md: clarify the description of the improvement in relabeling performance	2022-10-01 12:07:18 +03:00
Aliaksandr Valialkin	c628f5b6eb	lib/promscrape/discovery/ec2: expose __meta_ec2_region label in the same way as Prometheus 2.39 does See https://github.com/prometheus/prometheus/pull/11326	2022-09-30 20:49:08 +03:00
Roman Khavronenko	408d7043a1	vmalert: support auth configs per static_target (#3188 ) Allow configuring authorization params per list of targets in vmalert's notifier config for `static_configs`. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2690 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-30 18:38:11 +03:00
Aliaksandr Valialkin	c8000c029a	app/vminsert: remove support for undocumented VictoriaMetrics_AccountID and VictoriaMetrics_ProjectID labels in tcp-based data ingestion endpoints These labels are substituted by documented vm_account_id and vm_project_id labels. See https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#multitenancy-via-labels This is a follow up for `505d359b39`	2022-09-30 18:06:00 +03:00
Nikolay	505d359b39	app/vminsert: allows parsing tenant id from labels (#3009 ) * app/vminsert: allows parsing tenant id from labels it should help mitigate issues with vmagent's multiTenant mode, which works incorrectly at heavy load and it cannot handle more then 100 different tenants. This functional hidden with flag and do not change vminsert default behaviour https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2970 * Update docs/Cluster-VictoriaMetrics.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip * app/vminsert/netstorage: clean remaining labels in order to free up GC * docs/Cluster-VictoriaMetrics.md: typo fix * wip * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 17:28:35 +03:00
Aliaksandr Valialkin	9fc2817f41	lib/promrelabel: optimize `action: replace` for non-trivial regex values Cache `action: replace` results for non-trivial regexs and return them next time instead of performing CPU-intensive regex replacement. Optimize also `action: labelmap_all` and `action: replace_all` in the same way.	2022-09-30 12:28:25 +03:00
Dmytro Kozlov	d0a9fff70c	docs, app/vmgateway: add description about new `auth.httpHeader` flag (#3134 ) * docs, app/vmgateway: add description about new `auth.httpHeader` flag * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 08:56:43 +03:00
Aliaksandr Valialkin	98175493d7	app/vmselect/promql: remove empty series before applying aggregate function Previously empty series (e.g. series with all NaN samples) were passed to aggregate functions. Such series must be ingored by all the aggregate functions. So it is better from consistency PoV filtering out empty series before applying aggregate functions.	2022-09-30 08:44:06 +03:00
Roman Khavronenko	273472dc20	app/vmselect: ignore empty series for `limit_offset` (#3178 ) * app/vmselect: ignore empty series for `limit_offset` VictoriaMetrics doesn't return empty series (with all NaN values) to the user. But such series are filtered after transform functions. It means `limit_offset` will account for empty series as well. For example, let's consider following data set: ``` time series: foo{label="1"} NaN, NaN, NaN, NaN // empty series foo{label="2"} 1, 2, 3, 4 foo{label="3"} 4, 3, 2, 1 ``` When user requests all series for metric `foo` the empty series will be filtered out: ``` /query=foo: foo{label="v2"} 1, 2, 3, 4 foo{label="v3"} 4, 3, 2, 1 ``` But `limit_offset(1, 1, foo)` is applied to original series, not filtered yet. So it will return `foo{label="v2"}` (skips the first in list) ``` /query=limit_offset(1, 1, foo): foo{label="v2"} 1, 2, 3, 4 ``` Expected result would be to apply `limit_offset` to already filtered list, so in result we receive `foo{label="v3"}`: ``` /query=limit_offset(1, 1, foo): foo{label="v3"} 4, 3, 2, 1 ``` The change does exactly that - filters empty series before applying `limit_offset`. Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmselect: ignore empty series for `limit_offset` Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-30 08:44:05 +03:00
Aliaksandr Valialkin	f1eebc0a99	lib/promrelabel: properly parse regex with escaped $ at the end Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3131 Thanks to @dmitryk-dk for the initial fix at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3179	2022-09-30 08:20:57 +03:00
Aliaksandr Valialkin	33590c5fb9	docs/CHANGELOG.md: document `39f559d22b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3013	2022-09-30 07:49:54 +03:00
Nikolay	909709346e	lib/awsapi: fixes sign encoding (#3183 ) * lib/awsapi: fixes sign encoding previously white spaces at filter were incorrectly encoded encoding tip was copied from aws signing lib For example, the space character must be encoded as %20 (not using '+', as some encoding schemes do) https://docs.aws.amazon.com/general/latest/gr/sigv4-create-canonical-request.html https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3171 * Update lib/awsapi/sign.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 07:49:18 +03:00
nemobis	6723bdf867	docs: fix typo in Cluster-VictoriaMetrics.md (#3172 )	2022-09-28 10:43:17 +03:00
panguicai	156e7035c7	docs: fix typo for vmalert docs (#3173 ) Signed-off-by: panguicai008 <1121906548@qq.com>	2022-09-28 10:42:13 +03:00
Roman Khavronenko	3f78608da2	docs: update img for key concepts (#3176 ) Make dots bigger for range_query, so it will be easier to read the graph. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-28 10:41:35 +03:00
Dmytro Kozlov	28dcff5791	lib/{httpserver,netutil}: allow to define min and max TLS version of the http server (#3109 ) * lib/{httpserver,netutil}: allow to define min and max TLS version of the http server * lib/httpserver: added descriptions about tls supported versions * lib/netutil: check minimal tls version, added supported tls versions to error * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 17:38:43 +03:00
Denys Holius	3f38a88f71	docs: managed_victoriametrics/quickstart.md fix image link (#3165 )	2022-09-26 17:38:41 +03:00
Roman Khavronenko	b8c4c36b89	docs: clarify numeric label values for `label_value` (#3129 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3114 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 16:49:45 +03:00
Max Golionko	322e5006d2	added security policy (#3140 ) * added security policy * Update SECURITY.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:47:38 +03:00
Roman Khavronenko	fe71c73fe1	lib/mergeset: follow-up after `a0e7432e42` (#3145 ) * lib/mergeset: follow-up after `a0e7432e42` Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:43:17 +03:00
Aliaksandr Valialkin	d91bf89651	docs/CHANGELOG.md: document `f022296d96` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3147	2022-09-26 16:32:54 +03:00
Aliaksandr Valialkin	89e1060101	docs/CHANGELOG.md: document `166d444159`	2022-09-26 15:39:51 +03:00
Aliaksandr Valialkin	2b98f2bc1a	lib/protoparser/graphite: accept whitespace in metric names and tags according to the specification Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/99 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3102 See the specification https://graphite.readthedocs.io/en/latest/tags.html	2022-09-26 15:20:11 +03:00
Aliaksandr Valialkin	938d7a932c	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics sanitizes metric names in DataDog data by default This is a follow-up for `7c2474dac7`	2022-09-26 14:03:26 +03:00
Aliaksandr Valialkin	dbc20091b1	lib/protoparser/datadog: sanitize metric names by default in the same way as DataDog does This commit is based on the pull request https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3105 Thanks to @PerGon for the idea and initial implementation.	2022-09-26 13:58:36 +03:00
Aliaksandr Valialkin	6a6cf9c590	app/{vmagent,vminsert}: add `-usePromCompatibleNaming` command-line flag for normalizing metric names and label names in the ingested samples Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3113 Thanks to @erkexzcx for the idea and the initial pull request at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3146	2022-09-26 13:13:31 +03:00
Aliaksandr Valialkin	594a4ab345	docs/vmalert.md: follow-up for `0c95f928ae` - Clarify the description for -datasource.queryStep command-line flag - Consistently use a single dash in front of -datasource.queryStep command-line flag - Update -help output at docs/vmalert.md	2022-09-26 08:49:47 +03:00
Aliaksandr Valialkin	a6a869c365	docs/vmalert.md: follow-up after `7748a9d629` - Consistently use single dash in front of command-line flags instead of double dashes. - Add a warning that too small -search.latencyOffset may lead to incomplete query results.	2022-09-26 08:49:47 +03:00
Aliaksandr Valialkin	2fe38a3243	docs: follow-up for `03d54ac890` - Typo fix: 'adn' -> 'and' - Remove duplicate link to https://victoriametrics.com/blog/victoriametrics-monitoring/ from docs/Articles.md . The initial link has been already added in `27254096b2`	2022-09-26 08:49:47 +03:00
Roman Khavronenko	cffceba0f5	vmalert: set default value for `datasource.queryStep` to `5m` (#3149 ) Change default value for command-line flag `datasource.queryStep` from `0s` to `5m`. Param `step` is added by vmalert to every rule evaluation request sent to datasource. Before this change, `step` was equal to group's evaluation interval by default. Param `step` for instant queries defines how far VM can look back for the last written data point. The change supposed to improve reliability of the rules evaluation when evaluation interval is lower than scraping interval. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 08:40:17 +03:00
Roman Khavronenko	b86cf7d707	vmalert: add info about `search.latencyOffset` to Troubleshooting (#3151 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 08:38:23 +03:00
Roman Khavronenko	c027991caf	docs: mention VictoriaMetrics Monitoring blog post (#3152 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 08:29:02 +03:00
Aliaksandr Valialkin	722c5a4625	docs/Articles.md: add a link to https://victoriametrics.com/blog/victoriametrics-monitoring/	2022-09-22 19:18:51 +03:00
Aliaksandr Valialkin	8da1b4fc42	docs/Articles.md: add a link to https://dataswamp.org/~solene/2022-09-11-exploring-monitoring-stacks.html	2022-09-22 19:18:51 +03:00
Roman Khavronenko	f772ee8326	deployment/docker: move cluster compose env to master branch (#3130 ) * deployment/docker: move cluster compose env to master branch The change supposed to simplify the process of maintaining for single/cluster docker-compose envs, alerts, dashboards. It also supposes to reduce confusion for users when looking for cluster related alerts/configs. Signed-off-by: hagen1778 <roman@victoriametrics.com> * deployment/docker: move cluster compose env to master branch Review updates. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-21 12:03:10 +03:00
Aliaksandr Valialkin	1b99501798	docs/managed_victoriametrics/quickstart.md: small fixes after `606166ef68`	2022-09-19 15:04:37 +03:00
Aliaksandr Valialkin	19dc29abd7	docs/CHANGELOG.md: clarify the change at `622bbedbe1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3119	2022-09-19 15:04:37 +03:00
Roman Khavronenko	360b022603	vmalert: always re-evaluate Annotations (#3119 ) * vmalert: always re-evaluate Annotations Previously, Annotations were evaluated only: 1. On alert creating. 2. On alert's value change. This is premature optimization. It was assumed that since annotations could contain only text with alert's labels or value - there is no need in spending resources to re-compile Annotations. Later, template function `query` was added, which can execute arbitrary queries and return different results on every evaluation. So if it was used in annotations, it would be executed only on init or value change. Another case when optimization caused an issue - annotations hot reload. In this case, annotations of the active alert won't change even if Rule's annotations were changed. This fix enables Annotations re-evaluation on each iteration to resolve issues above. It would have some impact on performance, but it is unlikely it will be noticeable. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: add tp Changelog Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-19 15:04:37 +03:00
Roman Khavronenko	1c13cce5ed	vmalert: add Troubleshooting section to docs (#3115 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-19 15:04:37 +03:00
Dmytro Kozlov	8ca42b9bcb	docs/managed_victoriametrics: add how to restore password section (#3116 ) docs/managed_victoriametrics: add how to restore password section	2022-09-19 15:04:37 +03:00
Dmytro Kozlov	52a79a901e	app/vmctl: add description about `influx-skip-database-label` flag (#3111 )	2022-09-15 13:24:16 +03:00
Aliaksandr Valialkin	27a6ac5a30	docs/Cluster-VictoriaMetrics.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:19:11 +03:00
Aliaksandr Valialkin	713ebb8297	docs: update `-help` output after explicit mentioning of enterprise flags	2022-09-15 13:19:02 +03:00
Aliaksandr Valialkin	d77eb5170c	docs/vmauth.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:19:02 +03:00
Aliaksandr Valialkin	424bcfc17b	docs/vmalert.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:19:02 +03:00
Aliaksandr Valialkin	1275e0580e	docs: update docs with explicitly marked enterprise command-line flags for VictoriaMetrics and vmagent	2022-09-15 13:19:01 +03:00
Aliaksandr Valialkin	6f1f49c64a	docs/FAQ.md: add an answer for `What is the difference between single-node and cluster versions of VictoriaMetrics?`	2022-09-15 09:57:12 +03:00
Dmytro Kozlov	36ea8537d9	vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) (#2982 ) * vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) * vmselect/promql: fix tests, add documentation * vmselect/promql: update test * vmselect/promql: update for alphanumeric sorting, fix tests * vmselect/promql: remove comments * vmselect/promql: cleanup * vmselect/promql: avoid memory allocations, update functions descriptions * vmselect/promql: make linter happy (remove ineffectual assigment) * vmselect/promql: add test case, fix behavior when strings are equal * vendor: update github.com/VictoriaMetrics/metricsql from v0.44.1 to v0.45.0 this adds support for sort_by_label_numeric and sort_by_label_numeric_desc functions * wip * lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage. * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-14 17:42:07 +03:00
Aliaksandr Valialkin	73714c7516	docs/Articles.md: add a link to https://www.groundcover.com/blog/prometheus-grafana-kubernetes	2022-09-14 15:11:48 +03:00
Roman Khavronenko	6ae4f3526b	vmalert: add experimental feature of storing Rule's evaluation state (#3106 ) vmalert: add experimental feature of storing Rule's evaluation state The new feature keeps last 20 state changes of each Rule in memory. The state are available for view on the Rule's view page. The page can be opened by clicking on `Details` link next to Rule's name on the `/groups` page. States change suppose to help in investigating cases when Rule doesn't generate alerts or records. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 15:08:40 +03:00
Roman Khavronenko	d071e39694	bump Go version to 1.19.1 (#3108 ) The reason is to cover vulnerability GO-2022-0969 Found in: net/http@go1.18.5 Fixed in: net/http@go1.19.1 More info: https://pkg.go.dev/vuln/GO-2022-0969 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 13:43:27 +03:00
Aliaksandr Valialkin	2351468bc4	lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage.	2022-09-14 13:29:39 +03:00
Aliaksandr Valialkin	961e986ca9	docs: consistently use docs.victoriametrics.com instead of victoriametrics.github.io in all the links	2022-09-13 16:50:36 +03:00
Aliaksandr Valialkin	20834c1757	app/vmalert: follow-up after `8441375da2` - Rename logDebug() to logDebugf() and pass format string together with format args directly to logDebugf(). This eliminates fmt.Sprintf() overhead at logDebug() call site when debugging is disabled. - Format labels in debug message in Prometheus format, e.g. {label1="value1",...labelN="valueN"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025	2022-09-13 16:36:31 +03:00
Roman Khavronenko	a887c1bc07	vmalert: add `debug` mode for alerting rules (#3055 ) * vmalert: add `debug` mode for alerting rules Debug information includes alerts state changes and requests sent to the datasource. Debug can be enabled only on rule's level. It might be useful for debugging unexpected behaviour of alerting rule. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: review fixes Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmalert/alerting.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> * vmalert: go fmt Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-13 16:36:30 +03:00
Craig Rodrigues	6b5843eb66	docs: Use headings in DataDog section to make things easier to read (#3089 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-13 16:19:14 +03:00
Aliaksandr Valialkin	6a44e1bc06	docs/CHANGELOG.md: document atomic directory deletion Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3038	2022-09-13 16:16:12 +03:00
Aliaksandr Valialkin	7d26c37239	docs/ExtendedPromQL.md: move the page to the bottom of the contents list at http://docs.victoriametrics.com	2022-09-13 15:12:15 +03:00
Aliaksandr Valialkin	28545eb630	Revert "docs/ExtendedPromQL.md: remove outdated doc" This reverts commit `971e3d83f7`. Reason for revert: the ExtendedPromQL doc is still referred from third-party sites.	2022-09-13 15:10:03 +03:00
Yury Molodov	465894d720	vmui: fix data processing (#3092 ) * fix: change data processing * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-12 10:56:39 +03:00
Aliaksandr Valialkin	3a5b27dc2d	docs/FAQ.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/ to `VictoriaMetrics vs Mimir` chapter	2022-09-12 10:38:11 +03:00
Aliaksandr Valialkin	2c0c87ee79	docs/Articles.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/	2022-09-12 10:38:10 +03:00
Yury Molodov	c8de98e03f	vmui: add lists of top queries (#3065 ) * feat: add lists of top queries * fix: change the field label * refactor: add handlers for readability * app/vmselect: `make vmui-update` * docs: document `top queries` tab Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-08 21:44:43 +03:00
John Belmonte	eb0b2ef3d9	MetricsQL doc spellcheck (#3080 )	2022-09-08 21:28:49 +03:00
Aliaksandr Valialkin	052b527b39	docs/CHANGELOG.md: document `ec273eafef` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3076	2022-09-08 21:21:26 +03:00
Aliaksandr Valialkin	f6b3ad0c37	docs/Release-Guide.md: require manual push of the created release tags to public Github The automated push of release tags to Github require specifying the remote repository name when doing `git push <remote-repo-name> v1.xx.y`. The remote repository name can differ in different environments, so it cannot be put into Makefile rule. TODO: create a Makefile rule, which generates standard remote names for public and private repositories in Git, so `git push` for release tags could be automated then.	2022-09-08 15:00:34 +03:00
Aliaksandr Valialkin	f0eea5b02d	app/vmselect/netstorage: fix a typo, which leads to incorrect query results in VictoriaMetrics cluster The typo has been introduced in the commit `1a254ea20c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3067	2022-09-08 13:46:40 +03:00
Max Golionko	e07f23a1b9	moved cluster dashboard to master (#3074 ) dashboards: move cluster dashboard to master branch This change should simplify dashboards management.	2022-09-08 11:47:25 +03:00
Aliaksandr Valialkin	6ebe4f5392	docs/Single-server-VictoriaMetrics.md: add a note that cardinality explorer at cluster version of VictoriaMetrics may return lower than expected number of unique label values See the corresponding comment in the code: `5a6e617b5e/app/vmselect/netstorage/netstorage.go (L1039-L1045)`	2022-09-06 14:48:21 +03:00
Aliaksandr Valialkin	5a6e617b5e	docs/Articles.md: add https://tech.bedrockstreaming.com/2022/09/06/monitoring-at-scale-with-victoriametrics.html	2022-09-06 13:33:07 +03:00
Aliaksandr Valialkin	f6990871a3	docs/vmctl.md: `make docs-sync` after `c5261d5f56` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:20:16 +03:00
Zakhar Bessarab	ef01f01b6c	vmctl: implement support of chunking data for vm-native export (#3044 ) vmctl: implement support of chunking data for vm-native export process See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:14:48 +03:00
Craig Rodrigues	d02f09700f	docs: Clarify DataDog examples for VictoriaMetrics cluster (#3048 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-06 13:12:25 +03:00
Yurii Kravets	b47adb3e3e	docs: Update keyConcepts (#3040 ) docs: update keyConcepts Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-09-06 13:10:26 +03:00
Aliaksandr Valialkin	051e722112	lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block This should reduce chances of unnoticed on-disk data corruption. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011 This change modifies the format for data exported via /api/v1/export/native - now this data contains MaxTimestamp and PrecisionBits fields from blockHeader. This is OK, since the native export format is undocumented.	2022-09-06 13:07:49 +03:00
Aliaksandr Valialkin	b7f3569522	app/vmselect/prometheus: follow-up after `50e2524bc2` - Add getCommonParamsWithDefaultDuration function and use it at /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the default behaviour for setting 5 minutes time range if start arg isn't passed to /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the change at docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3052	2022-09-05 11:57:08 +03:00
Aliaksandr Valialkin	c6b74148cf	app/vmselect/promql: consistently calculate `rate_over_sum(m[d])` as `sum_over_time(m[d])/d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3045	2022-09-02 23:19:05 +03:00
Aliaksandr Valialkin	569843c0dd	docs/CHANGELOG.md: cut v1.81.1	2022-09-02 22:00:34 +03:00
Aliaksandr Valialkin	9cca3a0a1b	app/vmselect/netstorage: fix potential panic under high load The panic may trigger during data blocks' processing received from vmstorage nodes when some of vmstorage nodes return an error or when `-replicationFactor` is set to values higher than 2 at `vmselect`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3058	2022-09-02 21:36:15 +03:00
Aliaksandr Valialkin	024e2f18da	app/vmselect/promql: evaluate `union()` args in parallel in order to increase query performance Note that the parallel execution of `union()` args may take more memory and CPU time than the sequential execution if args contain heavy queries, which may load all the available CPU, disk and memory resources and vmselect and vmstorage levels.	2022-09-02 21:01:04 +03:00
Aliaksandr Valialkin	a580d7ac13	docs/Articles.md: add a link to https://aatarasoff.medium.com/optimizing-linkerd-metrics-in-prometheus-de607ec10f6b	2022-08-31 05:03:57 +03:00
Aliaksandr Valialkin	33b2a1df45	docs/FAQ.md: mention that single-node vm is easier to setup and operate than the cluster version of vm	2022-08-31 05:03:56 +03:00
Aliaksandr Valialkin	a11eae3a76	docs/CHANGELOG.md: cut v1.81.0	2022-08-31 02:33:36 +03:00
Max Golionko	0359fce052	simplify release process (#3012 ) * simplify release process * address comments * address comments * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-31 02:28:45 +03:00
Aliaksandr Valialkin	30a1d0c622	docs/CHANGELOG.md: add missing link to vmagent	2022-08-31 02:22:52 +03:00
Craig Rodrigues	6e057faf1b	docs: Add DataDog to list of ingestion methods (#3047 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-08-31 00:23:07 +03:00
Aliaksandr Valialkin	cdb22c5ca3	docs/CHANGELOG.md: document v1.79.3 LTS release	2022-08-31 00:15:26 +03:00
Craig Rodrigues	ee988cc71c	docs: add https://github.com/VictoriaMetrics/ansible-playbooks to README.md (#3046 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2022-08-31 00:13:26 +03:00
Aliaksandr Valialkin	74efe00649	docs: clarify why cluster version is recommended to use for serving high loads	2022-08-30 13:21:43 +03:00
Aliaksandr Valialkin	be5299be2c	docs/FAQ.md: add chapters explaining main differences between single-node and cluster versions of VictoriaMetrics - Which type of VictoriaMetrics is better to use in production? - How to migrate data from single-node VictoriaMetrics to cluster?	2022-08-30 13:12:57 +03:00
Artem Navoiev	1f5efd2a4c	update multi-region guide, specify multi-level vmselect option (#3039 ) * update multi-region guide, specify multi-level vmselect option Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * add more references * Apply suggestions from code review Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-30 12:34:53 +03:00
Aliaksandr Valialkin	4d5803c16d	docs: fix links to DogStatsD Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3042	2022-08-30 12:19:30 +03:00
Aliaksandr Valialkin	529bcc0761	docs/CHANGELOG.md: document the `044d51b668`	2022-08-30 09:42:51 +03:00
Aliaksandr Valialkin	8aaaf221cc	app/vmselect/promql: follow-up after `2d71b4859c` - Use getScalar() function for obtaining the expected scalar from phi arg - Reduce the error message returned to the user when incorrect phi is passed to histogram_quantiles - Improve the description of this bugfix in the docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3026	2022-08-27 01:38:17 +03:00
Dmytro Kozlov	2cf29cc4d1	vmselect/promql: fix panic in histogram_quantiles function (#3029 ) * vmselect/promql: fix panic in histogram_quantiles function * Update docs/MetricsQL.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-08-27 01:34:54 +03:00
Aliaksandr Valialkin	86394b4179	lib/promscrape: optimize discoveryutils.SanitizeLabelName() Cache sanitized label names and return them next time. This reduces the number of allocations and speeds up the SanitizeLabelName() function for common case when the number of unique label names is smaller than 100k	2022-08-27 00:18:19 +03:00
Aliaksandr Valialkin	e1bd38fa97	lib/promrelabel: optimize matching for commonly used regex patterns in `if` option The following regex patterns are optimized: - literal string match, e.g. "foo" - prefix match, e.g. "foo." and "foo.+" - substring match, e.g. ".foo.*" and ".+foo.+" - alternate values match, e.g. "foo\|bar\|baz"	2022-08-26 14:55:13 +03:00
Aliaksandr Valialkin	d60654eb0a	lib/promrelabel: optimize `action: {labeldrop,labelkeep,keep,drop}` with `regex` containing alternate values For example, the following relabeling rule must work much faster now: - action: labeldrop regex: "foo\|bar\|baz"	2022-08-24 17:55:54 +03:00
Aliaksandr Valialkin	d4cf52f092	app/vmagent: follow-up after `2b22aa1537` - Document the change at docs/CHANGELOG.md - Move auth token parsing from app/vmagent/opentsdbhttp/ to app/vmagent/main.go, since it must be parsed only when multitenancy support is enabled at vmagent side. See https://docs.victoriametrics.com/vmagent.html#multitenancy	2022-08-24 16:21:23 +03:00
Dmytro Kozlov	d32a6359b0	vmselect/promql: enable search.maxPointsSubqueryPerTimeseries for sub-queries (#2963 ) * vmselect/promql: enable search.maxPointsPerTimeSeriesSubquery for sub-queries * vmselect/promql: cleanup * vmselect/promql: rename config flag * vmselect/promql: add tests * vmselect/promql: use test object instead of log * vmselect/promql: fix posible panic is subquery has more points. add description * vmselect/promql: update tests descriptions * vmselect/promql: update doInternal validation * vmselect/promql: fix linter * vmselect/promql: fix linter * vmselect/promql: update documentation and release notes * wip - Properly apply -search.maxPointsSubqueryPerTimeseries limit to subqueries. Previously the -search.maxPointsPerTimeseries limit was unexpectedly applied to subqueries if it was smaller than the -search.maxPointsSubqueryPerTimeseries . - Clarify docs for -search.maxPointsSubqueryPerTimeseries command-line flag . - Document -search.maxPointsPerTimeseries and -search.maxPointsSubqueryPerTimeseries flags at https://docs.victoriametrics.com/#resource-usage-limits . - Update docs/CHANGELOG.md . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2922 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-24 15:27:41 +03:00
Aliaksandr Valialkin	e2d8916935	docs: mention that it is safe sharing the collected profiles from security PoV The collected profiles do not contain sensitive information	2022-08-24 14:08:30 +03:00
Aliaksandr Valialkin	7b9ba456ff	app/vmstorage: expose `vm_{hourly,daily}_series_limit_{max,current}_series` metrics if `-storage.max{Hourly,Daily}Series` limits are set These metrics allow alerting when the number of unique series approach the limit. For example, the following query alerts when the number of series reaches 90% of the configured limit: vm_hourly_series_limit_current_series / vm_hourly_series_limit_max_series > 0.9	2022-08-24 13:41:57 +03:00
Aliaksandr Valialkin	ad6652247c	all: update Google Analytics tracking code from Unversal Analytics to v4 This is needed because Google Analytics devs decided to force their users to update all their tracking codes to GA v4. See https://support.google.com/analytics/answer/9744165 The link to the new tracking property ( G-N9SVT8S3HK ) - https://analytics.google.com/analytics/web/?authuser=1#/a129683199p328513681/admin/streams/table/4004610168	2022-08-24 12:16:18 +03:00
Aliaksandr Valialkin	547d655d29	docs/vmagent.md: fix alerting query when scraped samples are dropped because of exceeded series limit This is a follow-up after `7d26414b2e`	2022-08-24 01:23:37 +03:00
Roman Khavronenko	555a202d80	docs: follow-up after `88425bb285` (#3007 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-24 01:23:37 +03:00
laixintao	76a291a95b	vmalert: add $activeAt into template variables. (#3000 ) vmalert: add `$activeAt` template variable for annotations https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2999	2022-08-24 01:23:37 +03:00
Aliaksandr Valialkin	c5325f2db5	docs/CHANGELOG.md: document `d59d829cdb` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2673	2022-08-21 23:37:15 +03:00
Ivan Dudin	c7ca124803	Update Cluster-VictoriaMetrics.md (#3005 ) Flags `-search.maxTagKeys` and `-search.maxTagValues` are present at vmstorage and not at vmselect ``` -search.maxTagKeys int -search.maxTagValues int ```	2022-08-21 23:30:15 +03:00
Aliaksandr Valialkin	7f46c17e4e	docs/Cluster-VictoriaMetrics.md: document the best strategies for cluster update / upgrade	2022-08-21 23:20:26 +03:00
Aliaksandr Valialkin	1c7f402598	app/vmagent: add ability to construct a label from multiple existing labels by referring them in the `replacement` field during relabeling For example: - target_label: composite-label replacement: {{source_label1}}-{{source_label2}}	2022-08-21 22:49:24 +03:00
Aliaksandr Valialkin	ecd8a03b28	docs: change links to Prometheus docs about instant and range queries to links to VictoriaMetrics docs	2022-08-21 19:02:46 +03:00
Aliaksandr Valialkin	3c597d1985	docs/keyConcepts.md: more fixes	2022-08-21 18:53:49 +03:00
Aliaksandr Valialkin	8e86d52c23	docs/FAQ.md: add a question on differences between Grafana Mimir and VictoriaMetrics	2022-08-21 17:00:49 +03:00
Aliaksandr Valialkin	7df5e19de5	docs/keyConcepts.md - clarify docs a bit	2022-08-21 12:00:53 +03:00
Aliaksandr Valialkin	34d764874f	docs/Cluster-VictoriaMetrics.md: clarify required conditions for cluster availability	2022-08-20 09:39:07 +03:00
Aliaksandr Valialkin	6d2354e7a4	app/vmalert/README.md: sync with docs/vmalert.md after `a229182dbe`	2022-08-20 08:54:55 +03:00
laixintao	107ac2a85e	doc: fix broken url of template function for vmalert. (#3002 )	2022-08-20 08:54:54 +03:00
Aliaksandr Valialkin	76844e519b	docs/CHANGELOG.md: document `10402459d8`	2022-08-19 11:44:29 +03:00
Roman Khavronenko	2256d51418	docs: fix docs formatting related to vmalert (#2994 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-19 11:05:08 +03:00
Aliaksandr Valialkin	84c80b0481	docs/relabeling.md: fix heading for `useful tips for target relabeling`	2022-08-18 01:33:22 +03:00
Aliaksandr Valialkin	26212aa14a	docs/relabeling.md: typo fixes	2022-08-18 01:30:27 +03:00
Aliaksandr Valialkin	570ce15cb8	docs/relabeling.md: improve relabeling tips for scrape targets	2022-08-18 01:24:35 +03:00
Aliaksandr Valialkin	aed6e33cb4	docs/relabeling.md: add a link to VictoriaMetrics enhancements for relabeling	2022-08-18 01:24:33 +03:00
Aliaksandr Valialkin	a6970e3052	docs: fix ordering after adding the docs/relabeling.md	2022-08-18 01:17:55 +03:00
Aliaksandr Valialkin	29eb9d4602	docs/relabeling.md: add a cookbook for common relabeling tasks	2022-08-18 01:14:30 +03:00
Aliaksandr Valialkin	bbfa52bd75	docs: follow-up after `68e56b6fc5`	2022-08-17 21:27:24 +03:00
Roman Khavronenko	cfcb5ab15b	vmalert: set alert's source link to UI instead of JSON source (#2986 ) We switch default alert's source link to redirect user to vmalert's UI instead of previous JSON object. While it breaks compatibility, it also supposed to improve user's experience. The old behavior can be achieved by updating `-external.alert.source` command-line flag. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 21:27:24 +03:00
Aliaksandr Valialkin	d62e9bc964	docs/sd_configs.md: clarify a bit honor_labels config option	2022-08-17 14:24:53 +03:00
Aliaksandr Valialkin	1812d33a2d	lib/promscrape: automatically generate additional per-target labels for targets with non-zero series limit The following metrics are generated: - scrape_series_limit - scrape_series_current - scrape_series_limit_samples_dropped These metrics simplify alerting on targets, which expose too many time series See https://docs.victoriametrics.com/vmagent.html#automatically-generated-metrics and https://docs.victoriametrics.com/vmagent.html#cardinality-limiter for more details	2022-08-17 13:22:02 +03:00
Roman Khavronenko	0261118765	docs: add new article link (#2989 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 13:22:02 +03:00
Aliaksandr Valialkin	e5c61cac22	docs/CHANGELOG.md: group vmalert features closer to each other	2022-08-17 11:49:53 +03:00
Aliaksandr Valialkin	aa37e6b438	lib/promscrape: retry http requests if the server returns 429 status code The 429 status code means that the server is overwhelmed with requests. The client can retry the request after some wait time. Implement this strategy for service discovery and scrape requests. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-16 14:57:26 +03:00
Aliaksandr Valialkin	dc929e0d16	lib/storage: improve performance for /api/v1/labels and /api/v1/label/.../values endpoints when `match[]` filter matches small number of time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2978	2022-08-16 13:34:23 +03:00
Aliaksandr Valialkin	d39915ff8e	docs/MetricsQL.md: add `the list of supported ... functions` lines just before the corresponding lists This improves the readability a bit	2022-08-16 12:10:09 +03:00
Roman Khavronenko	436b4d90af	docs: update vmalert docs (#2987 ) * mention recently added `$alertID` and `$groupID` variables in the changelog * properly escape template examples in the vmalert's README Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 12:10:08 +03:00
Roman Khavronenko	0d5c403b6e	vmalert: support `$alertID` and `$groupID` in template variables (#2983 ) Support of these two variables allows building custom URLs with alert's ID and group ID params. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/517#issuecomment-1207141432 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 11:24:01 +03:00
Artem Navoiev	5ae251d074	fix typo in influx guide (#2984 )	2022-08-16 11:23:59 +03:00
Aliaksandr Valialkin	7d7cf2b6fd	app/vmselect: follow-up after `63e0f16062` * Explicitly store a pointer to UserReadableError in the error interface. Previously Go automatically converted the value to a pointer before storing in the error interface. * Add Unwrap() method to UserReadableError, so it can be used transparently with the other code, which calls errors.Is() and errors.As(). * Document the change in docs/CHANGELOG.md	2022-08-15 13:53:19 +03:00
Roman Khavronenko	79e396dac9	docs: mention default vmalert's behavior change in Update notes (#2981 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-15 13:31:59 +03:00
Yury Molodov	dc52b283a3	vmui: shortcut keys legend (#2971 ) * feat: add shortcut modal * feat: add shortcut descriptions * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-15 12:04:30 +03:00
Yurii Kravets	d7dc7c81e7	doc: add upgrade/downgrade without downtime to FAQ (#2973 ) * doc: add upgrade/downgrade without downtime to FAQ Added info on how to upgrade or downgrade VictoriaMetrics without downtime to FAQ Based on reply https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2944#issuecomment-1207502038 * Udate pr Fixing format	2022-08-15 11:31:00 +03:00
Aliaksandr Valialkin	c27bd63f6c	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:48 +03:00
Aliaksandr Valialkin	1a00c9ef03	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_pod_container_image` label in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:57 +03:00
Aliaksandr Valialkin	2fb63dda83	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_service_port_number` label to `role: service` in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:07:19 +03:00
Aliaksandr Valialkin	198d8eeeaa	app/vmalert/templates: add `toTime()` template function in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:52 +03:00
Aliaksandr Valialkin	2b58bd9876	lib/promscrape/discovery/dns: add support for resolving MX records See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:33:06 +03:00
Aliaksandr Valialkin	78f584fb0b	docs/CHANGELOG.md: clarify the change at `28441711e6`	2022-08-11 23:53:32 +03:00
Roman Khavronenko	36660bcfe2	vmalert: follow-up after `28441711e6` (#2972 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 23:52:18 +03:00
Aliaksandr Valialkin	ec3df0b913	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 21:37:24 +03:00
Roman Khavronenko	f42853275f	lib/storage: prevent excessive loops when storage is in RO (#2962 ) * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:47 +03:00
Aliaksandr Valialkin	91d0b45537	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:59:02 +03:00
Aliaksandr Valialkin	7e892d3322	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:38 +03:00
Aliaksandr Valialkin	b8877da35b	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:39 +03:00
Aliaksandr Valialkin	ceb158c5bb	docs/vmagent.md: typo fix in __meta_kubernetes_annotation_prometheus_io_tenant label name It must be __meta_kubernetes_pod_annotation_prometheus_io_tenant	2022-08-08 14:53:28 +03:00
Aliaksandr Valialkin	310779d8b5	lib/promscrape: follow-up after `2c553d5a2f` - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:49:16 +03:00
Aliaksandr Valialkin	69d62d5736	docs: sync -help output with the latest changes	2022-08-08 14:05:36 +03:00
Aliaksandr Valialkin	221dd3a224	all: bump the minimum supported version of Go from 1.17 to 1.18 This is needed because some dependencies uses generics, which have been appeared in Go1.18 This is a follow-up for `caf3dd4fa2`	2022-08-08 13:45:39 +03:00
Roman Khavronenko	6af40f6275	vmalert: remove notions of vmalert being compatible with VM only (#2954 ) vmalert can be successfully used with datasources compatible with Prometheus HTTP API. So we remove comments or notes in Readme which are saying opposite. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-08 13:44:15 +03:00
Aliaksandr Valialkin	1996e36cf0	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:32:44 +03:00
Aliaksandr Valialkin	12f4c89ff7	docs/CHANGELOG.md: link to the issue with improper handling of `enpoint` option at ec2_sd_configs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:33:17 +03:00
Aliaksandr Valialkin	9039f23bd1	lib/promrelabel: do not split regex into multiple lines if it contains groups Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:16:15 +03:00
Aliaksandr Valialkin	23b7fa897a	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul This is a follow-up for `68de1f4e4a` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:23:01 +03:00
Aliaksandr Valialkin	b5a05f627c	docs/_includes/img.html: fix https://github.com/VictoriaMetrics/VictoriaMetrics/security/code-scanning/28	2022-08-08 01:04:20 +03:00
Yury Molodov	a2ecf311b8	vmui: graph action on moush hold and move (#2915 ) * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:56:08 +03:00
Aliaksandr Valialkin	7a1a95fd3e	docs/sd_configs.md: mention that http client configs can contain `headers` and `proxy_headers` options	2022-08-07 22:41:02 +03:00
Aliaksandr Valialkin	573f6c8d6c	Makefile: remove redundant `-mod=vendor` option when running Go tools The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:40:41 +03:00
Aliaksandr Valialkin	ed891049d5	docs/sd_configs.md: mention that http client options can be specified in scrape_configs section	2022-08-07 00:20:28 +03:00
Aliaksandr Valialkin	5e43145031	docs: add docs for scrape_configs section	2022-08-07 00:04:55 +03:00
Aliaksandr Valialkin	0596bae703	docs/sd_configs.md: add docs for static_configs	2022-08-06 23:17:28 +03:00
Aliaksandr Valialkin	d4c3702afe	docs/sd_configs.md: add docs for openstack_sd_configs	2022-08-06 23:07:11 +03:00
Aliaksandr Valialkin	659f093d87	docs/sd_configs.md: document kubernetes_sd_configs	2022-08-06 22:39:16 +03:00
Aliaksandr Valialkin	77bd4e37cc	lib/promscrape/discovery/kubernetes: add missing `__meta_kubernetes_ingress_class_name` label for `role: ingress` See `7e65ad3e43` and `7e1111ff14`	2022-08-06 22:39:14 +03:00
Aliaksandr Valialkin	98deef04f5	docs/sd_configs.md: document http_sd_configs	2022-08-05 19:50:29 +03:00
Aliaksandr Valialkin	8d63e316a9	docs/sd_configs.md: document gce_sd_configs	2022-08-05 19:37:23 +03:00
Aliaksandr Valialkin	ecdd57e13b	docs/sd_configs.md: document file_sd_configs	2022-08-05 19:17:29 +03:00
Aliaksandr Valialkin	6d5c8f82cf	docs/sd_configs.md: document eureka_sd_configs	2022-08-05 19:05:33 +03:00
Aliaksandr Valialkin	091c654c92	docs/sd_configs.md: document ec2_sd_configs	2022-08-05 18:52:39 +03:00
Aliaksandr Valialkin	ecbe1ddf1b	lib/promscrape/discovery/ec2: properly handle custom `endpoint` option in ec2_sd_configs This option was ignored since `d289ecded1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:52:37 +03:00
Aliaksandr Valialkin	8d6ac974b2	docs/sd_configs.md: add docs for dockerswarm_sd_configs	2022-08-05 16:20:30 +03:00
Aliaksandr Valialkin	80ecfcf759	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:20:29 +03:00
Aliaksandr Valialkin	d02ecc71bb	docs/sd_configs.md: document docker_sd_configs	2022-08-05 15:36:52 +03:00
Aliaksandr Valialkin	a931f75d51	docs/sd_configs.md: document dns_sd_configs	2022-08-05 15:27:07 +03:00
Aliaksandr Valialkin	81dc3a34ed	docs/sd_configs.md: document digitalocean_sd_configs	2022-08-05 15:17:09 +03:00
Aliaksandr Valialkin	c4e6973bc8	docs/sd_configs.md: document consul_sd_configs	2022-08-05 15:04:06 +03:00
Aliaksandr Valialkin	85b04732ed	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 15:04:05 +03:00
Aliaksandr Valialkin	2c2a5ff553	docs/sd_configs.md: document azure_sd_configs	2022-08-05 14:16:10 +03:00
Aliaksandr Valialkin	df34f8c5b8	docs: fixes after `83a4abda3f`	2022-08-05 10:15:28 +03:00
Aliaksandr Valialkin	8ddad31eef	lib/promscrape/discovery/yandexcloud: follow-up after `6e5ac32fba` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:28:21 +03:00
Igor Tiunov	0ba86fe87e	YC service discovery (#2923 ) * YC service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386 * Fixed linter suggestions * fixed golint errors	2022-08-04 22:28:20 +03:00
Aliaksandr Valialkin	a07891cca6	docs: exporing -> exporting typo fix This is a follow-up after `ccb6cb6501`	2022-08-04 20:31:59 +03:00
kevinflynn387	6d909c87f9	Docs: Fix typo from "HA paris" to "HA pairs" (#2935 ) * Update README.md: fix typo to "HA pairs" Update README.md to fix typo from "HA paris" to "HA pairs" * Update docs/README.md : Fix of typo from "HA paris" Update docs/README.md : Fix of typo from "HA paris" to "HA pairs" * Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs" Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs"	2022-08-04 20:29:02 +03:00
Aliaksandr Valialkin	98caffcfc4	docs: fix the recommended url for -vmalert.proxyURL accroding to `8667307d73`	2022-08-04 18:03:24 +03:00
Aliaksandr Valialkin	64183d4416	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:31:14 +03:00
Aliaksandr Valialkin	a1e49606ed	app/{vmselect,vmalert}: properly generate http redirects if `-http.pathPrefix` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 13:01:13 +03:00
Aliaksandr Valialkin	f1a49fe779	docs/Release-Guide.md: document that feature docs must be updated with the release where the feature appeared	2022-07-30 00:16:34 +03:00
Aliaksandr Valialkin	962ed46583	lib/mergeset: optimize mergeInmemoryBlocks() function Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-28 00:05:45 +03:00
Aliaksandr Valialkin	8722342819	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for `vmauth` with identical `username` and different `password` values	2022-07-26 19:39:00 +03:00
Aliaksandr Valialkin	86e0abe357	docs/Single-server-VictoriaMetrics.md: improve "Push metrics" docs	2022-07-26 19:34:29 +03:00
Aliaksandr Valialkin	9f1e558c58	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:25:26 +03:00
Aliaksandr Valialkin	bf797ba4d9	all: push metrics to -pusmetrics.url in gzip-compressed form in order to reduce the needed network bandwidth	2022-07-25 10:54:54 +03:00
Aliaksandr Valialkin	3d4c312ba2	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on `b596ac3745` Thanks to @zqyzyq for the idea.	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	1b5799f894	lib/promscrape: set `up=0` for partially failed scrape in stream parsing mode This behaviour aligns with Prometheus behavior	2022-07-22 13:38:25 +03:00
Aliaksandr Valialkin	b1129fda0c	docs/vmgateway: typo fix in regexp filter: `~=` is substituted with `=~`	2022-07-21 22:37:42 +03:00
Aliaksandr Valialkin	cfeb6138ae	docs/BestPractices.md: do not mention NFS Though VictoriaMetrics works OK on NFS-like filesystems, it is not a best practice	2022-07-21 21:31:14 +03:00
Aliaksandr Valialkin	aae522e501	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 This is a follow-up for `edecd2493c`	2022-07-21 21:00:34 +03:00
Aliaksandr Valialkin	3cbe232186	docs/CHANGELOG.md: follow-up after `88edb3f6cf`	2022-07-21 20:53:24 +03:00
Roman Khavronenko	d0abdc2b5b	vmalert: allow configuring custom headers per group (#2901 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:48:05 +03:00
Roman Khavronenko	356d8b99e0	vmalert: allow configuring custom headers for URLs (#2897 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:45:12 +03:00
Aliaksandr Valialkin	db96221cee	docs/Cluster-VictoriaMetrics.md: update after `fe68bb3ba7`	2022-07-21 20:21:39 +03:00
Aliaksandr Valialkin	fe68bb3ba7	all: follow-up after `46f803fa7a` Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:18:25 +03:00
Aliaksandr Valialkin	f00a6bf837	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
Aliaksandr Valialkin	7a06ee11fd	docs/vmauth.md: mention that multiple recrods for the same username are supported This is a follow-up for `88029c521c`	2022-07-19 19:43:20 +03:00
Nikolay	0102eb3869	app/vmauth: allow duplicate usernames (#2888 ) Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:35:28 +03:00
Denys Holius	419f913bb9	docs: faq update (#2889 ) * docs: faq update add links for OpenBSD ports & pre built binaries * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-19 17:51:04 +03:00
Aliaksandr Valialkin	f992f96a88	app/vmselect/promql: execute `q1` and `q2` from `q1 op q2` in parallel if labels pushdown cannot be applied This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:29:41 +03:00
Aliaksandr Valialkin	69c1272d1b	docs/Articles.md: add a link to "How do We Keep Metrics for a Long Time in VictoriaMetrics" talk	2022-07-19 13:01:39 +03:00
Aliaksandr Valialkin	2d1366353c	lib/promscrape: reload all the scrape configs when the `global` section is changed inside `-promscrape.config` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:42 +03:00
Aliaksandr Valialkin	d920b0afec	app/vmselect/promql: properly return `q1` series from `q1 ifnot q2` when `q2` returns nothing	2022-07-18 14:24:23 +03:00
Aliaksandr Valialkin	83fef7daf5	docs/CHANGELOG.md: document `2f9668eba5`	2022-07-18 12:37:34 +03:00
Aliaksandr Valialkin	979444b4ed	all: fix other typos in the same way as `6f4d9b2a48` does	2022-07-18 12:10:41 +03:00
cui fliter	e0d30f6ec5	fix some typos (#2882 ) Signed-off-by: cui fliter <imcusg@gmail.com>	2022-07-18 12:10:40 +03:00
Aliaksandr Valialkin	b2d9379bd0	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to `$(APP_NAME)-$(GOOS)-$(GOARCH)...` naming	2022-07-18 12:00:45 +03:00
Aliaksandr Valialkin	7669d34931	docs/Single-server-VictoriaMetrics.md: add a link on docs how to send signals to processes in Linux	2022-07-18 10:59:28 +03:00
Aliaksandr Valialkin	fae54e2e56	docs/Troubleshooting.md: clarify some texts there	2022-07-15 12:23:39 +03:00
Aliaksandr Valialkin	0237d987c0	docs/Troubleshooting.md: mention about `-search.setLookbackToStep` command-line flag in the section explaining why `/api/v1/query_range` returns calculated data	2022-07-15 11:55:34 +03:00
Aliaksandr Valialkin	0d4676f313	docs/Single-server-VictoriaMetrics.md: mention that the delete API doesnt delete the associated entries from inverted index	2022-07-14 21:29:28 +03:00
Aliaksandr Valialkin	a87f143e92	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:35 +03:00
Roman Khavronenko	80de6face8	vmalert: drop support of deprecated `extra_filter_labels` param (#2870 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 16:10:46 +03:00
Aliaksandr Valialkin	36062d27c5	docs/CHANGELOG.md: formatting fixes for update notes	2022-07-14 12:48:17 +03:00
Aliaksandr Valialkin	e6ee940daf	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:44 +03:00
Yury Molodov	1ca20caa4b	vmui: optimize table view (#2867 ) * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:16:57 +03:00
Dmytro Kozlov	99402541fb	vmui: update time picker behavior (#2847 ) * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:06:22 +03:00
Yury Molodov	23c3b5f8c7	vmui: change selection from autocomplete (#2862 ) * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:56:04 +03:00
Nikolay	c007b129cb	lib/promscrape: adds azure service discovery (#2743 ) * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:45:43 +03:00
Aliaksandr Valialkin	da6c85a2f6	all: follow-up for `d99ba3481b`	2022-07-13 17:17:08 +03:00
Dmytro Kozlov	4e4def9df8	Rename release packages (#2810 ) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 17:11:01 +03:00
Aliaksandr Valialkin	be5fb139d6	docs/CHANGELOG.md: document `91faa152a5`	2022-07-13 12:41:25 +03:00

... 3 4 5 6 7 ...

2101 commits