github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00

Author	SHA1	Message	Date
Denys Holius	d63410bf6f	docs: managed_victoriametrics/quickstart.md fix image link (#3165 )	2022-09-26 16:35:18 +02:00
Roman Khavronenko	36a9a834b3	docs: clarify numeric label values for `label_value` (#3129 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3114 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 16:48:38 +03:00
Max Golionko	d67948b8e3	added security policy (#3140 ) * added security policy * Update SECURITY.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:47:02 +03:00
Roman Khavronenko	e96ccf3f71	lib/mergeset: follow-up after `a0e7432e42` (#3145 ) * lib/mergeset: follow-up after `a0e7432e42` Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:39:56 +03:00
Aliaksandr Valialkin	72c29d762e	docs/CHANGELOG.md: document `f022296d96` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3147	2022-09-26 16:32:19 +03:00
Aliaksandr Valialkin	a2431c2a88	docs/CHANGELOG.md: document `166d444159`	2022-09-26 15:39:14 +03:00
Aliaksandr Valialkin	41f8c2987d	lib/protoparser/graphite: accept whitespace in metric names and tags according to the specification Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/99 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3102 See the specification https://graphite.readthedocs.io/en/latest/tags.html	2022-09-26 15:17:25 +03:00
Aliaksandr Valialkin	5983ecf4d1	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics sanitizes metric names in DataDog data by default This is a follow-up for `7c2474dac7`	2022-09-26 14:02:43 +03:00
Aliaksandr Valialkin	7c2474dac7	lib/protoparser/datadog: sanitize metric names by default in the same way as DataDog does This commit is based on the pull request https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3105 Thanks to @PerGon for the idea and initial implementation.	2022-09-26 13:57:23 +03:00
Aliaksandr Valialkin	fcffdba9dc	app/{vmagent,vminsert}: add `-usePromCompatibleNaming` command-line flag for normalizing metric names and label names in the ingested samples Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3113 Thanks to @erkexzcx for the idea and the initial pull request at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3146	2022-09-26 13:11:39 +03:00
Aliaksandr Valialkin	819aa95552	docs/vmalert.md: follow-up for `0c95f928ae` - Clarify the description for -datasource.queryStep command-line flag - Consistently use a single dash in front of -datasource.queryStep command-line flag - Update -help output at docs/vmalert.md	2022-09-26 08:47:31 +03:00
Aliaksandr Valialkin	6b71f33c8b	docs/vmalert.md: follow-up after `7748a9d629` - Consistently use single dash in front of command-line flags instead of double dashes. - Add a warning that too small -search.latencyOffset may lead to incomplete query results.	2022-09-26 08:36:24 +03:00
Aliaksandr Valialkin	b68cd810fc	docs: follow-up for `03d54ac890` - Typo fix: 'adn' -> 'and' - Remove duplicate link to https://victoriametrics.com/blog/victoriametrics-monitoring/ from docs/Articles.md . The initial link has been already added in `27254096b2`	2022-09-26 08:26:38 +03:00
Roman Khavronenko	0c95f928ae	vmalert: set default value for `datasource.queryStep` to `5m` (#3149 ) Change default value for command-line flag `datasource.queryStep` from `0s` to `5m`. Param `step` is added by vmalert to every rule evaluation request sent to datasource. Before this change, `step` was equal to group's evaluation interval by default. Param `step` for instant queries defines how far VM can look back for the last written data point. The change supposed to improve reliability of the rules evaluation when evaluation interval is lower than scraping interval. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 10:22:53 +02:00
Roman Khavronenko	7748a9d629	vmalert: add info about `search.latencyOffset` to Troubleshooting (#3151 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 09:49:14 +02:00
Roman Khavronenko	03d54ac890	docs: mention VictoriaMetrics Monitoring blog post (#3152 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 07:12:15 +02:00
Aliaksandr Valialkin	27254096b2	docs/Articles.md: add a link to https://victoriametrics.com/blog/victoriametrics-monitoring/	2022-09-22 19:17:10 +03:00
Aliaksandr Valialkin	a3e536c0e7	docs/Articles.md: add a link to https://dataswamp.org/~solene/2022-09-11-exploring-monitoring-stacks.html	2022-09-22 19:17:10 +03:00
Roman Khavronenko	5714a68ac6	deployment/docker: move cluster compose env to master branch (#3130 ) * deployment/docker: move cluster compose env to master branch The change supposed to simplify the process of maintaining for single/cluster docker-compose envs, alerts, dashboards. It also supposes to reduce confusion for users when looking for cluster related alerts/configs. Signed-off-by: hagen1778 <roman@victoriametrics.com> * deployment/docker: move cluster compose env to master branch Review updates. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-21 11:48:38 +03:00
Aliaksandr Valialkin	1aef635de4	docs/CHANGELOG.md: clarify the change at `622bbedbe1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3119	2022-09-19 15:02:05 +03:00
Aliaksandr Valialkin	584a5d6b1f	docs/managed_victoriametrics/quickstart.md: small fixes after `606166ef68`	2022-09-19 14:52:46 +03:00
Roman Khavronenko	622bbedbe1	vmalert: always re-evaluate Annotations (#3119 ) * vmalert: always re-evaluate Annotations Previously, Annotations were evaluated only: 1. On alert creating. 2. On alert's value change. This is premature optimization. It was assumed that since annotations could contain only text with alert's labels or value - there is no need in spending resources to re-compile Annotations. Later, template function `query` was added, which can execute arbitrary queries and return different results on every evaluation. So if it was used in annotations, it would be executed only on init or value change. Another case when optimization caused an issue - annotations hot reload. In this case, annotations of the active alert won't change even if Rule's annotations were changed. This fix enables Annotations re-evaluation on each iteration to resolve issues above. It would have some impact on performance, but it is unlikely it will be noticeable. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: add tp Changelog Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-16 16:19:10 +02:00
Roman Khavronenko	3484673566	vmalert: add Troubleshooting section to docs (#3115 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-15 16:15:39 +02:00
Dmytro Kozlov	606166ef68	docs/managed_victoriametrics: add how to restore password section (#3116 ) docs/managed_victoriametrics: add how to restore password section	2022-09-15 16:02:31 +02:00
Aliaksandr Valialkin	455002922e	docs/Cluster-VictoriaMetrics.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:58 +03:00
Aliaksandr Valialkin	e7995375b5	docs: update `-help` output after explicit mentioning of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	4193af4571	docs/vmauth.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	3b2599c659	docs/vmalert.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	bbecd27557	docs: update docs with explicitly marked enterprise command-line flags for VictoriaMetrics and vmagent	2022-09-15 13:22:56 +03:00
Dmytro Kozlov	a9629cc32d	app/vmctl: add description about `influx-skip-database-label` flag (#3111 )	2022-09-15 10:46:54 +02:00
Aliaksandr Valialkin	b869c757a9	docs/FAQ.md: add an answer for `What is the difference between single-node and cluster versions of VictoriaMetrics?`	2022-09-15 09:56:41 +03:00
Dmytro Kozlov	b75f1854c5	vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) (#2982 ) * vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) * vmselect/promql: fix tests, add documentation * vmselect/promql: update test * vmselect/promql: update for alphanumeric sorting, fix tests * vmselect/promql: remove comments * vmselect/promql: cleanup * vmselect/promql: avoid memory allocations, update functions descriptions * vmselect/promql: make linter happy (remove ineffectual assigment) * vmselect/promql: add test case, fix behavior when strings are equal * vendor: update github.com/VictoriaMetrics/metricsql from v0.44.1 to v0.45.0 this adds support for sort_by_label_numeric and sort_by_label_numeric_desc functions * wip * lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage. * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-14 17:41:09 +03:00
Aliaksandr Valialkin	5306f79fd1	docs/Articles.md: add a link to https://www.groundcover.com/blog/prometheus-grafana-kubernetes	2022-09-14 15:11:19 +03:00
Roman Khavronenko	877940a131	vmalert: add experimental feature of storing Rule's evaluation state (#3106 ) vmalert: add experimental feature of storing Rule's evaluation state The new feature keeps last 20 state changes of each Rule in memory. The state are available for view on the Rule's view page. The page can be opened by clicking on `Details` link next to Rule's name on the `/groups` page. States change suppose to help in investigating cases when Rule doesn't generate alerts or records. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 14:04:24 +02:00
Roman Khavronenko	efea51a9ee	bump Go version to 1.19.1 (#3108 ) The reason is to cover vulnerability GO-2022-0969 Found in: net/http@go1.18.5 Fixed in: net/http@go1.19.1 More info: https://pkg.go.dev/vuln/GO-2022-0969 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 12:29:19 +02:00
Aliaksandr Valialkin	74c00a8762	lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage.	2022-09-14 13:15:29 +03:00
Aliaksandr Valialkin	3af24a5b7c	docs: consistently use docs.victoriametrics.com instead of victoriametrics.github.io in all the links	2022-09-13 16:50:13 +03:00
Aliaksandr Valialkin	0ead64b6cf	app/vmalert: follow-up after `8441375da2` - Rename logDebug() to logDebugf() and pass format string together with format args directly to logDebugf(). This eliminates fmt.Sprintf() overhead at logDebug() call site when debugging is disabled. - Format labels in debug message in Prometheus format, e.g. {label1="value1",...labelN="valueN"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025	2022-09-13 16:35:14 +03:00
Roman Khavronenko	8441375da2	vmalert: add `debug` mode for alerting rules (#3055 ) * vmalert: add `debug` mode for alerting rules Debug information includes alerts state changes and requests sent to the datasource. Debug can be enabled only on rule's level. It might be useful for debugging unexpected behaviour of alerting rule. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: review fixes Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmalert/alerting.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> * vmalert: go fmt Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-13 16:25:43 +03:00
Aliaksandr Valialkin	25c9a1604a	docs/CHANGELOG.md: document atomic directory deletion Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3038	2022-09-13 16:17:39 +03:00
Aliaksandr Valialkin	db4f0fe6fc	docs/ExtendedPromQL.md: move the page to the bottom of the contents list at http://docs.victoriametrics.com	2022-09-13 16:17:37 +03:00
Aliaksandr Valialkin	e041c913bd	Revert "docs/ExtendedPromQL.md: remove outdated doc" This reverts commit `971e3d83f7`. Reason for revert: the ExtendedPromQL doc is still referred from third-party sites.	2022-09-13 16:17:37 +03:00
Craig Rodrigues	57ea8dbb36	docs: Use headings in DataDog section to make things easier to read (#3089 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-12 10:58:25 +03:00
Yury Molodov	1b41169415	vmui: fix data processing (#3092 ) * fix: change data processing * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-12 10:55:11 +03:00
Aliaksandr Valialkin	c48ff746c6	docs/FAQ.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/ to `VictoriaMetrics vs Mimir` chapter	2022-09-12 10:37:28 +03:00
Aliaksandr Valialkin	c4af0e833a	docs/Articles.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/	2022-09-11 15:23:35 +03:00
Yury Molodov	9541ef2e9e	vmui: add lists of top queries (#3065 ) * feat: add lists of top queries * fix: change the field label * refactor: add handlers for readability * app/vmselect: `make vmui-update` * docs: document `top queries` tab Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-08 21:43:37 +03:00
John Belmonte	defced2599	MetricsQL doc spellcheck (#3080 )	2022-09-08 21:28:03 +03:00
Aliaksandr Valialkin	53b0c2eee4	docs/CHANGELOG.md: document `ec273eafef` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3076	2022-09-08 21:25:30 +03:00
Aliaksandr Valialkin	b9231c715a	docs/Release-Guide.md: require manual push of the created release tags to public Github The automated push of release tags to Github require specifying the remote repository name when doing `git push <remote-repo-name> v1.xx.y`. The remote repository name can differ in different environments, so it cannot be put into Makefile rule. TODO: create a Makefile rule, which generates standard remote names for public and private repositories in Git, so `git push` for release tags could be automated then.	2022-09-08 15:00:18 +03:00
Aliaksandr Valialkin	07441b1cee	app/vmselect/netstorage: fix a typo, which leads to incorrect query results in VictoriaMetrics cluster The typo has been introduced in the commit `1a254ea20c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3067	2022-09-08 13:48:20 +03:00
Aliaksandr Valialkin	9f20d01a81	Revert "docs: add `Monitoring at scale with Victoria Metrics` (#3078 )" This reverts commit `f24572fa65`, because the article https://tech.bedrockstreaming.com/2022/09/06/monitoring-at-scale-with-victoriametrics.html has been already added at `09ff3f1928`	2022-09-08 11:05:25 +03:00
Roman Khavronenko	f24572fa65	docs: add `Monitoring at scale with Victoria Metrics` (#3078 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-06 16:29:48 +02:00
Max Golionko	7da9443686	moved cluster dashboard to master (#3074 ) dashboards: move cluster dashboard to master branch This change should simplify dashboards management.	2022-09-06 16:19:43 +02:00
Aliaksandr Valialkin	ef7fdbb63c	docs/Single-server-VictoriaMetrics.md: add a note that cardinality explorer at cluster version of VictoriaMetrics may return lower than expected number of unique label values See the corresponding comment in the code: `5a6e617b5e/app/vmselect/netstorage/netstorage.go (L1039-L1045)`	2022-09-06 14:46:35 +03:00
Aliaksandr Valialkin	09ff3f1928	docs/Articles.md: add https://tech.bedrockstreaming.com/2022/09/06/monitoring-at-scale-with-victoriametrics.html	2022-09-06 13:32:41 +03:00
Aliaksandr Valialkin	651ace6ce4	docs/vmctl.md: `make docs-sync` after `c5261d5f56` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:19:48 +03:00
Aliaksandr Valialkin	5fa9525498	lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block This should reduce chances of unnoticed on-disk data corruption. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011 This change modifies the format for data exported via /api/v1/export/native - now this data contains MaxTimestamp and PrecisionBits fields from blockHeader. This is OK, since the native export format is undocumented.	2022-09-06 13:08:09 +03:00
Zakhar Bessarab	c5261d5f56	vmctl: implement support of chunking data for vm-native export (#3044 ) vmctl: implement support of chunking data for vm-native export process See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 09:09:34 +02:00
Craig Rodrigues	462fc7b394	docs: Clarify DataDog examples for VictoriaMetrics cluster (#3048 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-05 16:25:05 +02:00
Yurii Kravets	7b04112352	docs: Update keyConcepts (#3040 ) docs: update keyConcepts Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-09-05 13:59:28 +02:00
Aliaksandr Valialkin	ae31b2363f	app/vmselect/prometheus: follow-up after `50e2524bc2` - Add getCommonParamsWithDefaultDuration function and use it at /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the default behaviour for setting 5 minutes time range if start arg isn't passed to /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the change at docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3052	2022-09-05 11:55:48 +03:00
Aliaksandr Valialkin	7dc632719d	app/vmselect/promql: consistently calculate `rate_over_sum(m[d])` as `sum_over_time(m[d])/d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3045	2022-09-02 23:18:04 +03:00
Aliaksandr Valialkin	ac98ecdc1d	docs/CHANGELOG.md: cut v1.81.1	2022-09-02 21:58:28 +03:00
Aliaksandr Valialkin	08538ff82a	app/vmselect/netstorage: fix potential panic under high load The panic may trigger during data blocks' processing received from vmstorage nodes when some of vmstorage nodes return an error or when `-replicationFactor` is set to values higher than 2 at `vmselect`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3058	2022-09-02 21:38:27 +03:00
Aliaksandr Valialkin	4076277cf0	app/vmselect/promql: evaluate `union()` args in parallel in order to increase query performance Note that the parallel execution of `union()` args may take more memory and CPU time than the sequential execution if args contain heavy queries, which may load all the available CPU, disk and memory resources and vmselect and vmstorage levels.	2022-09-02 19:46:27 +03:00
Aliaksandr Valialkin	f9d4ade35a	docs/Articles.md: add a link to https://aatarasoff.medium.com/optimizing-linkerd-metrics-in-prometheus-de607ec10f6b	2022-08-31 05:03:22 +03:00
Aliaksandr Valialkin	b26de84b4a	docs/FAQ.md: mention that single-node vm is easier to setup and operate than the cluster version of vm	2022-08-31 05:02:15 +03:00
Aliaksandr Valialkin	6b0050a028	docs/CHANGELOG.md: cut v1.81.0	2022-08-31 02:33:23 +03:00
Max Golionko	c685afebb2	simplify release process (#3012 ) * simplify release process * address comments * address comments * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-31 02:27:24 +03:00
Aliaksandr Valialkin	6c5d5bc7e6	docs/CHANGELOG.md: add missing link to vmagent	2022-08-31 02:21:44 +03:00
Aliaksandr Valialkin	c84e6429a0	docs/CHANGELOG.md: document v1.79.3 LTS release	2022-08-31 00:22:31 +03:00
Aliaksandr Valialkin	022bb62fa1	docs: clarify why cluster version is recommended to use for serving high loads	2022-08-31 00:22:30 +03:00
Craig Rodrigues	a54d7c24ff	docs: Add DataDog to list of ingestion methods (#3047 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-08-31 00:21:53 +03:00
Craig Rodrigues	e68a97f8d4	docs: add https://github.com/VictoriaMetrics/ansible-playbooks to README.md (#3046 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2022-08-30 20:52:24 +02:00
Aliaksandr Valialkin	bcdba8be18	docs/FAQ.md: add chapters explaining main differences between single-node and cluster versions of VictoriaMetrics - Which type of VictoriaMetrics is better to use in production? - How to migrate data from single-node VictoriaMetrics to cluster?	2022-08-30 13:12:03 +03:00
Artem Navoiev	5d4b1bc742	update multi-region guide, specify multi-level vmselect option (#3039 ) * update multi-region guide, specify multi-level vmselect option Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * add more references * Apply suggestions from code review Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-30 12:26:23 +03:00
Aliaksandr Valialkin	1eec2460ba	docs: fix links to DogStatsD Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3042	2022-08-30 10:49:26 +03:00
Aliaksandr Valialkin	d2e94ee91a	docs/CHANGELOG.md: document the `044d51b668`	2022-08-30 09:42:19 +03:00
Aliaksandr Valialkin	ad11b8d83d	app/vmselect/promql: follow-up after `2d71b4859c` - Use getScalar() function for obtaining the expected scalar from phi arg - Reduce the error message returned to the user when incorrect phi is passed to histogram_quantiles - Improve the description of this bugfix in the docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3026	2022-08-27 01:35:49 +03:00
Dmytro Kozlov	2d71b4859c	vmselect/promql: fix panic in histogram_quantiles function (#3029 ) * vmselect/promql: fix panic in histogram_quantiles function * Update docs/MetricsQL.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-08-27 01:33:56 +03:00
Aliaksandr Valialkin	c06e7a142c	lib/promscrape: optimize discoveryutils.SanitizeLabelName() Cache sanitized label names and return them next time. This reduces the number of allocations and speeds up the SanitizeLabelName() function for common case when the number of unique label names is smaller than 100k	2022-08-27 00:17:45 +03:00
Aliaksandr Valialkin	7afe8450fc	lib/promrelabel: optimize matching for commonly used regex patterns in `if` option The following regex patterns are optimized: - literal string match, e.g. "foo" - prefix match, e.g. "foo." and "foo.+" - substring match, e.g. ".foo.*" and ".+foo.+" - alternate values match, e.g. "foo\|bar\|baz"	2022-08-26 14:53:06 +03:00
Aliaksandr Valialkin	0d4ea03a73	lib/promrelabel: optimize `action: {labeldrop,labelkeep,keep,drop}` with `regex` containing alternate values For example, the following relabeling rule must work much faster now: - action: labeldrop regex: "foo\|bar\|baz"	2022-08-24 17:54:29 +03:00
Aliaksandr Valialkin	cdffe401e4	app/vmagent: follow-up after `2b22aa1537` - Document the change at docs/CHANGELOG.md - Move auth token parsing from app/vmagent/opentsdbhttp/ to app/vmagent/main.go, since it must be parsed only when multitenancy support is enabled at vmagent side. See https://docs.victoriametrics.com/vmagent.html#multitenancy	2022-08-24 16:18:59 +03:00
Dmytro Kozlov	463ea6897b	vmselect/promql: enable search.maxPointsSubqueryPerTimeseries for sub-queries (#2963 ) * vmselect/promql: enable search.maxPointsPerTimeSeriesSubquery for sub-queries * vmselect/promql: cleanup * vmselect/promql: rename config flag * vmselect/promql: add tests * vmselect/promql: use test object instead of log * vmselect/promql: fix posible panic is subquery has more points. add description * vmselect/promql: update tests descriptions * vmselect/promql: update doInternal validation * vmselect/promql: fix linter * vmselect/promql: fix linter * vmselect/promql: update documentation and release notes * wip - Properly apply -search.maxPointsSubqueryPerTimeseries limit to subqueries. Previously the -search.maxPointsPerTimeseries limit was unexpectedly applied to subqueries if it was smaller than the -search.maxPointsSubqueryPerTimeseries . - Clarify docs for -search.maxPointsSubqueryPerTimeseries command-line flag . - Document -search.maxPointsPerTimeseries and -search.maxPointsSubqueryPerTimeseries flags at https://docs.victoriametrics.com/#resource-usage-limits . - Update docs/CHANGELOG.md . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2922 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-24 15:25:18 +03:00
Aliaksandr Valialkin	3d12ee47f9	docs: mention that it is safe sharing the collected profiles from security PoV The collected profiles do not contain sensitive information	2022-08-24 14:07:36 +03:00
Aliaksandr Valialkin	796aa310c2	app/vmstorage: expose `vm_{hourly,daily}_series_limit_{max,current}_series` metrics if `-storage.max{Hourly,Daily}Series` limits are set These metrics allow alerting when the number of unique series approach the limit. For example, the following query alerts when the number of series reaches 90% of the configured limit: vm_hourly_series_limit_current_series / vm_hourly_series_limit_max_series > 0.9	2022-08-24 13:44:04 +03:00
Aliaksandr Valialkin	b1e1c50627	all: update Google Analytics tracking code from Unversal Analytics to v4 This is needed because Google Analytics devs decided to force their users to update all their tracking codes to GA v4. See https://support.google.com/analytics/answer/9744165 The link to the new tracking property ( G-N9SVT8S3HK ) - https://analytics.google.com/analytics/web/?authuser=1#/a129683199p328513681/admin/streams/table/4004610168	2022-08-24 12:16:37 +03:00
Aliaksandr Valialkin	c011fb0f30	docs/vmagent.md: fix alerting query when scraped samples are dropped because of exceeded series limit This is a follow-up after `7d26414b2e`	2022-08-24 01:18:31 +03:00
Roman Khavronenko	8d0f5b9e60	docs: follow-up after `88425bb285` (#3007 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-22 13:49:17 +02:00
laixintao	88425bb285	vmalert: add $activeAt into template variables. (#3000 ) vmalert: add `$activeAt` template variable for annotations https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2999	2022-08-22 13:32:36 +02:00
Aliaksandr Valialkin	6e4e3fae63	docs/CHANGELOG.md: document `d59d829cdb` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2673	2022-08-21 23:35:47 +03:00
Ivan Dudin	f69990ba10	Update Cluster-VictoriaMetrics.md (#3005 ) Flags `-search.maxTagKeys` and `-search.maxTagValues` are present at vmstorage and not at vmselect ``` # ./vmselect-prod -h \| egrep 'search.maxTagKeys\|search.maxTagValues' # ./vmstorage-prod -h \| egrep 'search.maxTagKeys\|search.maxTagValues' -search.maxTagKeys int -search.maxTagValues int ```	2022-08-21 23:28:40 +03:00
Aliaksandr Valialkin	22aa07b8c9	docs/Cluster-VictoriaMetrics.md: document the best strategies for cluster update / upgrade	2022-08-21 23:21:02 +03:00
Aliaksandr Valialkin	8550c44e31	app/vmagent: add ability to construct a label from multiple existing labels by referring them in the `replacement` field during relabeling For example: - target_label: composite-label replacement: "{{source_label1}}-{{source_label2}}"	2022-08-21 22:50:01 +03:00
Aliaksandr Valialkin	f2043d53ad	docs: change links to Prometheus docs about instant and range queries to links to VictoriaMetrics docs	2022-08-21 19:01:54 +03:00
Aliaksandr Valialkin	e94b4622f3	docs/keyConcepts.md: more fixes	2022-08-21 18:53:37 +03:00
Aliaksandr Valialkin	af8201cbcc	docs/FAQ.md: add a question on differences between Grafana Mimir and VictoriaMetrics	2022-08-21 17:00:33 +03:00
Aliaksandr Valialkin	1b6f66d566	docs/keyConcepts.md - clarify docs a bit	2022-08-21 12:00:21 +03:00
Aliaksandr Valialkin	c6736a3ad2	docs/Cluster-VictoriaMetrics.md: clarify required conditions for cluster availability	2022-08-20 09:40:34 +03:00
Yurii Kravets	4ca189bf94	doc: udpate Cluster-VictoriaMetrics (#3003 ) added note about resource usage for data re-routing	2022-08-20 09:37:27 +03:00
Aliaksandr Valialkin	3a1eb471a3	app/vmalert/README.md: sync with docs/vmalert.md after `a229182dbe`	2022-08-20 08:54:01 +03:00
laixintao	a229182dbe	doc: fix broken url of template function for vmalert. (#3002 )	2022-08-20 08:50:26 +03:00
Aliaksandr Valialkin	b90103d950	docs/CHANGELOG.md: document `10402459d8`	2022-08-19 11:43:59 +03:00
Roman Khavronenko	f451e0eabe	docs: fix docs formatting related to vmalert (#2994 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-18 09:53:46 +02:00
Aliaksandr Valialkin	dff6314c87	docs/relabeling.md: fix heading for `useful tips for target relabeling`	2022-08-18 01:32:49 +03:00
Aliaksandr Valialkin	149eb59546	docs/relabeling.md: typo fixes	2022-08-18 01:30:03 +03:00
Aliaksandr Valialkin	c1b43afdcd	docs/relabeling.md: improve relabeling tips for scrape targets	2022-08-18 01:24:50 +03:00
Aliaksandr Valialkin	21e63e1518	docs/relabeling.md: add a link to VictoriaMetrics enhancements for relabeling	2022-08-18 01:20:01 +03:00
Aliaksandr Valialkin	421aca7b2f	docs: fix ordering after adding the docs/relabeling.md	2022-08-18 01:17:27 +03:00
Aliaksandr Valialkin	43c6f81b90	docs/relabeling.md: add a cookbook for common relabeling tasks	2022-08-18 01:13:52 +03:00
Aliaksandr Valialkin	22c47e97a5	docs: follow-up after `68e56b6fc5`	2022-08-17 21:24:00 +03:00
Roman Khavronenko	68e56b6fc5	vmalert: set alert's source link to UI instead of JSON source (#2986 ) We switch default alert's source link to redirect user to vmalert's UI instead of previous JSON object. While it breaks compatibility, it also supposed to improve user's experience. The old behavior can be achieved by updating `-external.alert.source` command-line flag. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 14:46:28 +02:00
Aliaksandr Valialkin	eaa5d6cbd7	docs/sd_configs.md: clarify a bit honor_labels config option	2022-08-17 14:25:55 +03:00
Aliaksandr Valialkin	7d26414b2e	lib/promscrape: automatically generate additional per-target labels for targets with non-zero series limit The following metrics are generated: - scrape_series_limit - scrape_series_current - scrape_series_limit_samples_dropped These metrics simplify alerting on targets, which expose too many time series See https://docs.victoriametrics.com/vmagent.html#automatically-generated-metrics and https://docs.victoriametrics.com/vmagent.html#cardinality-limiter for more details	2022-08-17 13:19:33 +03:00
Aliaksandr Valialkin	5b449649b6	docs/CHANGELOG.md: group vmalert features closer to each other	2022-08-17 11:50:23 +03:00
Roman Khavronenko	04c174a11e	docs: add new article link (#2989 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 10:01:01 +02:00
Aliaksandr Valialkin	bb68ab99fa	lib/promscrape: retry http requests if the server returns 429 status code The 429 status code means that the server is overwhelmed with requests. The client can retry the request after some wait time. Implement this strategy for service discovery and scrape requests. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-16 15:01:08 +03:00
Aliaksandr Valialkin	f830edc0bc	lib/storage: improve performance for /api/v1/labels and /api/v1/label/.../values endpoints when `match[]` filter matches small number of time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2978	2022-08-16 13:32:40 +03:00
Aliaksandr Valialkin	e0e7c14788	docs/MetricsQL.md: add `the list of supported ... functions` lines just before the corresponding lists This improves the readability a bit	2022-08-16 12:08:57 +03:00
Roman Khavronenko	8b3989ba39	docs: update vmalert docs (#2987 ) * mention recently added `$alertID` and `$groupID` variables in the changelog * properly escape template examples in the vmalert's README Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 11:44:08 +03:00
Roman Khavronenko	f1b2273d13	vmalert: support `$alertID` and `$groupID` in template variables (#2983 ) Support of these two variables allows building custom URLs with alert's ID and group ID params. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/517#issuecomment-1207141432 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 08:08:27 +02:00
Artem Navoiev	edd7a92e8b	fix typo in influx guide (#2984 )	2022-08-15 22:59:35 +02:00
Aliaksandr Valialkin	4ac79d29ad	app/vmselect: follow-up after `63e0f16062` * Explicitly store a pointer to UserReadableError in the error interface. Previously Go automatically converted the value to a pointer before storing in the error interface. * Add Unwrap() method to UserReadableError, so it can be used transparently with the other code, which calls errors.Is() and errors.As(). * Document the change in docs/CHANGELOG.md	2022-08-15 13:50:16 +03:00
Roman Khavronenko	5792cae0ab	docs: mention default vmalert's behavior change in Update notes (#2981 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-15 13:31:24 +03:00
Yury Molodov	1513866d51	vmui: shortcut keys legend (#2971 ) * feat: add shortcut modal * feat: add shortcut descriptions * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-15 11:54:47 +03:00
Yurii Kravets	88c4f29ea5	doc: add upgrade/downgrade without downtime to FAQ (#2973 ) * doc: add upgrade/downgrade without downtime to FAQ Added info on how to upgrade or downgrade VictoriaMetrics without downtime to FAQ Based on reply https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2944#issuecomment-1207502038 * Udate pr Fixing format	2022-08-15 11:28:39 +03:00
Aliaksandr Valialkin	c3f8481011	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:20 +03:00
Aliaksandr Valialkin	95d36da358	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_pod_container_image` label in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:23 +03:00
Aliaksandr Valialkin	c4fcd9f1c5	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_service_port_number` label to `role: service` in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:06:34 +03:00
Aliaksandr Valialkin	d335694add	app/vmalert/templates: add `toTime()` template function in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:31 +03:00
Aliaksandr Valialkin	511805d88d	lib/promscrape/discovery/dns: add support for resolving MX records See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:32:34 +03:00
Aliaksandr Valialkin	e1cb15807e	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 23:53:58 +03:00
Aliaksandr Valialkin	1e4fc20486	docs/CHANGELOG.md: clarify the change at `28441711e6`	2022-08-11 23:49:22 +03:00
Roman Khavronenko	fa51c76ef9	vmalert: follow-up after `28441711e6` (#2972 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 13:30:32 +02:00
Roman Khavronenko	a0e7432e42	lib/storage: prevent excessive loops when storage is in RO (#2962 ) * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:00 +03:00
Aliaksandr Valialkin	ad00f4aaaa	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:58:50 +03:00
Aliaksandr Valialkin	901300aea2	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:00 +03:00
Aliaksandr Valialkin	06b6063a36	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:09 +03:00
Aliaksandr Valialkin	44c4c1a8cb	docs/vmagent.md: typo fix in __meta_kubernetes_annotation_prometheus_io_tenant label name It must be __meta_kubernetes_pod_annotation_prometheus_io_tenant	2022-08-08 14:52:49 +03:00
Aliaksandr Valialkin	46d7792b72	lib/promscrape: follow-up after `2c553d5a2f` - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:46:26 +03:00
Aliaksandr Valialkin	7a87251ff5	docs: sync -help output with the latest changes	2022-08-08 14:04:30 +03:00
Aliaksandr Valialkin	7b8bc8ad59	all: bump the minimum supported version of Go from 1.17 to 1.18 This is needed because some dependencies uses generics, which have been appeared in Go1.18 This is a follow-up for `caf3dd4fa2`	2022-08-08 13:39:38 +03:00
Aliaksandr Valialkin	730c39876e	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:35:25 +03:00
Roman Khavronenko	a086e48964	vmalert: remove notions of vmalert being compatible with VM only (#2954 ) vmalert can be successfully used with datasources compatible with Prometheus HTTP API. So we remove comments or notes in Readme which are saying opposite. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-08 09:45:21 +02:00
Aliaksandr Valialkin	34f0341b36	docs/CHANGELOG.md: link to the issue with improper handling of `enpoint` option at ec2_sd_configs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:32:50 +03:00
Aliaksandr Valialkin	68c4ec9472	lib/promrelabel: do not split regex into multiple lines if it contains groups Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:15:26 +03:00
Aliaksandr Valialkin	51debcdf6d	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul This is a follow-up for `68de1f4e4a` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:22:31 +03:00
Aliaksandr Valialkin	566d12d9ef	docs/_includes/img.html: fix https://github.com/VictoriaMetrics/VictoriaMetrics/security/code-scanning/28	2022-08-08 01:03:47 +03:00
Yury Molodov	3cb013aeb8	vmui: graph action on moush hold and move (#2915 ) * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:55:09 +03:00
Aliaksandr Valialkin	9f37935819	Makefile: remove redundant `-mod=vendor` option when running Go tools The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:39:08 +03:00
Aliaksandr Valialkin	004e683c55	docs/sd_configs.md: mention that http client configs can contain `headers` and `proxy_headers` options	2022-08-07 18:27:26 +03:00
Aliaksandr Valialkin	0e3f21bc25	docs/sd_configs.md: mention that http client options can be specified in scrape_configs section	2022-08-07 00:21:00 +03:00
Aliaksandr Valialkin	f36de0ecc9	docs: add docs for scrape_configs section	2022-08-07 00:04:31 +03:00
Aliaksandr Valialkin	46ed82b894	docs/sd_configs.md: add docs for static_configs	2022-08-06 23:17:17 +03:00
Aliaksandr Valialkin	b8fc2d356f	docs/sd_configs.md: add docs for openstack_sd_configs	2022-08-06 23:07:01 +03:00
Aliaksandr Valialkin	34d5eda904	docs/sd_configs.md: document kubernetes_sd_configs	2022-08-06 22:38:39 +03:00
Aliaksandr Valialkin	0ef29ceb14	lib/promscrape/discovery/kubernetes: add missing `__meta_kubernetes_ingress_class_name` label for `role: ingress` See `7e65ad3e43` and `7e1111ff14`	2022-08-05 20:55:00 +03:00
Aliaksandr Valialkin	b8fdac4bd7	docs/sd_configs.md: document http_sd_configs	2022-08-05 19:50:06 +03:00
Aliaksandr Valialkin	d8b9cb909a	docs/sd_configs.md: document gce_sd_configs	2022-08-05 19:36:57 +03:00
Aliaksandr Valialkin	e3b427ea54	docs/sd_configs.md: document file_sd_configs	2022-08-05 19:16:54 +03:00
Aliaksandr Valialkin	fad2e79747	docs/sd_configs.md: document eureka_sd_configs	2022-08-05 19:04:36 +03:00
Aliaksandr Valialkin	417d3baab0	docs/sd_configs.md: document ec2_sd_configs	2022-08-05 18:51:31 +03:00
Aliaksandr Valialkin	f2816ef031	lib/promscrape/discovery/ec2: properly handle custom `endpoint` option in ec2_sd_configs This option was ignored since `d289ecded1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:50:02 +03:00
Aliaksandr Valialkin	60e5005d17	docs/sd_configs.md: add docs for dockerswarm_sd_configs	2022-08-05 16:19:57 +03:00
Aliaksandr Valialkin	3e8890e71b	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:11:28 +03:00
Aliaksandr Valialkin	5760c68dd7	docs/sd_configs.md: document docker_sd_configs	2022-08-05 15:36:27 +03:00
Aliaksandr Valialkin	aa374af910	docs/sd_configs.md: document dns_sd_configs	2022-08-05 15:26:40 +03:00
Aliaksandr Valialkin	2d4a6a2237	docs/sd_configs.md: document digitalocean_sd_configs	2022-08-05 15:16:45 +03:00
Aliaksandr Valialkin	ca4f5eac0e	docs/sd_configs.md: document consul_sd_configs	2022-08-05 15:03:22 +03:00
Aliaksandr Valialkin	68de1f4e4a	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 14:41:40 +03:00
Aliaksandr Valialkin	01a380deb8	docs/sd_configs.md: document azure_sd_configs	2022-08-05 14:15:40 +03:00
Aliaksandr Valialkin	0c95d87abd	docs: fixes after `83a4abda3f`	2022-08-05 10:15:00 +03:00
Aliaksandr Valialkin	83a4abda3f	lib/promscrape/discovery/yandexcloud: follow-up after `6e5ac32fba` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:26:43 +03:00
Igor Tiunov	6e5ac32fba	YC service discovery (#2923 ) * YC service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386 * Fixed linter suggestions * fixed golint errors	2022-08-04 20:44:16 +03:00
Aliaksandr Valialkin	4e3e9b667e	docs: exporing -> exporting typo fix This is a follow-up after `ccb6cb6501`	2022-08-04 20:30:48 +03:00
kevinflynn387	56c117b558	Docs: Fix typo from "HA paris" to "HA pairs" (#2935 ) * Update README.md: fix typo to "HA pairs" Update README.md to fix typo from "HA paris" to "HA pairs" * Update docs/README.md : Fix of typo from "HA paris" Update docs/README.md : Fix of typo from "HA paris" to "HA pairs" * Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs" Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs"	2022-08-04 20:28:02 +03:00
Aliaksandr Valialkin	752a3008b4	docs: fix the recommended url for -vmalert.proxyURL accroding to `8667307d73`	2022-08-04 17:56:07 +03:00
Aliaksandr Valialkin	75c7170624	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:30:50 +03:00
Aliaksandr Valialkin	6b0550c023	app/{vmselect,vmalert}: properly generate http redirects if `-http.pathPrefix` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 12:59:07 +03:00
Aliaksandr Valialkin	90649de0c4	docs/Release-Guide.md: document that feature docs must be updated with the release where the feature appeared	2022-07-30 00:15:49 +03:00
Aliaksandr Valialkin	de6dd1cd5a	lib/mergeset: optimize mergeInmemoryBlocks() function Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-27 23:58:05 +03:00
Aliaksandr Valialkin	1f6f883016	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for `vmauth` with identical `username` and different `password` values	2022-07-26 19:38:46 +03:00
Aliaksandr Valialkin	ef85f45998	docs/Single-server-VictoriaMetrics.md: improve "Push metrics" docs	2022-07-26 19:34:07 +03:00
Aliaksandr Valialkin	da11056d85	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:24:24 +03:00
Aliaksandr Valialkin	7afcc42454	all: push metrics to -pusmetrics.url in gzip-compressed form in order to reduce the needed network bandwidth	2022-07-25 10:42:26 +03:00
Aliaksandr Valialkin	92630c1ab4	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on `b596ac3745` Thanks to @zqyzyq for the idea.	2022-07-25 09:18:44 +03:00
Aliaksandr Valialkin	4c2f9a1a2e	lib/promscrape: set `up=0` for partially failed scrape in stream parsing mode This behaviour aligns with Prometheus behavior	2022-07-22 13:29:44 +03:00
Aliaksandr Valialkin	89890eab5d	docs/vmgateway: typo fix in regexp filter: `~=` is substituted with `=~`	2022-07-21 22:37:12 +03:00
Aliaksandr Valialkin	2db4e79a03	docs/BestPractices.md: do not mention NFS Though VictoriaMetrics works OK on NFS-like filesystems, it is not a best practice	2022-07-21 21:29:50 +03:00
Aliaksandr Valialkin	f2326f953b	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 This is a follow-up for `edecd2493c`	2022-07-21 20:57:04 +03:00
Aliaksandr Valialkin	2095421905	docs/CHANGELOG.md: follow-up after `88edb3f6cf`	2022-07-21 20:53:06 +03:00
Aliaksandr Valialkin	d19a368aff	docs/Cluster-VictoriaMetrics.md: update after `fe68bb3ba7`	2022-07-21 20:36:28 +03:00
Aliaksandr Valialkin	5ced032d66	all: follow-up after `46f803fa7a` Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:36:27 +03:00
Aliaksandr Valialkin	4ce5875fa8	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:36:27 +03:00
Roman Khavronenko	88edb3f6cf	vmalert: allow configuring custom headers per group (#2901 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 15:59:55 +02:00
Roman Khavronenko	70a822f3a0	vmalert: allow configuring custom headers for URLs (#2897 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 13:57:53 +02:00
Aliaksandr Valialkin	22fc7e0e04	docs/vmauth.md: mention that multiple recrods for the same username are supported This is a follow-up for `88029c521c`	2022-07-19 19:42:42 +03:00
Nikolay	88029c521c	app/vmauth: allow duplicate usernames (#2888 ) Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:33:17 +03:00
Denys Holius	58b64246e2	docs: faq update (#2889 ) * docs: faq update add links for OpenBSD ports & pre built binaries * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-19 17:49:18 +03:00
Aliaksandr Valialkin	cc7d499bbd	app/vmselect/promql: execute `q1` and `q2` from `q1 op q2` in parallel if labels pushdown cannot be applied This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:27:48 +03:00
Aliaksandr Valialkin	daa0b604f9	docs/Articles.md: add a link to "How do We Keep Metrics for a Long Time in VictoriaMetrics" talk	2022-07-19 13:00:38 +03:00
Aliaksandr Valialkin	0fd86e2364	lib/promscrape: reload all the scrape configs when the `global` section is changed inside `-promscrape.config` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:07 +03:00
Aliaksandr Valialkin	b5da47bfaf	app/vmselect/promql: properly return `q1` series from `q1 ifnot q2` when `q2` returns nothing	2022-07-18 14:24:54 +03:00
Aliaksandr Valialkin	a4424174bb	docs/CHANGELOG.md: document `2f9668eba5`	2022-07-18 12:36:53 +03:00
Aliaksandr Valialkin	814bb1685f	all: fix other typos in the same way as `6f4d9b2a48` does	2022-07-18 12:08:15 +03:00
Aliaksandr Valialkin	429369f028	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to `$(APP_NAME)-$(GOOS)-$(GOARCH)...` naming	2022-07-18 11:59:45 +03:00
Aliaksandr Valialkin	41d0502d99	docs/Single-server-VictoriaMetrics.md: add a link on docs how to send signals to processes in Linux	2022-07-18 10:58:43 +03:00
Aliaksandr Valialkin	15b421435a	docs/Troubleshooting.md: clarify some texts there	2022-07-15 12:23:11 +03:00
Aliaksandr Valialkin	f9f73c0255	docs/Troubleshooting.md: mention about `-search.setLookbackToStep` command-line flag in the section explaining why `/api/v1/query_range` returns calculated data	2022-07-15 11:54:51 +03:00
Aliaksandr Valialkin	12ec8a7ae7	docs/Single-server-VictoriaMetrics.md: mention that the delete API doesnt delete the associated entries from inverted index	2022-07-14 21:28:58 +03:00
Aliaksandr Valialkin	d3116d9862	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:24 +03:00
Roman Khavronenko	f07bfcf0c9	vmalert: drop support of deprecated `extra_filter_labels` param (#2870 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 15:45:08 +03:00
Aliaksandr Valialkin	cb79c3e765	docs/CHANGELOG.md: formatting fixes for update notes	2022-07-14 12:47:19 +03:00
Aliaksandr Valialkin	9c435d7a9d	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:07 +03:00
Yury Molodov	17c33132df	vmui: optimize table view (#2867 ) * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:15:43 +03:00
Dmytro Kozlov	a0d0ba7219	vmui: update time picker behavior (#2847 ) * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:05:47 +03:00
Yury Molodov	e4efebf4a4	vmui: change selection from autocomplete (#2862 ) * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:54:56 +03:00
Nikolay	7301aa678c	lib/promscrape: adds azure service discovery (#2743 ) * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:43:18 +03:00
Aliaksandr Valialkin	ed93330e66	all: follow-up for `d99ba3481b`	2022-07-13 16:44:39 +03:00
Dmytro Kozlov	d99ba3481b	Rename release packages (#2810 ) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 15:42:48 +03:00
Aliaksandr Valialkin	765278243b	docs/CHANGELOG.md: document `91faa152a5`	2022-07-13 12:40:35 +03:00
Aliaksandr Valialkin	f7eda4a73c	docs/CHANGELOG.md: mention that the communication protocol between `vmselect` and `vmstorage` nodes is updated in the new release	2022-07-13 12:16:00 +03:00
Aliaksandr Valialkin	076799ae29	docs: add links to https://docs.victoriametrics.com/CHANGELOG.html in relevant docs	2022-07-11 21:23:19 +03:00
Aliaksandr Valialkin	80c084df02	docs/Articles.md: add a link to https://habr.com/ru/company/sravni/blog/672908/	2022-07-11 21:11:32 +03:00
Aliaksandr Valialkin	cad471037a	app/vmselect/prometheus: follow-up after `3efe33b917`	2022-07-11 20:35:28 +03:00
Dmytro Kozlov	3efe33b917	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851 ) * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:18:30 +03:00
Aliaksandr Valialkin	8851cf68e1	docs: make more clear the relation between replication and deduplication This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:22:15 +03:00
Aliaksandr Valialkin	743ff84863	app/vmselect/netstorage: optimize mergeSortBlocks function - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:34:42 +03:00
Roman Khavronenko	e1a41cfab5	metricsql: properly evaluate `timezone_offset` over time interval (#2842 ) * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:03:56 +03:00
Aliaksandr Valialkin	2e9ae40d56	app/vmselect/vmui: follow-up after `0bf6841140` * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:14:17 +03:00
Aliaksandr Valialkin	126e32f79a	docs/CHANGELOG.md: clarifications after `e9b977859b`	2022-07-08 13:02:41 +03:00
Aliaksandr Valialkin	08db70fa3e	docs/CHANGELOG.md: recommend clearing caches after the upgrade from v1.78.0 to v1.78.1	2022-07-08 12:49:42 +03:00
Roman Khavronenko	e9b977859b	vmalert: deprecate alert's status link (#2840 ) * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 10:26:13 +02:00
Aliaksandr Valialkin	0713da9e7a	docs/CHANGELOG.md: link to the issue related to multi-level vmselect	2022-07-08 05:23:18 +03:00
Aliaksandr Valialkin	b206bd0aee	docs/CHANGELOG.md: recommend upgrading from v1.78.0 to v1.78.1 because of the bug in v1.78.0	2022-07-08 03:44:26 +03:00
Aliaksandr Valialkin	138ae99602	docs/CHANGELOG.md: cut v1.78.1	2022-07-08 01:02:42 +03:00
Aliaksandr Valialkin	d3711e66fd	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:21:28 +03:00
Aliaksandr Valialkin	ec4d39e893	docs/vmagent.md: typo fixes after `ef2eeeb642`	2022-07-07 21:16:37 +03:00
Aliaksandr Valialkin	ef2eeeb642	docs/vmagent.md: actualize docs	2022-07-07 20:35:47 +03:00
Aliaksandr Valialkin	0f0525c208	docs/Single-server-VictoriaMetrics.md: actualize `vmui` docs according to recent changes	2022-07-07 20:35:12 +03:00
Aliaksandr Valialkin	1f1be61b78	docs/CHANGELOG.md: typo fixes	2022-07-07 20:34:08 +03:00
Aliaksandr Valialkin	20df81f1aa	docs: sync after recent changes	2022-07-07 02:44:17 +03:00
Aliaksandr Valialkin	1828665a64	docs/CHANGELOG.md: link another bugreport related to the bug with per-day inverted index in v1.78.0	2022-07-07 02:34:48 +03:00
Aliaksandr Valialkin	f97355d9fb	lib/promscrape: properly set Host header when sending requests via http proxy Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794	2022-07-07 02:27:52 +03:00
Aliaksandr Valialkin	893ca6f87e	docs/CHANGELOG.md: link to the issue about incorrect per-day index handling in v1.78.0	2022-07-07 02:00:07 +03:00
Aliaksandr Valialkin	10cb67adb5	app/{vmagent,vminsert}: follow-up after `d19e46de55` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:30:58 +03:00
Roman Khavronenko	7eb519b92e	docs: mention deduplication issue for HA vmalert topology (#2838 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-07 01:13:05 +03:00
Aliaksandr Valialkin	01f55bc66b	lib/promscrape/discovery/kubernetes: properly populate service-level labels for `role: endpointslice` targets Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2823	2022-07-07 00:32:26 +03:00
Aliaksandr Valialkin	b186b63e07	lib/promscrape/discovery/kubernetes: allow attaching node-level labels to `role: endpoints` and `role: endpointlice` targets in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/10759	2022-07-06 23:18:59 +03:00
Aliaksandr Valialkin	ef62da3750	app/vmselect: add `-clusternative.tls*` options for mTLS setup in multi-level clusters	2022-07-06 13:49:07 +03:00
Aliaksandr Valialkin	bd5b20445e	app/vmselect: add ability to query `vmselect` from another `vmselect`	2022-07-06 13:30:12 +03:00
Aliaksandr Valialkin	c030d920dd	docs/Cluster-VictoriaMetrics.md: sync with cluster branch after `f51bc07d97`	2022-07-06 13:00:34 +03:00
Aliaksandr Valialkin	17de8a41c2	all: follow-up after `ed89106274`	2022-07-06 12:44:46 +03:00
Aliaksandr Valialkin	c66f676f3b	lib/promscrape: push `scrape_samples_limit` metric to remote storage if `sample_limit` option is set in `scrape_config` for this target See https://github.com/VictoriaMetrics/operator/issues/497	2022-07-06 12:37:55 +03:00
Roman Khavronenko	ed89106274	vmselect: allow proxying requests to vmalert from single-node (#2834 ) The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:26 +02:00
Aliaksandr Valialkin	edc76286ac	lib/storage: put the (date, metricID) entry in dateMetricIDCache just after the corresponding series is registered in the per-day inverted index Previously the time series could be put into dateMetricIDCache without registering in the per-day inverted index if GetOrCreateTSIDByName finds TSID entry in the global index. This could lead to missing series in query results. The issue has been introduced in the commit `55e7afae3a`, which has been included in VictoriaMetrics v1.78.0	2022-07-05 14:54:03 +03:00
Aliaksandr Valialkin	f3ece83e67	app/vmselect/promql: properly calculate histogram_quantile over unexpected `le` buckets See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:19:24 +03:00
Artem Navoiev	9c763490b7	Docs: Operator Additional Scrape Configuration - update docs (#2826 ) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-07-05 11:06:23 +02:00
Aliaksandr Valialkin	17dc3dbd72	docs/Troubleshooting.md: add a link to `Monitoring` chapter added at `41d1834a99`	2022-07-04 11:56:11 +03:00
Roman Khavronenko	41d1834a99	docs: update Troubleshooting guide (#2809 ) Follow-up after `a4d9388ecb` Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:54:40 +03:00
Roman Khavronenko	c7acf36e39	docs: warn about potential issue with read queries for 1.78.0 (#2818 ) * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:03:27 +03:00
Aliaksandr Valialkin	234901b36c	docs/Cluster-VictoriaMetrics.md: mention about -storage.maxDailySeries and -storage.maxHourlySeries options in `resource usage limits` chapter	2022-06-30 23:17:50 +03:00
Aliaksandr Valialkin	84e373e5c7	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions	2022-06-30 22:39:38 +03:00
Aliaksandr Valialkin	fcc4258404	app/vmagent/remotewrite: clarify descriptions for `-remoteWrite.*` options, which must be set per each `-remoteWrite.url`	2022-06-30 20:18:11 +03:00
Aliaksandr Valialkin	c392d6d173	app/vmagent/remotewrite: add `-remoteWrite.header` command-line flag for setting additional http headers to send to -remoteWrite.url Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:23 +03:00
Aliaksandr Valialkin	e40b40afe6	Revert "lib/promscrape, vmagent: fix path to files (#2801 )" This reverts commit `0a8e35835c`. Reason for revert: it incorrectly fixes the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799#issuecomment-1171392005	2022-06-30 18:23:56 +03:00
Dmytro Kozlov	0a8e35835c	lib/promscrape, vmagent: fix path to files (#2801 ) vmagent: respect `-pathPrefix` flag for static files and links	2022-06-30 16:22:54 +02:00
Dmytro Kozlov	4d9715f5a8	vmui: update render logic for nested component (#2795 ) * vmui: update render logic for nested component, avoid rerender, remove local storage usage for tracing flag * docs/url-examples.md: fix various documentation issues there * docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics. * docs/Troubleshooting.md: add troubleshooting guide for cluster instability * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-30 15:47:12 +03:00
Aliaksandr Valialkin	ee42f18dcb	docs/Troubleshooting.md: refer to subqueries doc, since this is the most frequent source of improperly consutructed queries	2022-06-30 15:09:35 +03:00
Aliaksandr Valialkin	921ff3f49d	docs/Troubleshooting.md: refer to capacity planning docs	2022-06-30 14:59:52 +03:00
Aliaksandr Valialkin	ca263371a6	docs/Troubleshooting.md: various typo fixes and clarifications	2022-06-30 14:56:35 +03:00
Aliaksandr Valialkin	bcb1175162	docs/Troubleshooting.md: formatting fixes	2022-06-30 14:38:42 +03:00
Aliaksandr Valialkin	a4d9388ecb	docs/Troubleshooting.md: add troubleshooting guide for cluster instability	2022-06-30 14:35:39 +03:00
Aliaksandr Valialkin	836c19f7ba	Revert "follow-up after `bdf9f4669a` (#2803 )" This reverts commit `ec5d3253ff`, because there was a similar commit already - `119dc333e1`	2022-06-30 13:54:33 +03:00
Aliaksandr Valialkin	119dc333e1	docs/CHANGELOG.md: document `bdf9f4669a`	2022-06-30 13:53:59 +03:00
Aliaksandr Valialkin	56622bff73	docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:53:59 +03:00
Roman Khavronenko	ec5d3253ff	follow-up after `bdf9f4669a` (#2803 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-30 12:46:57 +02:00
Aliaksandr Valialkin	32ddc90ec1	docs/url-examples.md: fix various documentation issues there	2022-06-29 11:57:54 +03:00
Aliaksandr Valialkin	a14188dd8e	app/vmselect: expose additional histograms at `/metrics` page, which may help get more insights for the query workload This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:13 +03:00
Aliaksandr Valialkin	a350d1e81c	lib/storage: return marshaled metric names from SearchMetricNames Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:17:15 +03:00
Aliaksandr Valialkin	bffd72e9a9	docs/Single-server-VictoriaMetrics.md: mention about -search.maxTagValueSuffixesPerSearch command-line flag in `resource limits` docs	2022-06-27 14:03:54 +03:00
Aliaksandr Valialkin	741dd47273	docs/CHANGELOG.md: document `45f20ad1aa`	2022-06-27 13:52:59 +03:00
Aliaksandr Valialkin	a963b2a0aa	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:45:51 +03:00
Aliaksandr Valialkin	94445e8bd1	docs/CHANGELOG.md: update after `e40d015e9a`	2022-06-24 18:04:55 +03:00
Aliaksandr Valialkin	d2bbbf147c	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:57:43 +03:00
Dmytro Kozlov	bb7f31541f	vmui: added query tracing (#2748 ) * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 22:59:20 +03:00
Nikolay	7f1c73bdaf	app/vmselect: fixes partial response with replicationFactor (#2777 ) * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:19:35 +03:00
Yurii Kravets	86e80428d5	docs: Update CHANGELOG Update notes (#2776 ) * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 15:46:51 +02:00
Aliaksandr Valialkin	52eadb729e	lib/promscrape: always send stale markers with the real scrape timestamp This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:34:18 +03:00
Denys Holius	668d67a3d3	Adds a list of supported architectures (#2769 ) * add list of supported architectures * Update docs/BestPractices.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-06-22 21:56:57 +03:00
Aliaksandr Valialkin	1c4f67c5d2	lib/promauth: add ability to send additional http headers in requests to scrape targets This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:39:43 +03:00
Aliaksandr Valialkin	51362f9333	app/vmselect: add `-search.setLookbackToStep` command-line flag for making the gap filling algorithm similar to InfluxDB data model This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:19:30 +03:00
Aliaksandr Valialkin	6a1e0692f6	docs/Cluster-VictoriaMetrics.md: small fixes	2022-06-22 13:42:43 +03:00
Roman Khavronenko	75dd7542e5	docs: follow-up for `197d3cdd74` (#2766 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 08:53:54 +02:00
云原生驿站	197d3cdd74	docs: supplement vmalert downsampling docs (#2765 ) Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 07:43:41 +02:00
Denys Holius	f456e486b7	url-examples: added curl output after deleting metrics (#2764 ) docs: add more details to url-examples for series deleting	2022-06-21 16:20:08 +02:00
Aliaksandr Valialkin	f88c642464	docs: update `-help` output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:01 +03:00
Aliaksandr Valialkin	cfc99e12da	docs: update docs after `e4d6b750f6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:12 +03:00
Aliaksandr Valialkin	091408be62	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:10:38 +03:00
Aliaksandr Valialkin	3837b50f37	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:36:41 +03:00
Aliaksandr Valialkin	49586566a3	docs: follow-up after `e4d6b750f6`	2022-06-20 17:14:43 +03:00
Nikolay	e4d6b750f6	lib/httpserver: adds flagsAuthKey command-line flag (#2758 ) * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:09:32 +03:00
Aliaksandr Valialkin	9f6a19a904	docs/Articles.md: add a link to https://www.sobyte.net/post/2022-05/victoriametrics-bloomfilter/	2022-06-20 14:43:46 +03:00
Roman Khavronenko	4b4f03fa1f	docs: reference links from key concepts (#2745 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:12:10 +03:00
Artem Navoiev	954a7a6fc6	docs: replace bash code block type with console (#2746 )	2022-06-19 22:57:53 +03:00
Aliaksandr Valialkin	c022c4af0a	docs/CHANGELOG.md: document `ef7f52e0e6`	2022-06-19 22:48:39 +03:00
Aliaksandr Valialkin	5fb45173ae	lib/storage: do not register new series if `-storage.maxHourlySeries` or `-storage.maxDailySeries` limits are exceeded Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:42:09 +03:00
Aliaksandr Valialkin	62e2371a67	lib/storage: reset metric id caches for the previous and the current hour Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:42:09 +03:00
Aliaksandr Valialkin	00831e0ee5	docs: update docs on how to add tags to metrics collected by DataDog agent Follow-up for `f16072c3c1`	2022-06-17 13:11:43 +03:00
Dmytro Kozlov	10454d1735	vmui: added focusLabel, enable cardinality app configuratior (#2736 ) * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:03:02 +03:00
Dmytro Kozlov	f16072c3c1	doc: added workaround for datadog agent (#2712 ) * Added workaround for datadog agent * docs: update datadog workaround * doc: update doc description * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 22:22:55 +03:00
Roman Khavronenko	b875628ae6	docs: mention sandbox update in release procedure (#2724 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:48:01 +03:00
Roman Khavronenko	723d90536c	vmselect: limit `end` param max value by 2d in future (#2729 ) * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:46:31 +03:00
Aliaksandr Valialkin	eabd2e2320	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:30:30 +03:00
Aliaksandr Valialkin	c18f8cccfa	lib/promrelabel: support `action: graphite` relabeling Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:24:22 +03:00
Roman Khavronenko	45c1e27937	docs: add multiple-remote-writes topology to vmalert (#2738 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 13:30:28 +02:00
Aliaksandr Valialkin	0f889497b5	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:40:59 +03:00
Aliaksandr Valialkin	e8214ed4e8	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:04 +03:00
Aliaksandr Valialkin	ec7963208d	app/vmselect: accept `focusLabel` query arg at /api/v1/status/tsdb This allows filling the seriesCountByFocusLabelValue list in the /api/v1/status/tsdb response with label values for the specified focusLabel, which contain the highest number of time series. TODO: add this to Cardinality explorer at VMUI - https://docs.victoriametrics.com/#cardinality-explorer	2022-06-14 18:36:54 +03:00
Aliaksandr Valialkin	b6c1ca12b7	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:32:38 +03:00
Aliaksandr Valialkin	7b3c9c50a8	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:00 +03:00
Roman Khavronenko	97183e4ec5	docs: reduce free disk recommendation from 30% to 20% (#2728 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:54:39 +03:00
Aliaksandr Valialkin	29b7c0b4a6	docs/guides/migrate-from-influx.md: suggest more real-world value for `-search.maxStalenessInterval` Suggest `-search.maxStalenessInterval=10s` instead of `-search.maxStalenessInterval=1ms`, since `1ms` would result in empty graphs in most cases, since the interval between data points on the graph is usually much higher than 1ms. For example, if the graph shows time range of one hour and it contains 1000 points, then the interval between points on the graph would equal to 3600s/1000=3.6 seconds.	2022-06-14 12:32:02 +03:00
Roman Khavronenko	aecac75ec7	docs: migrating from influx (#2720 ) Mention `-search.maxStalenessInterval` flag and its effect on query engine. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 09:10:44 +02:00
Aliaksandr Valialkin	86da001963	docs/Single-server-VictoriaMetrics.md: recommend running all the VictoriaMetrics components behind auth proxy in Security chapter	2022-06-13 10:30:01 +03:00
Aliaksandr Valialkin	de2be31275	docs/CHANGELOG.md: document `99dbe7f9d4`	2022-06-13 10:01:48 +03:00
Roman Khavronenko	cd2f0e0760	Readme cleanup (#2715 ) * docs: minor styling and wording changes Changes made after reading https://developers.google.com/tech-writing Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: set proper types for code blocks Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: add `copy` wrapper for some commands Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: sync Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: resolve conflicts Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-13 09:48:26 +03:00
Yury Molodov	879670418f	vmui: enhancements (#2638 ) (#2717 ) * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:43:37 +03:00
Aliaksandr Valialkin	55a0d34be5	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added The optimization has been added in `374beb350e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:45 +03:00
Aliaksandr Valialkin	374beb350e	app/vmselect: optimize `/api/v1/labels` and `/api/v1/label/.../values` handlers when `match[]` query arg is passed to them	2022-06-12 04:32:13 +03:00
Aliaksandr Valialkin	89b778902b	app/vmselect: add optional `limit` query arg to `/api/v1/labels` and `/api/v1/label_values` endpoints This arg allows limiting the number of sample values returned from these APIs	2022-06-10 09:50:33 +03:00
Roman Khavronenko	48a60eb593	vmalert: followup for `76f05f8670` (#2706 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 08:58:25 +02:00
Howie	76f05f8670	feat: rule limit (#2676 ) vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 08:21:30 +02:00
Aliaksandr Valialkin	12ac255dae	lib/querytracer: make it easier to use by passing trace context message to New and NewChild The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:06:52 +03:00
Aliaksandr Valialkin	a072a061a2	docs/Single-server-VictoriaMetrics.md: explain why free disk space shortage may negatively impact VictoriaMetrics performance	2022-06-08 20:03:53 +03:00
Aliaksandr Valialkin	8888e2b955	docs: add a link to cardinality explorer playground	2022-06-08 19:39:36 +03:00
Aliaksandr Valialkin	2c2418d079	docs: refer to cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:17:41 +03:00
Dmytro Kozlov	018d2303c4	Cardinality explorer (#2625 ) * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:43:05 +03:00
Aliaksandr Valialkin	46d8fb03d1	docs/CHANGELOG.md: document `63b538ecd1`	2022-06-07 15:52:32 +03:00
Aliaksandr Valialkin	a93deb307f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:13 +03:00
Aliaksandr Valialkin	cbb64c824d	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage The changes are related to the added query tracing in `afced37c0b` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:35 +03:00
Aliaksandr Valialkin	638ba4614a	docs/CHANGELOG.md: document `e755d0ec3f`	2022-06-07 15:16:48 +03:00
Aliaksandr Valialkin	b022f1f113	docs/CHANGELOG.md: document `1ee1e986da`	2022-06-07 15:02:22 +03:00
Aliaksandr Valialkin	194258c7b4	docs: run `make docs-sync` after `fda8da297e`	2022-06-07 14:50:39 +03:00
Dmytro Kozlov	fda8da297e	docs: fixed typos (#2680 ) * docs: fixed typos * Update README.md * Update docs/README.md * Update docs/Single-server-VictoriaMetrics.md * docs: added examples with start and end params in request * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 14:47:15 +03:00
Aliaksandr Valialkin	f9d22e2ad3	docs/Cluster-VictoriaMetrics.md: run `make docs-sync` after `1c96dce367`	2022-06-07 14:30:43 +03:00
Aliaksandr Valialkin	f04b997a3d	docs: run `make docs-sync` after `a439e887a3`	2022-06-07 14:26:56 +03:00
Aliaksandr Valialkin	8608dd093c	all: follow-up after `8edb390e21` - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 00:57:09 +03:00

... 5 6 7 8 9 ...

2209 commits