github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-12-01 14:47:38 +00:00

Author	SHA1	Message	Date
Artem Navoiev	2e2b1ba87e	change docs for VictoriaMetrics Managed (#3803 ) * change docs for VictoriaMetrics Managedd Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * Update docs/managed-victoriametrics/user-managment.md Co-authored-by: Max Golionko <8kirk8@gmail.com> --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Co-authored-by: Max Golionko <8kirk8@gmail.com>	2023-02-13 13:29:03 +01:00
Aliaksandr Valialkin	e5070c0bcd	docs/sd_configs.md: properly escape __address__ string	2023-02-11 14:45:54 -08:00
Aliaksandr Valialkin	c5b9f7f751	docs/sd_configs.md: document how the __address__ label is generated per each discovered target	2023-02-11 14:41:59 -08:00
Aliaksandr Valialkin	25a9017a72	app/vmui: show `median` instead of `avg` on graph tooltip and line legend Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3706	2023-02-11 12:51:12 -08:00
Aliaksandr Valialkin	3ec8a4dc80	lib/{mergeset,storage}: allow at least 3 concurrent flushes during background merges on systems with 1 or 2 CPU cores This should prevent from data ingestion slowdown and query performance degradation on systems with small number of CPU cores (1 or 2), when big merge is performed. This should help https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3790 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2023-02-11 12:08:52 -08:00
Aliaksandr Valialkin	4156e78e11	docs/Articles.md: add a link to https://www.techetio.com/2022/08/21/evaluating-backend-options-for-prometheus-metrics/	2023-02-11 12:08:52 -08:00
Aliaksandr Valialkin	b11bdc46be	app/vmselect/promql: add `mad_over_time(m[d])` function See https://github.com/prometheus/prometheus/issues/5514	2023-02-11 01:06:20 -08:00
Aliaksandr Valialkin	ed4492ddd5	all: update alpine base docker image from 1.17.1 to 1.17.2 See https://alpinelinux.org/posts/Alpine-3.17.2-released.html	2023-02-11 00:37:17 -08:00
Aliaksandr Valialkin	776391917f	app/vmauth: improve load balancing by sending incoming requests to backends with the lowest number of concurrent requests While at it, stop sending requests to unavailable backend for 3 seconds before the next attempt. This should reduce the amounts of useless work and the number of useless network packets when the backend is temporarily unavailable.	2023-02-11 00:30:31 -08:00
Aliaksandr Valialkin	f3625e4f3f	app/vmauth: add `-maxConcurrentPerUserRequests` command-line option for limiting the number of concurrent requests on a per-user basis Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3346	2023-02-10 21:58:21 -08:00
Aliaksandr Valialkin	70f8911ca7	app/vmauth: automatically retry failing GET requests on the remaining backends	2023-02-09 21:05:55 -08:00
Dmytro Kozlov	f582f9e8ab	app/vmauth: add concurrent requests limit per auth record (#3749 ) * app/vmauth: add concurent requests limit per auth record * app/vmauth: added clarification comment * app/vmauth: remove unused code * app/vmauth: move read from limiter * app/vmauth: fix text * app/vmauth: fix comments * - Clarify the docs for the max_concurrent_requests option at docs/vmauth.md - Clarify the description of the change at docs/CHANGELOG.md - Make sure that the -maxConcurrentRequests takes precedence over per-user max_concurrent_requests - Update tests for verifying that the max_concurrent_requests option is parsed properly Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3346 --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-09 20:03:01 -08:00
Aliaksandr Valialkin	73358571ee	app/vmalert: follow-up after d3c64aae8768d58781ee7e358bd7f3d8e0eb836d - Document the change at docs/CHANGELOG.md - Add `Reading rules from object storage` section to docs/vmalert.md - Add `s3` prefix to command-line flags related to the configuration of s3 and gcs clients - Explicitly mention that reading rules from object storage is supported only in enterprise version	2023-02-09 18:52:00 -08:00
Aliaksandr Valialkin	d4b97b69bf	docs/CHANGELOG.md: document d621d50d4fb3b43a0bcb4419bee979f0192d38fe	2023-02-09 14:40:07 -08:00
Aliaksandr Valialkin	a42e3e8dfb	docs/CHANGELOG.md: cut v1.87.1 and mark 1.87.x as LTS release	2023-02-09 11:20:57 -08:00
Zakhar Bessarab	f13a255918	lib/promscrape: fix cancelling in-flight scrape requests during configuration reload (#3791 ) * lib/promscrape: fix cancelling in-flight scrape requests during configuration reload when using `streamParse` mode (see #3747) Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * Update docs/CHANGELOG.md --------- Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-09 11:13:06 -08:00
Aliaksandr Valialkin	513707a8c7	app/vmui: UX enhancements for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3706 - Display `min` value additionally to `avg`, `max` and `last` - Allow copy-n-pasting metric name with its labels from both legend and tooltup	2023-02-09 11:04:51 -08:00
Aliaksandr Valialkin	f40661e7b7	docs/vmagent.md: clarify that automatically generated metrics contain all the target-specific labels, including `instance` and `job`	2023-02-09 11:04:51 -08:00
Air	a1432e6b0a	Possibly spelling in the Quick start	2023-02-09 15:50:20 +02:00
Yury Molodov	e1063ce3c1	vmui: improve tenant selector (#3794 ) * fix: change styles tenant selector (#3792) * docs/CHANGELOG.md: document the change Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3792 --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-09 00:08:59 -08:00
Aliaksandr Valialkin	46a521191f	docs/CHANGELOG.md: document changes at v1.79.8 LTS release	2023-02-08 23:38:46 -08:00
Yury Molodov	8afc0aef8d	vmui: add last/max/avg values (#3789 ) * feat: add last/max/avg values (#3706) * fix: change filter exclude values * app/vmui: wip - improve the visualization for avg/max/last values - make getAvgFromArray() function resilient against inf/undefined/nil - export getLastFromArray() function, which is resilient against inf/undefined/nil - run `make vmui-update` --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-08 22:41:20 -08:00
Aliaksandr Valialkin	114c14febf	docs/CHANGELOG.md: document `75bcf86a31` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3740	2023-02-08 11:24:07 -08:00
Aliaksandr Valialkin	a1ee679042	docs/CHANGELOG.md: add more context to the bugfix description in Nomad service discovery See `146fd2eca3`	2023-02-08 09:24:48 -08:00
Aliaksandr Valialkin	6c21b6ec09	docs/CHANGELOG.md: document the change at `67b01329a0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3761	2023-02-08 08:42:19 -08:00
Roman Khavronenko	e83f14210d	Vmalert fixes (#3788 ) * vmalert: use group's ID in UI to avoid collisions Identical group names are allowed. So we should used IDs for various groupings and aggregations in UI. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: prevent disabling state updates tracking The minimum number of update states to track is now set to 1. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: properly update `debug` and `update_entries_limit` params on hot-reload Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: display `debug` field for rule in UI Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: exclude `updates` field from json marhsaling This field isn't correctly marshaled right now. And implementing the correct marshaling for it doesn't seem right, since json representation is mostly used by systems like Grafana. And Grafana doesn't expect this field to be present. Signed-off-by: hagen1778 <roman@victoriametrics.com> * fix test for disabled state Signed-off-by: hagen1778 <roman@victoriametrics.com> * fix test for disabled state Signed-off-by: hagen1778 <roman@victoriametrics.com> --------- Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-02-08 14:34:03 +01:00
Roman Khavronenko	86e47177dc	docs: follow-up after `2e4bfcce63` (#3785 ) `2e4bfcce63` Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-02-08 09:48:05 +01:00
Aliaksandr Valialkin	1901fbf19b	docs/CHANGELOG.md: fix formatting for the change from `6fd10e8871`	2023-02-07 09:34:57 -08:00
earthgecko	3a51a3bc42	Clarifications between standalone/cluster ingestion endpoints (#3771 ) docs: clarifications between standalone/cluster ingestion endpoints This is an attempt to make it a bit clearer to the user that the cluster version ingestion URLs are different from the standalone ones. I have also changed the order of the list items to make it a bit clearer and hopefully stop the user simply inferring that `/prometheus/api/v1` is only related to Prometheus data.	2023-02-07 15:17:12 +01:00
Max Golionko	977c642934	docs: update formatiing for k8s monitoring with Managed VictoriaMetrics (#3768 ) * jekyll formatting madness	2023-02-06 18:33:40 +08:00
Roman Khavronenko	c32d8ea29e	vmalert: update docs (#3770 ) vmalert: update flags description Signed-off-by: hagen1778 <roman@victoriametrics.com> --------- Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-02-06 09:51:30 +01:00
Roman Khavronenko	6fd10e8871	vmalert: speed up state restore procedure on start (#3758 ) * vmalert: speed up state restore procedure on start Alerts state restore procedure has been changed to become asynchronous. It doesn't block groups start anymore which significantly improves vmalert's startup time. Instead, state restore is called by each group in their goroutines after the first rules evaluation. While previously state restore attempt was made for all loaded alerting rules, now it is called only for alerts which became active after the first evaluation. This reduces the amount of API calls to the configured remote read URL. This also means that `remoteRead.ignoreRestoreErrors` command-line flag becomes deprecated now and will have no effect if configured. See relevant issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2608 Signed-off-by: hagen1778 <roman@victoriametrics.com> * make lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review --------- Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-03 19:46:13 -08:00
Aliaksandr Valialkin	98dc968920	docs/CHANGELOG.md: document `f63f487787` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3707	2023-02-03 19:30:12 -08:00
Aliaksandr Valialkin	7440f971ab	docs/MetricsQL.md: add links to "rollup results" explanation	2023-02-03 11:09:42 -08:00
Aliaksandr Valialkin	12cf8d9f69	docs/managed-victoriametrics/how-to-monitor-k8s.md: rename image files according to docs/assets/README.md	2023-02-03 10:43:02 -08:00
Max Golionko	e18f8e9413	docs: move managed victoria metics guide into right folder (#3750 ) * move guide folder * image width control	2023-02-03 03:13:36 +08:00
Max Golionko	07b7fe83c4	Update docs/managed_victoriametrics/how-to-monitor-k8s.md Co-authored-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-02-02 15:43:55 +02:00
Max Golionko	a2ba1f09e4	add guide to list of guides	2023-02-02 15:43:55 +02:00
Max Golionko	79527441ec	added k8s guide for managed VM	2023-02-02 15:43:55 +02:00
Aliaksandr Valialkin	dc142867b8	docs/CHANGELOG.md: typo fixes	2023-02-01 20:40:44 -08:00
Aliaksandr Valialkin	fe736c5388	docs/CHANGELOG.md: cut v1.87.0	2023-02-01 13:03:11 -08:00
Dmytro Kozlov	7b87fac8e7	lib/promscrape: fix `honor_labels` behavior (#3739 ) Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-02-01 11:21:44 -08:00
Aliaksandr Valialkin	7b1caf1db3	docs/CHANGELOG.md: document `9254e494f9`	2023-02-01 09:56:52 -08:00
Zakhar Bessarab	68985455f1	fix: vmselect multi-level setup panic (#3738 ) * app/vmselect/netstorage: fix panic for multi-level cluster setup when `replicationFactor` was set and request contained `trace` parameter (#3734) Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * app/vmselect/netstorage: use correct context for retry Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> --------- Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-02-01 08:59:30 -08:00
Zakhar Bessarab	4cf37c5e70	app/vmbackup: fix deleting snapshot after backup completion (#3735 ) (#3736 ) Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-02-01 11:23:58 +01:00
Aliaksandr Valialkin	4ecb61e247	docs/CHANGELOG.md: document `442a9f16b4` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3661	2023-01-31 13:03:46 -08:00
Roman Khavronenko	1cbdcd391c	docs: mention `-vmalert.proxyURL` in vmalert docs (#3730 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-01-30 16:28:33 +01:00
Aliaksandr Valialkin	0788be35eb	lib/promscrape/discovery/azure: add __meta_azure_machine_size label in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/11650	2023-01-27 17:07:12 -08:00
Aliaksandr Valialkin	ab57b92932	lib/promscrape/discovery/kubernetes: add support for __meta_kubernetes_pod_container_id See https://github.com/prometheus/prometheus/issues/11843 and https://github.com/prometheus/prometheus/pull/11844	2023-01-27 16:34:06 -08:00
Yury Molodov	ac14d50c18	vmui: add select of Tenant ID (#3673 ) * feat: add select of tenantID * feat: replace tenantID to default url * fix: move the tenantID selector to the top header * fix: hide tenantID selector by condition * fix: correct z-index * app/vmselect/vmui: `make vmui-update` --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-27 15:53:14 -08:00
Aliaksandr Valialkin	51ad94677c	docs: update security chapters after `bd716d1b0c`	2023-01-27 15:45:35 -08:00
Denys Holius	bd716d1b0c	Improving docs by adding additional security sections (#3713 ) * docs/Cluster-VictoriaMetrics.md: adds security section * docs/Quick-Start.md: adds Security recommendation section	2023-01-27 15:22:21 -08:00
Aliaksandr Valialkin	06f6b76521	app/vmagent: properly return 200 response code when importing data via Prometheus PushGateway protocol This is the same fix as has been already applied to app/vminsert at `cdb6d651e9` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3636 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1415	2023-01-27 14:40:02 -08:00
Aliaksandr Valialkin	a0c8b86eab	docs/vmauth.md: update docs after `ff39a91147` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3346	2023-01-27 14:10:19 -08:00
Aliaksandr Valialkin	ff39a91147	app/vmauth: limit the number of concurrent requests served by `vmauth` with the `-maxConcurrentRequests` command-line flag See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3346 This commit is based on the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3486	2023-01-27 14:07:30 -08:00
Aliaksandr Valialkin	372b1688d7	app/vmauth: do not use net/http/httputil.ReverseProxy This allows better controlling requests to backends and providing better error logging. For example, if the backend was unavailable, then the ReverseProxy was logging the error message without client ip and the initial request uri. This could harden debugging. This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3486	2023-01-27 13:40:05 -08:00
Aliaksandr Valialkin	2afa4ae00a	docs/managed-victoriametrics: typo fix in links to images	2023-01-27 11:36:20 -08:00
Aliaksandr Valialkin	6342eb5523	docs/assets/README.md: mention that locally placed doc-specific images simplify referring them from various views without the need to deal with folder prefixes	2023-01-27 11:29:23 -08:00
Aliaksandr Valialkin	54a0ccbaca	docs/managed-victoriametrics/user-management.md: move the associated images to docs/managed-victoriametrics/ folder with user-management_ prefix according to docs/assets/README.md	2023-01-27 11:25:22 -08:00
Aliaksandr Valialkin	b28cf0faa8	docs/managed-victoriametrics/quickstart.md: move the associated images to docs/managed-victoriametrics/ folder with quickstart_ prefix according to docs/assets/README.md	2023-01-27 11:16:03 -08:00
Aliaksandr Valialkin	3251d392b5	docs/assets: add README.md with the explanation on which files can be put into the docs/assets folder	2023-01-27 11:02:16 -08:00
Aliaksandr Valialkin	119010f7f2	docs/Cluster-VictoriaMetrics.md: move Naive_cluster_scheme.png from the docs/assets/images/ folder into docs/ folder and add Cluster-VictoriaMetrics_ prefix to the image name The docs/assets folder should be used only for assets specific to docs generation at https://docs.victoriametrics.com, e.g. css, js and images. All the other assets related to specific docs should be placed in the same folder as the corresponding .md file. These assets should have the same name prefix as the corresponding doc file name. This simplifies tracking the lifetime of these assets. For example, if the doc is removed, it is very easy to remove all assets associated with it with a simple `rm -rf docs/doc-name` command. This also simplifies generating correct urls for doc-specific assets from both https://docs.victoriametrics.com and from https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/docs/ - just refer to the asset name without any directory prefixes.	2023-01-27 10:54:27 -08:00
dmitryk-dk	4250b67fe8	docs: move how to register from dbaas to docs	2023-01-27 14:07:09 +02:00
dmitryk-dk	465c889f7f	docs: use absolute path	2023-01-27 14:07:09 +02:00
dmitryk-dk	834c18a346	docs: add documentation of user management on managed-vm	2023-01-27 14:07:09 +02:00
Aliaksandr Valialkin	558165521b	docs/Cluster-VictoriaMetrics.md: update command-line descriptions after `ebebaecd94`	2023-01-27 00:04:41 -08:00
Aliaksandr Valialkin	0890adde67	docs: update command-line descriptions after `73256fe438`	2023-01-27 00:00:37 -08:00
Nikolay	73256fe438	lib/netutil: init implimentation of proxy protocol (#3687 ) * lib/netutil: init implimentation of proxy protocol https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3335 * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-26 23:08:35 -08:00
Aliaksandr Valialkin	2c1419c687	docs/CHANGELOG.md: make the description for the bugfix from `465a285324` more reader-friendly	2023-01-26 10:08:13 -08:00
Nikolay	465a285324	lib/storage: properly release parts inMerge lock (#3711 ) if storage doesn't have enough disk space, finalDedupWatcher holds inMerge lock for all parts and never release it until storage restart	2023-01-26 08:05:20 -08:00
Roman Khavronenko	95ee86b600	docs: specify the time window for `series_limit` (#3708 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-01-25 09:30:20 -08:00
Aliaksandr Valialkin	28f66f0079	docs: update the list of command-line flags according to the latest changes	2023-01-25 09:20:24 -08:00
Aliaksandr Valialkin	d655d6b047	lib/streamaggr: add ability to de-duplicate input samples before aggregation	2023-01-25 09:14:49 -08:00
Yury Molodov	99d49e3ceb	vmui: include fonts in its bundle (#3705 ) * feat: include fonts in the build * fix: reduce size fonts * wip - Document the change at docs/CHANGELOG.md - Run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-24 09:30:56 -08:00
Yury Molodov	20ad848c5d	vmui: improvements to the UI styles (#3704 ) * feat: add dark theme * update packages * feat: add multilevel menu (#3678) * fix: correct styles * fix: update link to cardinality-explorer * fix: remove unused scss variables * docs/CHANGELOG.md: document the changes Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-24 09:20:31 -08:00
Roman Khavronenko	1a8875b417	discover/ec2: follow-up after `e2b4ab8384` (#3703 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-01-24 11:02:18 +01:00
Aliaksandr Valialkin	a971bcc3fe	lib/bytesutil: do not intern long strings, since they may need big amounts of additional memory for the cache Allow users fine-tuning the maximum string length for interning via -internStringMaxLen command-line flag. This may be used for fine-tuning RAM vs CPU usage for certain workloads. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3692	2023-01-23 23:36:22 -08:00
Aliaksandr Valialkin	babecd8363	lib/promscrape: follow-up for `393876e52a` - Document the change in docs/CHANGELOG.md - Reduce memory usage when sending stale markers even more by parsing the response in stream parsing mode - Update the TestSendStaleSeries Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3668 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3675	2023-01-23 21:52:59 -08:00
Denys Holius	f3cb412508	Fix/remove vmanomaly from release guide (#3699 ) * docs/Release-Guide.md: remove vmanomaly from release guide because it has own release cycle * fixed a typo	2023-01-23 14:32:26 +01:00
Aliaksandr Valialkin	edc51b3119	docs/Articles.md: added missing third-party articles about VictoriaMetrics	2023-01-22 14:23:45 -08:00
Aliaksandr Valialkin	cb5d073bc9	docs/Single-server-VictoriaMetrics.md: make it clear that VictoriaMetrics supports both pull and push protocols at `how to import time series data` chapter	2023-01-22 14:04:29 -08:00
Aliaksandr Valialkin	864c651c03	docs/Articles.md: add https://dev.to/aws-builders/ultra-monitoring-with-victoria-metrics-1p2	2023-01-22 13:51:53 -08:00
Aliaksandr Valialkin	4e25bc2087	lib/vmselectapi: propagate timeout errors from vmselect to vmstorage instead of closing the connection established from vmselect to vmstorage This is a follow-up for `20e9598254`	2023-01-20 19:33:42 -08:00
Aliaksandr Valialkin	74df30456b	app/vmselect: `make vmui-update` after `df7b81b44d`	2023-01-20 12:07:13 -08:00
Yury Molodov	df7b81b44d	vmui: add support for time zone selection for older versions of browsers (#3680 ) * fix: add check for support of getting time zones * vmui: add support for time zone selection for older versions of browsers	2023-01-20 11:47:53 -08:00
Denys Holius	d513230d43	Adds some improvements to release guide docs (#3679 ) * docs/Release-Guide.md: fixed a typo * Release-Guide.md: adds missed steps for updating vmanomaly and vmgateway helm charts	2023-01-19 16:03:42 +01:00
Aliaksandr Valialkin	9785b3f57f	docs/CHANGELOG.md: cut v1.86.2	2023-01-18 12:01:07 -08:00
Aliaksandr Valialkin	19e28ce7b6	docs/CHANGELOG.md: document `777038fe44` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3672	2023-01-18 11:39:48 -08:00
Aliaksandr Valialkin	68463c9e87	lib/promscrape: follow-up for `d79f1b106c` - Document the fix at docs/CHANGELOG.md - Limit the concurrency for sendStaleMarkers() function in order to limit its memory usage when big number of targets disappear and staleness markers are sent for all the metrics exposed by these targets. - Make sure that the writeRequestCtx is returned to the pool when there is no need to send staleness markers. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3668	2023-01-17 23:11:56 -08:00
Zakhar Bessarab	322d96bfe5	discovery/{consul,nomad}: fix cancelling serviceWatcher in-flight requests (#3658 ) * lib/promscrape/discovery/{consul,nomad}: fix background service update watches not canceling requests on serviceWatcher stop Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * lib/promscrape/discovery/{consul,nomad}: fix closing serviseWatcher during scrape job restart Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * wip Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3468 Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-17 21:47:11 -08:00
Yury Molodov	fcef2ff6b2	vmui: correctly display range results in Table view (#3657 ) * fix: properly display range results * fix: set range values to empty array * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-17 21:03:28 -08:00
Aliaksandr Valialkin	1ffa793322	docs/CHANGELOG.md: fix the link to feature request implemented at `e58921aa8f` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3571	2023-01-17 20:27:43 -08:00
Yury Molodov	e58921aa8f	vmui: give more visually different colors to graph lines (#3656 ) * feat: make more different colors of graph lines * docs/CHANGELOG.md: give more visually different colors to graph lines	2023-01-17 20:25:37 -08:00
Aliaksandr Valialkin	006af394ff	vendor: update github.com/VictoriaMetrics/metricsql from v0.51.1 to v0.51.2 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3664	2023-01-17 11:26:41 -08:00
Aliaksandr Valialkin	289af65071	lib/promscrape: properly apply series limit Fix the following issues: - Series limit wasn't applied when staleness tracking was disabled. - Series limit didn't prevent from sending staleness markers for new series exceeding the limit. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3660 Thanks to @hagen1778 for the initial attempt to fix the issue at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3665	2023-01-17 10:14:49 -08:00
Aliaksandr Valialkin	e06168f489	docs/CHANGELOG.md: document the 74f196c37813a18c2c8f28831696ed7d9f535604	2023-01-17 09:10:41 -08:00
Aliaksandr Valialkin	09d7fa2737	lib/{mergeset,storage}: do not slow down concurrently executed queries during assisted merges Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3647 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3641 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/648 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/291	2023-01-16 14:31:52 -08:00
Yury Molodov	04c408e986	vmui: make the step input field global across all the tabs and views (#3644 ) * feat: make the step input field global * fix: correct get step from url * fix: set minimumSignificantDigits to 1 * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-15 13:47:08 -08:00
Aliaksandr Valialkin	cdb6d651e9	app/vminsert: return 200 OK status code when importing data in pushgateway format Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1415 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3636	2023-01-15 13:29:53 -08:00
Denys Holius	ffe6e6fe59	guides/guide-delete-or-replace-metrics.md: fixed wrong curl command (#3652 )	2023-01-15 13:02:52 -08:00
Corporte Gadfly	f32a79189b	docs: fix typo (#3648 )	2023-01-13 09:39:11 +01:00
Aliaksandr Valialkin	be8fba9b6a	app/vmselect/netstorage: tune the number of blocks per series which should be unpacked by a single goroutine instead of spinning up multiple goroutines This reduces overhead on time series data unpacking for typical cases, this reducing CPU usage at vmselect	2023-01-12 09:31:44 -08:00
Aliaksandr Valialkin	98de06ff38	docs/CHANGELOG.md: update the description of the change at `20f28eb9d6`	2023-01-12 08:58:52 -08:00
Nikolay	20f28eb9d6	/lib/promscrape: use correct err logger for scrape unmarshalling (#3645 ) /lib/promscrape: use correct err logger for scrape unmarshalling It correctly suppresses scrape errors and adds correct context for err msg	2023-01-12 17:40:42 +01:00
Aliaksandr Valialkin	9fdd1a10c6	docs/Cluster-VictoriaMetrics.md: mention the -vmui.customDashboardsPath command-line flag at vmselect Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3322	2023-01-11 23:39:55 -08:00
Aliaksandr Valialkin	a194982117	app/vmselect: follow-up after `820312a2b1` - Move the feature description at the correct place at docs/CHANGELOG.md - Run `make vmui-update` - Various cosmetic fixes Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3322	2023-01-11 23:28:00 -08:00
Dmytro Kozlov	820312a2b1	app/vmui: define custom path for dashboards json file (#3545 ) * app/vmui: define custom path for dashboards json file * app/vmui: remove unneeded code * app/vmui: move handler to own file, fix show dashboards, * app/vmui: move flag to handler, add flag description * app/vmauth: fix part of the comments * feat: add store for dashboards * fix: prevent fetch dashboards for app mode * app/vmauth: use simple cache for predefined dashboards * app/vmauth: update dashboards doc * app/vmauth: fix ci * app/vmui: decrease timeout * app/vmselect: removed cache, fix comments * app/vmselect: remove unused const * app/vmselect: fix error log, use slice byte instead of struct Co-authored-by: Yury Moladau <yurymolodov@gmail.com>	2023-01-11 23:06:07 -08:00
Zakhar Bessarab	8537533beb	lib/promscrape/discovery/dockerswarm: fix discovery filters being applied to all objects (#3632 ) * lib/promscrape/discovery/dockerswarm: fix discovery filters being applied to all objects Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * Update docs/CHANGELOG.md Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-11 22:50:34 -08:00
Artem Navoiev	13a1a7f826	fix operator docs hugo schema Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-01-11 17:28:34 +01:00
Artem Navoiev	83c87f822a	docs: prepare operator docs to migration Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-01-11 18:19:40 +02:00
Artem Navoiev	54aec2b1ba	docs: operator .MD -> .md Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-01-11 16:29:29 +01:00
Aliaksandr Valialkin	351fc152e0	docs/CHANGELOG.md: cut v1.86.1	2023-01-11 01:26:43 -08:00
Aliaksandr Valialkin	975bb8722f	lib/vmselectapi: properly calculate query timeout vmselect passes query timeout to vmstorage in seconds. The commit `20e9598254` treated it as timeout in nanoseconds. Fix this in order to prevent from the following errors under vmstorage load: cannot process vmselect request: cannot execute "search_v7": couldn't start executing the request in 0.000 seconds, since -search.maxConcurrentRequests=... concurrent requests are already executed.	2023-01-11 01:22:33 -08:00
Aliaksandr Valialkin	0771d57860	app/vmselect/promql: make a copy of per-series timestamps before their modification The per-series timestamps are usually shared among series, so it is unsafe modifying them. The issue has been appeared after the optimization at `2f3ddd4884`	2023-01-11 00:59:13 -08:00
Aliaksandr Valialkin	a0f9cb27f9	docs/CHANGELOG.md: document v1.79.7 LTS release	2023-01-10 21:24:28 -08:00
Aliaksandr Valialkin	37fe04999c	docs/CHANGELOG.md: add release date for v1.86.0	2023-01-10 17:45:57 -08:00
Aliaksandr Valialkin	28df7c2a96	docs/CHANGELOG.md: cut v1.86.0	2023-01-10 16:22:26 -08:00
Zakhar Bessarab	4225a0bd75	Use `httpAuth.` flags as a fallback for endpoints protected by `AuthKey` flags (#3582 ) * {lib/server, app/}: use `httpAuth.` flag as fallback for `AuthKey` if it is not set * lib/ingestserver/opentsdbhttp: fix opentdb HTTP handler not respecting `httpAuth.` flags Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-10 15:46:13 -08:00
Dmytro Kozlov	0811000bb0	app/vmctl: Add insecure skip verify flag for remote read protocol (#3611 ) * app/vmctl: Add insecure skip verify flag for remote read protocol	2023-01-10 23:18:49 +01:00
Artem Navoiev	37c52ccaf4	vmagent: add minimal scrape file exampe for vmagent quick start (#3627 ) * vmagent: add minimal scrape file exampe for vmagent quick start Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * replace example with link to your prometheus.yml in docker Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-01-10 23:16:10 +01:00
Aliaksandr Valialkin	cbe62f23ba	lib/promscrape/discovery/gce: follow-up for `b2ccdaaa2f` - Use promutils.Labels.GetLabels() instead of comparing promutils.Labels.Labels to nil. This make the code more consistent with other places. - Mention the release where the issue has been introduced at docs/CHANGELOG.md. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3624	2023-01-10 13:51:03 -08:00
Zakhar Bessarab	b2ccdaaa2f	lib/promscrape/discovery/gce: fix crash in case instance does not have any labels set (#3625 ) Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-01-10 11:07:11 +01:00
Denys Holius	b06e795a1e	docs/Release-Guide.md: added missed link to rpm repository (#3623 )	2023-01-10 10:14:56 +01:00
Aliaksandr Valialkin	e5eca54951	lib/promscrape/discovery/nomad: sync nomad_sd_configs fields with the Prometheus implementation See the list of configs supported by Prometheus at `f88a0a7d83/discovery/nomad/nomad.go (L76-L84)` - Removed "token" option. In can be set either via NOMAD_TOKEN env var or via `bearer_token` config option. - Removed "scheme" option. It is automatically detected depending on whether the `tls_config` is set. - Removed "services" and "tags" options, since they aren't supported by Prometheus. - Added "region" option. If it is missing, then the region is read from NOMAD_REGION env var. If this var is empty, then it is set to "global" in the same way as Nomad client does. See `865ee8d37c/api/api.go (L297)` and `865ee8d37c/api/api.go (L555-L556)` - If the "server" option is missing, then it is read from NOMAD_ADDR in the same way as Nomad client does - see `865ee8d37c/api/api.go (L294-L296)` This is a follow-up for `8aee209c53` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3367	2023-01-09 21:14:48 -08:00
Aliaksandr Valialkin	1f9d605988	app/vmselect/netstorage: consistently select the sample with the biggest value out of samples with identical timestamps Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3333 This fix is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3620 , but doesn't slow down the common case with merging replicated data blocks so significantly. Benchmark results: Before the change: BenchmarkMergeSortBlocks/replicationFactor-1-4 13968 85643 ns/op 956.53 MB/s 1700 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-2-4 10806 109171 ns/op 1500.77 MB/s 2191 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-3-4 8887 130623 ns/op 1881.45 MB/s 2660 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-4-4 7440 157348 ns/op 2082.52 MB/s 3174 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-5-4 6534 184473 ns/op 2220.38 MB/s 3612 B/op 1 allocs/op BenchmarkMergeSortBlocks/overlapped-blocks-bestcase-4 13419 85205 ns/op 961.44 MB/s 2213 B/op 1 allocs/op BenchmarkMergeSortBlocks/overlapped-blocks-worstcase-4 579 1894900 ns/op 43.23 MB/s 46760 B/op 1 allocs/op After the change: BenchmarkMergeSortBlocks/replicationFactor-1-4 13832 85298 ns/op 960.40 MB/s 1716 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-2-4 8833 134222 ns/op 1220.66 MB/s 2675 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-3-4 6487 184830 ns/op 1329.65 MB/s 3636 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-4-4 4977 236318 ns/op 1386.61 MB/s 4733 B/op 1 allocs/op BenchmarkMergeSortBlocks/replicationFactor-5-4 4088 296734 ns/op 1380.36 MB/s 5761 B/op 1 allocs/op BenchmarkMergeSortBlocks/overlapped-blocks-bestcase-4 14083 84067 ns/op 974.47 MB/s 2110 B/op 1 allocs/op BenchmarkMergeSortBlocks/overlapped-blocks-worstcase-4 536 2043534 ns/op 40.09 MB/s 50511 B/op 1 allocs/op	2023-01-09 13:01:48 -08:00
Roman Khavronenko	8aee209c53	lib/promscrape: remove `datacenter` field from nomad_sd_config (#3612 ) Looks like `datacenter` field isn't part of `/v1/services` API. See https://developer.hashicorp.com/nomad/api-docs/services#list-services and https://developer.hashicorp.com/nomad/api-docs/services#read-service Related issues: https://github.com/traefik/traefik/issues/9109 https://github.com/prometheus/prometheus/issues/11776 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-01-09 09:07:40 +01:00
Dmytro Kozlov	488940502c	lib/storage: fix returning camelcase label names (#3608 ) * lib/storage: fix returning camelcase label names * doc: add change log * Update docs/CHANGELOG.md * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-07 00:50:14 -08:00
Aliaksandr Valialkin	af263fe881	all: small improvements in error messages and command-line flag descriptions related to concurrency limiters	2023-01-07 00:11:44 -08:00
Aliaksandr Valialkin	986a05e18d	lib/promscrape: limit the concurrency during parsing and relabeling the scraped samples This should reduce memory usage when scraping big number of targets, since this limits the summary memory usage during concurrent parsing and relabeling by the number of available CPU cores.	2023-01-06 22:59:17 -08:00
Aliaksandr Valialkin	c63755c316	lib/writeconcurrencylimiter: improve the logic behind -maxConcurrentInserts limit Previously the -maxConcurrentInserts was limiting the number of established client connections, which write data to VictoriaMetrics. Some of these connections could be idle. Such connections do not consume big amounts of CPU and RAM, so there is a little sense in limiting the number of such connections. So now the -maxConcurrentInserts command-line option limits the number of concurrently executed insert requests, not including idle connections. It is recommended removing -maxConcurrentInserts command-line option, since the default value for this option should work good for most cases.	2023-01-06 22:20:19 -08:00
Aliaksandr Valialkin	f299d2ca1a	lib/vmselectapi: limit the number of concurrently executed requests This should prevent from out of memory errors when big number of vmselect nodes send many concurrent requests to vmstorage The limit can be controlled at vmstorage via the following command-line flags: - search.maxConcurrentRequests - search.maxQueueDuration See https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#resource-usage-limits	2023-01-06 22:11:34 -08:00
Aliaksandr Valialkin	f392913d00	lib/promscrape: follow-up after `bced9fb978` - Document the bugfix at docs/CHANGELOG.md - Wait until all the worker goroutines are done in consulWatcher.mustStop() - Do not log `context canceled` errors when discovering consul serviceNames - Removed explicit handling of gzipped responses at lib/promscrape/discoveryutils.Client, since this handling is automatically performed by net/http.Transport. See DisableCompression option at https://pkg.go.dev/net/http#Transport . - Remove explicit handling of the proxyURL, since it is automatically handled by net/http.Transport. See Proxy option at https://pkg.go.dev/net/http#Transport . - Expliticly set MaxIdleConnsPerHost, since its default value equals to 2. Such a small value may result in excess tcp connection churn when more than 2 concurrent requests are processed by lib/promscrape/discoveryutils.Client. - Do not set explicitly the `Host` request header, since it is automatically set by net/http.Client. - Backport the bugfix to the recently added nomad_sd_configs - see https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3367 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3468	2023-01-05 21:13:06 -08:00
Aliaksandr Valialkin	9f348cf8a1	lib/promscrape/discovery/nomad: follow-up after `48f371a46c` - Remove undocumented `username` and `password` config options from `nomad_sd_config`. TODO: probably, remove these options from `consul_sd_config` too? These options exist there for backwards compatibility purposes. - Add __meta_nomad_service_alloc_id and __meta_nomad_service_job_id meta-labels These labels contain AllocID and JobID fields for the discovered Nomad services. - Various typo fixes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3367	2023-01-05 18:07:20 -08:00
Karan Sharma	48f371a46c	lib/promscrape: add Prometheus-compatible service discovery for Nomad (#3549 ) Add nomad_sd_config support for service discovery	2023-01-05 23:03:58 +01:00
Zakhar Bessarab	01bc0c94ab	doc: add vmbackupmanager monitoring section (#3605 ) * doc: add vmbackupmanager monitoring section Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-01-05 16:03:06 +01:00
Artem Navoiev	8b763175ff	Add Understand Your Setup Size Guide (#3572 ) docs: add Understand Your Setup Size Guide Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-01-05 14:56:50 +01:00
Aliaksandr Valialkin	2ee81a5dbb	docs/CHANGELOG.md: add missing dot	2023-01-05 03:35:02 -08:00
Zakhar Bessarab	185cdcd813	lib/promscrape/discovery/dockerswarm: fix query encoding of filters (#3586 ) Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-01-05 03:34:25 -08:00
Aliaksandr Valialkin	0dea3b71da	lib/promscrape: pre-fetch metric_relabel_configs rules when debugging metric relabeling for a particular target Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3407	2023-01-05 03:26:49 -08:00
Aliaksandr Valialkin	a1076abcbf	lib/promscrape: follow-up for `a7e29c38bc` - Document the bugfix at docs/CHANGELOG.md - Make the fix more durable against future changes when droppedTargetsMap.Register may be called from other places. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3580	2023-01-05 02:52:08 -08:00
Aliaksandr Valialkin	0e1f0ade31	lib/streamaggr: sort `by` and `without` labels in the aggregate output metric name Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3460	2023-01-05 02:08:44 -08:00
Aliaksandr Valialkin	04dff34de4	vendor: update github.com/VictoriaMetrics/metricsql from v0.50.0 to v0.51.0 Updates https://github.com/VictoriaMetrics/metricsql/pull/7 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3589	2023-01-05 01:50:10 -08:00
Denys Holius	09fe346d18	docs/Release-Guide.md: adds release scenario for RPM LTS packages (#3588 )	2023-01-04 14:36:14 +01:00
Aliaksandr Valialkin	fd175ad80b	docs: update `-help` outputs for vm* tools	2023-01-03 23:27:06 -08:00
Aliaksandr Valialkin	fa13bbc48a	app/{vmagent,vminsert}: add support for streaming aggregation See https://docs.victoriametrics.com/stream-aggregation.html Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3460	2023-01-03 22:19:21 -08:00
Aliaksandr Valialkin	d3a1c36842	docs/Single-server-VictoriaMetrics.md: impromve formatting for `prominent features` chapter	2023-01-03 21:58:21 -08:00
Aliaksandr Valialkin	189f85b24c	docs/vmbackupmanager.md: run `make docs-sync` after `fa842d6534`	2023-01-03 21:50:28 -08:00
Roman Khavronenko	4b3d8eb573	vmalert: mention specifics of Alertmanager HA mode (#3573 ) Stress the importance of specifying of all Alertmanager URLs in vmalert's `-notifier.url` or `notifier.config` if it runs in cluster mode. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3547 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-30 09:54:03 +01:00
Aliaksandr Valialkin	59e1e84a92	docs/CHANGELOG.md: document `1720bddb4f` Updats https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3530	2022-12-29 12:31:48 -08:00
Roman Khavronenko	2cedb3e883	csvimport: support empty values (#3565 ) Before, if the imported line contained multiple metrics and one or more of them had an empty values - the whole line was ignored. Now, only metrics with empty values are ignored, and the rest of the metrics are accepted successfully. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3540 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-12-29 11:52:10 -08:00
Aliaksandr Valialkin	7af8857b68	docs/CHANGELOG.md: add a link to the docs and the pull request for `update_entries_limit` option in vmalert This is a follow up for `6588fcbfca`	2022-12-29 10:38:26 -08:00
Aliaksandr Valialkin	c90752a8be	vendor: update github.com/valyala/fastjson/fastfloat from v1.6.3 to v1.6.4 This should properly parse floating-point numbers with missing integer or fractional parts. For example, 123. or .123 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3544	2022-12-29 10:34:11 -08:00
Roman Khavronenko	6588fcbfca	vmalert: allow configuring the default number of stored rule's update states (#3556 ) Allow configuring the default number of stored rule's update states in memory via global `-rule.updateEntriesLimit` command-line flag or per-rule via rule's `update_entries_limit` configuration param. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-29 12:36:44 +01:00
Aliaksandr Valialkin	3dc684634e	app/vmselect/searchutils: accept partial RFC3339 values at `time`, `start` and `end` query args This simplifies manual usage of the APIs. For example, the following query would return the results over the 2022 year. /api/v1/query_range?start=2022&end=2023&step=1d&query=... This is equivalent to: /api/v1/query_range?start=2022-01-01T00:00:00Z&end=2023-01-01T00:00:00Z&step=1d&query=...	2022-12-28 19:41:54 -08:00
Aliaksandr Valialkin	ed9161a04f	docs: remove a case study for Dreamteam.gg, since it looks like the company no longer exists	2022-12-28 11:34:40 -08:00
Artem Navoiev	34c705988e	fix broken links Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-12-27 13:17:22 +02:00
Artem Navoiev	7d9c4bebc0	update links to grafana dashboards (#3534 ) docs: update links to grafana dashboards Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-12-25 17:36:20 +01:00
Aliaksandr Valialkin	0dca224ec3	app/vmui: small improvements for header panel - Rename `Custom panel` tab to more clear `Query` tab - Rename `Cardinality` tab to `Explore cardinality`, so it becomes consistent with `Explore metrics` tab - Move `Dashboards` tab to the end, since it isn't used too much	2022-12-23 22:24:31 -08:00
Aliaksandr Valialkin	4deea604bf	app/vmui: follow-up after `f6d31f5216` - Document the feature at docs/CHANGELOG.md. - Document the metrics explorer at https://docs.victoriametrics.com/#metrics-explorer . - Properly set `start` and `end` args for the selected time range when performing the request, which returns metric names. - Improve queries, so they return lower number of lines and labels. This should improve metrics' exploration. - Properly encode label filters and query args before passing them to VictoriaMetrics. - Various cosmetic fixes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3386	2022-12-22 17:17:01 -08:00
Yury Molodov	f6d31f5216	vmui: add explore tab for exploration of metrics, which belong to a particular job/instance (#3470 ) * feat: add "Explore" page * feat: add graphs for explore page * vmui: add explore tab for exploration of metrics, which belong to a particular job/instance * refactor: rename variables * refactor: extract graph to ExploreMetricItemGraph.tsx * feat: add searchable for Select.tsx * feat: improve metrics explorer * feat: set document title by page * feat: add page to view icons * fix: improve styles * fix: add encodeURIComponent to query	2022-12-22 15:24:40 -08:00
Aliaksandr Valialkin	f6ac045933	docs/CHANGELOG.md: document `1df87807fd` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3513	2022-12-22 15:22:09 -08:00
Aliaksandr Valialkin	31886aef3d	lib/promrelabel: add support for `keepequal` and `dropequal` relabeling actions These actions are supported by Prometheus starting from v2.41.0 See https://github.com/prometheus/prometheus/pull/11564 , https://github.com/prometheus/prometheus/issues/11556 and https://github.com/prometheus/prometheus/issues/3756 Side note: It's a pity that Prometheus developers decided inventing `keepequal` and `dropequal` relabeling actions instead of adding support for `keep_if_equal` and `drop_if_equal` relabeling actions supported by VictoriaMetrics since June 2020 - see `2a39ba639d` .	2022-12-21 20:04:55 -08:00
Yury Molodov	0f8ffc7df9	vmui: fix change timezone (#3519 ) vmui: fix time picker with changed time zone	2022-12-21 17:22:37 +01:00
Aliaksandr Valialkin	f443fad56d	docs/CHANGELOG.md: cut v1.85.3	2022-12-20 14:51:23 -08:00
Roman Khavronenko	e4e9dfb785	vmagent: respect `-usePromCompatibleNaming` if no relabeling is set (#3511 ) * vmagent: respect `-usePromCompatibleNaming` if no relabeling is set See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3493 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmagent: upd test Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-12-20 14:32:45 -08:00
Yury Molodov	731d189fa9	fix: change the logic for hide query (#3514 )	2022-12-20 14:29:46 -08:00
Zakhar Bessarab	4be4645142	app/vmbackupmanager: add metrics for better observability (#488 ) * app/vmbackupmanager: add metrics for better observability, include more information to `/api/v1/backups` API call response * app/vmbackupmanager: drop old metrics before creating new ones * app/vmbackupmanager: use `_total` postfix for counter metrics * app/vmbackupmanager: remove `_total` postfix for gauge-like metrics * app/vmbackupmanager: add `_last_run_failed` metrics for backups and retention * app/vmbackupmanager: address review feedback * app/vmbackupmanager: fix metric name * app/vmbackupmanager: address review feedback, remove background updates of metrics, add restoring state of `_last_run_failed` metric from remote storage * app/vmbackupmanager: improve performance for backup size calculation * app/vmbackupmanager: refactor backup and retention runs to deduplicate each run logic * {app/vmbackupmanager,lib/formatutil}: move HumanizeBytes into lib package * app/vmbackupmanager: fix creating new metrics instead of reusing existing ones * lit/formatutil: add comment to make linter happy * app/vmbackupmanager: address review feedback	2022-12-20 14:18:06 -08:00
Aliaksandr Valialkin	4e55b67a44	lib/storage: clear the err if it is set to io.EOF when searching for the TSID by metricID This is expected error after when recently added indexdb data isn't available for search yet or wasn't flushed to disk after unclean shutdown of VictoriaMetrics. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3515	2022-12-20 14:05:29 -08:00
Aliaksandr Valialkin	a48510573e	Revert "docs/Release-Guide.md: add LATEST_TAG=stable env var for `make publish-release` in order to create `stable` tag for the published components at DockerHub" This reverts commit `8afa7ef837`.	2022-12-20 12:24:27 -08:00
Aliaksandr Valialkin	8afa7ef837	docs/Release-Guide.md: add LATEST_TAG=stable env var for `make publish-release` in order to create `stable` tag for the published components at DockerHub Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2911	2022-12-20 12:22:42 -08:00
Aliaksandr Valialkin	1d7b5cb83c	docs/CHANGELOG.md: document the change at 547f07463b29c09c62c9af35eac9cee6764b3286 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2612	2022-12-20 10:22:07 -08:00
Roman Khavronenko	8122191368	docs: fix link typo in operator docs (#3508 )	2022-12-20 14:52:47 +01:00
Aliaksandr Valialkin	6bf46c7bf5	docs/CHANGELOG.md: formatting fix	2022-12-20 01:06:34 -08:00
Aliaksandr Valialkin	9fa3f1dc57	app/vmselect/promql: do not extend too short lookbehind window for rate() function if it is set explicitly Previously too short lookbehind window d for rate(m[d]) could be automatically extended if it didn't cover at least two raw samples. This was needed in order to guarantee non-empty results from rate(m[d]) on short time ranges. Now the lookbehind window isn't extended if it is set explicitly, since it is expected that the user knows what he is doing. The lookbehind window continues to be extended when needed if it isn't set explicitly. For example, in the case of rate(m). Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3483	2022-12-20 00:18:20 -08:00
Aliaksandr Valialkin	eabb8762ee	docs/Articles.md: add a link to https://www.youtube.com/watch?v=Mesc6JBFNhQ	2022-12-19 21:40:51 -08:00
Aliaksandr Valialkin	680925f872	docs/CHANGELOG.md: add a warning for releases between v1.83.0 and v1.85.1 that it is recommended upgrading to v1.85.2 because of the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3502 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3502	2022-12-19 13:36:49 -08:00
Aliaksandr Valialkin	d2ad184377	docs/CHANGELOG.md: consistently use YYYY-MM-DD format for release dates The previously used DD-MM-YYYY format could be confused with the MM-DD-YYYY format. The YYYY-MM-DD format reduces this confusion.	2022-12-19 13:33:05 -08:00
Aliaksandr Valialkin	6530344a8f	docs/CHANGELOG.md: cut v1.85.2	2022-12-19 13:09:29 -08:00
Aliaksandr Valialkin	0bf3ae9559	lib/promscrape/discovery/consul: expose service tags in individual labels `__meta_consul_tag_<tagname>` This simplifies copying service tags to target labels with the following relabeling rule: - action: labelmap regex: __meta_consul_tag_(.+) See https://stackoverflow.com/questions/44339461/relabeling-in-prometheus	2022-12-19 13:08:11 -08:00
Aliaksandr Valialkin	6c98b56935	lib/storage: search for TSIDs for the given metricIDs in the previous indexdb if they aren't found in the current indexdb The issue triggers after the indexdb rotation for time series, which stop receiving new samples. This results in missing data for such time series in query responses. This commit should address the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3502 The issue has been introduced in `2dd93449d8`	2022-12-19 12:03:09 -08:00
Aliaksandr Valialkin	4cb83f0f4a	lib/logger: follow-up for `72f8fce107` - Document the change at docs/CHANELOG.md - Log fatal errors if the -loggerJSONFields contains unexpected values - Rename -loggerJsonFields to -loggerJSONFields for the sake of consistency naming commonly used in Go Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2348	2022-12-16 17:42:07 -08:00
Aliaksandr Valialkin	56a9ea3753	docs/vmalert.md: mention `latency_offset` query arg, which has been added in `86dae56bd0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3481	2022-12-16 17:20:37 -08:00
Aliaksandr Valialkin	65f8fc527f	lib/promscrape: stop dropping metric name if relabeling rules do not instruct to do this on the /metric-relabel-debug page	2022-12-16 17:02:41 -08:00
Roman Khavronenko	86dae56bd0	vmselect: support overriding of `-search.latencyOffset` (#3489 ) support overriding of `-search.latencyOffset` value via URL param `latency_offset`. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3481 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-16 16:54:57 -08:00
Aliaksandr Valialkin	17a244571b	docs/keyConcepts.md: update the list of supported data ingestion protocols - Add DataDog protocol - Remove native protocol, since it isn't intended for general-purpose usage by external clients	2022-12-15 12:01:59 -08:00
Aliaksandr Valialkin	4de9d35458	lib/flagutil/bytes.go: properly handle values bigger than 2GiB on 32-bit architectures This fixes handling of values bigger than 2GiB for the following command-line flags: - -storage.minFreeDiskSpaceBytes - -remoteWrite.maxDiskUsagePerURL	2022-12-14 19:26:31 -08:00
Aliaksandr Valialkin	5d30080555	lib/flagutil: support for TB and TiB suffixes for command-line flags, which accept byte sizes	2022-12-14 17:52:32 -08:00
Aliaksandr Valialkin	38341802c2	app/vmselect: add /expand-with-exprs page	2022-12-14 16:18:55 -08:00
Aliaksandr Valialkin	231569f89b	docs/vmagent.md: small formatting fix	2022-12-14 14:25:35 -08:00
Aliaksandr Valialkin	0c54ff20eb	docs/CHANGELOG.md: fix the link to the issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466	2022-12-14 14:17:17 -08:00
Aliaksandr Valialkin	76445bfd98	docs/CHANGELOG.md: add release date for v1.85.1	2022-12-14 14:12:07 -08:00
Aliaksandr Valialkin	ea44c39377	docs/CHANGELOG.md: cut v1.85.1	2022-12-14 11:57:49 -08:00
Aliaksandr Valialkin	e0009ec466	docs/Cluster-VictoriaMetrics.md: mention the `vm_storage_is_read_only` metric, which can help debugging readonly mode at vmstorage	2022-12-14 09:31:28 -08:00
Aliaksandr Valialkin	7a61bafe59	docs/vmagent.md: clarify that relabeling is actually a debugging at `relabel debug` section	2022-12-13 15:46:21 -08:00
Aliaksandr Valialkin	b89d862aa5	docs/CHANGELOG.md: document the bugfix at `a50120a212`	2022-12-13 09:36:24 -08:00
Dima Lazerka	bde93844de	Add Anomaly Detection to enterprise features list (#3476 ) * Add Anomaly Detection to enterprise features list * Update docs/enterprise.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-12-12 17:42:44 -08:00
Aliaksandr Valialkin	d1af6046c7	lib/{mergeset,storage}: do not block small merges by pending big merges - assist with small merges instead Blocked small merges may result into big number of small parts, which, in turn, may result in increased CPU and memory usage during queries, since queries need to inspect all the existing small parts. The issue has been introduced in `8189770c50` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2022-12-12 17:00:50 -08:00
Aliaksandr Valialkin	3b18931050	lib/bytesutil: cache results for all the input strings, which were passed during the last 5 minutes from FastStringMatcher.Match(), FastStringTransformer.Transform() and InternString() Previously only up to 100K results were cached. This could result in sub-optimal performance when more than 100K unique strings were actually used. For example, when the relabeling rule was applied to a million of unique Graphite metric names like in the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466 This commit should reduce the long-term CPU usage for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466 after all the unique Graphite metrics are registered in the FastStringMatcher.Transform() cache. It is expected that the number of unique strings, which are passed to FastStringMatcher.Match(), FastStringTransformer.Transform() and to InternString() during the last 5 minutes, is limited, so the function results fit memory. Otherwise OOM crash can occur. This should be the case for typical production workloads.	2022-12-12 14:41:13 -08:00
Zakhar Bessarab	ebcb4ab617	{app/{vmbackup/vmrestore}: update path example to use Azure terminology for consistency (#3475 )	2022-12-12 22:17:22 +03:00
Roman Khavronenko	8286f9608f	vmalert: support `$for` or `.For` template variables (#3474 ) support `$for` or `.For` template variables in alert's annotations. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3246 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-12 22:16:10 +03:00
Aliaksandr Valialkin	7ae744fce6	lib/protoparser/datadog: do not re-use previously parsed field values if they are missing in the currently parsed message Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3432	2022-12-11 13:09:25 -08:00
Aliaksandr Valialkin	9f642d10ff	docs/CHANGELOG.md: cut v1.85.0	2022-12-11 02:01:11 -08:00
Aliaksandr Valialkin	38f8e8adc3	docs/CHANGELOG.md: document changes at v1.79.6	2022-12-11 01:51:36 -08:00
Aliaksandr Valialkin	d141cb28a6	docs/CHANGELOG.md: document `461158a437` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3427	2022-12-10 23:42:16 -08:00
Aliaksandr Valialkin	88597f187b	app/{vmagent,vminsert}/datadog: make the `host` label optional in DataDog data ingestion protocol Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3432	2022-12-10 23:32:31 -08:00
Aliaksandr Valialkin	e272a0ec78	app/vmselect/promql: allow passing `inf` arg into functions, which accept numeric limit on the number of output time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3461	2022-12-10 22:47:47 -08:00
Aliaksandr Valialkin	b7aec1be4d	docs/CHANGELOG.md: add a link to the issue related to reduced CPU and memory usage at vmalert Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3464 The related commit - `b97bd01605`	2022-12-10 22:21:19 -08:00
Aliaksandr Valialkin	b01607e3fb	docs: clarify that single-node VictoriaMetrics also provides functionality for relabel debugging Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3407	2022-12-10 20:49:52 -08:00
Aliaksandr Valialkin	3f4cb9a142	docs: sync with cluster branch after `97b41e727c`	2022-12-10 02:32:24 -08:00
Aliaksandr Valialkin	a8b8e23d68	lib/promscrape: implement target-level and metric-level relabel debugging Target-level debugging is performed by clicking the 'debug' link at the corresponding target on either http://vmagent:8429/targets page or on http://vmagent:8428/service-discovery page. Metric-level debugging is perfromed at http://vmagent:8429/metric-relabel-debug page. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3407 See https://docs.victoriametrics.com/vmagent.html#relabel-debug	2022-12-10 02:09:44 -08:00
Aliaksandr Valialkin	c5dd973f9c	docs/url-examples.md: add missing whitespace for proper heading for the example on how to send data via OpenTSDB protocol	2022-12-09 17:33:44 -08:00
Aliaksandr Valialkin	765ee5f7ba	docs/CHANGELOG.md: document `b97bd01605`	2022-12-09 11:49:29 -08:00
Aliaksandr Valialkin	2406c0dcfd	docs/CHANGELOG.md: document the bugfix at `05b42601c3` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3247	2022-12-08 18:35:28 -08:00
Aliaksandr Valialkin	5b9e6b9d24	lib/storage: follow-up after `7c0ae3a86a` - Update docs at https://docs.victoriametrics.com/#deduplication - Optimize the deduplication loop a bit Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3333	2022-12-08 18:16:57 -08:00
Roman Khavronenko	7c0ae3a86a	lib/storage: keep sample with the biggest value on timestamp conflict (#3421 ) The change leaves raw sample with the biggest value for identical timestamps per each `-dedup.minScrapeInterval` discrete interval when the deduplication is enabled. ``` benchstat old.txt new.txt name old time/op new time/op delta DeduplicateSamples/minScrapeInterval=1s-10 817ns ± 2% 832ns ± 3% ~ (p=0.052 n=10+10) DeduplicateSamples/minScrapeInterval=2s-10 1.56µs ± 1% 2.12µs ± 0% +35.19% (p=0.000 n=9+7) DeduplicateSamples/minScrapeInterval=5s-10 1.32µs ± 3% 1.65µs ± 2% +25.57% (p=0.000 n=10+10) DeduplicateSamples/minScrapeInterval=10s-10 1.13µs ± 2% 1.50µs ± 1% +32.85% (p=0.000 n=10+10) name old speed new speed delta DeduplicateSamples/minScrapeInterval=1s-10 10.0GB/s ± 2% 9.9GB/s ± 3% ~ (p=0.052 n=10+10) DeduplicateSamples/minScrapeInterval=2s-10 5.24GB/s ± 1% 3.87GB/s ± 0% -26.03% (p=0.000 n=9+7) DeduplicateSamples/minScrapeInterval=5s-10 6.22GB/s ± 3% 4.96GB/s ± 2% -20.37% (p=0.000 n=10+10) DeduplicateSamples/minScrapeInterval=10s-10 7.28GB/s ± 2% 5.48GB/s ± 1% -24.74% (p=0.000 n=10+10) ``` https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3333 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-08 18:06:11 -08:00
Aliaksandr Valialkin	eeacbaf0b6	all: update Go builder from v1.19.3 to v1.19.4 See https://github.com/golang/go/issues?q=milestone%3AGo1.19.4+label%3ACherryPickApproved	2022-12-08 16:41:24 -08:00
Aliaksandr Valialkin	56b8980915	lib/promscrape: allow using `sample_limit` and `series_limit` options in stream parsing mode Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3458	2022-12-08 16:33:38 -08:00
Aliaksandr Valialkin	bce1c5d572	docs/Cluster-VictoriaMetrics.md: typo fix	2022-12-07 12:26:34 -08:00
Aliaksandr Valialkin	189217a069	docs/CHANGELOG.md: document the addition of file-based discovery of vmstorage nodes	2022-12-07 12:04:57 -08:00
Aliaksandr Valialkin	59430e4274	docs/Cluster-VictoriaMetrics.md: `make docs-sync` after 5de8330ce00adfc5ac794070d30a2617ddc14bf2	2022-12-07 12:02:38 -08:00
Aliaksandr Valialkin	49ebc48809	lib/querytracer: put the version of VictoriaMetrics in the first message of query trace This should simplify further debugging, since the first thing to start the debugging by query trace is to know the version of VictoriaMetrics, which produced this trace.	2022-12-07 09:46:39 -08:00
Aliaksandr Valialkin	3f82e3fa36	docs: follow-up after e1bf2a85d0559d112908ce81597f3261d3a085c0 - Document the change at docs/CHANGELOG.md - Run `make docs-sync` for copying app/vmgateway/README.md to docs/vmgateway.md in order to propagate docs' changes to https://docs.victoriametrics.com/vmgateway.html	2022-12-06 21:05:22 -08:00
Aliaksandr Valialkin	35a3170d97	docs: document the addition of `-storageNode.discoveryInterval` command-line flag in VictoriaMetrics cluster enterprise Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3417	2022-12-06 19:57:06 -08:00
Aliaksandr Valialkin	5cc19b1f7e	docs/Articles.md: change the link to `How we tried using VictoriaMetrics and Thanos at the same time` from Russian to English article	2022-12-06 16:30:10 -08:00
Roman Khavronenko	3dec847c93	vmalert: correctly return error for RW failures (#3452 ) * vmalert: correctly return error for RW failures By mistake, in `0989649ad0` the error for remote write failures weren't return to user. This change fixes it. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-06 15:36:46 +01:00
Aliaksandr Valialkin	9a7c36e645	docs/Articles.md: add a link to the talk "How do We Keep Metrics for a Long Time in VictoriaMetrics"	2022-12-06 00:55:38 -08:00
Aliaksandr Valialkin	50ea632bfe	docs/Articles.md: link to a video for the talk 'VictoriaMetrics: scaling to 100 million metrics per second'	2022-12-06 00:53:05 -08:00
Aliaksandr Valialkin	a40c50f4fe	docs/CHANGELOG.md: document `1e0666abb4`	2022-12-05 23:10:17 -08:00
Aliaksandr Valialkin	caa1c43166	docs: follow-up for `7645d9ae00` - Document the change at docs/CHANGELOG.md - Document the feature at https://docs.victoriametrics.com/#vmui Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3446	2022-12-05 22:50:41 -08:00
Yury Molodov	01a9b36a95	vmui: timezone select (#3414 ) * feat: add timezone selection * vmui: provide feature timezone select * fix: correct timezone with relative time Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-12-05 22:44:31 -08:00
Aliaksandr Valialkin	718d1d90b6	docs/CHANGELOG.md: document `fd43b5bad0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3444 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3445	2022-12-05 22:01:42 -08:00
Aliaksandr Valialkin	5eae9a9914	app/vmselect/promql: add range_trim_spikes(phi, q) function for trimming phi percent of largest spikes per each time series returned by q	2022-12-05 21:55:01 -08:00
Aliaksandr Valialkin	eed32b368c	docs/vmctl.md: `make docs-sync` after `86c31f2955` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2930	2022-12-05 17:24:10 -08:00
Zakhar Bessarab	86c31f2955	app/vmctl: add option to migrate between clusters with automatic tenants discovery (#3450 )	2022-12-05 17:18:09 -08:00
Aliaksandr Valialkin	f3e84b4dea	{dashboards,alerts}: subtitute `{type="indexdb"}` with `{type=~"indexdb.*"}` inside queries after `8189770c50` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2022-12-05 16:00:22 -08:00
Aliaksandr Valialkin	8189770c50	all: add `-inmemoryDataFlushInterval` command-line flag for controlling the frequency of saving in-memory data to disk The main purpose of this command-line flag is to increase the lifetime of low-end flash storage with the limited number of write operations it can perform. Such flash storage is usually installed on Raspberry PI or similar appliances. For example, `-inmemoryDataFlushInterval=1h` reduces the frequency of disk write operations to up to once per hour if the ingested one-hour worth of data fits the limit for in-memory data. The in-memory data is searchable in the same way as the data stored on disk. VictoriaMetrics automatically flushes the in-memory data to disk on graceful shutdown via SIGINT signal. The in-memory data is lost on unclean shutdown (hardware power loss, OOM crash, SIGKILL). Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2022-12-05 15:16:14 -08:00
Aliaksandr Valialkin	ddc3d6b5c3	lib/mergeset: drop the crufty code responsible for direct upgrade from releases prior v1.28.0 Upgrade to v1.84.0, wait until the "finished round 2 of background conversion" message appears in the log and then upgrade to newer release.	2022-12-03 21:17:31 -08:00
Aliaksandr Valialkin	c1cd4a9101	docs/CHANGELOG.md: consistently add `-` prefix in front of command-line flags This is a follow-up for `bcba5d2a78`	2022-12-02 19:08:26 -08:00
Aliaksandr Valialkin	b6712ac08e	docs: follow-up after `30fea30685` - Run `make docs-sync`, so app/vmalert/README.md is copied to docs/vmalert.md - Clarify the feature description in the docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3408	2022-12-02 19:03:11 -08:00
Denys Holius	54741f6f38	docs/Articles.md: fir broken link (#3433 )	2022-12-02 10:35:40 +01:00
Roman Khavronenko	cd5c451ea3	docs: fix typo in cluster's README (#3430 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-01 16:24:16 +01:00
Roman Khavronenko	bcba5d2a78	vmalert: fix replay step param (#3428 ) The recent change in modifying default value of `datasource.queryStep` flag resulted in situation where replay mode was always running queries with step=`datasource.queryStep`. When it should always use rule's evaluation interval. The fix is related not to replay mode only, but for all Range requests. Now step param is set individually for each mode. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-01 13:57:53 +01:00
Zakhar Bessarab	30fea30685	app/vmalert: add `remoteWrite.sendTimeout` command-line flag to configure timeout for sending data to `remoteWrite.url` (#3423 ) * app/vmalert: add `remoteWrite.sendTimeout` command-line flag to configure timeout for sending data to `remoteWrite.url` * vmalert: remove WriteTimeout from clients Cfg No need to have it as a part of configuration struct: * the client isn't used by other packages; * there are no internal tests to check the WriteTimeout. * vmalert: remove DisablePathAppend from clients Cfg No need to have it as a part of configuration struct: * the client isn't used by other packages; * there are no internal tests to check the DisablePathAppend. Co-authored-by: hagen1778 <roman@victoriametrics.com>	2022-12-01 09:57:19 +01:00
Roman Khavronenko	8cc4f7eac6	vmalert: properly pass headers during the restore procedure (#3420 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3418 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-01 09:27:39 +01:00
Aliaksandr Valialkin	3cdff3de23	docs/vmagent.md: update after `959f06d175`	2022-11-29 21:33:49 -08:00
Aliaksandr Valialkin	f325410c26	lib/promscrape: optimize service discovery speed - Return meta-labels for the discovered targets via promutils.Labels instead of map[string]string. This improves the speed of generating meta-labels for discovered targets by up to 5x. - Remove memory allocations in hot paths during ScrapeWork generation. The ScrapeWork contains scrape settings for a single discovered target. This improves the service discovery speed by up to 2x.	2022-11-29 21:26:00 -08:00
Aliaksandr Valialkin	c7ce4979ec	all: follow-up after `05cf8a6ecc`	2022-11-29 21:03:59 -08:00
Aliaksandr Valialkin	4822406b64	app/vmalert: substitute -datasource.disablePathAppend with -remoteRead.disablePathAppend in the description for -datasource.url command-line flag This is a follow-up for `959f06d175`	2022-11-29 20:36:41 -08:00
Dmytro Kozlov	05cf8a6ecc	vmctl: support of the remote read protocol (#3232 ) vmctl: support of the remote read protocol Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: hagen1778 <roman@victoriametrics.com>	2022-11-29 22:53:28 +01:00
Max Golionko	959f06d175	vmalert: flag reference update (#3415 ) * flag reference update there is no flag `-datasource.disablePathAppend` and datasource actually checking for `-remoteRead.disablePathAppend` * update source for doc as well	2022-11-29 19:22:57 +01:00
Zakhar Bessarab	2f837c1b23	doc/operator: update formatting for backup section, add FAQ section (#3416 ) * doc/operator: update formatting for backup section, add FAQ section * doc/operator: address review feedback * doc/operator: add note about difference between `VMRestore` and `VMBackupmanager` as init containers * Update docs/operator/backups.MD Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-11-29 19:19:46 +01:00
Aliaksandr Valialkin	0002de937b	docs/CHANGELOG.md: document `027ab74efb` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3402	2022-11-28 18:55:01 -08:00
Aliaksandr Valialkin	5c906beea2	docs/url-examples.md: allow linking to `how to send OpenTSDB/Graphite data` chapters	2022-11-28 18:42:49 -08:00
Aliaksandr Valialkin	654e94f420	lib/promscrape: add `exported_` prefix to metric names exported by scrape targets if they clash with automatically generated metrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3406	2022-11-28 18:37:09 -08:00
Aliaksandr Valialkin	090343ff50	docs/Articles.md: add a link to slides about scaling to 100 million metrics per second	2022-11-28 16:41:14 -08:00
Aliaksandr Valialkin	ad105147dd	docs/CHANGELOG.md: cut v1.84.0	2022-11-25 19:53:29 -08:00
Aliaksandr Valialkin	e014467f42	docs/README.md: `make docs-sync` after `58d459e8a8`	2022-11-25 16:55:47 -08:00
Aliaksandr Valialkin	58d459e8a8	app/{vminsert,vmagent}: follow-up after `53a63c6c4c` Extend /api/v1/import/prometheus with the support for Pushgateway way of specifying additional labels. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1415	2022-11-25 16:48:14 -08:00
Zakhar Bessarab	8b6d528fbd	{app/vmstorage,app/vmselect}: add API to get list of existing tenants (#3348 ) * {app/vmstorage,app/vmselect}: add API to get list of existing tenants * {app/vmstorage,app/vmselect}: add API to get list of existing tenants * app/vmselect: fix error message * {app/vmstorage,app/vmselect}: fix error messages * app/vmselect: change log level for error handling * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-11-25 11:05:47 -08:00
Aliaksandr Valialkin	da13d36af9	app/vmselect/vmui: `make vmui-update` after `eb772aa50e`	2022-11-24 17:37:18 -08:00
Yury Molodov	eb772aa50e	vmui: improve table view (#3377 ) * vmui: add compact table view (#3365) * feat: add compact table view * fix: add overflow table * fix: change table styles * vmui: compact table view * Update docs/CHANGELOG.md Co-authored-by: Michal Kralik <michal.kralik@percona.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-11-24 17:33:07 -08:00
Aliaksandr Valialkin	399ed9a3b9	docs/MetricsQL.md: document that `histogram_share()` accepts optional `boundsLabel` arg	2022-11-24 17:27:30 -08:00
Aliaksandr Valialkin	045fec631b	docs/vmagent.md: typo fix	2022-11-24 17:19:45 -08:00
Aliaksandr Valialkin	04bb2e14dd	docs/Articles.md: add a link to "The cost of scale in Prometheus ecosystem" talk	2022-11-23 00:11:51 +02:00
Yury Molodov	7dc2349913	vmui: add set up series custom limits (#3368 ) * feat: add set up series custom limits * feat: add button for show series without limits * fix: resolve merge conflicts	2022-11-22 15:31:17 +02:00
Aliaksandr Valialkin	b1622ad63e	docs/Articles.md: add a link to https://www.youtube.com/watch?v=_zORxrgLtec (OSA Con 2022: Specifics of data analysis in Time Series Databases)	2022-11-22 01:08:21 +02:00
Aliaksandr Valialkin	9498f871e7	app/vminsert: add missing vm_relabel_config_* metrics after `03d88bc066` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3345	2022-11-22 00:47:49 +02:00
Roman Khavronenko	03d88bc066	vmagent: expose metrics for tracking config state (#3375 ) Expose `vm_relabel_config_` and `vm_promscrape_config_` metrics for tracking relabel and scrape configuration hot-reloads. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3345 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-11-22 00:38:43 +02:00
Yury Molodov	7d1b3e7e14	vmui: add copy button to row on Table view (#3363 ) * feat: add copy button to row on Table view * vmui: add copy button to row on Table view Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-11-22 00:31:33 +02:00
Yury Molodov	82d254af08	vmui: sticky tooltip (#3376 ) * feat: add ability to make tooltip "sticky" * vmui: add ability to make tooltip "sticky"	2022-11-22 00:26:53 +02:00
Aliaksandr Valialkin	ee1479bac6	docs/CHANGELOG.md: link to the related issue for range_normalize() function	2022-11-21 23:27:00 +02:00
Aliaksandr Valialkin	d9c3a2b605	app/vmselect/promql: add `range_normalize(q1, ..., qN)` function for normalizing query results into [0..1] value range This may be useful for analyzing correlation between time series with different value ranges	2022-11-21 23:25:00 +02:00
Aliaksandr Valialkin	95f0266558	lib/promscrape/discovery/gce: do not pass filter arg when discovering zones The filter arg isn't supported by zones API in GCE. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3202	2022-11-21 22:32:05 +02:00
Aliaksandr Valialkin	05ed98c98b	app/vmselect/promql: allow using SI and IEC suffixes in numeric values inside queries For example, 10Ki is equivalent to 101024, while 5.3M is equivalent to 5.31000*1000	2022-11-21 21:27:55 +02:00
Aliaksandr Valialkin	2c9e403d5f	app/vmselect/promql: properly return an empty result from limit_offset() if offset exceeds the number of inner time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3312	2022-11-21 16:47:37 +02:00
Aliaksandr Valialkin	b796a0dc3f	app/vmselect/promql: optimize `e1 op e2` when `e1` returns an empty result Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3349	2022-11-21 16:09:10 +02:00
Roman Khavronenko	84742f229a	vmalert: add default list of alerting rules (#3373 ) The default list of alerting rules contains the basic rules for checking vmalert's health state and is recommended to use for monitoring vmalert deployments. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-11-21 14:45:45 +01:00
Aliaksandr Valialkin	20d758e3e4	all: add a link to https://docs.victoriametrics.com/enterprise.html into description for enterprise flags	2022-11-21 15:42:01 +02:00
Aliaksandr Valialkin	cb1a621d63	app/{vminsert,vmselect}: add `-storageNode.filter` command-line flag for filtering the discovered storage nodes Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3353	2022-11-21 15:20:14 +02:00
Aliaksandr Valialkin	65b4e96a80	docs/Cluster-VictoriaMetrics.md: sync with cluster branch	2022-11-18 14:06:23 +02:00
Aliaksandr Valialkin	a061d33400	app/vmselect: clarify that it isnt recommended setting -replicationFactor at vmselect nodes even if the replication is enabled at vminsert nodes	2022-11-18 14:04:53 +02:00
Yury Molodov	519bd2af7b	vmui: add trace analyzer (#3310 ) * refactor: change structure project * refactor: change structure project * fix: add hooks for set query params * refactor: add index for pages * docs: add TESTCASES.md * refactor: restructure components * feat: add page with trace analyzer * fix: change detect trace data * Update app/vmui/packages/vmui/src/pages/TracePage/index.tsx Co-authored-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * Update app/vmui/packages/vmui/src/pages/TracePage/index.tsx Co-authored-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * fix: change descriptions on trace page * Update app/vmui/packages/vmui/src/pages/TracePage/index.tsx Co-authored-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * feat: add base components * feat: add reset styles * docs: add description about trace analyzer * feat: add styles for custom panel page * feat: add styles for predefined panels * feat: add style for TracingsView.tsx * feat: add Alerts * feat: add Tooltip.tsx * fix: correct styles * feat: add DatePicker.tsx * feat: add tables * feat: add theme provider * fix: replace using callbacks as props to handlers * fix: correct update time * fix: change TimePicker.tsx * fix: correct styles * fix: update packages * vmui: refactor code, remove material-ui * feat: add paste json for trace analyzer * vmui: update trace analyzer docs * app/vmselect/vmui: `make vmui-update` Co-authored-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-11-17 22:22:01 +02:00
Aliaksandr Valialkin	e79bfdf4b8	docs/CHANGELOG.md: document the fix for CPU usage spikes Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3343	2022-11-17 22:02:02 +02:00
Aliaksandr Valialkin	578bb58ea9	app/vmselect/vmui: `make vmui-update` after `51bfd1ab80`	2022-11-17 18:54:55 +02:00
Yury Molodov	51bfd1ab80	vmui: add ability hide query (#3359 ) * feat: add ability hide query * fix: change logic hide query * fix: remove console.log	2022-11-17 18:42:33 +02:00
Yury Molodov	bc8a782f74	vmui/refactor (#3298 ) * refactor: change structure project * refactor: change structure project * fix: add hooks for set query params * refactor: add index for pages * docs: add TESTCASES.md * refactor: restructure components * feat: add base components * feat: add reset styles * feat: add styles for custom panel page * feat: add styles for predefined panels * feat: add style for TracingsView.tsx * feat: add Alerts * feat: add Tooltip.tsx * fix: correct styles * feat: add DatePicker.tsx * feat: add tables * feat: add theme provider * fix: replace using callbacks as props to handlers * fix: correct update time * fix: change TimePicker.tsx * fix: correct styles * fix: update packages * vmui: refactor code, remove material-ui Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-11-17 01:09:14 +02:00
Aliaksandr Valialkin	a260e2659e	app/vmselect/promql: add `range_stdvar()` and `range_stddev()` functions for calculating variance and deviation over time series on the selected time range	2022-11-17 01:03:40 +02:00
Aliaksandr Valialkin	c1a3192d8b	app/vmselect/promql: add `range_linear_regression(q)` function for calculating simple linear regression for the selected time series on the selected time range	2022-11-17 00:38:48 +02:00
Aliaksandr Valialkin	c3362e3db4	lib/workingsetcache: add `-prevCacheRemovalPercent` command-line flag for tuning memory usage vs CPU usage ratio Reduce the default value of this flag from 1% to 0.2% after `71335e6024` This flag should help determining the best ratio for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3343	2022-11-16 12:39:39 +02:00
Aliaksandr Valialkin	09b79d74a7	docs/CHANGELOG.md: document changes in v1.79.5 release	2022-11-11 01:27:45 +02:00
Aliaksandr Valialkin	bbe1a1472c	docs/CHANGELOG.md: cut v1.83.1	2022-11-10 14:06:57 +02:00
Aliaksandr Valialkin	1b9dff133a	docs/CHANGELOG.md: document the fix at `71335e6024`	2022-11-10 13:46:51 +02:00
Aliaksandr Valialkin	b8839df32c	lib/protoparser/opentsdb: follow-up after `04b0e4e7bf` - Simplify the parser code to be less error prone - Document the change - Add a test for OpenTSDB put line with trailing whitespace without tags Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3290	2022-11-09 15:35:05 +02:00
Aliaksandr Valialkin	e17a1acf4a	docs/CHANGELOG.md: document `7130af7fd2` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2814	2022-11-09 12:15:49 +02:00
Denys Holius	aebe21e2c8	guides/README.md: fix link to guide-delete-or-replace-metrics.html (#3331 )	2022-11-09 12:00:46 +02:00
Aliaksandr Valialkin	c973aca617	app/vminsert/netstorage: move nodesHash from global state to storageNodesBucket This should prevent from panics when the list of discovered vmstorage nodes changes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3329	2022-11-09 11:51:10 +02:00
Roman Khavronenko	9f8bf524ad	bump go version to 1.19.3 (#3327 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-11-08 16:43:59 +01:00
Zakhar Bessarab	91dd79f40f	docs/operator: fix description for SA at VMClusterSpec (#3313 )	2022-11-07 16:51:01 +01:00
Aliaksandr Valialkin	7fa5d043f5	lib/promscrape/discovery/consul: add `__meta_consul_partition` label in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/11482	2022-11-07 15:25:53 +02:00
Aliaksandr Valialkin	daa70e6560	lib/storage: follow-up for `790768f20b` - Document the bugfix at docs/CHANGELOG.md - Simplify the bugfix a bit	2022-11-07 14:04:08 +02:00
Aliaksandr Valialkin	23c79e2e49	docs/Single-server-VictoriaMetrics.md: mention about security certifications at Security chapter This is a follow-up for `94bd49402e`	2022-11-05 10:07:29 +02:00
Aliaksandr Valialkin	4ef5fe1317	docs/guides/guide-vmcluster-multiple-retention-setup.md: clarify docs after `a75d85b11e`	2022-11-05 10:02:48 +02:00
Artem Navoiev	94bd49402e	docs: Add link to security page from Readme (#3286 ) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-11-04 09:49:12 +01:00
Dmytro Kozlov	99d8fcb332	docs/operator: change VMAgentRemoteWriteSettings.MaxDiskUsagePerURL type from int32 to int64 (#3307 ) * docs/operator: change VMAgentRemoteWriteSettings.MaxDiskUsagePerURL type from int32 to int64 * docs: operator updates api description Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-11-04 01:12:57 +01:00
Artem Navoiev	a75d85b11e	update multi-tenancy guide. Add infromation about Enterprise and Rete… (#3285 ) docs: update multi-tenancy guide Add information about Enterprise and Retention Filters Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-11-01 15:19:09 +01:00
Aliaksandr Valialkin	df88832c86	docs/Single-server-VictoriaMetrics.md: follow-up after `a1a97b9321` - Remove trailing whitespace at the end of lines - Remove redundant sentence stating that time series matching the given selector will be deleted. It should be clear from the surrounding context.	2022-11-01 10:49:10 +02:00
Dmytro Kozlov	a1a97b9321	docs: clarify information about usage of the `api/v1/admin/tsdb/delete_series` API (#3287 ) docs: clarify information about usage of the `api/v1/admin/tsdb/delete_series` API	2022-11-01 09:36:28 +01:00
Aliaksandr Valialkin	a1011931ac	docs/Release-Guide.md: instruct to update VictoriaMetrics version in deployment/docker/docker-compose*.yml files after creating new release This is a follow-up for `d1509f4559`	2022-11-01 10:31:02 +02:00
Aliaksandr Valialkin	619b3c926d	docs/enterprise.md: mention that feature requests from enterprise customers are prioritized	2022-11-01 10:28:12 +02:00
Aliaksandr Valialkin	0f8f36de24	docs: typo fixes	2022-10-29 04:52:18 +03:00
Aliaksandr Valialkin	740f7ac5e0	docs/CHANGELOG.md: cut v1.83.0	2022-10-29 02:54:54 +03:00
Aliaksandr Valialkin	cdd3443806	app/vmbackupmanager: add functionality for automated restore from backup	2022-10-29 02:30:52 +03:00
Aliaksandr Valialkin	76e8888272	lib/promscrape: properly add `exported_` prefix to labels, which clash with target labels if `honor_labels: true` option isn't set. The issue was in the `labels := dst[offset:]` line in the beginning of appendExtraLabels() function. The `dst` may be re-allocated when adding extra labels to it. In this case the addition of `exported_` prefix to labels inside `labels` slice become invisible in the returned `dst` labels. While at it, properly handle some corner cases: - Add additional `exported_` prefix to clashing metric labels with already existing `exported_` prefix. - Store scraped metric names in `exported___name__` label if scrape target contains `__name__` label. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3278 Thanks to @jplanckeel for the initial attempt to fix this issue at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3281	2022-10-28 22:14:26 +03:00
Aliaksandr Valialkin	9aee303ca1	docs/Cluster-VictoriaMetrics.md: improve docs for `dns+srv` service discovery	2022-10-28 14:24:48 +03:00
Aliaksandr Valialkin	a72c5f76eb	app/{vminsert,vmselect}: add support for automatic discovery and update of vmstorage nodes Thanks to @dmitryk-dk for the initial implemenation at https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/446	2022-10-28 13:13:45 +03:00
Aliaksandr Valialkin	a018b1d75e	app/vmalert/templates: properly escape all the special chars in `quotesEscape` function Previously the `quotesEscape` function was escaping only double quotes. This wasn't enough, since the input string could contain other special chars, which must be escaped when put inside JSON string. For example, carriage return and line feed chars (\n\r), backslash char, etc. This led to the following issues, which were improperly fixed: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890 - this issue was "fixed" by introducing the `crlfEscape` function, which led to unnecessary complications in user templates, while not fixing various corner cases such as backslash chars in the input string. See `1de15ad490` - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3139 - this issue was "fixed" by urlencoding the whole string passed to -external.alert.source command-line flag. This led to invalid urls, which couldn't be parsed by Grafana. See `00c838353d` and `4bd0244599` This commit properly encodes the input string passed to `quotesEscape`, so it can be safely embedded inside JSON strings. This commit deprecates crlfEscape template function and adds the following new template functions: - strvalue and stripDomain - these functions are supported by Prometheus, so they were added for compatibility purposes. - jsonEscape and htmlEscape for converting the input string to valid quoted JSON string and for html-escaping the input string, so it could be safely embedded as a plaintext into html. This commit also documents all supported template functions at https://docs.victoriametrics.com/vmalert.html#template-functions The deprecated crlfEscape function isn't documented on purpose, since its usefulness is negative in general case.	2022-10-28 00:01:16 +03:00
Aliaksandr Valialkin	4bd0244599	Revert "vmalert: escape query params if external alert source defined (#3267 )" This reverts commit `00c838353d`. Reason for revert: it incorrectly fixes the issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3139 . Now `-external.alert.source=explore?orgId=1&left=...` is converted to the following invalid url, which cannot be handled by Grafana: https://grafana.example.com/explore%3ForgId%3D1%26left%3D... The next commit will contain the correct fix of the issue - the `quotesEscape` function must properly escape the string, so it could be embedded into JSON string. This function must properly escape \n\r chars too. In this case the `crlfEscape` function becomes unnecessary. Actually, the next commit makes the `crlfEscape` function deprecated.	2022-10-27 22:30:27 +03:00
Dmytro Kozlov	00c838353d	vmalert: escape query params if external alert source defined (#3267 ) vmalert: escape query args if external alert source defined	2022-10-26 10:00:14 -04:00
Aliaksandr Valialkin	518c340ae3	lib/envtemplate: allow referring env vars from other env vars via %{ENV_VAR} syntax This is a follow-up for `02096e06d0`	2022-10-26 14:49:33 +03:00
Yury Molodov	eae6063450	fix: change step setting field (#3270 ) Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-10-26 02:46:46 +03:00
Yury Molodov	bc7456841f	vmui: add responsive styles for small screens (#3256 ) * fix: add responsive styles for small screens * fix: correct additional settings margins * docs/CHANGELOG.md: add responsive styles	2022-10-26 02:39:54 +03:00
Aliaksandr Valialkin	685433b8da	docs/Cluster-VictoriaMetrics.md: update docs about env vars usage in command-line flags This is a follow-up for `02096e06d0`	2022-10-26 01:54:15 +03:00
Aliaksandr Valialkin	02096e06d0	lib/envflag: allow referring environment variables in command-line flags	2022-10-26 01:52:05 +03:00
Aliaksandr Valialkin	5d82e7d64a	docs: run `make docs-sync` after `2ed3d49c26`	2022-10-26 01:14:31 +03:00
Aliaksandr Valialkin	db8abd000e	docs/Makefile: fix `docs-up` Makefile command after `9ccd22c1f6`	2022-10-25 17:53:24 +03:00
Denys Holius	9ccd22c1f6	Docs: add guide "How to delete and replace metrics" (#2829 ) docs: add guide how to delete and replace metrics	2022-10-25 09:02:14 -04:00
Aliaksandr Valialkin	15849cb571	docs/guides/migrate-from-influx.md: properly display images at https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/docs/guides/migrate-from-influx.md This is a follow-up for `42375679db`	2022-10-24 21:28:31 +03:00
Nguyen Van Duc	42375679db	Fix images not display on key concepts document (#3266 )	2022-10-24 21:22:41 +03:00
Aliaksandr Valialkin	b1324631b1	docs/CHANGELOG.md: document `274e235bf7` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3240	2022-10-24 21:02:17 +03:00
Aliaksandr Valialkin	c52c23c272	docs/enterprise.md: describe all the enteprise features in a short doc at https://docs.victoriametrics.com/enterprise.html	2022-10-24 18:02:03 +03:00
Aliaksandr Valialkin	cac28ae0ae	docs/CHANGELOG.md: typo fixes	2022-10-24 16:59:55 +03:00
Aliaksandr Valialkin	8e998aa1a1	lib/storage: add support for retention filters (aka multiple retentions for distinct sets of time series) Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/143 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/289	2022-10-24 16:40:20 +03:00
Aliaksandr Valialkin	d7e657e5f9	docs/CHANGELOG.md: document 69b27275d2b2bf1bdae0d8b887b44bde2a787649	2022-10-24 16:08:15 +03:00
Aliaksandr Valialkin	5e4dfe50c6	lib/storage: subsitute searchTSIDs functions with more lightweight searchMetricIDs function The searchTSIDs function was searching for metricIDs matching the the given tag filters and then was locating the corresponding TSID entries for the found metricIDs. The TSID entries aren't needed when searching for time series names (aka MetricName), so this commit removes the uneeded TSID search from the implementation of /api/v1/series API. This improves perfromance of /api/v1/series calls. This commit also improves performance a bit for /api/v1/query and /api/v1/query_range calls, since now these calls cache small metricIDs instead of big TSID entries in the indexdb/tagFilters cache (now this cache is named indexdb/tagFiltersToMetricIDs) without the need to compress the saved entries in order to save cache space. This commit also removes concurrency limiter during searching for matching time series, which was introduced in `8f16388428`, since the concurrency for all the read queries is already limited with -search.maxConcurrentRequests command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/648	2022-10-23 12:23:47 +03:00
Aliaksandr Valialkin	a10647e0bf	app/vmselect/promql: expose missing metric `vm_cache_size_max_bytes{type="promql/rollupResult"}`	2022-10-23 12:13:47 +03:00
Aliaksandr Valialkin	4cd173bbaa	lib/procutil: stop immediately after receiving the second SIGINT or SIGTERM signal Previously VictoriaMetrics apps could stop responding to SIGINT and SIGTERM signals if they hang for some reason in graceful shutdown procedure.	2022-10-20 21:40:20 +03:00
Aliaksandr Valialkin	cba9696a14	docs/CHANGELOG.md: move the BUGFIX line for `1059c4d84a` into correct place	2022-10-18 20:38:57 +03:00
Nikolay	1059c4d84a	lib/promscrape/discovery/kubernetes: correctly wrap error (#3250 ) * lib/promscrape/discovery/kubernetes: correctly wrap error follow-up after `1304824201` * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-10-18 20:37:42 +03:00
Roman Khavronenko	4e0ea95f26	vmalert: lower severity level for RW retries (#3237 ) The message about dropped data still remains at `error` level. The change supposed to make log message more clear about how serious it is. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-18 14:27:20 +02:00
Aliaksandr Valialkin	069401a304	all: log error when environment variables referred from `-promscrape.config` are missing This should prevent from using incorrect config files	2022-10-18 10:47:16 +03:00
Aliaksandr Valialkin	646fb17237	docs/MetricsQL.md: document that input histograms must have the same set of buckets when calculating the quantile over them Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3231	2022-10-14 13:59:58 +03:00
Aliaksandr Valialkin	adf3419699	docs/CHANGELOG.md: add a note that it is recommended to use v1.82.1 instead of v1.82.0	2022-10-14 13:41:01 +03:00
Aliaksandr Valialkin	3a0c69651a	docs/CHANGELOG.md: release v1.82.1	2022-10-14 11:33:25 +03:00
Aliaksandr Valialkin	2e3be68617	lib/bytesutil: make sure that the string passed to FastStringMather.Match() is copied before using it as a key in the internal cache map This prevents from possible corruption of the internal cache map when the underlying byte slice used by the string key is modified. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3227	2022-10-14 09:51:19 +03:00
Denys Holius	b1de74a6ba	k8s-monitoring-via-vm-cluster.md: remove extra spaces (#3234 )	2022-10-13 17:25:35 +02:00
Yury Molodov	ff6151fa49	vmui: limit number of plotted series (#3229 ) * feat: add maximum display series by tabs * feat: add warning on PredefinedPanels.tsx * docs/CHANGELOG.md: vmui limit number of plotted series * docs/CHANGELOG.md: vmui limit number of plotted series * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-10-13 12:13:47 +03:00
Aliaksandr Valialkin	e6fd33044f	app/vmselect/promql: follow-up for `930f1ee153` Document the change at docs/CHANGELOG.md Apply it to histogram_quantile() in the same way as to histogram_share() Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3225	2022-10-13 12:03:08 +03:00
Aliaksandr Valialkin	76e275ddef	docs/CHANGELOG.md: document `b856581ad3`	2022-10-13 10:35:48 +03:00
Dan Fredell	42ce4364fc	Multi retention standardization of docs (#3223 ) * Multi retention standardization of docs While reading through the docs the implementation details had different formatting for storageNode. This standardizes them and adds a link to the retention docs. * Update docs/guides/guide-vmcluster-multiple-retention-setup.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-10-13 10:27:16 +03:00
Roman Khavronenko	96a106eab2	vmalert: update troubleshooting docs (#3228 ) The default value of `-datasource.queryStep` has changed, so we update the troubleshooting docs accordingly. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-12 12:12:37 +02:00
Aliaksandr Valialkin	cfae887c75	docs/CHANGELOG.md: document `a4975ace86` The original commit, which led to the issue - `877940a131`	2022-10-12 09:30:36 +03:00
Aliaksandr Valialkin	41925a9500	docs/CHANGELOG.md: document 9544b5cacf7446203fac19eb7c575779dc9b280e	2022-10-12 09:25:17 +03:00
Aliaksandr Valialkin	a79272db1f	docs/vmbackup.md: run `make docs-sync` after `076e721c22`	2022-10-10 21:57:46 +03:00
Aliaksandr Valialkin	875abf0ef4	docs/CHANGELOG.md: document `e384d88abf`	2022-10-10 21:52:06 +03:00
Aliaksandr Valialkin	04a05f161c	app/vmselect: return back the logic for limits the amounts of memory occupied by concurrently executed queries if -search.maxMemoryPerQuery isn't set This is needed for preserving backwards compatibility with the previous releases of VictoriaMetrics. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-10 21:45:13 +03:00
Aliaksandr Valialkin	921918cb49	docs/sd_configs.md: document __scrape_timeout__, __scrape_interval__ and __series_limit__ labels	2022-10-09 15:05:30 +03:00
Aliaksandr Valialkin	50f5eae0e0	lib/promrelabel: remove unconditional sorting of the labels in ParsedConfigs.Apply(), since the sorting isnt needed in many places Sort labels explicitly after calling the ParsedConfigs.Apply() when needed. This reduces CPU usage when performing metric-level relabeling, where labels' sorting isn't needed.	2022-10-09 14:51:16 +03:00
Aliaksandr Valialkin	8e1ccecd97	docs: mention -search.maxMemoryPerQuery in the description to -search.maxConcurrentQueries command-line flag This is a follow-up for `5138eaeea0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-09 13:56:59 +03:00
Aliaksandr Valialkin	4f4d591ccb	docs/vmbackupmanager.md: update docs after adding the support to make backups to Azure blob storage This is a follow-up for `262ce77e2d`	2022-10-08 10:30:39 +03:00
Aliaksandr Valialkin	8f8ce5e238	docs: add description for -search.maxMemoryPerQuery command-line flag	2022-10-08 01:16:55 +03:00
Aliaksandr Valialkin	5138eaeea0	app/vmselect: allow limiting per-query memory usage via -search.maxMemoryPerQuery command-line flag Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-08 01:08:05 +03:00
Aliaksandr Valialkin	3aafbc3624	docs/CHANGELOG.md: add a link to a feature request for the feature, which allows specifying full scrape urls in `targets` list and in the `__address__` label Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3208	2022-10-07 23:45:57 +03:00
Aliaksandr Valialkin	5269b1ad77	lib/promscrape: allow controlling staleness tracking on a per-scrape_config basis Add support for no_stale_markers option at scrape_config section. See https://docs.victoriametrics.com/sd_configs.html#scrape_configs and https://docs.victoriametrics.com/vmagent.html#prometheus-staleness-markers	2022-10-07 23:36:14 +03:00
Aliaksandr Valialkin	93811da76d	docs/CHANGELOG.md: document the `27ed4b853e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3169 See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3196#issuecomment-1269765205	2022-10-07 23:06:32 +03:00
Aliaksandr Valialkin	b47caa86db	all: update the minimum required Go verson from 1.19.1 to 1.19.2 This is needed because of security vulnerabilities found in Go 1.19.1 See https://go.dev/doc/devel/release#go1.19.2	2022-10-07 22:43:37 +03:00
Aliaksandr Valialkin	f9df0cae16	lib/promscrape: allow specifying full target url in `__address__` label Previously the `__address__` label could contain only `host:port` part of the target url, while the scheme and metrics path were obtained from `__scheme__` and `__metrics_path__` labels. Now it is possible to set the full url in `__address__` label. This makes valid the following scrape config, which is frequently used by novice users: scrape_configs: - job_name: foo static_configs: - targets: - http://host1/metrics1 - https://host2/metrics2	2022-10-07 22:43:04 +03:00
Aliaksandr Valialkin	8bc840358f	docs/CHANGELOG.md: cut v1.82.0	2022-10-07 03:15:23 +03:00
Aliaksandr Valialkin	7b6ce3f75e	docs/CHANGELOG.md: typo fix	2022-10-07 03:11:22 +03:00
Aliaksandr Valialkin	ba4050ab1f	docs/CHANGELOG.md: add a changelog for v1.79.4 LTS release (copied from lts-1.79 branch)	2022-10-07 02:50:59 +03:00
Aliaksandr Valialkin	285e92706d	docs/MetricsQL.md: formatting improvements Also put a link to the function type in docs for every function. This should simplify understanding of MetricsQL functions for novice users.	2022-10-07 00:53:14 +03:00
Aliaksandr Valialkin	f452c84579	app/vmselect/promql: properly calculate `vm_rows_scanned_per_query` histogram for rollup functions, which take into account only a few samples on the provided lookbehind window	2022-10-06 23:22:24 +03:00
Aliaksandr Valialkin	40e899fd67	app/vmselect/promql: properly calculate `quantiles_over_time()` over a single raw sample	2022-10-06 22:37:21 +03:00
Aliaksandr Valialkin	8ae713253e	docs/CHANGELOG.md: remove duplicate description of the bugfix, which has been included in v1.81.2	2022-10-06 15:53:05 +03:00
Roman Khavronenko	5b10fa87b2	vmalert: fix misleading line regarding multitenancy (#3206 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-06 15:03:45 +03:00
Aliaksandr Valialkin	8d7910a463	docs/CHANGELOG.md: add missing link to /api/v1/export docs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3161	2022-10-06 15:02:13 +03:00
Aliaksandr Valialkin	d9282027e6	app: follow-up after `ec04fcac93` * Optimize fast path for /api/v1/import when importing numeric values * Move the docs about the change from features to bugfixes at docs/CHANGELOG.md * Update tests at lib/protoparser/vmimport Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3161	2022-10-06 14:52:02 +03:00
Dmytro Kozlov	ec04fcac93	Properly parse json when export import metric (#3180 ) * app/vmselect: properly work when export import json from `api/v1/{export, import}` API * app/vmselect: update convert function * app/vmselect: export null if `math.IsNaN(v)` * app/vmselect: get float from json * lib/protoparser: add test * docs: add change log * lib/protoparser: make export import api compatible	2022-10-06 13:54:20 +03:00
Aliaksandr Valialkin	dba49943d3	docs/Single-server-VictoriaMetrics.md: update docs after the `a54987f671`	2022-10-06 13:29:38 +03:00
Yury Molodov	a54987f671	vmui: maximum queries (#3196 ) vmui: allow using up 4 queries at the same time The change also introduces UI updates to make using multiple queries more conveniently.	2022-10-06 07:10:21 +02:00
Aliaksandr Valialkin	5307cf068f	docs: follow-up after `262ce77e2d` * Document the addition of Azure blob storage support in vmbackup / vmrestore * List the supported storage system types at docs/vmrestore.md * Mention about azblob storage system support at -src and -dst command-line flags for vmbackup / vmrestore tools. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1029	2022-10-06 00:35:34 +03:00
Aliaksandr Valialkin	f596e49881	docs/CHANGELOG.md: document f8ac55d70ada9ef8490b322abefb05f28f75e2e9	2022-10-06 00:05:37 +03:00
Aliaksandr Valialkin	c45c61cf93	app/vmalert: follow-up after f8ac55d70ada9ef8490b322abefb05f28f75e2e9 * Use vm_account_id and vm_project_id labels to be consistent with https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#multitenancy-via-labels * Document the feature that vmalert now exposes vm_account_id and vm_project_id labels if -clusterMode is set. * Use literal strings instead of string constants for vm_account_id and vm_project_id. This improves code readability.	2022-10-06 00:05:33 +03:00
Aliaksandr Valialkin	703094a37a	app/vmbackupmanager: expose `vm_backup_in_flight` metrics (follow-up after c6bca4a0b47b4f5626e1913d3480e62d657ed4cf)	2022-10-05 23:30:21 +03:00
Aliaksandr Valialkin	f9fc838b7b	app/vmalert: update -external.alert.source command-line flag description after `61544e13ad`	2022-10-05 22:52:38 +03:00
Aliaksandr Valialkin	440495df52	Makefile: fix sed command and if condition for Linux bash after `2d11896486`	2022-10-05 22:40:04 +03:00
Roman Khavronenko	61544e13ad	vmalert: allow using `{{$labels}}` for templating in `-external.alert.source` (#3194 ) The change is supposed to provide additional flexibility for generating alert's source link based on label values. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-05 19:25:03 +02:00
Dmytro Kozlov	e0ea76db62	docs: add cardinality explorer blog post (#3198 ) docs: add cardinality explorer blog post	2022-10-05 13:19:41 +02:00
Roman Khavronenko	2d11896486	docs: udpate Datadog section (#3190 ) The `docs-sync` command was updated to modify images path for assets in `docs/` folder. The change allows to refer images from `docs` without copying them to the root folder. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-10-03 13:13:07 +02:00
Yurii Kravets	272f00dbb6	docs: Update How to send data from DataDog agent (#3168 ) docs: Update How to send data from DataDog agent	2022-10-03 11:45:05 +02:00
Aliaksandr Valialkin	c53b7e66ef	app/vmselect: improve performance scalability on multi-CPU systems for `/api/v1/export/...` endpoints	2022-10-01 22:05:43 +03:00
Aliaksandr Valialkin	fcc7ab71b3	app/vmselect: do not export NaN values for stale metrics at /federate endpoint Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3185	2022-10-01 19:47:37 +03:00
Aliaksandr Valialkin	7812761ab4	docs/Cluster-VictoriaMetrics.md: add a security note for multitenant support via labels	2022-10-01 18:57:28 +03:00
Aliaksandr Valialkin	d7327d2f02	docs/vmagent.md: fix incorrect url for multitenant writes to VictoriaMetrics cluster	2022-10-01 18:51:37 +03:00
Aliaksandr Valialkin	0dc93cca7f	app/vmagent/remotewrite: allow specifying per-`-remoteWrite.url` disk limits for persistent queue with pending data This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3071 Related issue: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2970	2022-10-01 18:40:59 +03:00
Aliaksandr Valialkin	a296994fed	app/vmauth: do not remove trailing slash from the proxied path This should fix the issue with opening VMUI at /vmui/ page. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1752	2022-10-01 16:52:30 +03:00
Aliaksandr Valialkin	4998402004	lib/promscrape: add `external_labels` from `global` section of `-promscrape.config` after the relabeling is applied to the scraped metrics This aligns with Prometheus behaviour. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3137	2022-10-01 16:13:19 +03:00
Aliaksandr Valialkin	973ce4b561	app/vmagent: accept requests with `/prometheus` and `/influx` path prefixes in the same way as VictoriaMetrics does This allows using vmagent as a drop-in replacement for VictoriaMetrics for push protocols.	2022-10-01 14:10:48 +03:00
Aliaksandr Valialkin	63a94b1d54	docs/vmagent.md: formatting fixes	2022-10-01 13:36:24 +03:00
lionelee	1fda517af9	docs/vmagent.md: fix typo (#3186 )	2022-10-01 12:30:01 +03:00
Aliaksandr Valialkin	db16759c68	lib/storage: optimize matching speed for non-trivial regexp filters Wrap re.Match into bytesutil.FastStringMatcher. This increases performance for `{foo=~"complex_regex_here"}` filters by up to 4x.	2022-10-01 12:06:06 +03:00
Aliaksandr Valialkin	9e8fbef27e	docs/CHANGELOG.md: clarify the description of the improvement in relabeling performance	2022-10-01 11:54:48 +03:00
Aliaksandr Valialkin	c54e14cdec	lib/promscrape/discovery/ec2: expose __meta_ec2_region label in the same way as Prometheus 2.39 does See https://github.com/prometheus/prometheus/pull/11326	2022-09-30 20:48:32 +03:00
Aliaksandr Valialkin	d0b7172316	app/vminsert: remove support for undocumented VictoriaMetrics_AccountID and VictoriaMetrics_ProjectID labels in tcp-based data ingestion endpoints These labels are substituted by documented vm_account_id and vm_project_id labels. See https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#multitenancy-via-labels This is a follow up for `505d359b39`	2022-09-30 18:35:53 +03:00
Nikolay	33f40f4a5f	app/vminsert: allows parsing tenant id from labels (#3009 ) * app/vminsert: allows parsing tenant id from labels it should help mitigate issues with vmagent's multiTenant mode, which works incorrectly at heavy load and it cannot handle more then 100 different tenants. This functional hidden with flag and do not change vminsert default behaviour https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2970 * Update docs/Cluster-VictoriaMetrics.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip * app/vminsert/netstorage: clean remaining labels in order to free up GC * docs/Cluster-VictoriaMetrics.md: typo fix * wip * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 18:35:53 +03:00
Roman Khavronenko	740bb2cc00	vmalert: support auth configs per static_target (#3188 ) Allow configuring authorization params per list of targets in vmalert's notifier config for `static_configs`. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2690 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-30 17:10:17 +02:00
Aliaksandr Valialkin	a18d6d5ccc	lib/promrelabel: optimize `action: replace` for non-trivial regex values Cache `action: replace` results for non-trivial regexs and return them next time instead of performing CPU-intensive regex replacement. Optimize also `action: labelmap_all` and `action: replace_all` in the same way.	2022-09-30 12:25:05 +03:00
Dmytro Kozlov	e220bc3cd5	docs, app/vmgateway: add description about new `auth.httpHeader` flag (#3134 ) * docs, app/vmgateway: add description about new `auth.httpHeader` flag * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 08:55:12 +03:00
Aliaksandr Valialkin	b70f815dc4	app/vmselect/promql: remove empty series before applying aggregate function Previously empty series (e.g. series with all NaN samples) were passed to aggregate functions. Such series must be ingored by all the aggregate functions. So it is better from consistency PoV filtering out empty series before applying aggregate functions.	2022-09-30 08:39:54 +03:00
Roman Khavronenko	b64b9b9fec	app/vmselect: ignore empty series for `limit_offset` (#3178 ) * app/vmselect: ignore empty series for `limit_offset` VictoriaMetrics doesn't return empty series (with all NaN values) to the user. But such series are filtered after transform functions. It means `limit_offset` will account for empty series as well. For example, let's consider following data set: ``` time series: foo{label="1"} NaN, NaN, NaN, NaN // empty series foo{label="2"} 1, 2, 3, 4 foo{label="3"} 4, 3, 2, 1 ``` When user requests all series for metric `foo` the empty series will be filtered out: ``` /query=foo: foo{label="v2"} 1, 2, 3, 4 foo{label="v3"} 4, 3, 2, 1 ``` But `limit_offset(1, 1, foo)` is applied to original series, not filtered yet. So it will return `foo{label="v2"}` (skips the first in list) ``` /query=limit_offset(1, 1, foo): foo{label="v2"} 1, 2, 3, 4 ``` Expected result would be to apply `limit_offset` to already filtered list, so in result we receive `foo{label="v3"}`: ``` /query=limit_offset(1, 1, foo): foo{label="v3"} 4, 3, 2, 1 ``` The change does exactly that - filters empty series before applying `limit_offset`. Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmselect: ignore empty series for `limit_offset` Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-30 08:20:34 +03:00
Aliaksandr Valialkin	fda60b3d4d	lib/promrelabel: properly parse regex with escaped $ at the end Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3131 Thanks to @dmitryk-dk for the initial fix at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3179	2022-09-30 08:15:43 +03:00
Aliaksandr Valialkin	bf2f14a3a6	docs/CHANGELOG.md: document `39f559d22b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3013	2022-09-30 07:48:25 +03:00
Nikolay	f61b8cec69	lib/awsapi: fixes sign encoding (#3183 ) * lib/awsapi: fixes sign encoding previously white spaces at filter were incorrectly encoded encoding tip was copied from aws signing lib For example, the space character must be encoded as %20 (not using '+', as some encoding schemes do) https://docs.aws.amazon.com/general/latest/gr/sigv4-create-canonical-request.html https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3171 * Update lib/awsapi/sign.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 07:43:44 +03:00
nemobis	6a818dbddf	docs: fix typo in Cluster-VictoriaMetrics.md (#3172 )	2022-09-28 09:18:29 +02:00
panguicai	fbc85e654c	docs: fix typo for vmalert docs (#3173 ) Signed-off-by: panguicai008 <1121906548@qq.com>	2022-09-28 09:15:05 +02:00
Roman Khavronenko	4ad3b36630	docs: update img for key concepts (#3176 ) Make dots bigger for range_query, so it will be easier to read the graph. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-27 21:22:59 +02:00
Dmytro Kozlov	6ab1cede62	lib/{httpserver,netutil}: allow to define min and max TLS version of the http server (#3109 ) * lib/{httpserver,netutil}: allow to define min and max TLS version of the http server * lib/httpserver: added descriptions about tls supported versions * lib/netutil: check minimal tls version, added supported tls versions to error * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 17:35:45 +03:00
Denys Holius	d63410bf6f	docs: managed_victoriametrics/quickstart.md fix image link (#3165 )	2022-09-26 16:35:18 +02:00
Roman Khavronenko	36a9a834b3	docs: clarify numeric label values for `label_value` (#3129 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3114 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-26 16:48:38 +03:00
Max Golionko	d67948b8e3	added security policy (#3140 ) * added security policy * Update SECURITY.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:47:02 +03:00
Roman Khavronenko	e96ccf3f71	lib/mergeset: follow-up after `a0e7432e42` (#3145 ) * lib/mergeset: follow-up after `a0e7432e42` Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 16:39:56 +03:00
Aliaksandr Valialkin	72c29d762e	docs/CHANGELOG.md: document `f022296d96` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3147	2022-09-26 16:32:19 +03:00
Aliaksandr Valialkin	a2431c2a88	docs/CHANGELOG.md: document `166d444159`	2022-09-26 15:39:14 +03:00
Aliaksandr Valialkin	41f8c2987d	lib/protoparser/graphite: accept whitespace in metric names and tags according to the specification Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/99 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3102 See the specification https://graphite.readthedocs.io/en/latest/tags.html	2022-09-26 15:17:25 +03:00
Aliaksandr Valialkin	5983ecf4d1	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics sanitizes metric names in DataDog data by default This is a follow-up for `7c2474dac7`	2022-09-26 14:02:43 +03:00
Aliaksandr Valialkin	7c2474dac7	lib/protoparser/datadog: sanitize metric names by default in the same way as DataDog does This commit is based on the pull request https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3105 Thanks to @PerGon for the idea and initial implementation.	2022-09-26 13:57:23 +03:00
Aliaksandr Valialkin	fcffdba9dc	app/{vmagent,vminsert}: add `-usePromCompatibleNaming` command-line flag for normalizing metric names and label names in the ingested samples Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3113 Thanks to @erkexzcx for the idea and the initial pull request at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3146	2022-09-26 13:11:39 +03:00
Aliaksandr Valialkin	819aa95552	docs/vmalert.md: follow-up for `0c95f928ae` - Clarify the description for -datasource.queryStep command-line flag - Consistently use a single dash in front of -datasource.queryStep command-line flag - Update -help output at docs/vmalert.md	2022-09-26 08:47:31 +03:00
Aliaksandr Valialkin	6b71f33c8b	docs/vmalert.md: follow-up after `7748a9d629` - Consistently use single dash in front of command-line flags instead of double dashes. - Add a warning that too small -search.latencyOffset may lead to incomplete query results.	2022-09-26 08:36:24 +03:00
Aliaksandr Valialkin	b68cd810fc	docs: follow-up for `03d54ac890` - Typo fix: 'adn' -> 'and' - Remove duplicate link to https://victoriametrics.com/blog/victoriametrics-monitoring/ from docs/Articles.md . The initial link has been already added in `27254096b2`	2022-09-26 08:26:38 +03:00
Roman Khavronenko	0c95f928ae	vmalert: set default value for `datasource.queryStep` to `5m` (#3149 ) Change default value for command-line flag `datasource.queryStep` from `0s` to `5m`. Param `step` is added by vmalert to every rule evaluation request sent to datasource. Before this change, `step` was equal to group's evaluation interval by default. Param `step` for instant queries defines how far VM can look back for the last written data point. The change supposed to improve reliability of the rules evaluation when evaluation interval is lower than scraping interval. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 10:22:53 +02:00
Roman Khavronenko	7748a9d629	vmalert: add info about `search.latencyOffset` to Troubleshooting (#3151 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 09:49:14 +02:00
Roman Khavronenko	03d54ac890	docs: mention VictoriaMetrics Monitoring blog post (#3152 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 07:12:15 +02:00
Aliaksandr Valialkin	27254096b2	docs/Articles.md: add a link to https://victoriametrics.com/blog/victoriametrics-monitoring/	2022-09-22 19:17:10 +03:00
Aliaksandr Valialkin	a3e536c0e7	docs/Articles.md: add a link to https://dataswamp.org/~solene/2022-09-11-exploring-monitoring-stacks.html	2022-09-22 19:17:10 +03:00
Roman Khavronenko	5714a68ac6	deployment/docker: move cluster compose env to master branch (#3130 ) * deployment/docker: move cluster compose env to master branch The change supposed to simplify the process of maintaining for single/cluster docker-compose envs, alerts, dashboards. It also supposes to reduce confusion for users when looking for cluster related alerts/configs. Signed-off-by: hagen1778 <roman@victoriametrics.com> * deployment/docker: move cluster compose env to master branch Review updates. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-21 11:48:38 +03:00
Aliaksandr Valialkin	1aef635de4	docs/CHANGELOG.md: clarify the change at `622bbedbe1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3119	2022-09-19 15:02:05 +03:00
Aliaksandr Valialkin	584a5d6b1f	docs/managed_victoriametrics/quickstart.md: small fixes after `606166ef68`	2022-09-19 14:52:46 +03:00
Roman Khavronenko	622bbedbe1	vmalert: always re-evaluate Annotations (#3119 ) * vmalert: always re-evaluate Annotations Previously, Annotations were evaluated only: 1. On alert creating. 2. On alert's value change. This is premature optimization. It was assumed that since annotations could contain only text with alert's labels or value - there is no need in spending resources to re-compile Annotations. Later, template function `query` was added, which can execute arbitrary queries and return different results on every evaluation. So if it was used in annotations, it would be executed only on init or value change. Another case when optimization caused an issue - annotations hot reload. In this case, annotations of the active alert won't change even if Rule's annotations were changed. This fix enables Annotations re-evaluation on each iteration to resolve issues above. It would have some impact on performance, but it is unlikely it will be noticeable. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: add tp Changelog Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-16 16:19:10 +02:00
Roman Khavronenko	3484673566	vmalert: add Troubleshooting section to docs (#3115 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-15 16:15:39 +02:00
Dmytro Kozlov	606166ef68	docs/managed_victoriametrics: add how to restore password section (#3116 ) docs/managed_victoriametrics: add how to restore password section	2022-09-15 16:02:31 +02:00
Aliaksandr Valialkin	455002922e	docs/Cluster-VictoriaMetrics.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:58 +03:00
Aliaksandr Valialkin	e7995375b5	docs: update `-help` output after explicit mentioning of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	4193af4571	docs/vmauth.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	3b2599c659	docs/vmalert.md: update `-help` output after explicit marking of enterprise flags	2022-09-15 13:22:57 +03:00
Aliaksandr Valialkin	bbecd27557	docs: update docs with explicitly marked enterprise command-line flags for VictoriaMetrics and vmagent	2022-09-15 13:22:56 +03:00
Dmytro Kozlov	a9629cc32d	app/vmctl: add description about `influx-skip-database-label` flag (#3111 )	2022-09-15 10:46:54 +02:00
Aliaksandr Valialkin	b869c757a9	docs/FAQ.md: add an answer for `What is the difference between single-node and cluster versions of VictoriaMetrics?`	2022-09-15 09:56:41 +03:00
Dmytro Kozlov	b75f1854c5	vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) (#2982 ) * vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) * vmselect/promql: fix tests, add documentation * vmselect/promql: update test * vmselect/promql: update for alphanumeric sorting, fix tests * vmselect/promql: remove comments * vmselect/promql: cleanup * vmselect/promql: avoid memory allocations, update functions descriptions * vmselect/promql: make linter happy (remove ineffectual assigment) * vmselect/promql: add test case, fix behavior when strings are equal * vendor: update github.com/VictoriaMetrics/metricsql from v0.44.1 to v0.45.0 this adds support for sort_by_label_numeric and sort_by_label_numeric_desc functions * wip * lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage. * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-14 17:41:09 +03:00
Aliaksandr Valialkin	5306f79fd1	docs/Articles.md: add a link to https://www.groundcover.com/blog/prometheus-grafana-kubernetes	2022-09-14 15:11:19 +03:00
Roman Khavronenko	877940a131	vmalert: add experimental feature of storing Rule's evaluation state (#3106 ) vmalert: add experimental feature of storing Rule's evaluation state The new feature keeps last 20 state changes of each Rule in memory. The state are available for view on the Rule's view page. The page can be opened by clicking on `Details` link next to Rule's name on the `/groups` page. States change suppose to help in investigating cases when Rule doesn't generate alerts or records. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 14:04:24 +02:00
Roman Khavronenko	efea51a9ee	bump Go version to 1.19.1 (#3108 ) The reason is to cover vulnerability GO-2022-0969 Found in: net/http@go1.18.5 Fixed in: net/http@go1.19.1 More info: https://pkg.go.dev/vuln/GO-2022-0969 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-14 12:29:19 +02:00
Aliaksandr Valialkin	74c00a8762	lib/promscrape: read response body into memory in stream parsing mode before parsing it This reduces scrape duration for targets returning big responses. The response body was already read into memory in stream parsing mode before this change, so this commit shouldn't increase memory usage.	2022-09-14 13:15:29 +03:00
Aliaksandr Valialkin	3af24a5b7c	docs: consistently use docs.victoriametrics.com instead of victoriametrics.github.io in all the links	2022-09-13 16:50:13 +03:00
Aliaksandr Valialkin	0ead64b6cf	app/vmalert: follow-up after `8441375da2` - Rename logDebug() to logDebugf() and pass format string together with format args directly to logDebugf(). This eliminates fmt.Sprintf() overhead at logDebug() call site when debugging is disabled. - Format labels in debug message in Prometheus format, e.g. {label1="value1",...labelN="valueN"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025	2022-09-13 16:35:14 +03:00
Roman Khavronenko	8441375da2	vmalert: add `debug` mode for alerting rules (#3055 ) * vmalert: add `debug` mode for alerting rules Debug information includes alerts state changes and requests sent to the datasource. Debug can be enabled only on rule's level. It might be useful for debugging unexpected behaviour of alerting rule. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3025 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: review fixes Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update app/vmalert/alerting.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> * vmalert: go fmt Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-13 16:25:43 +03:00
Aliaksandr Valialkin	25c9a1604a	docs/CHANGELOG.md: document atomic directory deletion Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3038	2022-09-13 16:17:39 +03:00
Aliaksandr Valialkin	db4f0fe6fc	docs/ExtendedPromQL.md: move the page to the bottom of the contents list at http://docs.victoriametrics.com	2022-09-13 16:17:37 +03:00
Aliaksandr Valialkin	e041c913bd	Revert "docs/ExtendedPromQL.md: remove outdated doc" This reverts commit `971e3d83f7`. Reason for revert: the ExtendedPromQL doc is still referred from third-party sites.	2022-09-13 16:17:37 +03:00
Craig Rodrigues	57ea8dbb36	docs: Use headings in DataDog section to make things easier to read (#3089 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-12 10:58:25 +03:00
Yury Molodov	1b41169415	vmui: fix data processing (#3092 ) * fix: change data processing * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-12 10:55:11 +03:00
Aliaksandr Valialkin	c48ff746c6	docs/FAQ.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/ to `VictoriaMetrics vs Mimir` chapter	2022-09-12 10:37:28 +03:00
Aliaksandr Valialkin	c4af0e833a	docs/Articles.md: add a link to https://victoriametrics.com/blog/mimir-benchmark/	2022-09-11 15:23:35 +03:00
Yury Molodov	9541ef2e9e	vmui: add lists of top queries (#3065 ) * feat: add lists of top queries * fix: change the field label * refactor: add handlers for readability * app/vmselect: `make vmui-update` * docs: document `top queries` tab Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-08 21:43:37 +03:00
John Belmonte	defced2599	MetricsQL doc spellcheck (#3080 )	2022-09-08 21:28:03 +03:00
Aliaksandr Valialkin	53b0c2eee4	docs/CHANGELOG.md: document `ec273eafef` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3076	2022-09-08 21:25:30 +03:00
Aliaksandr Valialkin	b9231c715a	docs/Release-Guide.md: require manual push of the created release tags to public Github The automated push of release tags to Github require specifying the remote repository name when doing `git push <remote-repo-name> v1.xx.y`. The remote repository name can differ in different environments, so it cannot be put into Makefile rule. TODO: create a Makefile rule, which generates standard remote names for public and private repositories in Git, so `git push` for release tags could be automated then.	2022-09-08 15:00:18 +03:00
Aliaksandr Valialkin	07441b1cee	app/vmselect/netstorage: fix a typo, which leads to incorrect query results in VictoriaMetrics cluster The typo has been introduced in the commit `1a254ea20c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3067	2022-09-08 13:48:20 +03:00
Aliaksandr Valialkin	9f20d01a81	Revert "docs: add `Monitoring at scale with Victoria Metrics` (#3078 )" This reverts commit `f24572fa65`, because the article https://tech.bedrockstreaming.com/2022/09/06/monitoring-at-scale-with-victoriametrics.html has been already added at `09ff3f1928`	2022-09-08 11:05:25 +03:00
Roman Khavronenko	f24572fa65	docs: add `Monitoring at scale with Victoria Metrics` (#3078 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-06 16:29:48 +02:00
Max Golionko	7da9443686	moved cluster dashboard to master (#3074 ) dashboards: move cluster dashboard to master branch This change should simplify dashboards management.	2022-09-06 16:19:43 +02:00
Aliaksandr Valialkin	ef7fdbb63c	docs/Single-server-VictoriaMetrics.md: add a note that cardinality explorer at cluster version of VictoriaMetrics may return lower than expected number of unique label values See the corresponding comment in the code: `5a6e617b5e/app/vmselect/netstorage/netstorage.go (L1039-L1045)`	2022-09-06 14:46:35 +03:00
Aliaksandr Valialkin	09ff3f1928	docs/Articles.md: add https://tech.bedrockstreaming.com/2022/09/06/monitoring-at-scale-with-victoriametrics.html	2022-09-06 13:32:41 +03:00
Aliaksandr Valialkin	651ace6ce4	docs/vmctl.md: `make docs-sync` after `c5261d5f56` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 13:19:48 +03:00
Aliaksandr Valialkin	5fa9525498	lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block This should reduce chances of unnoticed on-disk data corruption. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011 This change modifies the format for data exported via /api/v1/export/native - now this data contains MaxTimestamp and PrecisionBits fields from blockHeader. This is OK, since the native export format is undocumented.	2022-09-06 13:08:09 +03:00
Zakhar Bessarab	c5261d5f56	vmctl: implement support of chunking data for vm-native export (#3044 ) vmctl: implement support of chunking data for vm-native export process See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2733	2022-09-06 09:09:34 +02:00
Craig Rodrigues	462fc7b394	docs: Clarify DataDog examples for VictoriaMetrics cluster (#3048 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-09-05 16:25:05 +02:00
Yurii Kravets	7b04112352	docs: Update keyConcepts (#3040 ) docs: update keyConcepts Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-09-05 13:59:28 +02:00
Aliaksandr Valialkin	ae31b2363f	app/vmselect/prometheus: follow-up after `50e2524bc2` - Add getCommonParamsWithDefaultDuration function and use it at /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the default behaviour for setting 5 minutes time range if start arg isn't passed to /api/v1/series, /api/v1/labels and /api/v1/label/.../values - Document the change at docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3052	2022-09-05 11:55:48 +03:00
Aliaksandr Valialkin	7dc632719d	app/vmselect/promql: consistently calculate `rate_over_sum(m[d])` as `sum_over_time(m[d])/d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3045	2022-09-02 23:18:04 +03:00
Aliaksandr Valialkin	ac98ecdc1d	docs/CHANGELOG.md: cut v1.81.1	2022-09-02 21:58:28 +03:00
Aliaksandr Valialkin	08538ff82a	app/vmselect/netstorage: fix potential panic under high load The panic may trigger during data blocks' processing received from vmstorage nodes when some of vmstorage nodes return an error or when `-replicationFactor` is set to values higher than 2 at `vmselect`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3058	2022-09-02 21:38:27 +03:00
Aliaksandr Valialkin	4076277cf0	app/vmselect/promql: evaluate `union()` args in parallel in order to increase query performance Note that the parallel execution of `union()` args may take more memory and CPU time than the sequential execution if args contain heavy queries, which may load all the available CPU, disk and memory resources and vmselect and vmstorage levels.	2022-09-02 19:46:27 +03:00
Aliaksandr Valialkin	f9d4ade35a	docs/Articles.md: add a link to https://aatarasoff.medium.com/optimizing-linkerd-metrics-in-prometheus-de607ec10f6b	2022-08-31 05:03:22 +03:00
Aliaksandr Valialkin	b26de84b4a	docs/FAQ.md: mention that single-node vm is easier to setup and operate than the cluster version of vm	2022-08-31 05:02:15 +03:00
Aliaksandr Valialkin	6b0050a028	docs/CHANGELOG.md: cut v1.81.0	2022-08-31 02:33:23 +03:00
Max Golionko	c685afebb2	simplify release process (#3012 ) * simplify release process * address comments * address comments * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-31 02:27:24 +03:00
Aliaksandr Valialkin	6c5d5bc7e6	docs/CHANGELOG.md: add missing link to vmagent	2022-08-31 02:21:44 +03:00
Aliaksandr Valialkin	c84e6429a0	docs/CHANGELOG.md: document v1.79.3 LTS release	2022-08-31 00:22:31 +03:00
Aliaksandr Valialkin	022bb62fa1	docs: clarify why cluster version is recommended to use for serving high loads	2022-08-31 00:22:30 +03:00
Craig Rodrigues	a54d7c24ff	docs: Add DataDog to list of ingestion methods (#3047 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org>	2022-08-31 00:21:53 +03:00
Craig Rodrigues	e68a97f8d4	docs: add https://github.com/VictoriaMetrics/ansible-playbooks to README.md (#3046 ) Signed-off-by: Craig Rodrigues <rodrigc@crodrigues.org> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2022-08-30 20:52:24 +02:00
Aliaksandr Valialkin	bcdba8be18	docs/FAQ.md: add chapters explaining main differences between single-node and cluster versions of VictoriaMetrics - Which type of VictoriaMetrics is better to use in production? - How to migrate data from single-node VictoriaMetrics to cluster?	2022-08-30 13:12:03 +03:00
Artem Navoiev	5d4b1bc742	update multi-region guide, specify multi-level vmselect option (#3039 ) * update multi-region guide, specify multi-level vmselect option Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * add more references * Apply suggestions from code review Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-30 12:26:23 +03:00
Aliaksandr Valialkin	1eec2460ba	docs: fix links to DogStatsD Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3042	2022-08-30 10:49:26 +03:00
Aliaksandr Valialkin	d2e94ee91a	docs/CHANGELOG.md: document the `044d51b668`	2022-08-30 09:42:19 +03:00
Aliaksandr Valialkin	ad11b8d83d	app/vmselect/promql: follow-up after `2d71b4859c` - Use getScalar() function for obtaining the expected scalar from phi arg - Reduce the error message returned to the user when incorrect phi is passed to histogram_quantiles - Improve the description of this bugfix in the docs/CHANGELOG.md Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3026	2022-08-27 01:35:49 +03:00
Dmytro Kozlov	2d71b4859c	vmselect/promql: fix panic in histogram_quantiles function (#3029 ) * vmselect/promql: fix panic in histogram_quantiles function * Update docs/MetricsQL.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-08-27 01:33:56 +03:00
Aliaksandr Valialkin	c06e7a142c	lib/promscrape: optimize discoveryutils.SanitizeLabelName() Cache sanitized label names and return them next time. This reduces the number of allocations and speeds up the SanitizeLabelName() function for common case when the number of unique label names is smaller than 100k	2022-08-27 00:17:45 +03:00
Aliaksandr Valialkin	7afe8450fc	lib/promrelabel: optimize matching for commonly used regex patterns in `if` option The following regex patterns are optimized: - literal string match, e.g. "foo" - prefix match, e.g. "foo." and "foo.+" - substring match, e.g. ".foo.*" and ".+foo.+" - alternate values match, e.g. "foo\|bar\|baz"	2022-08-26 14:53:06 +03:00
Aliaksandr Valialkin	0d4ea03a73	lib/promrelabel: optimize `action: {labeldrop,labelkeep,keep,drop}` with `regex` containing alternate values For example, the following relabeling rule must work much faster now: - action: labeldrop regex: "foo\|bar\|baz"	2022-08-24 17:54:29 +03:00
Aliaksandr Valialkin	cdffe401e4	app/vmagent: follow-up after `2b22aa1537` - Document the change at docs/CHANGELOG.md - Move auth token parsing from app/vmagent/opentsdbhttp/ to app/vmagent/main.go, since it must be parsed only when multitenancy support is enabled at vmagent side. See https://docs.victoriametrics.com/vmagent.html#multitenancy	2022-08-24 16:18:59 +03:00
Dmytro Kozlov	463ea6897b	vmselect/promql: enable search.maxPointsSubqueryPerTimeseries for sub-queries (#2963 ) * vmselect/promql: enable search.maxPointsPerTimeSeriesSubquery for sub-queries * vmselect/promql: cleanup * vmselect/promql: rename config flag * vmselect/promql: add tests * vmselect/promql: use test object instead of log * vmselect/promql: fix posible panic is subquery has more points. add description * vmselect/promql: update tests descriptions * vmselect/promql: update doInternal validation * vmselect/promql: fix linter * vmselect/promql: fix linter * vmselect/promql: update documentation and release notes * wip - Properly apply -search.maxPointsSubqueryPerTimeseries limit to subqueries. Previously the -search.maxPointsPerTimeseries limit was unexpectedly applied to subqueries if it was smaller than the -search.maxPointsSubqueryPerTimeseries . - Clarify docs for -search.maxPointsSubqueryPerTimeseries command-line flag . - Document -search.maxPointsPerTimeseries and -search.maxPointsSubqueryPerTimeseries flags at https://docs.victoriametrics.com/#resource-usage-limits . - Update docs/CHANGELOG.md . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2922 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-24 15:25:18 +03:00
Aliaksandr Valialkin	3d12ee47f9	docs: mention that it is safe sharing the collected profiles from security PoV The collected profiles do not contain sensitive information	2022-08-24 14:07:36 +03:00
Aliaksandr Valialkin	796aa310c2	app/vmstorage: expose `vm_{hourly,daily}_series_limit_{max,current}_series` metrics if `-storage.max{Hourly,Daily}Series` limits are set These metrics allow alerting when the number of unique series approach the limit. For example, the following query alerts when the number of series reaches 90% of the configured limit: vm_hourly_series_limit_current_series / vm_hourly_series_limit_max_series > 0.9	2022-08-24 13:44:04 +03:00
Aliaksandr Valialkin	b1e1c50627	all: update Google Analytics tracking code from Unversal Analytics to v4 This is needed because Google Analytics devs decided to force their users to update all their tracking codes to GA v4. See https://support.google.com/analytics/answer/9744165 The link to the new tracking property ( G-N9SVT8S3HK ) - https://analytics.google.com/analytics/web/?authuser=1#/a129683199p328513681/admin/streams/table/4004610168	2022-08-24 12:16:37 +03:00
Aliaksandr Valialkin	c011fb0f30	docs/vmagent.md: fix alerting query when scraped samples are dropped because of exceeded series limit This is a follow-up after `7d26414b2e`	2022-08-24 01:18:31 +03:00
Roman Khavronenko	8d0f5b9e60	docs: follow-up after `88425bb285` (#3007 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-22 13:49:17 +02:00
laixintao	88425bb285	vmalert: add $activeAt into template variables. (#3000 ) vmalert: add `$activeAt` template variable for annotations https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2999	2022-08-22 13:32:36 +02:00
Aliaksandr Valialkin	6e4e3fae63	docs/CHANGELOG.md: document `d59d829cdb` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2673	2022-08-21 23:35:47 +03:00
Ivan Dudin	f69990ba10	Update Cluster-VictoriaMetrics.md (#3005 ) Flags `-search.maxTagKeys` and `-search.maxTagValues` are present at vmstorage and not at vmselect ``` # ./vmselect-prod -h \| egrep 'search.maxTagKeys\|search.maxTagValues' # ./vmstorage-prod -h \| egrep 'search.maxTagKeys\|search.maxTagValues' -search.maxTagKeys int -search.maxTagValues int ```	2022-08-21 23:28:40 +03:00
Aliaksandr Valialkin	22aa07b8c9	docs/Cluster-VictoriaMetrics.md: document the best strategies for cluster update / upgrade	2022-08-21 23:21:02 +03:00
Aliaksandr Valialkin	8550c44e31	app/vmagent: add ability to construct a label from multiple existing labels by referring them in the `replacement` field during relabeling For example: - target_label: composite-label replacement: "{{source_label1}}-{{source_label2}}"	2022-08-21 22:50:01 +03:00
Aliaksandr Valialkin	f2043d53ad	docs: change links to Prometheus docs about instant and range queries to links to VictoriaMetrics docs	2022-08-21 19:01:54 +03:00
Aliaksandr Valialkin	e94b4622f3	docs/keyConcepts.md: more fixes	2022-08-21 18:53:37 +03:00
Aliaksandr Valialkin	af8201cbcc	docs/FAQ.md: add a question on differences between Grafana Mimir and VictoriaMetrics	2022-08-21 17:00:33 +03:00
Aliaksandr Valialkin	1b6f66d566	docs/keyConcepts.md - clarify docs a bit	2022-08-21 12:00:21 +03:00
Aliaksandr Valialkin	c6736a3ad2	docs/Cluster-VictoriaMetrics.md: clarify required conditions for cluster availability	2022-08-20 09:40:34 +03:00
Yurii Kravets	4ca189bf94	doc: udpate Cluster-VictoriaMetrics (#3003 ) added note about resource usage for data re-routing	2022-08-20 09:37:27 +03:00
Aliaksandr Valialkin	3a1eb471a3	app/vmalert/README.md: sync with docs/vmalert.md after `a229182dbe`	2022-08-20 08:54:01 +03:00
laixintao	a229182dbe	doc: fix broken url of template function for vmalert. (#3002 )	2022-08-20 08:50:26 +03:00
Aliaksandr Valialkin	b90103d950	docs/CHANGELOG.md: document `10402459d8`	2022-08-19 11:43:59 +03:00
Roman Khavronenko	f451e0eabe	docs: fix docs formatting related to vmalert (#2994 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-18 09:53:46 +02:00
Aliaksandr Valialkin	dff6314c87	docs/relabeling.md: fix heading for `useful tips for target relabeling`	2022-08-18 01:32:49 +03:00
Aliaksandr Valialkin	149eb59546	docs/relabeling.md: typo fixes	2022-08-18 01:30:03 +03:00
Aliaksandr Valialkin	c1b43afdcd	docs/relabeling.md: improve relabeling tips for scrape targets	2022-08-18 01:24:50 +03:00
Aliaksandr Valialkin	21e63e1518	docs/relabeling.md: add a link to VictoriaMetrics enhancements for relabeling	2022-08-18 01:20:01 +03:00
Aliaksandr Valialkin	421aca7b2f	docs: fix ordering after adding the docs/relabeling.md	2022-08-18 01:17:27 +03:00
Aliaksandr Valialkin	43c6f81b90	docs/relabeling.md: add a cookbook for common relabeling tasks	2022-08-18 01:13:52 +03:00
Aliaksandr Valialkin	22c47e97a5	docs: follow-up after `68e56b6fc5`	2022-08-17 21:24:00 +03:00
Roman Khavronenko	68e56b6fc5	vmalert: set alert's source link to UI instead of JSON source (#2986 ) We switch default alert's source link to redirect user to vmalert's UI instead of previous JSON object. While it breaks compatibility, it also supposed to improve user's experience. The old behavior can be achieved by updating `-external.alert.source` command-line flag. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 14:46:28 +02:00
Aliaksandr Valialkin	eaa5d6cbd7	docs/sd_configs.md: clarify a bit honor_labels config option	2022-08-17 14:25:55 +03:00
Aliaksandr Valialkin	7d26414b2e	lib/promscrape: automatically generate additional per-target labels for targets with non-zero series limit The following metrics are generated: - scrape_series_limit - scrape_series_current - scrape_series_limit_samples_dropped These metrics simplify alerting on targets, which expose too many time series See https://docs.victoriametrics.com/vmagent.html#automatically-generated-metrics and https://docs.victoriametrics.com/vmagent.html#cardinality-limiter for more details	2022-08-17 13:19:33 +03:00
Aliaksandr Valialkin	5b449649b6	docs/CHANGELOG.md: group vmalert features closer to each other	2022-08-17 11:50:23 +03:00
Roman Khavronenko	04c174a11e	docs: add new article link (#2989 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 10:01:01 +02:00
Aliaksandr Valialkin	bb68ab99fa	lib/promscrape: retry http requests if the server returns 429 status code The 429 status code means that the server is overwhelmed with requests. The client can retry the request after some wait time. Implement this strategy for service discovery and scrape requests. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-16 15:01:08 +03:00
Aliaksandr Valialkin	f830edc0bc	lib/storage: improve performance for /api/v1/labels and /api/v1/label/.../values endpoints when `match[]` filter matches small number of time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2978	2022-08-16 13:32:40 +03:00
Aliaksandr Valialkin	e0e7c14788	docs/MetricsQL.md: add `the list of supported ... functions` lines just before the corresponding lists This improves the readability a bit	2022-08-16 12:08:57 +03:00
Roman Khavronenko	8b3989ba39	docs: update vmalert docs (#2987 ) * mention recently added `$alertID` and `$groupID` variables in the changelog * properly escape template examples in the vmalert's README Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 11:44:08 +03:00
Roman Khavronenko	f1b2273d13	vmalert: support `$alertID` and `$groupID` in template variables (#2983 ) Support of these two variables allows building custom URLs with alert's ID and group ID params. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/517#issuecomment-1207141432 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 08:08:27 +02:00
Artem Navoiev	edd7a92e8b	fix typo in influx guide (#2984 )	2022-08-15 22:59:35 +02:00
Aliaksandr Valialkin	4ac79d29ad	app/vmselect: follow-up after `63e0f16062` * Explicitly store a pointer to UserReadableError in the error interface. Previously Go automatically converted the value to a pointer before storing in the error interface. * Add Unwrap() method to UserReadableError, so it can be used transparently with the other code, which calls errors.Is() and errors.As(). * Document the change in docs/CHANGELOG.md	2022-08-15 13:50:16 +03:00
Roman Khavronenko	5792cae0ab	docs: mention default vmalert's behavior change in Update notes (#2981 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-15 13:31:24 +03:00
Yury Molodov	1513866d51	vmui: shortcut keys legend (#2971 ) * feat: add shortcut modal * feat: add shortcut descriptions * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-15 11:54:47 +03:00
Yurii Kravets	88c4f29ea5	doc: add upgrade/downgrade without downtime to FAQ (#2973 ) * doc: add upgrade/downgrade without downtime to FAQ Added info on how to upgrade or downgrade VictoriaMetrics without downtime to FAQ Based on reply https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2944#issuecomment-1207502038 * Udate pr Fixing format	2022-08-15 11:28:39 +03:00
Aliaksandr Valialkin	c3f8481011	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:20 +03:00
Aliaksandr Valialkin	95d36da358	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_pod_container_image` label in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:23 +03:00
Aliaksandr Valialkin	c4fcd9f1c5	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_service_port_number` label to `role: service` in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:06:34 +03:00
Aliaksandr Valialkin	d335694add	app/vmalert/templates: add `toTime()` template function in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:31 +03:00
Aliaksandr Valialkin	511805d88d	lib/promscrape/discovery/dns: add support for resolving MX records See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:32:34 +03:00
Aliaksandr Valialkin	e1cb15807e	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 23:53:58 +03:00
Aliaksandr Valialkin	1e4fc20486	docs/CHANGELOG.md: clarify the change at `28441711e6`	2022-08-11 23:49:22 +03:00
Roman Khavronenko	fa51c76ef9	vmalert: follow-up after `28441711e6` (#2972 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 13:30:32 +02:00
Roman Khavronenko	a0e7432e42	lib/storage: prevent excessive loops when storage is in RO (#2962 ) * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:00 +03:00
Aliaksandr Valialkin	ad00f4aaaa	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:58:50 +03:00
Aliaksandr Valialkin	901300aea2	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:00 +03:00
Aliaksandr Valialkin	06b6063a36	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:09 +03:00
Aliaksandr Valialkin	44c4c1a8cb	docs/vmagent.md: typo fix in __meta_kubernetes_annotation_prometheus_io_tenant label name It must be __meta_kubernetes_pod_annotation_prometheus_io_tenant	2022-08-08 14:52:49 +03:00
Aliaksandr Valialkin	46d7792b72	lib/promscrape: follow-up after `2c553d5a2f` - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:46:26 +03:00
Aliaksandr Valialkin	7a87251ff5	docs: sync -help output with the latest changes	2022-08-08 14:04:30 +03:00
Aliaksandr Valialkin	7b8bc8ad59	all: bump the minimum supported version of Go from 1.17 to 1.18 This is needed because some dependencies uses generics, which have been appeared in Go1.18 This is a follow-up for `caf3dd4fa2`	2022-08-08 13:39:38 +03:00
Aliaksandr Valialkin	730c39876e	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:35:25 +03:00
Roman Khavronenko	a086e48964	vmalert: remove notions of vmalert being compatible with VM only (#2954 ) vmalert can be successfully used with datasources compatible with Prometheus HTTP API. So we remove comments or notes in Readme which are saying opposite. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-08 09:45:21 +02:00
Aliaksandr Valialkin	34f0341b36	docs/CHANGELOG.md: link to the issue with improper handling of `enpoint` option at ec2_sd_configs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:32:50 +03:00
Aliaksandr Valialkin	68c4ec9472	lib/promrelabel: do not split regex into multiple lines if it contains groups Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:15:26 +03:00
Aliaksandr Valialkin	51debcdf6d	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul This is a follow-up for `68de1f4e4a` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:22:31 +03:00
Aliaksandr Valialkin	566d12d9ef	docs/_includes/img.html: fix https://github.com/VictoriaMetrics/VictoriaMetrics/security/code-scanning/28	2022-08-08 01:03:47 +03:00
Yury Molodov	3cb013aeb8	vmui: graph action on moush hold and move (#2915 ) * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:55:09 +03:00
Aliaksandr Valialkin	9f37935819	Makefile: remove redundant `-mod=vendor` option when running Go tools The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:39:08 +03:00
Aliaksandr Valialkin	004e683c55	docs/sd_configs.md: mention that http client configs can contain `headers` and `proxy_headers` options	2022-08-07 18:27:26 +03:00
Aliaksandr Valialkin	0e3f21bc25	docs/sd_configs.md: mention that http client options can be specified in scrape_configs section	2022-08-07 00:21:00 +03:00
Aliaksandr Valialkin	f36de0ecc9	docs: add docs for scrape_configs section	2022-08-07 00:04:31 +03:00
Aliaksandr Valialkin	46ed82b894	docs/sd_configs.md: add docs for static_configs	2022-08-06 23:17:17 +03:00
Aliaksandr Valialkin	b8fc2d356f	docs/sd_configs.md: add docs for openstack_sd_configs	2022-08-06 23:07:01 +03:00
Aliaksandr Valialkin	34d5eda904	docs/sd_configs.md: document kubernetes_sd_configs	2022-08-06 22:38:39 +03:00
Aliaksandr Valialkin	0ef29ceb14	lib/promscrape/discovery/kubernetes: add missing `__meta_kubernetes_ingress_class_name` label for `role: ingress` See `7e65ad3e43` and `7e1111ff14`	2022-08-05 20:55:00 +03:00
Aliaksandr Valialkin	b8fdac4bd7	docs/sd_configs.md: document http_sd_configs	2022-08-05 19:50:06 +03:00
Aliaksandr Valialkin	d8b9cb909a	docs/sd_configs.md: document gce_sd_configs	2022-08-05 19:36:57 +03:00
Aliaksandr Valialkin	e3b427ea54	docs/sd_configs.md: document file_sd_configs	2022-08-05 19:16:54 +03:00
Aliaksandr Valialkin	fad2e79747	docs/sd_configs.md: document eureka_sd_configs	2022-08-05 19:04:36 +03:00
Aliaksandr Valialkin	417d3baab0	docs/sd_configs.md: document ec2_sd_configs	2022-08-05 18:51:31 +03:00
Aliaksandr Valialkin	f2816ef031	lib/promscrape/discovery/ec2: properly handle custom `endpoint` option in ec2_sd_configs This option was ignored since `d289ecded1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:50:02 +03:00
Aliaksandr Valialkin	60e5005d17	docs/sd_configs.md: add docs for dockerswarm_sd_configs	2022-08-05 16:19:57 +03:00
Aliaksandr Valialkin	3e8890e71b	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:11:28 +03:00
Aliaksandr Valialkin	5760c68dd7	docs/sd_configs.md: document docker_sd_configs	2022-08-05 15:36:27 +03:00
Aliaksandr Valialkin	aa374af910	docs/sd_configs.md: document dns_sd_configs	2022-08-05 15:26:40 +03:00
Aliaksandr Valialkin	2d4a6a2237	docs/sd_configs.md: document digitalocean_sd_configs	2022-08-05 15:16:45 +03:00
Aliaksandr Valialkin	ca4f5eac0e	docs/sd_configs.md: document consul_sd_configs	2022-08-05 15:03:22 +03:00
Aliaksandr Valialkin	68de1f4e4a	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 14:41:40 +03:00
Aliaksandr Valialkin	01a380deb8	docs/sd_configs.md: document azure_sd_configs	2022-08-05 14:15:40 +03:00
Aliaksandr Valialkin	0c95d87abd	docs: fixes after `83a4abda3f`	2022-08-05 10:15:00 +03:00
Aliaksandr Valialkin	83a4abda3f	lib/promscrape/discovery/yandexcloud: follow-up after `6e5ac32fba` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:26:43 +03:00
Igor Tiunov	6e5ac32fba	YC service discovery (#2923 ) * YC service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386 * Fixed linter suggestions * fixed golint errors	2022-08-04 20:44:16 +03:00
Aliaksandr Valialkin	4e3e9b667e	docs: exporing -> exporting typo fix This is a follow-up after `ccb6cb6501`	2022-08-04 20:30:48 +03:00
kevinflynn387	56c117b558	Docs: Fix typo from "HA paris" to "HA pairs" (#2935 ) * Update README.md: fix typo to "HA pairs" Update README.md to fix typo from "HA paris" to "HA pairs" * Update docs/README.md : Fix of typo from "HA paris" Update docs/README.md : Fix of typo from "HA paris" to "HA pairs" * Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs" Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs"	2022-08-04 20:28:02 +03:00
Aliaksandr Valialkin	752a3008b4	docs: fix the recommended url for -vmalert.proxyURL accroding to `8667307d73`	2022-08-04 17:56:07 +03:00
Aliaksandr Valialkin	75c7170624	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:30:50 +03:00
Aliaksandr Valialkin	6b0550c023	app/{vmselect,vmalert}: properly generate http redirects if `-http.pathPrefix` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 12:59:07 +03:00
Aliaksandr Valialkin	90649de0c4	docs/Release-Guide.md: document that feature docs must be updated with the release where the feature appeared	2022-07-30 00:15:49 +03:00
Aliaksandr Valialkin	de6dd1cd5a	lib/mergeset: optimize mergeInmemoryBlocks() function Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-27 23:58:05 +03:00
Aliaksandr Valialkin	1f6f883016	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for `vmauth` with identical `username` and different `password` values	2022-07-26 19:38:46 +03:00
Aliaksandr Valialkin	ef85f45998	docs/Single-server-VictoriaMetrics.md: improve "Push metrics" docs	2022-07-26 19:34:07 +03:00
Aliaksandr Valialkin	da11056d85	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:24:24 +03:00
Aliaksandr Valialkin	7afcc42454	all: push metrics to -pusmetrics.url in gzip-compressed form in order to reduce the needed network bandwidth	2022-07-25 10:42:26 +03:00
Aliaksandr Valialkin	92630c1ab4	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on `b596ac3745` Thanks to @zqyzyq for the idea.	2022-07-25 09:18:44 +03:00
Aliaksandr Valialkin	4c2f9a1a2e	lib/promscrape: set `up=0` for partially failed scrape in stream parsing mode This behaviour aligns with Prometheus behavior	2022-07-22 13:29:44 +03:00
Aliaksandr Valialkin	89890eab5d	docs/vmgateway: typo fix in regexp filter: `~=` is substituted with `=~`	2022-07-21 22:37:12 +03:00
Aliaksandr Valialkin	2db4e79a03	docs/BestPractices.md: do not mention NFS Though VictoriaMetrics works OK on NFS-like filesystems, it is not a best practice	2022-07-21 21:29:50 +03:00
Aliaksandr Valialkin	f2326f953b	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 This is a follow-up for `edecd2493c`	2022-07-21 20:57:04 +03:00
Aliaksandr Valialkin	2095421905	docs/CHANGELOG.md: follow-up after `88edb3f6cf`	2022-07-21 20:53:06 +03:00
Aliaksandr Valialkin	d19a368aff	docs/Cluster-VictoriaMetrics.md: update after `fe68bb3ba7`	2022-07-21 20:36:28 +03:00
Aliaksandr Valialkin	5ced032d66	all: follow-up after `46f803fa7a` Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:36:27 +03:00
Aliaksandr Valialkin	4ce5875fa8	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:36:27 +03:00
Roman Khavronenko	88edb3f6cf	vmalert: allow configuring custom headers per group (#2901 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 15:59:55 +02:00
Roman Khavronenko	70a822f3a0	vmalert: allow configuring custom headers for URLs (#2897 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 13:57:53 +02:00
Aliaksandr Valialkin	22fc7e0e04	docs/vmauth.md: mention that multiple recrods for the same username are supported This is a follow-up for `88029c521c`	2022-07-19 19:42:42 +03:00
Nikolay	88029c521c	app/vmauth: allow duplicate usernames (#2888 ) Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:33:17 +03:00
Denys Holius	58b64246e2	docs: faq update (#2889 ) * docs: faq update add links for OpenBSD ports & pre built binaries * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-19 17:49:18 +03:00
Aliaksandr Valialkin	cc7d499bbd	app/vmselect/promql: execute `q1` and `q2` from `q1 op q2` in parallel if labels pushdown cannot be applied This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:27:48 +03:00
Aliaksandr Valialkin	daa0b604f9	docs/Articles.md: add a link to "How do We Keep Metrics for a Long Time in VictoriaMetrics" talk	2022-07-19 13:00:38 +03:00
Aliaksandr Valialkin	0fd86e2364	lib/promscrape: reload all the scrape configs when the `global` section is changed inside `-promscrape.config` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:07 +03:00
Aliaksandr Valialkin	b5da47bfaf	app/vmselect/promql: properly return `q1` series from `q1 ifnot q2` when `q2` returns nothing	2022-07-18 14:24:54 +03:00
Aliaksandr Valialkin	a4424174bb	docs/CHANGELOG.md: document `2f9668eba5`	2022-07-18 12:36:53 +03:00
Aliaksandr Valialkin	814bb1685f	all: fix other typos in the same way as `6f4d9b2a48` does	2022-07-18 12:08:15 +03:00
Aliaksandr Valialkin	429369f028	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to `$(APP_NAME)-$(GOOS)-$(GOARCH)...` naming	2022-07-18 11:59:45 +03:00
Aliaksandr Valialkin	41d0502d99	docs/Single-server-VictoriaMetrics.md: add a link on docs how to send signals to processes in Linux	2022-07-18 10:58:43 +03:00
Aliaksandr Valialkin	15b421435a	docs/Troubleshooting.md: clarify some texts there	2022-07-15 12:23:11 +03:00
Aliaksandr Valialkin	f9f73c0255	docs/Troubleshooting.md: mention about `-search.setLookbackToStep` command-line flag in the section explaining why `/api/v1/query_range` returns calculated data	2022-07-15 11:54:51 +03:00
Aliaksandr Valialkin	12ec8a7ae7	docs/Single-server-VictoriaMetrics.md: mention that the delete API doesnt delete the associated entries from inverted index	2022-07-14 21:28:58 +03:00
Aliaksandr Valialkin	d3116d9862	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:24 +03:00
Roman Khavronenko	f07bfcf0c9	vmalert: drop support of deprecated `extra_filter_labels` param (#2870 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 15:45:08 +03:00
Aliaksandr Valialkin	cb79c3e765	docs/CHANGELOG.md: formatting fixes for update notes	2022-07-14 12:47:19 +03:00
Aliaksandr Valialkin	9c435d7a9d	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:07 +03:00
Yury Molodov	17c33132df	vmui: optimize table view (#2867 ) * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:15:43 +03:00
Dmytro Kozlov	a0d0ba7219	vmui: update time picker behavior (#2847 ) * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:05:47 +03:00
Yury Molodov	e4efebf4a4	vmui: change selection from autocomplete (#2862 ) * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:54:56 +03:00
Nikolay	7301aa678c	lib/promscrape: adds azure service discovery (#2743 ) * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:43:18 +03:00
Aliaksandr Valialkin	ed93330e66	all: follow-up for `d99ba3481b`	2022-07-13 16:44:39 +03:00
Dmytro Kozlov	d99ba3481b	Rename release packages (#2810 ) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 15:42:48 +03:00
Aliaksandr Valialkin	765278243b	docs/CHANGELOG.md: document `91faa152a5`	2022-07-13 12:40:35 +03:00
Aliaksandr Valialkin	f7eda4a73c	docs/CHANGELOG.md: mention that the communication protocol between `vmselect` and `vmstorage` nodes is updated in the new release	2022-07-13 12:16:00 +03:00
Aliaksandr Valialkin	076799ae29	docs: add links to https://docs.victoriametrics.com/CHANGELOG.html in relevant docs	2022-07-11 21:23:19 +03:00
Aliaksandr Valialkin	80c084df02	docs/Articles.md: add a link to https://habr.com/ru/company/sravni/blog/672908/	2022-07-11 21:11:32 +03:00
Aliaksandr Valialkin	cad471037a	app/vmselect/prometheus: follow-up after `3efe33b917`	2022-07-11 20:35:28 +03:00
Dmytro Kozlov	3efe33b917	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851 ) * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:18:30 +03:00
Aliaksandr Valialkin	8851cf68e1	docs: make more clear the relation between replication and deduplication This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:22:15 +03:00
Aliaksandr Valialkin	743ff84863	app/vmselect/netstorage: optimize mergeSortBlocks function - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:34:42 +03:00
Roman Khavronenko	e1a41cfab5	metricsql: properly evaluate `timezone_offset` over time interval (#2842 ) * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:03:56 +03:00
Aliaksandr Valialkin	2e9ae40d56	app/vmselect/vmui: follow-up after `0bf6841140` * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:14:17 +03:00
Aliaksandr Valialkin	126e32f79a	docs/CHANGELOG.md: clarifications after `e9b977859b`	2022-07-08 13:02:41 +03:00
Aliaksandr Valialkin	08db70fa3e	docs/CHANGELOG.md: recommend clearing caches after the upgrade from v1.78.0 to v1.78.1	2022-07-08 12:49:42 +03:00
Roman Khavronenko	e9b977859b	vmalert: deprecate alert's status link (#2840 ) * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 10:26:13 +02:00
Aliaksandr Valialkin	0713da9e7a	docs/CHANGELOG.md: link to the issue related to multi-level vmselect	2022-07-08 05:23:18 +03:00
Aliaksandr Valialkin	b206bd0aee	docs/CHANGELOG.md: recommend upgrading from v1.78.0 to v1.78.1 because of the bug in v1.78.0	2022-07-08 03:44:26 +03:00
Aliaksandr Valialkin	138ae99602	docs/CHANGELOG.md: cut v1.78.1	2022-07-08 01:02:42 +03:00
Aliaksandr Valialkin	d3711e66fd	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:21:28 +03:00
Aliaksandr Valialkin	ec4d39e893	docs/vmagent.md: typo fixes after `ef2eeeb642`	2022-07-07 21:16:37 +03:00
Aliaksandr Valialkin	ef2eeeb642	docs/vmagent.md: actualize docs	2022-07-07 20:35:47 +03:00
Aliaksandr Valialkin	0f0525c208	docs/Single-server-VictoriaMetrics.md: actualize `vmui` docs according to recent changes	2022-07-07 20:35:12 +03:00
Aliaksandr Valialkin	1f1be61b78	docs/CHANGELOG.md: typo fixes	2022-07-07 20:34:08 +03:00
Aliaksandr Valialkin	20df81f1aa	docs: sync after recent changes	2022-07-07 02:44:17 +03:00
Aliaksandr Valialkin	1828665a64	docs/CHANGELOG.md: link another bugreport related to the bug with per-day inverted index in v1.78.0	2022-07-07 02:34:48 +03:00
Aliaksandr Valialkin	f97355d9fb	lib/promscrape: properly set Host header when sending requests via http proxy Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794	2022-07-07 02:27:52 +03:00
Aliaksandr Valialkin	893ca6f87e	docs/CHANGELOG.md: link to the issue about incorrect per-day index handling in v1.78.0	2022-07-07 02:00:07 +03:00
Aliaksandr Valialkin	10cb67adb5	app/{vmagent,vminsert}: follow-up after `d19e46de55` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:30:58 +03:00
Roman Khavronenko	7eb519b92e	docs: mention deduplication issue for HA vmalert topology (#2838 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-07 01:13:05 +03:00
Aliaksandr Valialkin	01f55bc66b	lib/promscrape/discovery/kubernetes: properly populate service-level labels for `role: endpointslice` targets Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2823	2022-07-07 00:32:26 +03:00
Aliaksandr Valialkin	b186b63e07	lib/promscrape/discovery/kubernetes: allow attaching node-level labels to `role: endpoints` and `role: endpointlice` targets in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/10759	2022-07-06 23:18:59 +03:00
Aliaksandr Valialkin	ef62da3750	app/vmselect: add `-clusternative.tls*` options for mTLS setup in multi-level clusters	2022-07-06 13:49:07 +03:00
Aliaksandr Valialkin	bd5b20445e	app/vmselect: add ability to query `vmselect` from another `vmselect`	2022-07-06 13:30:12 +03:00
Aliaksandr Valialkin	c030d920dd	docs/Cluster-VictoriaMetrics.md: sync with cluster branch after `f51bc07d97`	2022-07-06 13:00:34 +03:00
Aliaksandr Valialkin	17de8a41c2	all: follow-up after `ed89106274`	2022-07-06 12:44:46 +03:00
Aliaksandr Valialkin	c66f676f3b	lib/promscrape: push `scrape_samples_limit` metric to remote storage if `sample_limit` option is set in `scrape_config` for this target See https://github.com/VictoriaMetrics/operator/issues/497	2022-07-06 12:37:55 +03:00
Roman Khavronenko	ed89106274	vmselect: allow proxying requests to vmalert from single-node (#2834 ) The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:26 +02:00
Aliaksandr Valialkin	edc76286ac	lib/storage: put the (date, metricID) entry in dateMetricIDCache just after the corresponding series is registered in the per-day inverted index Previously the time series could be put into dateMetricIDCache without registering in the per-day inverted index if GetOrCreateTSIDByName finds TSID entry in the global index. This could lead to missing series in query results. The issue has been introduced in the commit `55e7afae3a`, which has been included in VictoriaMetrics v1.78.0	2022-07-05 14:54:03 +03:00
Aliaksandr Valialkin	f3ece83e67	app/vmselect/promql: properly calculate histogram_quantile over unexpected `le` buckets See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:19:24 +03:00
Artem Navoiev	9c763490b7	Docs: Operator Additional Scrape Configuration - update docs (#2826 ) Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-07-05 11:06:23 +02:00
Aliaksandr Valialkin	17dc3dbd72	docs/Troubleshooting.md: add a link to `Monitoring` chapter added at `41d1834a99`	2022-07-04 11:56:11 +03:00
Roman Khavronenko	41d1834a99	docs: update Troubleshooting guide (#2809 ) Follow-up after `a4d9388ecb` Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:54:40 +03:00
Roman Khavronenko	c7acf36e39	docs: warn about potential issue with read queries for 1.78.0 (#2818 ) * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:03:27 +03:00
Aliaksandr Valialkin	234901b36c	docs/Cluster-VictoriaMetrics.md: mention about -storage.maxDailySeries and -storage.maxHourlySeries options in `resource usage limits` chapter	2022-06-30 23:17:50 +03:00
Aliaksandr Valialkin	84e373e5c7	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions	2022-06-30 22:39:38 +03:00
Aliaksandr Valialkin	fcc4258404	app/vmagent/remotewrite: clarify descriptions for `-remoteWrite.*` options, which must be set per each `-remoteWrite.url`	2022-06-30 20:18:11 +03:00
Aliaksandr Valialkin	c392d6d173	app/vmagent/remotewrite: add `-remoteWrite.header` command-line flag for setting additional http headers to send to -remoteWrite.url Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:23 +03:00
Aliaksandr Valialkin	e40b40afe6	Revert "lib/promscrape, vmagent: fix path to files (#2801 )" This reverts commit `0a8e35835c`. Reason for revert: it incorrectly fixes the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799#issuecomment-1171392005	2022-06-30 18:23:56 +03:00
Dmytro Kozlov	0a8e35835c	lib/promscrape, vmagent: fix path to files (#2801 ) vmagent: respect `-pathPrefix` flag for static files and links	2022-06-30 16:22:54 +02:00
Dmytro Kozlov	4d9715f5a8	vmui: update render logic for nested component (#2795 ) * vmui: update render logic for nested component, avoid rerender, remove local storage usage for tracing flag * docs/url-examples.md: fix various documentation issues there * docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics. * docs/Troubleshooting.md: add troubleshooting guide for cluster instability * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-30 15:47:12 +03:00
Aliaksandr Valialkin	ee42f18dcb	docs/Troubleshooting.md: refer to subqueries doc, since this is the most frequent source of improperly consutructed queries	2022-06-30 15:09:35 +03:00
Aliaksandr Valialkin	921ff3f49d	docs/Troubleshooting.md: refer to capacity planning docs	2022-06-30 14:59:52 +03:00
Aliaksandr Valialkin	ca263371a6	docs/Troubleshooting.md: various typo fixes and clarifications	2022-06-30 14:56:35 +03:00
Aliaksandr Valialkin	bcb1175162	docs/Troubleshooting.md: formatting fixes	2022-06-30 14:38:42 +03:00
Aliaksandr Valialkin	a4d9388ecb	docs/Troubleshooting.md: add troubleshooting guide for cluster instability	2022-06-30 14:35:39 +03:00
Aliaksandr Valialkin	836c19f7ba	Revert "follow-up after `bdf9f4669a` (#2803 )" This reverts commit `ec5d3253ff`, because there was a similar commit already - `119dc333e1`	2022-06-30 13:54:33 +03:00
Aliaksandr Valialkin	119dc333e1	docs/CHANGELOG.md: document `bdf9f4669a`	2022-06-30 13:53:59 +03:00
Aliaksandr Valialkin	56622bff73	docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:53:59 +03:00
Roman Khavronenko	ec5d3253ff	follow-up after `bdf9f4669a` (#2803 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-30 12:46:57 +02:00
Aliaksandr Valialkin	32ddc90ec1	docs/url-examples.md: fix various documentation issues there	2022-06-29 11:57:54 +03:00
Aliaksandr Valialkin	a14188dd8e	app/vmselect: expose additional histograms at `/metrics` page, which may help get more insights for the query workload This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:13 +03:00
Aliaksandr Valialkin	a350d1e81c	lib/storage: return marshaled metric names from SearchMetricNames Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:17:15 +03:00
Aliaksandr Valialkin	bffd72e9a9	docs/Single-server-VictoriaMetrics.md: mention about -search.maxTagValueSuffixesPerSearch command-line flag in `resource limits` docs	2022-06-27 14:03:54 +03:00
Aliaksandr Valialkin	741dd47273	docs/CHANGELOG.md: document `45f20ad1aa`	2022-06-27 13:52:59 +03:00
Aliaksandr Valialkin	a963b2a0aa	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:45:51 +03:00
Aliaksandr Valialkin	94445e8bd1	docs/CHANGELOG.md: update after `e40d015e9a`	2022-06-24 18:04:55 +03:00
Aliaksandr Valialkin	d2bbbf147c	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:57:43 +03:00
Dmytro Kozlov	bb7f31541f	vmui: added query tracing (#2748 ) * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 22:59:20 +03:00
Nikolay	7f1c73bdaf	app/vmselect: fixes partial response with replicationFactor (#2777 ) * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:19:35 +03:00
Yurii Kravets	86e80428d5	docs: Update CHANGELOG Update notes (#2776 ) * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 15:46:51 +02:00
Aliaksandr Valialkin	52eadb729e	lib/promscrape: always send stale markers with the real scrape timestamp This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:34:18 +03:00
Denys Holius	668d67a3d3	Adds a list of supported architectures (#2769 ) * add list of supported architectures * Update docs/BestPractices.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-06-22 21:56:57 +03:00
Aliaksandr Valialkin	1c4f67c5d2	lib/promauth: add ability to send additional http headers in requests to scrape targets This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:39:43 +03:00
Aliaksandr Valialkin	51362f9333	app/vmselect: add `-search.setLookbackToStep` command-line flag for making the gap filling algorithm similar to InfluxDB data model This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:19:30 +03:00
Aliaksandr Valialkin	6a1e0692f6	docs/Cluster-VictoriaMetrics.md: small fixes	2022-06-22 13:42:43 +03:00
Roman Khavronenko	75dd7542e5	docs: follow-up for `197d3cdd74` (#2766 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 08:53:54 +02:00
云原生驿站	197d3cdd74	docs: supplement vmalert downsampling docs (#2765 ) Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 07:43:41 +02:00
Denys Holius	f456e486b7	url-examples: added curl output after deleting metrics (#2764 ) docs: add more details to url-examples for series deleting	2022-06-21 16:20:08 +02:00
Aliaksandr Valialkin	f88c642464	docs: update `-help` output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:01 +03:00
Aliaksandr Valialkin	cfc99e12da	docs: update docs after `e4d6b750f6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:12 +03:00
Aliaksandr Valialkin	091408be62	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:10:38 +03:00
Aliaksandr Valialkin	3837b50f37	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:36:41 +03:00
Aliaksandr Valialkin	49586566a3	docs: follow-up after `e4d6b750f6`	2022-06-20 17:14:43 +03:00
Nikolay	e4d6b750f6	lib/httpserver: adds flagsAuthKey command-line flag (#2758 ) * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:09:32 +03:00
Aliaksandr Valialkin	9f6a19a904	docs/Articles.md: add a link to https://www.sobyte.net/post/2022-05/victoriametrics-bloomfilter/	2022-06-20 14:43:46 +03:00
Roman Khavronenko	4b4f03fa1f	docs: reference links from key concepts (#2745 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:12:10 +03:00
Artem Navoiev	954a7a6fc6	docs: replace bash code block type with console (#2746 )	2022-06-19 22:57:53 +03:00
Aliaksandr Valialkin	c022c4af0a	docs/CHANGELOG.md: document `ef7f52e0e6`	2022-06-19 22:48:39 +03:00
Aliaksandr Valialkin	5fb45173ae	lib/storage: do not register new series if `-storage.maxHourlySeries` or `-storage.maxDailySeries` limits are exceeded Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:42:09 +03:00
Aliaksandr Valialkin	62e2371a67	lib/storage: reset metric id caches for the previous and the current hour Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:42:09 +03:00
Aliaksandr Valialkin	00831e0ee5	docs: update docs on how to add tags to metrics collected by DataDog agent Follow-up for `f16072c3c1`	2022-06-17 13:11:43 +03:00
Dmytro Kozlov	10454d1735	vmui: added focusLabel, enable cardinality app configuratior (#2736 ) * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:03:02 +03:00
Dmytro Kozlov	f16072c3c1	doc: added workaround for datadog agent (#2712 ) * Added workaround for datadog agent * docs: update datadog workaround * doc: update doc description * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 22:22:55 +03:00
Roman Khavronenko	b875628ae6	docs: mention sandbox update in release procedure (#2724 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:48:01 +03:00
Roman Khavronenko	723d90536c	vmselect: limit `end` param max value by 2d in future (#2729 ) * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:46:31 +03:00
Aliaksandr Valialkin	eabd2e2320	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:30:30 +03:00
Aliaksandr Valialkin	c18f8cccfa	lib/promrelabel: support `action: graphite` relabeling Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:24:22 +03:00
Roman Khavronenko	45c1e27937	docs: add multiple-remote-writes topology to vmalert (#2738 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 13:30:28 +02:00
Aliaksandr Valialkin	0f889497b5	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:40:59 +03:00
Aliaksandr Valialkin	e8214ed4e8	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:04 +03:00
Aliaksandr Valialkin	ec7963208d	app/vmselect: accept `focusLabel` query arg at /api/v1/status/tsdb This allows filling the seriesCountByFocusLabelValue list in the /api/v1/status/tsdb response with label values for the specified focusLabel, which contain the highest number of time series. TODO: add this to Cardinality explorer at VMUI - https://docs.victoriametrics.com/#cardinality-explorer	2022-06-14 18:36:54 +03:00
Aliaksandr Valialkin	b6c1ca12b7	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:32:38 +03:00
Aliaksandr Valialkin	7b3c9c50a8	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:00 +03:00
Roman Khavronenko	97183e4ec5	docs: reduce free disk recommendation from 30% to 20% (#2728 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:54:39 +03:00
Aliaksandr Valialkin	29b7c0b4a6	docs/guides/migrate-from-influx.md: suggest more real-world value for `-search.maxStalenessInterval` Suggest `-search.maxStalenessInterval=10s` instead of `-search.maxStalenessInterval=1ms`, since `1ms` would result in empty graphs in most cases, since the interval between data points on the graph is usually much higher than 1ms. For example, if the graph shows time range of one hour and it contains 1000 points, then the interval between points on the graph would equal to 3600s/1000=3.6 seconds.	2022-06-14 12:32:02 +03:00
Roman Khavronenko	aecac75ec7	docs: migrating from influx (#2720 ) Mention `-search.maxStalenessInterval` flag and its effect on query engine. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 09:10:44 +02:00
Aliaksandr Valialkin	86da001963	docs/Single-server-VictoriaMetrics.md: recommend running all the VictoriaMetrics components behind auth proxy in Security chapter	2022-06-13 10:30:01 +03:00
Aliaksandr Valialkin	de2be31275	docs/CHANGELOG.md: document `99dbe7f9d4`	2022-06-13 10:01:48 +03:00
Roman Khavronenko	cd2f0e0760	Readme cleanup (#2715 ) * docs: minor styling and wording changes Changes made after reading https://developers.google.com/tech-writing Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: set proper types for code blocks Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: add `copy` wrapper for some commands Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: sync Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: resolve conflicts Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-13 09:48:26 +03:00
Yury Molodov	879670418f	vmui: enhancements (#2638 ) (#2717 ) * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:43:37 +03:00
Aliaksandr Valialkin	55a0d34be5	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added The optimization has been added in `374beb350e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:45 +03:00
Aliaksandr Valialkin	374beb350e	app/vmselect: optimize `/api/v1/labels` and `/api/v1/label/.../values` handlers when `match[]` query arg is passed to them	2022-06-12 04:32:13 +03:00
Aliaksandr Valialkin	89b778902b	app/vmselect: add optional `limit` query arg to `/api/v1/labels` and `/api/v1/label_values` endpoints This arg allows limiting the number of sample values returned from these APIs	2022-06-10 09:50:33 +03:00
Roman Khavronenko	48a60eb593	vmalert: followup for `76f05f8670` (#2706 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 08:58:25 +02:00
Howie	76f05f8670	feat: rule limit (#2676 ) vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 08:21:30 +02:00
Aliaksandr Valialkin	12ac255dae	lib/querytracer: make it easier to use by passing trace context message to New and NewChild The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:06:52 +03:00
Aliaksandr Valialkin	a072a061a2	docs/Single-server-VictoriaMetrics.md: explain why free disk space shortage may negatively impact VictoriaMetrics performance	2022-06-08 20:03:53 +03:00
Aliaksandr Valialkin	8888e2b955	docs: add a link to cardinality explorer playground	2022-06-08 19:39:36 +03:00
Aliaksandr Valialkin	2c2418d079	docs: refer to cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:17:41 +03:00
Dmytro Kozlov	018d2303c4	Cardinality explorer (#2625 ) * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:43:05 +03:00
Aliaksandr Valialkin	46d8fb03d1	docs/CHANGELOG.md: document `63b538ecd1`	2022-06-07 15:52:32 +03:00
Aliaksandr Valialkin	a93deb307f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:13 +03:00
Aliaksandr Valialkin	cbb64c824d	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage The changes are related to the added query tracing in `afced37c0b` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:35 +03:00
Aliaksandr Valialkin	638ba4614a	docs/CHANGELOG.md: document `e755d0ec3f`	2022-06-07 15:16:48 +03:00
Aliaksandr Valialkin	b022f1f113	docs/CHANGELOG.md: document `1ee1e986da`	2022-06-07 15:02:22 +03:00
Aliaksandr Valialkin	194258c7b4	docs: run `make docs-sync` after `fda8da297e`	2022-06-07 14:50:39 +03:00
Dmytro Kozlov	fda8da297e	docs: fixed typos (#2680 ) * docs: fixed typos * Update README.md * Update docs/README.md * Update docs/Single-server-VictoriaMetrics.md * docs: added examples with start and end params in request * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 14:47:15 +03:00
Aliaksandr Valialkin	f9d22e2ad3	docs/Cluster-VictoriaMetrics.md: run `make docs-sync` after `1c96dce367`	2022-06-07 14:30:43 +03:00
Aliaksandr Valialkin	f04b997a3d	docs: run `make docs-sync` after `a439e887a3`	2022-06-07 14:26:56 +03:00
Aliaksandr Valialkin	8608dd093c	all: follow-up after `8edb390e21` - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 00:57:09 +03:00
Aliaksandr Valialkin	6f0a0e3072	lib/promscrape/discovery/kubernetes: follow-up after `006b8c7534` - make more clear error logs - simplify testing for newKubeConfig by passing only the path to kube_config file instead of SDConfig struct	2022-06-06 14:40:52 +03:00
Aliaksandr Valialkin	6c5372c694	docs/Articles.md: add a link to https://percona.community/blog/2022/06/02/long-time-keeping-metrics-victoriametrics/	2022-06-06 13:15:11 +03:00
Aliaksandr Valialkin	0922ed2b7e	lib/promscrape: add `-promscrape.cluster.name` command-line flag This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 00:37:01 +03:00
Dmytro Kozlov	8edb390e21	lib/promscrape: adds service discovery visualization for /targets page(#2675 ) * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-03 15:38:45 +02:00
Nikolay	a18914abee	lib/promscrape/discovery/kubernetes: follow-up after `0b5c874911` (#2672 )	2022-06-01 20:44:45 +02:00
Aliaksandr Valialkin	3aee7751b3	docs/Single-server-VictoriaMetrics.md: small clarification about custom cache size tuning	2022-06-01 14:55:54 +03:00
Aliaksandr Valialkin	ca689fec54	docs/CHANGELOG.md: follow-up after `2177089f94`	2022-06-01 14:51:26 +03:00
Aliaksandr Valialkin	ea06d2fd3c	lib/storage: stop background merge when storage enters read-only mode This should prevent from `no space left on device` errors when VictoriaMetrics under-estimates the additional disk space needed for background merge. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2603	2022-06-01 14:36:45 +03:00
Roman Khavronenko	642eb1c534	lib/storage: make `indexdb/tagFilters` cache size configurable (#2667 ) The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 10:07:53 +02:00
Roman Khavronenko	2177089f94	promrelabel: add support of `lowercase` and `uppercase` relabeling actions (#2665 ) * promrelabel: add support of `lowercase` and `uppercase` relabeling actions https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2664 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/storage: make golangci-lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 10:02:37 +02:00
Aliaksandr Valialkin	41958ed5dd	all: add initial support for query tracing See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:29:23 +03:00
Aliaksandr Valialkin	89c0172778	docs/CHANGELOG.md: follow-up after `11f91532c5` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:27:56 +03:00
Dmytro Kozlov	11f91532c5	issue-2594: use embedded for static files (#2650 ) embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 01:55:28 +02:00
Dima Lazerka	4c3b35a5ca	Change img urls to the same domain (#2649 )	2022-05-30 12:23:48 +03:00
Howie	7c3d43fa7f	fix: docs (#2658 ) Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-05-30 08:16:07 +02:00
Roman Khavronenko	af5bf8fada	docs: add more details to the key concepts (#2648 ) - data modification - more applications for gauges - recommendations for instrumenting app with metrics Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-27 16:55:40 +02:00
Aliaksandr Valialkin	796804e4b0	lib/promscrape: add -promscrape.suppressScrapeErrorsDelay command-line flag This flag can be used for reducing the amounts of logs when scraping unreliable scrape targets. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2575 The patch is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2576 . Thanks to @jelmd .	2022-05-25 22:59:36 +03:00
Roman Khavronenko	1e15ff5320	docs: update single version docs by adding extra links and formatting (#2643 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 21:49:43 +02:00
Aliaksandr Valialkin	f6d11a49aa	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag This is a follow-up for `0fbf59199a` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:05:29 +03:00
Aliaksandr Valialkin	bfe96a3cb4	docs/CHANGELOG.md: document `9e343faa41`	2022-05-25 15:03:46 +03:00
Roman Khavronenko	5bf5caab93	docs: mention guide for migrating from inlfux in vmctl readme (#2640 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 13:28:56 +02:00
Aliaksandr Valialkin	7747708ca7	app: expose `/api/v1/status/config` endpoint in the same way as Prometheus does This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 09:57:13 +03:00
Aliaksandr Valialkin	1e745416aa	docs/Single-server-VictoriaMetrics.md: mention `Cardinality limiter` docs at `Resource usage limits` section	2022-05-23 10:51:50 +03:00
Nikolay	ce644e9942	Updates operator docs (#2622 ) * docs/operator: adds information about VMAgent statefulMode * docs/operator: adds description for alertmanager configuration * docs/operator: adds description for configuration syncronization https://github.com/VictoriaMetrics/operator/issues/124 Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-23 07:46:53 +02:00
Roman Khavronenko	113301308a	vmalert: mention how to build a custom image (#2626 ) Thanks to @f41gh7 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-23 00:59:34 +02:00
Aliaksandr Valialkin	2d2d15b0d0	docs/CHANGELOG.md: cut v1.77.2	2022-05-21 02:26:15 +03:00
Aliaksandr Valialkin	9854fc4dd5	docs/CHANGELOG.md: group vmalert features together	2022-05-21 01:52:01 +03:00
Aliaksandr Valialkin	cf05750d40	docs/CHANGELOG.md: document `2cf586da78`	2022-05-21 01:12:32 +03:00
Roman Khavronenko	d5eb6afe26	lib/promscrape/discovery/kubernetes: fixes kubernetes service discovery (#2615 ) * lib/promscrape/discovery/kubernetes: properly updates discovered scrape works previously, added or updated scrapeworks may override previuosly discovered. it happens because swosByKey may contain small subset of kubernetes objects with it's labels. It happens for objectsUpdated and objectsAdded maps, which include only changed elements * Properly calculate vm_promscrape_discovery_kubernetes_scrape_works Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-21 01:01:37 +03:00
Yurii Kravets	ac55ca052c	Update README.md (#2624 )	2022-05-20 15:48:32 +02:00
Aliaksandr Valialkin	1731fe2ada	docs: update the description for command-line flags according to recent changes	2022-05-20 15:09:43 +03:00
Aliaksandr Valialkin	6b5979cd76	docs/CHANGELOG.md: document `3df8caca15`	2022-05-20 14:22:48 +03:00
Aliaksandr Valialkin	667e018a7e	docs/CHANGELOG.md: formatting fixes	2022-05-20 14:22:47 +03:00
Aliaksandr Valialkin	832623516b	docs/CHANGELOG.md: formatting fix for the issue url https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607	2022-05-20 14:22:47 +03:00
Aliaksandr Valialkin	65227b88a6	docs/CHANGELOG.md: link to the feature request about reusable templates in vmalert Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2510	2022-05-20 14:22:46 +03:00
Roman Khavronenko	b9d7a66800	docs: add migration guide for influxdb (#2619 ) docs: add migration guide for influxdb Co-authored by @denisgolius Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 11:20:36 +02:00
Roman Khavronenko	e79a1d1476	docs: follow-up after `4b3eb40658` (#2602 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-19 13:24:15 +02:00
Roman Khavronenko	f056121128	docs: fix a typo of mentioning scrape support for vmselect (#2617 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-19 13:23:55 +02:00
Roman Khavronenko	34116882b4	vmalert: support `scalar` type in response (#2610 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-18 09:50:46 +02:00
Roman Khavronenko	1fad4dc919	vmalert: support strings in `humanize.*` templates (#2606 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-17 15:38:54 +02:00
Yurii Kravets	5c42c1218a	Update vmalert.md (#2580 ) docs: update vmalert/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-17 14:14:18 +02:00
Roman Khavronenko	808d0d8ffe	docs: quickstart update (#2572 ) docs: update docs for beginners QuickStart page was updated with more relevant information. Key Concepts was added to cover basics for the VictoriaMetrics.	2022-05-17 14:06:58 +02:00
Roman Khavronenko	b74c001c92	vmalert: support `/rules` path for Grafana's ngalert requests (#2593 ) Unexpectedly, Grafana makes an extra request to `/rules` handler in addition to `/api/v1/rules` calls in alerts UI. This happens only for Grafana versions older than 8.5.*. Apparently, this is related to support of other monitoring systems. Prometheus responds with `text/html` content for UI page `/rules` to such requests. Actually, returning just a blank page with SC=200 works as well. Returning actual response of `/api/v1/rules` results in error in Grafana since it expects a `yaml` (?) in response. So we add a placeholder to `vmalert`. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2583 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-16 10:00:24 +02:00
Roman Khavronenko	284bda8746	docs: fix liquid syntax errors (#2592 ) For liquid text processor double braces `{{` `}}` are special chars for templating. Since we use them in some of our docs with different purpose, we must escape them to avoid syntax errors from liquid. For escaping curly braces we use bult-in plugin which helps to enclose sections of text via `{% raw %}` and `{% endraw %}`. This approach prevents liquid syntax errors and makes render correct. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-16 09:27:19 +02:00
Roman Khavronenko	0d07166eed	vmalert: fix readme formatting (#2587 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-14 19:29:09 +02:00
Roman Khavronenko	9bc03f6b04	vmalert: follow-up after `0ac1cdfff5` (#2586 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-14 18:56:31 +02:00
Andrii Chubatiuk	a531a96193	added reusable templates support (#2532 ) Signed-off-by: Andrii Chubatiuk <andrew.chubatiuk@gmail.com>	2022-05-14 11:38:44 +02:00
Aliaksandr Valialkin	9d7da130b5	docs/CHANGELOG.md: document `3f0ecee128` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2577	2022-05-13 16:56:38 +03:00
Aliaksandr Valialkin	c448d2fcbb	app/vmalert: apply `-remoteRead.disablePathAppend` to `-datasource.url` in the same way as for the `-remoteRead.url` This is a follow-up for `0e2486df56` The related pull requests: - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1536 - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1712	2022-05-13 16:44:43 +03:00
Yurii Kravets	20cef877a1	Update docs (#2566 ) * deployment/docker: pass `-buildvs=false` to `go build` for production builds This should resolve the `error obtaining VCS status: exit status 128` error when the environment contains incorrect version of git or has incorrect access rights to the directory with VictoriaMetrics source code. See the following links for additional info: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508#issuecomment-1117126702 , - https://github.com/google/ko/issues/672 - https://github.com/golang/go/issues/49004 * lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552 * docs/CHANGELOG.md: document `c8af625bcc` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146 * docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by` * docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits * docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect * Update root Readme and root vmagent readme Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-12 19:22:13 +02:00
Aliaksandr Valialkin	a0727ab1b1	docs/vmagent.md: typo fix in the description for `-promscrape.cluster.replicationFactor` command-line flag	2022-05-12 18:50:29 +03:00
Aliaksandr Valialkin	7ddf9f0700	docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect	2022-05-11 20:01:24 +03:00
Aliaksandr Valialkin	73cbc87dbb	docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits	2022-05-11 19:52:03 +03:00
Aliaksandr Valialkin	b828c6e1ff	docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by`	2022-05-11 18:13:07 +03:00
Aliaksandr Valialkin	3f6a7bff85	docs/CHANGELOG.md: document `c8af625bcc` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146	2022-05-11 14:33:27 +03:00
Aliaksandr Valialkin	19f019d0d5	lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552	2022-05-11 14:17:22 +03:00
Denys Holius	3dbdd4ef8a	docs: fixed typos in CHANGELOG.md (#2565 )	2022-05-10 13:16:17 +02:00
Aliaksandr Valialkin	a7f18f8cb2	app/vmselect/promql: do not return values from `label_value()` if the original time series has no values at the selected timestamps	2022-05-09 17:57:39 +03:00
Aliaksandr Valialkin	f901788c7f	docs/CHANGELOG.md: document `8f4f5f1d68`	2022-05-09 17:32:51 +03:00
Aliaksandr Valialkin	84326eacd6	docs/Release-Guide.md: typo fix: signle->single	2022-05-09 15:27:44 +03:00
Manuel Polo	58c1472394	docs: fix typo in quickstart	2022-05-08 19:43:42 +00:00
Artem Navoiev	3f78a609ac	docs: add flags list to vmbackupmanager (#2554 ) docs: add flags list to vmbackupmanager docs Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: tenmozes <artem@victoriametrics.com>	2022-05-08 12:18:39 +00:00
Aliaksandr Valialkin	da9e96bc55	docs/CHANGELOG.md: cut v1.77.1	2022-05-07 01:46:27 +03:00
Aliaksandr Valialkin	f26daecc8d	app/vminsert/netstorage: re-route samples from readonly vmstorage nodes to healthy nodes if `-dropSamplesOnOverload` command-line flag is set	2022-05-07 01:41:00 +03:00
Aliaksandr Valialkin	d6ad8d090d	app/vmstorage: do not allow to set -retentionPeriod smaller than one day VictoriaMetrics doesn't support retention periods smaller than one day, so do not allow to set it to small values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2496	2022-05-07 00:53:01 +03:00
Aliaksandr Valialkin	123aa4c79e	lib/promscrape: properly implement ScrapeConfig.clone() Previously ScrapeConfig.clone() was improperly copying promauth.Secret fields - their contents was replaced with `<secret>` value. This led to inability to use passwords and secrets in `-promscrape.config` file. The bug has been introduced in v1.77.0 in the commit `67b10896d2` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2551	2022-05-07 00:05:40 +03:00
Aliaksandr Valialkin	38629b53ef	docs/CHANGELOG.md: document `e726340914`	2022-05-06 18:10:40 +03:00
Dmytro Kozlov	9a63f6c1b8	vmbackup: Prevent save backups to the same folder where TSDB data is (#2547 ) * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip * vmbackup: Prevent save backups to the same folder where TSDB data is * Apply suggestions from code review * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-06 18:04:09 +03:00
Aliaksandr Valialkin	80092f087e	docs/Cluster-VictoriaMetrics.md: typo fix: bandidth -> bandwidth	2022-05-06 16:35:36 +03:00
Aliaksandr Valialkin	8100c9a301	docs/Cluster-VictoriaMetrics.md: make the description for `-rpc.disableCompression` command-line flag more clear	2022-05-06 16:27:33 +03:00
Roman Khavronenko	20ccf0ba81	vmctl: add tip about safety flags during for native data export (#2540 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-06 15:12:29 +02:00
Aliaksandr Valialkin	8d81703635	app/vmagent: add missing `_total` suffix to `vmagent_remotewrite_global_rows_pushed_before_relabel_total` counter This is a follow up for `c536139d0b`	2022-05-06 15:50:57 +03:00
Aliaksandr Valialkin	1dc4cc243b	lib/promscrape: rename `promscrape_stale_samples_created_total` metric to `vm_promscrape_stale_samples_created_total`, so its name is consistent with the rest of `vm_promscrape_` metrics	2022-05-06 15:33:13 +03:00
Aliaksandr Valialkin	c536139d0b	app/vmagent: expose `vmagent_remotewrite_global_rows_pushed_before_relabel` and `vmagent_remotewrite_rows_pushed_after_relabel_total` metrics	2022-05-06 15:28:59 +03:00
Aliaksandr Valialkin	51e36fd533	app/vmagent: rename `vmagent_remote_write_rate_limit_reached_total` to `vmagent_remotewrite_rate_limit_reached_total` for the sake of consistency with other `vmagent_remotewrite_` metrics	2022-05-06 15:01:54 +03:00
Aliaksandr Valialkin	d5b55fe22d	lib/promscrape/discovery/ec2: add ability to filter Availability Zones in `ec2_sd_config` via `az_filters` section	2022-05-06 12:43:29 +03:00
Aliaksandr Valialkin	ca4ca4630b	app/vmselect/vmui: `make vmui-update` after `450d879eaa`	2022-05-05 21:26:01 +03:00
Denis Fondras	928728807c	Fix typo (#2538 )	2022-05-05 21:16:03 +03:00
Aliaksandr Valialkin	6343b20943	docs/Cluster-VictoriaMetrics.md: update cluster scalability tips	2022-05-05 21:11:51 +03:00
Aliaksandr Valialkin	be76d49150	docs/CHANGELOG.md: document `bf5e3774cc`	2022-05-05 13:38:17 +03:00
Aliaksandr Valialkin	6bb32ab9de	docs/CHANGELOG.md: cut v1.77.0	2022-05-05 00:16:16 +03:00
Aliaksandr Valialkin	2c037ae0d3	docs/vmbackup.md: added missing -storageDataPath argument in the command for creating daily backups	2022-05-04 22:49:37 +03:00
Aliaksandr Valialkin	910f715ffe	docs/vmbackup.md: acutalize docs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2503	2022-05-04 22:44:15 +03:00
Aliaksandr Valialkin	e761d9449c	app/vmagent: rename -remoteWrite.useSigv4 command-line flag to -remoteWrite.aws.useSigv4, so its name is consistent with the other -remoteWrite.aws.* command-line flags	2022-05-04 20:41:17 +03:00
Aliaksandr Valialkin	381e2de59c	app/vmalert: run `make quicktemplate-gen` from the root directory after the commit `f6dcfbcdd6`	2022-05-04 20:27:36 +03:00
Nikolay	d289ecded1	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458 ) * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:24:19 +03:00
Dmytro Kozlov	f6dcfbcdd6	vmalert/tpl: fixed truncating alerts expression in table (#2494 ) vmalert: improve `/groups` UI visual The change also fixes truncated rules expressions in UI https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2484	2022-05-04 18:02:18 +02:00
Aliaksandr Valialkin	242856ce97	docs/guides/multi-regional-setup-dedicated-regions.md: clarify wording on vmagent configuration	2022-05-04 18:49:56 +03:00
Aliaksandr Valialkin	4e4ca1b6db	docs/Cluster-VictoriaMetrics.md: move `environment variables` entry closer to `cluster setup` section	2022-05-04 18:43:57 +03:00
Aliaksandr Valialkin	bab9670d69	docs/CHANGELOG.md: yet another typo fix: present -> pressed	2022-05-04 18:20:39 +03:00
Aliaksandr Valialkin	554008bb4e	docs/CHANGELOG.md: typo fixes	2022-05-04 18:18:37 +03:00
Aliaksandr Valialkin	2e6827ff04	docs/CHANGELOG.md: document `8639e79d38`	2022-05-04 10:46:03 +03:00
Aliaksandr Valialkin	1c7a541247	docs/Cluster-VictoriaMetrics.md: typo fix: serparated -> separated	2022-05-03 15:19:15 +03:00
Aliaksandr Valialkin	2ced6746a7	docs/CHANGELOG.md: document `3575aabeaf`	2022-05-03 14:01:15 +03:00
Aliaksandr Valialkin	b5fedfd3bb	all: add -cluster.tlsInsecureSkipVerify command-line option to vminsert, vmselect and vmstorage components in order to be able to disable TLS certificate verification in mTLS mode See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2490	2022-05-03 13:12:50 +03:00
Aliaksandr Valialkin	528b332fe0	docs/Cluster-VictoriaMetrics.md: refer to the doc on how to set up mTLS	2022-05-03 11:55:06 +03:00
Aliaksandr Valialkin	53cef612b0	docs/CHANGELOG.md: document `488c34f5e1`	2022-05-03 11:01:02 +03:00
Aliaksandr Valialkin	aa02719d86	docs/CHANGELOG.md: document `d0706c8c95`	2022-05-02 22:24:45 +03:00
Aliaksandr Valialkin	0d86644d65	lib/storage: leave the last sample per each discrete interval during the deduplicaton This aligns better with staleness logic in Prometheus - https://prometheus.io/docs/prometheus/latest/querying/basics/#staleness	2022-05-02 21:50:45 +03:00
Aliaksandr Valialkin	a186434b50	app/vmui: execute query by pressing `enter` in the same way as Prometheus does Multi-line query can be entered via `shift-enter` in the query input field	2022-05-02 19:49:29 +03:00
Aliaksandr Valialkin	2c4565bb3d	docs/Cluster-VictoriaMetrics.md: move here the `deduplication` docs related to cluster version	2022-05-02 15:53:34 +03:00
Max Golionko	e79aa037b0	added details about deduplication (#2527 ) * added details about deduplication * Update docs/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Apply suggestions from code review * Update docs/README.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-02 15:45:57 +03:00
Aliaksandr Valialkin	bae7e8b16b	docs/CHANGELOG.md: document `3616337812` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2514	2022-05-02 15:36:00 +03:00
Aliaksandr Valialkin	70d9e7346b	docs/CHANGELOG.md: document `32a6b67e6c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1761	2022-05-02 15:26:21 +03:00
Aliaksandr Valialkin	6039640a26	docs/CHANGELOG.md: document `b2294d1cf1`	2022-05-02 15:21:24 +03:00
Aliaksandr Valialkin	7bc6595b45	lib/netutil: close connections in ConnPool if they are idle for more than 30 seconds Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508	2022-05-02 15:14:05 +03:00
Artem Navoiev	37cf509c3a	lib/{storage,flagutil} - Add option for snapshot autoremoval (#2487 ) * lib/{storage,flagutil} - Add option for snapshot autoremoval - add prometheus-like duration as command flag - add option to delete stale snapshots - update duration.go flag to re-use own code * wip * lib/flagutil: re-use Duration.Set() call in NewDuration * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-02 11:00:15 +03:00
Peter Dupej	8688ea8aa8	Update MetricsQL.md (#2519 ) remove typo from label_replace doc.	2022-05-02 09:42:58 +03:00
Dima Lazerka	ed8e88af11	Export "null" in jsonl instead of NaN (#2518 ) * Export "null" in jsonl instead of NaN The NaN appeared because of staleness markers that were added for compatibility. I think it's better to use json `null`, implemented here. Also maybe it also makes sense to add a flag like `?skip-staleness-markers=true` to `/export`, to skip nulls at all? * Update app/vmselect/prometheus/export.qtpl * app/vmselect/prometheus/export.qtpl.go: `make quicktemplate-gen` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-29 12:49:47 +03:00
Aliaksandr Valialkin	f5635d6920	docs/CHANGELOG.md: document `c7aad8d441`	2022-04-29 11:39:23 +03:00
Aliaksandr Valialkin	9bb35779d2	docs/MetricsQL.md: clarify keep_metric_names docs	2022-04-27 11:24:32 +03:00
Aliaksandr Valialkin	cce1b6d7f9	app/vmselect/promql: add `tlast_change_over_time(m[d])` function, which returns the timestamp for the last change of `m` on the given lookbehind window `d`	2022-04-27 10:59:03 +03:00
Aliaksandr Valialkin	4176be38c4	app/vmagent: substitute hard-to-read 500000000 with 500MB in `-remoteWrite.maxDiskUsagePerURL` description	2022-04-26 15:48:20 +03:00
Yury Molodov	9b4bff67e0	vmui: add support relative time (#2504 ) * feat: add support relative time * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-26 15:46:06 +03:00
Aliaksandr Valialkin	ce1190974c	docs/Cluster-VictoriaMetrics.md: remove incorrect and misleading instructions for passing `-replicationFactor` flag to vmselect nodes in multi-level setup. The `-replicationFactor` passed to top-level `vmselect` nodes mustn't exceed the `-replicationFactor` passed to top-level `vminsert` nodes	2022-04-26 15:13:56 +03:00
Aliaksandr Valialkin	8594609385	docs/CHANGELOG.md: document `4c1fbcd6b0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2368	2022-04-26 15:10:00 +03:00
Aliaksandr Valialkin	5d87744ba2	docs/CHANGELOG.md: typo fix: `may result` -> `could result`	2022-04-23 00:31:22 +03:00
Aliaksandr Valialkin	eb5d7ad089	lib/promauth: add support for `min_version` option at `tls_config` section in the same way as Prometheus does	2022-04-23 00:16:39 +03:00
Aliaksandr Valialkin	174431e31b	lib/promauth: add support for `proxy_url` option at `oauth2` section in the same way as Prometheus does	2022-04-23 00:00:44 +03:00
Aliaksandr Valialkin	18b14aad8e	lib/promauth: add support for `tls_config` section at `oauth2` config in the same way as Prometheus does	2022-04-22 23:51:07 +03:00
Aliaksandr Valialkin	15190fcdae	lib/promscrape/discovery/kubernetes: allow attaching node-level labels and annotations to discovered pod targets in the same way as Prometheus 2.35 does See https://github.com/prometheus/prometheus/issues/9510 and https://github.com/prometheus/prometheus/pull/10080	2022-04-22 20:15:41 +03:00
Aliaksandr Valialkin	1970b3db34	docs/Cluster-VictoriaMetrics.md: mention that enterprise binaries are available for evaluation	2022-04-21 15:58:03 +03:00
Aliaksandr Valialkin	912a5a6f28	docs/Single-server-VictoriaMetrics.md: refer to the docs on how to set up multiple vmagent instances for scraping the same set of targets	2022-04-21 15:51:52 +03:00
Aliaksandr Valialkin	25fe83577d	app/vmselect/promql: properly handle `scalar default vector`, `scalar if vector` and `scalar ifnot vector` queries Previously `vector` time series could be unexpectedly returned from such queries	2022-04-21 15:34:36 +03:00
Aliaksandr Valialkin	de892239a9	app/vmselect/promql: add `drop_common_labels()` function	2022-04-21 14:20:20 +03:00
Aliaksandr Valialkin	98129d4a8e	app/vmstorage: expose `vm_indexdb_items_added_total` and `vm_indexdb_items_added_size_bytes_total` counters at `/metrics` page These counters can be used for monitoring the rate of addition of new entries in indexdb (aka inverted index). See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2471	2022-04-21 13:18:39 +03:00
Aliaksandr Valialkin	d335cc886c	app/vmselect/promql: fix `duplicate time series` error on joins against time series filtered by values This should prevent from `duplicate time series` errors when executing the following query: kube_pod_container_resource_requests{resource="cpu"} * on (namespace,pod) group_left() (kube_pod_status_phase{phase=~"Pending\|Running"}==1) where `kube_pod_status_phase{phase=~"Pending\|Running"}==1` filters out diplicate time series	2022-04-20 22:18:44 +03:00
Aliaksandr Valialkin	694887cea8	docs/CHANGELOG.md: document that the service discovery speed now scales with the number of CPU cores	2022-04-20 16:22:18 +03:00
Aliaksandr Valialkin	3d0549c982	lib/promscrape: optimize getScrapeWork() function Reduce the number of memory allocations in this function. This improves its performance by up to 50%. This should improve service discovery speed when big number of potential targets with big number of meta-labels are generated by service discovery. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2270	2022-04-20 15:37:00 +03:00
Aliaksandr Valialkin	f6d0e5e74a	all: typo fix: Kuberntes -> Kubernetes	2022-04-20 10:50:49 +03:00
Dmytro Kozlov	a3ee275149	lib/promscrape: Enable filters for endpoint and labels (#2466 ) * lib/promscrape: Enable filters for endpoint and labels * lib/promscrape: cleanup * lib/promscrape: update template * lib/promscrape: move logic filter logic to backend * lib/promscrape: updated placeholder * lib/promscrape: updated placeholder * lib/promscrape: use two different fields for filters, updated form, added error on parsing queries * lib/promscrape: rename functions * lib/promscrape: removed unused values * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-19 18:26:21 +03:00
Nikolay	26b78ad707	lib/promscrape: adds job restart method (#2455 ) * lib/promscrape: adds job restart method it must restart only ScrapeConfig with changed content this change greatly reduce time, that needed for job restart and it should decrease possible data loss when config frequently changed at kubernetes based deployments Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 20:28:46 +03:00
Yury Molodov	514e3660e2	fix: prevent graph hiding without data (#2456 ) * fix: prevent graph hiding without data * fix: add yaxis labels default * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 17:15:31 +03:00
Aliaksandr Valialkin	f62fc2f318	docs/Cluster-VictoriaMetrics.md: sync docs	2022-04-16 16:59:27 +03:00
Aliaksandr Valialkin	1097ebebe6	lib/httpserver: clarify that `-tls` flag enables TLS for http requests to `-httpListenAddr`	2022-04-16 16:59:26 +03:00
Aliaksandr Valialkin	cad488fe7e	app/vmstorage: add support for mTLS cipher suites via `-cluster.tlsCipherSuites` command-line flag Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2404	2022-04-16 16:39:21 +03:00
Aliaksandr Valialkin	54bb8c2bc6	docs/Cluster-VictoriaMetrics.md: update docs after `26ae50ec26`	2022-04-16 16:04:58 +03:00
Aliaksandr Valialkin	b49b8020d6	docs: sync docs with the latest changes	2022-04-16 15:59:53 +03:00
Aliaksandr Valialkin	7e4bdf31ba	lib/httpserver: follow up after `def0032c7d`	2022-04-16 15:27:21 +03:00
Aliaksandr Valialkin	ebaa1c7ad5	lib/promscrape: follow-up after `baa1c24b36`	2022-04-16 14:25:54 +03:00
Aliaksandr Valialkin	057c3a745f	docs/Cluster-VictoriaMetrics.md: clarify the issue with multi-level cluster, which may result in data gaps at some AZs	2022-04-16 13:04:29 +03:00
Aliaksandr Valialkin	4169b97af9	docs/Cluster-VictoriaMetrics.md: improve docs on cluster setup, resizing and scalability	2022-04-15 15:05:47 +03:00
Aliaksandr Valialkin	b11e9de386	docs/Cluster-VictoriaMetrics.md: mention about possible issues with multi-level cluster setup	2022-04-15 15:05:45 +03:00
Aliaksandr Valialkin	e6535a75f7	docs/CHANGELOG.md: document `45fcaa33e8`	2022-04-13 14:12:17 +03:00
Aliaksandr Valialkin	77ffa4e447	docs/CHANGELOG.md: document `f7e4c5a628`	2022-04-13 14:09:11 +03:00
Roman Khavronenko	45fcaa33e8	vmalert: add DNS service discovery (#2465 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2460 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-13 11:50:26 +03:00
Anton Bystrov	9307fe3c04	Update CHANGELOG.md (#2463 ) May be mispint here?	2022-04-13 11:18:42 +03:00
Aliaksandr Valialkin	f8de318bfc	docs/CHANGELOG.md: cut v1.76.1	2022-04-12 16:20:55 +03:00
Aliaksandr Valialkin	ef66b048c9	app/vmui: further improvements for number display on graphs This is a follow-up for `c4d2cd8336` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2409	2022-04-12 16:01:27 +03:00
Aliaksandr Valialkin	52cb80ed4f	docs/CHANGELOG.md: link to the bug related to improper handling of maxSeries limit passed from vmselect to vmstorage	2022-04-12 16:00:25 +03:00
Yurii Kravets	38383c0bec	Update Quick-Start (#2422 ) * Update Quick-Start * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * update Quick-Start.md added "Starting VM-Cluster via Docker" + Anchor fixes * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-12 14:22:53 +03:00
Roman Khavronenko	dbbacc8847	docs: add managed vm documentation section (#2437 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-12 13:03:25 +03:00
Aliaksandr Valialkin	f3d4671bb6	lib/promscrape: follow-up after `7e79adfb55`	2022-04-12 12:36:17 +03:00
Yurii Kravets	708a3ef276	url-examples.md (#2435 ) * url-examples.md added 1 more example * Update url-examples.md	2022-04-12 11:27:17 +03:00
Aliaksandr Valialkin	54de0531a4	app/vmstorage: properly handle `maxSeries` limit passed from vmselect to vmstorage	2022-04-12 11:23:04 +03:00
Aliaksandr Valialkin	deaa8c1ffa	lib/protoparser/native: follow-up after `fe01f4803d`	2022-04-11 19:27:07 +03:00
Aliaksandr Valialkin	d7bf0a7348	vendor: update github.com/VictoriaMetrics/metricsql from v0.40.0 to v0.41.0 This allows using built-in function names as with template names	2022-04-11 18:31:44 +03:00
Aliaksandr Valialkin	e27dac25b9	docs/Single-server-VictoriaMetrics.md: clarify that `ingestion protocol` means `data ingestion protocol`	2022-04-11 12:57:26 +03:00
Aliaksandr Valialkin	b89e846ce3	docs/CHANGELOG.md: document `ed364a42e3`	2022-04-11 12:11:32 +03:00
Aliaksandr Valialkin	3121085e8f	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics supports data ingestion in Graphite protocol at `Graphite API usage` chapter	2022-04-10 16:20:41 +03:00
Aliaksandr Valialkin	f1ad5b6857	docs/Cluster-VictoriaMetrics.md: update docs after `b843f0e229`	2022-04-10 16:18:21 +03:00
Yurii Kravets	ed8c6f69e4	Update url-examples (#2410 )	2022-04-08 13:05:46 +03:00
Aliaksandr Valialkin	a0e77744d4	docs/Cluster-VictoriaMetrics.md: clarify high availability docs	2022-04-08 12:51:57 +03:00
Aliaksandr Valialkin	fbd71f3083	docs/CHANGELOG.md: document backwards-incompatible changes in cluster version of v1.76.0	2022-04-08 12:05:45 +03:00
Dmytro Kozlov	66a03a7fa9	docs/guides: Multi-regional setup with VictoriaMetrics (#2416 ) * docs/guides: Multi-regional setup with VictoriaMetrics * docs/guides: cleanup	2022-04-08 11:39:40 +03:00
Aliaksandr Valialkin	dc60e99e94	docs/CHANGELOG.md: document the bugfix in hitCount function	2022-04-08 11:31:52 +03:00
Aliaksandr Valialkin	978f6d0f89	docs/CHANGELOG.md: typo fix	2022-04-07 17:19:59 +03:00
Aliaksandr Valialkin	ef690932ee	docs/CHANGELOG.md: cut v1.76.0	2022-04-07 15:33:55 +03:00
Aliaksandr Valialkin	7da20a4b3f	app/vmagent: reduce the probability of TLS handshake timeout when dialing the remote storage The following actions are taken: - Increase the TLS hashdshake timeout from 5 seconds to 10 seconds - Increase dial timeout from 5 seconds to 30 seconds - Specify DialContext instead of Dial in http.Transport. This allows properly handling the Context arg during dialing the remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1699	2022-04-06 12:34:25 +03:00
Aliaksandr Valialkin	cde1e2ec93	docs/Release-Guide.md: add missing steps	2022-04-06 11:41:09 +03:00
Aliaksandr Valialkin	7ecb72648d	docs/CHANGELOG.md: document `0c0efc7781`	2022-04-05 19:21:49 +03:00
Nikolay	0c0efc7781	vmctl verify-blocks command (#2390 ) * lib/protoparser: changes ParseStream for native format uses reader instead of http.Request updates app/vmagent and app/vmagent method usage * app/vmctl: add verify-block subcommand it allows to check exported from VictoriaMetrics data block in native format https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2362 Update app/vmctl/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-04-05 16:01:32 +02:00
Aliaksandr Valialkin	4ecb86c179	app/vminsert: reduce the max packet size, which vminsert can send to vmstorage This reduces the max memory usage for vminsert and vmstorage under heavy ingestion rate by up to 50% on production workload	2022-04-05 15:43:07 +03:00
Aliaksandr Valialkin	d011446f6f	docs/CHANGELOG.md: document `70bb0d2708`	2022-04-04 13:02:27 +03:00
Roman Khavronenko	70bb0d2708	vmalert: add flag for disabling long-lived connections (keepalive) (#2395 ) The new flag `datasource.disableKeepAlive` allows disabling keepalive connections. This may be useful if there are multiple datasource replicas (e.g. vmselects) behind the HTTP balancer to avoid uneven load spread because of long-lived connections. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-04 12:59:04 +03:00
Aliaksandr Valialkin	43df19a742	docs/CHANGELOG.md: document 173073364e1bb1e0259ddc873dbd96ce62b07543	2022-04-04 12:55:43 +03:00
Artem Navoiev	3d3b9e3b59	Update release process. Actualize helm-charts release process. Add re… (#2397 ) * Update release process. Actualize helm-charts release process. Add release guide for ansible playbooks * add step to Ansible steps	2022-04-04 12:14:27 +03:00
Ross Dougherty	0fd4c48568	fix object selectors link (#2391 ) * fix object selectors link * update kustomize url	2022-04-01 12:40:41 +03:00
Dima Lazerka	e2b1097545	Fix typo "vmanomapy"	2022-04-01 12:26:59 +03:00
Aliaksandr Valialkin	f977ca8eaf	docs/CHANGELOG.md: document a57e3807537914396ee3eb378648a464fa9e1b97	2022-04-01 12:24:49 +03:00
Aliaksandr Valialkin	1c38ff6f48	docs/CHANGELOG.md: document `0989649ad0`	2022-04-01 12:01:34 +03:00
Yurii Kravets	a9b6cf53a2	url-examples (#2389 )	2022-04-01 11:23:18 +03:00
Roman Khavronenko	56de8f0356	docs: fix typo in vmalert's API (#2380 ) The API handler was changed in 1.75 but docs still contain the old address. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2366 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-28 12:07:02 +02:00
Aliaksandr Valialkin	e210384f7e	docs/CHANGELOG.md: cut v1.75.1	2022-03-28 12:28:48 +03:00
Roman Khavronenko	cb878d50fc	docs: update `increase_prometheus` desc (#2381 ) Remove note that this func is supported by PromQL.	2022-03-28 11:57:03 +03:00
Roman Khavronenko	3a2a60cb08	docs: escape chars for /label/values endpoint (#2379 ) Without escaping the part wrapped with `<` `>` chars won't be rendered properly.	2022-03-28 10:18:37 +02:00
Yury Molodov	c8d29ed78e	vmui: predefined panels (#2243 ) * feat: add basic components for predefined dashboards * fix: change display alert * feat: add autosize and unit for axes * feat: add component for CircularProgress * feat: change layout for predefined dashboards * feat: add override step for predefined panels * feat: add override step for predefined panels * feat: change yaxis limits for predefined panels * fix: rename flag for hide legend * feat: add formatted panel description * feat: add README.md for dashboard setup * feat: validate dashboard settings * feat: add unit for y-ticks * fix: correct display error for dashboards * fix: disable auto refresh after route change * update package-lock.json * fix: add basename for BrowserRouter * fix: add dynamic basename for routing * update packages * feat: add a pre-defined dashboard "per-job resource usage" * feat: display unit in the hover-tooltip * fix: change routing and home layout * fix: change axis width calc * updated packages * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-26 13:03:11 +02:00
Aliaksandr Valialkin	6e364e19ef	app/vmselect: add fine-grained limits for the number of returned/scanned time series for various APIs	2022-03-26 11:29:49 +02:00
Dima Lazerka	1fa0f3ec89	VMAnomaly docs fixes (#2361 ) * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Squeeze vmanomaly after vmbackupmanager before Case Studies Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-25 12:08:17 +02:00
Dima Lazerka	7377163659	Add vmanomaly docs section (#2356 ) * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-24 11:56:23 +02:00
Yurii Kravets	c46d9be108	Update url-examples (#2358 ) * Update url-examples Add federate example * Update docs/url-examples.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-24 11:53:28 +02:00
Aliaksandr Valialkin	f8dfc22350	docs: a follow-up after `76a477c609`	2022-03-23 19:39:08 +02:00
Yurii Kravets	76a477c609	Update Single-server-VictoriaMetrics.md (#2357 ) * Update Single-server-VictoriaMetrics.md Adding /federate link * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-23 19:37:23 +02:00
Yurii Kravets	23d0fc220d	Update url-examples.md (#2297 ) * Update url-examples.md +additional examples * Update * Update url-examples Some changes requested by Roman. * Update url-examples.md * Update url-example * Update url-examples Additional info and marking for /labels part * Update url-example Added example with complex query which needs encoding: How to execute the query similar to - sum(increase(foo{status="bar"}[5m])) by (status) * Update url-samples Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-22 15:11:43 +02:00
Aliaksandr Valialkin	b421a1f57b	docs/Cluster-VictoriaMetrics.md: clarify mTLS protection docs	2022-03-22 13:55:40 +02:00
Arash Hatami	a8de1ab000	A good change for MD files (#2353 ) * Lint YAML * Remove extra comment * Fix command problem * Format MD files * Format & fix problem of MD files for docs * Another fix for MD files	2022-03-22 13:40:55 +02:00
Roman Khavronenko	f367ff086c	docs: update release notes (#2349 ) Warn about memory issue introduced in releases 1.73 - 1.74	2022-03-21 15:40:50 +02:00
Aliaksandr Valialkin	5ab6c350ec	docs/CHANGELOG.md: document `a1e17e91f8`	2022-03-21 15:34:49 +02:00
hagen1778	82659ab5b6	docs: add update note to v1.75.0 release note Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-19 17:55:38 +01:00
Aliaksandr Valialkin	87d356348b	docs/CHANGELOG.md: cut v1.75.0	2022-03-18 19:53:45 +02:00
Aliaksandr Valialkin	e78f3ac8ac	app/vmselect/bufferedwriter: suppress trivial network errors, which can be generated by remote side These errors include `broken pipe` and `reset by peer`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2334	2022-03-18 19:28:02 +02:00
Aliaksandr Valialkin	ec03dec72d	app/vmagent/remotewrite: prevent from infinite recursion panic when pushing a time series with big number of samples to remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2335	2022-03-18 19:06:22 +02:00
Aliaksandr Valialkin	620b605786	docs: document `20bb5e703c`	2022-03-18 18:41:19 +02:00
Aliaksandr Valialkin	2ae3a9a8a3	lib/storage: reduce the interval for checking for free disk space from 30 seconds to 1 second This should reduce the probability of out of disk space panics when -storage.minFreeDiskSpaceBytes is set to low values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2305	2022-03-18 16:52:27 +02:00
Aliaksandr Valialkin	88605a7ea2	lib/blockcache: properly release memory occupied by deleted entries Proviously the deleted entries could remain referenced via lastAccessHeap for long time. This could lead to increased memory usage for the following caches starting from v1.73.0: * indexdb/indexBlocks * indexdb/dataBlocks * storage/indexBlocks Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2242 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-03-18 16:52:27 +02:00
Aliaksandr Valialkin	db781a9342	docs/CHANGELOG.md: document `e5868b9c29` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/546 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2255	2022-03-18 13:07:32 +02:00
Aliaksandr Valialkin	09c6c7350b	docs/vmalert.md: sync after `11ae1ae924`	2022-03-17 20:17:40 +02:00
Aliaksandr Valialkin	e6acd16daf	docs/CHANGELOG.md: document `11ae1ae924`	2022-03-17 20:08:05 +02:00
Aliaksandr Valialkin	11869a8307	docs: document the addition of mTLS communication between cluster components	2022-03-17 20:00:56 +02:00
Aliaksandr Valialkin	8ae9825bb4	docs/CHANGELOG.md: document c1d07e7c52f0a2ab892921b0639cd42677aa33a8	2022-03-16 14:25:44 +02:00
Aliaksandr Valialkin	54ec080bbc	docs/CHANGELOG.md: document changes from `fb6eab03a2`	2022-03-16 13:21:57 +02:00
Aliaksandr Valialkin	370024c7ed	docs/CHANGELOG.md: document `565bd08c43` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1824	2022-03-16 12:50:49 +02:00
Aliaksandr Valialkin	e03e46af4e	docs: `make docs-sync`	2022-03-16 12:30:02 +02:00
hagen1778	894416b4ca	docs: add update details for some releases Some of the releases could negatively affect performance for a limited period of time due to some changes in core. Update details are meant to warn users about expected changes in peformance after the update. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-15 07:06:48 +03:00
Roman Khavronenko	0fa7effc4b	docs: fix broken links (#2303 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-13 15:56:01 +02:00
Dmytro Kozlov	565bd08c43	Issue-1824: added flags and different auth types support (#2287 ) * vmalert/notifier: added flags and different auth types support Co-authored-by: hagen1778 <roman@victoriametrics.com>	2022-03-10 13:09:12 +02:00
Ted Robertson	ef1afeed6c	Clarify lack of support for InfluxQL (#2273 )	2022-03-07 09:49:14 +02:00
Bastien Dronneau	8b21f40217	docs(vmalert): typo in path (#2278 )	2022-03-05 22:35:10 +02:00
Aliaksandr Valialkin	74bb9ea734	docs/CHANGELOG.md: cut v1.74.0	2022-03-03 19:30:41 +02:00
Aliaksandr Valialkin	7717967d42	docs: `make docs-sync` after `702aa4948b`	2022-03-03 18:34:06 +02:00
Dan Dascalescu	702aa4948b	docs: clarify Retention, improve English (#2266 )	2022-03-03 18:28:46 +02:00
nemobis	df088dd78a	Fix typo, sentence flow in operator description (#2251 )	2022-03-03 18:27:12 +02:00
Aliaksandr Valialkin	ce8d28f8f4	docs/CHANGELOG.md: document performance improvements when registering new time series	2022-03-03 17:11:30 +02:00
Aliaksandr Valialkin	e757ebc58b	app/vmselect/netstorage: report vmstorage errors to vmselect clients even if partial responses are allowed If a vmstorage is reachable and returns an application-level error to vmselect, then such error must be returned to the caller even if partial responses are allowed, since it usually means cluster mis-configuration. Partial responses may be returned only if some vmstorage nodes are temporarily unavailable. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1941 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/678	2022-02-25 13:56:42 +02:00
Nikolay	9fe2e4e2c2	fixes incorrect step for calculation for MovingWindow functions (#283 ) * fixes incorrect step for calculation for MovingWindow functions https://victoriametrics.zendesk.com/agent/tickets/99 * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-25 13:54:03 +02:00
Aliaksandr Valialkin	0d79c8cbef	docs/CHANGELOG.md: document cfc6c14dc48ae9dd35e65f1a6e5c7af8ccb9f029	2022-02-25 13:52:48 +02:00
Aliaksandr Valialkin	a16f1ae565	lib/storage: properly handle series selector matching multiple metric names plus a negative filter Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2238 This is a follow-up for `00cbb099b6`	2022-02-24 12:15:54 +02:00
Aliaksandr Valialkin	3f49bdaeff	lib/promrelabel: add support for conditional relabeling via `if` filter Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1998	2022-02-24 02:27:26 +02:00
Nikolay	fbac1a9dad	fixes jwt token parse with correct base64Url decoding (#281 ) * fixes jwt token parse with correct base64Url decoding it must be applied according to jwt RFC that requires token to be URL safe added slow path for decoding tokens with std base64 decoding adds error logging for vmgateway * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-23 13:57:36 +02:00
Aliaksandr Valialkin	62b46007c5	lib/workingsetcache: reduce the default cache rotation period from hour to 20 minutes This should reduce memory usage under high time series churn rate	2022-02-23 13:41:45 +02:00
Aliaksandr Valialkin	acbea6c1ee	docs/CHANGELOG.md: cut v1.73.1	2022-02-22 21:11:42 +02:00
Aliaksandr Valialkin	0a38542a45	docs/CHANGELOG.md: link to the feature request for X-Influxdb-Version response header Follow-up for `71ef3155c8` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2209	2022-02-22 20:35:53 +02:00
Yurii Kravets	75f3db1f5c	Update URL examples (#2207 ) added div with copy function	2022-02-22 20:08:35 +02:00
Denys Holius	1685e181ae	Added minimal supported version of AlertManager (#2237 ) * added minimal supported version of supported AlertManager * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-22 20:07:04 +02:00
Roman Khavronenko	69d1893f4c	Consul SD - update services on the watcher's start (#2202 ) * lib/discovery/consul: update services on the watcher's start Previously, watcher's start was only initing goroutines for discovery but not waiting for the first iteration to end. It means first Consul discovery wasn't returning discovered targets until the next iteration. The change makes the watcher's start blocking until we get first discovery iteration done and all registries updated. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: remove workarounds for consul SD Now when consul SD lib properly updates services on the first start, we don't need workarounds in vmalert. Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/discovery/consul: update after review Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 15:32:45 +02:00
Aliaksandr Valialkin	979d89f5dd	app/vmagent: add `-influxDBLabel` in the same way as for app/vminsert This is a follow-up for `3d19fa6932`	2022-02-21 14:09:20 +02:00
Roman Khavronenko	b6ed9afd6d	lib: allow to configure cache size by type (#2206 ) * lib: allow to configure cache size by type https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1940 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 13:50:34 +02:00
Pablo Ley	affaf373ea	Added missing inlineScrapeConfig field to the VMAgentSpec docs	2022-02-18 19:46:17 +03:00
Aliaksandr Valialkin	debe75f51c	docs: `make docs-sync`	2022-02-18 12:24:49 +02:00
Roman Khavronenko	3ac3124eed	docs: make profiling commands more copy-friendly (#2213 ) * docs: make profiling commands more copy-friendly The change adds `copy text` snippet to code examples and replaces hostname placeholders with `0.0.0.0`. Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-18 12:23:36 +02:00
Aliaksandr Valialkin	71ef3155c8	app/vminsert: add `X-Influxdb-Version` response header for InfluxDB API requests This is needed for some clients, which expect this header. See https://github.com/ntop/ntopng/issues/5449#issuecomment-1005347597	2022-02-17 12:47:43 +02:00
Aliaksandr Valialkin	3c3805865b	docs: document `3d19fa6932`	2022-02-16 23:30:17 +02:00
Aliaksandr Valialkin	b71be42d90	lib/storage: use binary search instead of full scan for skipping artificial tags when searching for tag names or tag values This should improve performance for /api/v1/labels and /api/v1/label/<label_name>/values See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2200	2022-02-16 18:15:41 +02:00
Aliaksandr Valialkin	21c92d7ef1	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics doesnt check DD_API_KEY when accepting data via DataDog protocol	2022-02-16 14:38:00 +02:00
匠心零度	88a2659f1a	Correct URL:How to delete time series (#2201 ) Co-authored-by: lirenzuo <lirenzuo@shein.com>	2022-02-16 08:32:57 +02:00
Aliaksandr Valialkin	5748139aa4	docs/url-examples.md: formatting fixes	2022-02-15 21:24:49 +02:00
Aliaksandr Valialkin	424121c126	docs/CHANGELOG.md: document `2efa46a11c`	2022-02-15 21:11:56 +02:00
Aliaksandr Valialkin	55facde841	docs/Single-server-VictoriaMetrics.md: clarify that the data is imported into VictoriaMetrics at `how to import data` section	2022-02-15 21:08:22 +02:00
Aliaksandr Valialkin	ee5da826e9	docs: update `-help` output for VictoriaMetrics components	2022-02-15 21:08:22 +02:00
Denys Holius	b3e1119592	Update revisions of dashboards (#2199 ) * update revision of vmcluster for operator guide * update revision of vmcluster for vmcluster guide	2022-02-15 17:21:42 +02:00
Yurii Kravets	64720d3c03	Create url-examples.md	2022-02-15 16:19:55 +02:00
Oct	6f685c8e43	docs: correct address in the docs (#2189 ) * docs/FAQ.md:fix 404 url * app/vmui/packages/vmui/README.md:rm 404 url	2022-02-15 12:58:48 +02:00
Aliaksandr Valialkin	0f9e107e36	docs/CHANGELOG.md: document `ad6bdd78d0`	2022-02-15 12:47:55 +02:00
Aliaksandr Valialkin	ac502785b6	docs/CHANGELOG.md: cut v1.73.0	2022-02-14 17:54:32 +02:00
Aliaksandr Valialkin	1215f51043	docs/CHANGELOG.md: document `3d890e89f1`	2022-02-14 17:39:12 +02:00
Nikolay	75e84144c7	adds release build for macos darwin amd64 and arm64 (#2185 ) * adds release build for macos darwin amd64 and arm64 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1896 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1851 * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-14 17:28:56 +02:00
Aliaksandr Valialkin	578a37aa14	docs/CHANGELOG.md: document `c90c1c4d54`	2022-02-14 13:09:12 +02:00
Aliaksandr Valialkin	f10c38b827	lib/promscrape: add `expand all` and `collapse all` buttons to `/targets` page	2022-02-12 18:41:29 +02:00
Aliaksandr Valialkin	b1f94f7f0e	app/vmselect/promql: return at most one time series from `absent_over_time()` in the same way as Prometheus does See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2130	2022-02-12 15:45:09 +02:00
Aliaksandr Valialkin	a56b77db5b	docs/vmagent.md: add `unsupported Prometheus config sections` chapter	2022-02-12 01:08:10 +02:00
Aliaksandr Valialkin	d8ffbf55a2	docs/CHANGELOG.md: document `ea153e5f90`	2022-02-12 00:48:06 +02:00
Roman Khavronenko	cf1a8bce6b	lib/index: reduce read/write load after indexDB rotation (#2177 ) * lib/index: reduce read/write load after indexDB rotation IndexDB in VM is responsible for storing TSID - ID's used for identifying time series. The index is stored on disk and used by both ingestion and read path. IndexDB is stored separately to data parts and is global for all stored data. It can't be deleted partially as VM deletes data parts. Instead, indexDB is rotated once in `retention` interval. The rotation procedure means that `current` indexDB becomes `previous`, and new freshly created indexDB struct becomes `current`. So in any time, VM holds indexDB for current and previous retention periods. When time series is ingested or queried, VM checks if its TSID is present in `current` indexDB. If it is missing, it checks the `previous` indexDB. If TSID was found, it gets copied to the `current` indexDB. In this way `current` indexDB stores only series which were active during the retention period. To improve indexDB lookups, VM uses a cache layer called `tsidCache`. Both write and read path consult `tsidCache` and on miss the relad lookup happens. When rotation happens, VM resets the `tsidCache`. This is needed for ingestion path to trigger `current` indexDB re-population. Since index re-population requires additional resources, every index rotation event may cause some extra load on CPU and disk. While it may be unnoticeable for most of the cases, for systems with very high number of unique series each rotation may lead to performance degradation for some period of time. This PR makes an attempt to smooth out resource usage after the rotation. The changes are following: 1. `tsidCache` is no longer reset after the rotation; 2. Instead, each entry in `tsidCache` gains a notion of indexDB to which they belong; 3. On ingestion path after the rotation we check if requested TSID was found in `tsidCache`. Then we have 3 branches: 3.1 Fast path. It was found, and belongs to the `current` indexDB. Return TSID. 3.2 Slow path. It wasn't found, so we generate it from scratch, add to `current` indexDB, add it to `tsidCache`. 3.3 Smooth path. It was found but does not belong to the `current` indexDB. In this case, we add it to the `current` indexDB with some probability. The probability is based on time passed since the last rotation with some threshold. The more time has passed since rotation the higher is chance to re-populate `current` indexDB. The default re-population interval in this PR is set to `1h`, during which entries from `previous` index supposed to slowly re-populate `current` index. The new metric `vm_timeseries_repopulated_total` was added to identify how many TSIDs were moved from `previous` indexDB to the `current` indexDB. This metric supposed to grow only during the first `1h` after the last rotation. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-12 00:30:08 +02:00
Roman Khavronenko	e3adcbec6e	lib/promscrape: support prometheus-like duration in scrape configs (#2169 ) * lib/promscrape: support prometheus-like duration in scrape configs The change allows to specify duration values like `1d`, `1w` for fields `scrape_interval`, `scrape_timeout`, etc. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/817#issuecomment-1033384766 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/blockcache: make linter happy Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/promscrape: support prometheus-like duration in scrape configs * add support for extra fields `scrape_align_interval` and `scrape_offset`; * support Prometheus duration parsing for `__scrape_interval__` and `__scrape_duration__` labels; Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip * docs/CHANGELOG.md: document the feature Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 16:17:00 +02:00
Aliaksandr Valialkin	3cb72ccc2a	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_endpointslice_{label,annotation}*` labels to be consistent with other `role` values for Kubernetes service discovery	2022-02-11 14:54:47 +02:00
Nikolay	4e7f7f3302	fixes service discovery for kubernetes (#2173 ) * fixes service discovery for kubernetes now it must take in account all pods that belong to the discovered endpoint and endpointslice adds simple test for endpoints https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2134 * wip * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 13:34:22 +02:00
Aliaksandr Valialkin	8f2d03fdc7	docs/CHANGELOG.md: document `4e722c459b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2167	2022-02-10 12:20:12 +02:00
Aliaksandr Valialkin	480e40b344	docs/Articles.md: add an article from Asserts.io, which mentions VictoriaMetrics components	2022-02-10 12:16:43 +02:00
Aliaksandr Valialkin	0028b2c6d1	docs/CHANGELOG.md: add instructions on how to build VictoriaMetrics components from source code in order to test tip changes	2022-02-08 16:44:08 +02:00
Nikolay	a8acad7453	adds CGO build for arm64 (#2102 ) * adds CGO build for arm64 it must improve performance for arm64 based deployments of vmstorage and vmsingle for 15-20% it depends on gozstd package update for correct musl gozstd vendoring * typo fixes * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 16:25:59 +02:00
Roman Khavronenko	e855b202df	docs: add Storage section to docs (#2155 ) * docs: add Storage section to docs https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2151 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 15:59:17 +02:00
Aliaksandr Valialkin	3e783aa2a1	docs/Cluster-VictoriaMetrics.md: sync with cluster branch	2022-02-08 15:43:21 +02:00
Aliaksandr Valialkin	9bb60ab00f	lib/promscrape: set `-promscrape.config.strictParse` to true by default This allows detecting long-living silent errors in -promscrape.config	2022-02-08 15:41:43 +02:00
Aliaksandr Valialkin	de26d1ff23	docs/Single-server-VictoriaMetrics.md: add a link to exlanation on how downsampling works	2022-02-08 15:10:41 +02:00
Aliaksandr Valialkin	8b36044c93	docs/CHANGELOG.md: add links to issues, which could benefit from improved re-routing algorithm	2022-02-07 16:55:28 +02:00
Aliaksandr Valialkin	baab622db6	docs: fix links to FAQ.md entries after they have been changed in `ccf04239e6`	2022-02-07 16:02:44 +02:00
Aliaksandr Valialkin	865f09ecbb	docs: sync with cluster branch	2022-02-07 14:54:16 +02:00
Aliaksandr Valialkin	ba1b3b8ef2	docs: cross-link downsampling docs from deduplication and vmalert docs	2022-02-04 11:57:05 +02:00
Aliaksandr Valialkin	b5b3c585b3	lib/promscrape: show the total number of scrapes and the total number of scrape errors per target at /targets page This information may be useful when debugging unreliable scrape targets	2022-02-03 20:22:41 +02:00
Aliaksandr Valialkin	2968779f16	lib/promscrape: provide the ability to fetch target responses on behalf of vmagent or single-node VictoriaMetrics This feature may be useful when debugging metrics for the given target located in isolated environment	2022-02-03 19:00:55 +02:00
Aliaksandr Valialkin	4b850c2a59	app/vmselect/promql: do not push down filters, which enumerate more than 10k unique values Such filters may slow down time series search, so just skip them. This is a follow-up for `e7f1ceeb84` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1827	2022-02-02 23:40:02 +02:00
Aliaksandr Valialkin	4ef32df4fa	docs/CHANGELOG.md: document `55e3bbd4cc` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1567	2022-02-02 23:32:35 +02:00
Aliaksandr Valialkin	6530bcedec	docs: updates after `5da71eb685` * Mention about the ability to configure vmalert notifiers via files in docs/CHANGELOG.md * Mention about the ability to use Consul service discovery for vmalert notifiers in docs/CHANGELOG.md * Run `make docs-sync` in order to sync app/vmalert/README.md to docs/vmalert.md	2022-02-02 23:26:18 +02:00
Pablo Ley	a6587ded51	Added missing links in EmbeddedHPA API docs	2022-02-02 18:59:42 +03:00
Aliaksandr Valialkin	ead66155ef	lib/cgroup: expose `process_cpu_cores_available` metric This metric shows the number of CPU cores available to the process. This allows creating alerting rules on CPU saturation with the following query: rate(process_cpu_seconds_total[5m]) / process_cpu_cores_available > 0.9 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2107	2022-01-31 20:24:41 +02:00
Aliaksandr Valialkin	e7f1ceeb84	app/vmselect/promql: optimize queries, which join on `_info` metrics. Automatically add common filters from one side of binary operation to the other side before sending the query to storage subsystem. See https://grafana.com/blog/2021/08/04/how-to-use-promql-joins-for-more-effective-queries-of-prometheus-metrics-at-scale/ and https://www.robustperception.io/exposing-the-software-version-to-prometheus	2022-01-31 19:32:36 +02:00
Aliaksandr Valialkin	15475a9d1f	docs/Release-Guide.md: add instructions on how to create signed release tags	2022-01-31 19:18:48 +02:00
Aliaksandr Valialkin	3d8a4bf023	docs/CHANGELOG.md: document `6a519896db`	2022-01-31 12:41:57 +02:00
Aliaksandr Valialkin	97947c5fcf	docs/vmauth.md: mention that backend services must be accessible only via vmauth	2022-01-28 12:06:45 +02:00
Denys Holius	527bee4b1e	FAQ update (#2111 ) * FAQ update: how downsampling and deduplication will work at the same time * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-01-27 20:35:16 +02:00
jaysony	2e59b17108	correct VMAgentStatus description (#2109 ) correct VMAgentStatus description from VMAlert to VMAgent.	2022-01-27 20:18:05 +02:00
Aliaksandr Valialkin	e02e0508da	vendor: update github.com/VictoriaMetrics/metricsql from v0.37.0 to v0.38.0 This adds more optimization cases for https://utcc.utoronto.ca/~cks/space/blog/sysadmin/PrometheusLabelNonOptimization For example: * Multi-level transform functions. For example, abs(round(foo{a="b"})) + bar{x="y"} is now optimized to abs(round(foo{a="b",x="y"})) + bar{a="b",x="y"} * Binary operations with `on()`, `without()`, `group_left()` and `group_right()` modifiers. For example, foo{a="b"} on (a) + bar is now optimized to foo{a="b"} on (a) + bar{a="b"} * Multi-level binary operations. For example, foo{a="b"} + bar{x="y"} + baz{z="q"} is now optimized to foo{a="b",x="y",z="q"} + bar{a="b",x="y",z="q"} + baz{a="b",x="y",z="q"} * Aggregate functions. For example, sum(foo{a="b"}) by (c) + bar{c="d"} is now optimized to sum(foo{a="b",c="d"}) by (c) + bar{c="d"}	2022-01-27 19:03:54 +02:00
Aliaksandr Valialkin	a41c34705e	docs/operator: fix links to Operator API docs	2022-01-25 17:38:16 +02:00
Aliaksandr Valialkin	746ee191e8	lib/logger/throttler.go: show the original location of the error and warning message Previously the location inside LogThrottler implementation was shown. This could complicate debugging.	2022-01-23 13:55:00 +02:00
f41gh7	ceb1376267	updates operator docs	2022-01-21 19:03:19 +03:00
Yury Molodov	ad5059f2d3	vmui: fixed display type switching (#2088 ) * fix: correct switch display type * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 16:56:22 +02:00
Yurii Kravets	3ea054a52c	Created Operator folder in docs (#2034 ) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed	2022-01-21 12:05:58 +02:00
Yury Molodov	adbb821eac	vmui: fix time range selector (#2085 ) * fix: add date validate for time range * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 12:02:38 +02:00
Aliaksandr Valialkin	eb4bd92fac	all: update link to EULA from https://victoriametrics.com/assets/VM_EULA.pdf to https://victoriametrics.com/legal/eula/	2022-01-20 22:23:27 +02:00
Aliaksandr Valialkin	145337792d	lib/{mergeset,storage}: properly limit cache sizes for indexdb Previously these caches could exceed limits set via `-memory.allowedPercent` and/or `-memory.allowedBytes`, since limits were set independently per each data part. If the number of data parts was big, then limits could be exceeded, which could result to out of memory errors. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-01-20 18:37:17 +02:00
Aliaksandr Valialkin	84f6b3014c	docs/CHANGELOG.md: document the bugfix for highestMax() function is Graphite render API	2022-01-20 12:16:18 +02:00
Aliaksandr Valialkin	56168d8565	docs/Release-Guide.md: update instructions for exporting snapcraft login to ~/.snap/login.json	2022-01-19 15:20:59 +02:00
Aliaksandr Valialkin	109363de49	docs/CHANGELOG.md: add missing parens in example for `@` modifier	2022-01-19 13:04:51 +02:00
Oct	ccf04239e6	docs: Correct some urls in the docs (#2081 ) * docs:update Swift S3 api url * docs/vmbackup.md: update Swift S3 api url * docs: update KairosDB docs url * docs: update thanos docs url	2022-01-19 11:55:30 +02:00
Aliaksandr Valialkin	98edeac7b7	docs/CHANGELOG.md: fix incorrect link to the issue Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2022-01-19 00:06:44 +02:00
Aliaksandr Valialkin	8f5902dfcf	docs/CHANGELOG.md: cut v1.72.0	2022-01-18 22:43:18 +02:00
Aliaksandr Valialkin	919ee73153	docs/vmbackup.md: `make docs-sync` after `ca11def2a5`	2022-01-18 22:29:17 +02:00
Roman Khavronenko	0b0bf94c96	docs: update retention docs with additional details (#2060 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-01-18 22:25:48 +02:00
Yury Molodov	8bdc45ba00	fix: remove buffer period (#2078 ) * fix: remove buffer period * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the implemented feature Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2064 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 21:42:56 +02:00
Yury Molodov	70737ea4ac	vmui: correct url encoding (#2067 ) * fix: correct encode multi-line queries * fix: change autocomplete for correct arrows work * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2039 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 21:31:46 +02:00
Aliaksandr Valialkin	dcadec65b6	docs/CHANGELOG.md: document `8e3f9c1fbb`	2022-01-18 21:24:49 +02:00
Oct	ca11def2a5	docs: Correct config URL (#2077 ) docs: update incorrect links	2022-01-18 15:06:00 +02:00
Aliaksandr Valialkin	e933e3150d	docs/CHANGELOG.md: document `fcd33fc409`	2022-01-18 12:46:33 +02:00
Aliaksandr Valialkin	c2a3911bb5	docs/CHANGELOG.md: document that vmgateway now supports extra_filters option Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:39:25 +02:00
Aliaksandr Valialkin	dbfa1421ac	docs/vmgateway.md: update docs, since vmgateway now supports extra_filters See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:39:25 +02:00
Aziz Köksal	74a4c29729	docs: proofread FAQ.md (#2062 ) * Added missing articles. * Changed minus characters to long dashes. * Rephrased some words. * Corrected grammar mistakes. * Set correct possessive apostrophes. * "setup" -> "set up" * "no need in" -> "no need for" * "comparing" -> "compared" * "less" -> "fewer" * "additionally" -> "in addition to"	2022-01-17 21:56:19 +02:00
Aliaksandr Valialkin	1bdc71d917	app/vmselect/promql: implement `keep_metric_names` modifier for transform and rollup functions Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949	2022-01-14 04:14:59 +02:00
Aliaksandr Valialkin	f41846d002	app/vmselect/promql: add `stale_samples_over_time()` function	2022-01-14 01:48:04 +02:00
Aliaksandr Valialkin	96707223db	docs/CHANGELOG.md: yet another attempt to fix formatting for yaml snippet	2022-01-14 01:14:55 +02:00
Aliaksandr Valialkin	d7d83d6d93	docs/CHANGELOG.md: fix formatting for `scrape_configs` example	2022-01-14 01:02:32 +02:00
Aliaksandr Valialkin	1d05444b33	lib/promscrape: expose promscrape_stale_samples_created_total metric for monitoring the number of created stale samples	2022-01-14 01:00:46 +02:00
Aliaksandr Valialkin	831b93a755	app/vmalert: add `parseDuration` function in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/8817	2022-01-13 23:30:41 +02:00
Aliaksandr Valialkin	80f03177c4	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_node_provider_id` label for discovered Kubernetes nodes in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/9603	2022-01-13 23:16:02 +02:00
Aliaksandr Valialkin	80f966b80c	app/vmalert: add `stripPort` template function in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/10002	2022-01-13 22:53:42 +02:00
Aliaksandr Valialkin	355a63733d	lib/promscrape/discovery/kubernetes: add the ability to limit service discovery to the current namespace See https://github.com/prometheus/prometheus/issues/9782 and https://github.com/prometheus/prometheus/pull/9881	2022-01-13 22:44:35 +02:00
Aliaksandr Valialkin	c883c15878	app/vmselect/promql: add support for `@` modifier Add support for `@` modifier in MetricsQL according to https://prometheus.io/docs/prometheus/latest/querying/basics/#modifier Extend the support with the following features: * Allow using `@` modifier everywhere in the query. For example, `sum(foo) @ end()` * Allow using arbitrary expression as `@` modifier. For example, `foo @ (end() - 1h)` returns `foo` value at `end - 1 hour` timestamp on the selected time range `[start ... end]` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1348	2022-01-13 22:12:06 +02:00
Aliaksandr Valialkin	17eb86a689	lib/promscrape/discovery/dockerswarm: follow up after `68a117a25a` - Document the bugfix at docs/CHANGELOG.md - Set __address__ field after copying commonLabels to the resulting map of discovered labels. This makes sure that the correct __address__ label is used.	2022-01-11 09:20:10 +02:00
Aliaksandr Valialkin	7a2c46d951	docs/CHANGELOG.md: document `77bfa8181d`	2022-01-11 08:53:49 +02:00
Dmitry Tolstoy	b434be3d2d	docs: Correct config URL (#2051 ) Missed /guides folder	2022-01-10 16:24:41 +02:00
Aliaksandr Valialkin	bdba50432b	docs/CHANGELOG.md: add release dates for every release	2022-01-07 12:27:32 +02:00
Aliaksandr Valialkin	e4e36383e2	lib/promscrape: do not send staleness markers on graceful shutdown This follows Prometheus behavior. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2013#issuecomment-1006994079	2022-01-07 01:17:57 +02:00
Aliaksandr Valialkin	bc03ab6688	docs/vmctl.md: `make docs-sync`	2022-01-07 01:17:30 +02:00
Aliaksandr Valialkin	46c310f62f	docs/FAQ.md: add `what is the difference between vmagent and Prometheus agent` chapter	2022-01-06 23:13:11 +02:00
Aliaksandr Valialkin	c70c064752	docs: follow-up after `ae89b4e818`	2022-01-05 16:31:45 +02:00
Denys Holius	ae89b4e818	Old links replaced for newest (#2033 ) * replaced old links to the website * fixed deletion main README.md file * fix: added docs files after docs-sync	2022-01-05 16:30:13 +02:00
Aliaksandr Valialkin	dbe592597f	docs/CHANGELOG.md: clarify the issue description, which is fixed by `38bf5fc136`	2022-01-05 16:19:06 +02:00
Aliaksandr Valialkin	178dd87e26	lib/storage: follow-up for `38bf5fc136`	2022-01-05 16:00:11 +02:00
Aliaksandr Valialkin	e1d7cbfc77	docs/CHANGELOG.md: document `60266078ca`	2022-01-04 11:44:57 +02:00
Aliaksandr Valialkin	5ce94e1dd3	docs/CHANGELOG.md: document `ac47733044`	2022-01-03 21:15:44 +02:00
Aliaksandr Valialkin	b1b67169f1	docs/Quick-Start.md: simplify quick start guide	2022-01-03 17:28:38 +02:00
Yurii Kravets	f0c331c724	Update README.md (#1996 ) * Update README.md go 1.16 -> 1.17 * Update README.md * Update README.md * Update Cluster-VictoriaMetrics.md * Update Single-server-VictoriaMetrics.md * Update vmauth.md * Update vmbackup.md * Update vmrestore.md * Update vmagent.md * Update vmctl.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md	2021-12-23 12:09:59 +02:00
Aliaksandr Valialkin	b5ce35dfc8	docs/CHANGELOG.md: document `543bd0ea0c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1999	2021-12-23 12:08:06 +02:00
Aliaksandr Valialkin	cbaa2af280	lib/promscrape: scrape replicated targets at different offsets in vmagent replicated clustering mode This guarantees that the deduplication consistently leaves samples from the same vmagent replica. See https://docs.victoriametrics.com/vmagent.html#scraping-big-number-of-targets	2021-12-23 00:20:39 +02:00
Aliaksandr Valialkin	c7826ab36e	docs/FAQ.md: link to managed VictoriaMetrics at AWS See https://docs.victoriametrics.com/FAQ.html#what-is-the-pricing-for-victoriametrics	2021-12-22 23:14:47 +02:00
Nikolay	8ff7da7202	adds restore.lock (#1988 ) * adds restore.lock it must prevent from running storage after incomplete restore process https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 * return back flock file deletion * Apply suggestions from code review * wip * docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-22 13:10:15 +02:00
Aliaksandr Valialkin	3cfb90b227	docs/CHANGELOG.md: document `34fdc8881b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2021-12-21 16:40:39 +02:00
Denys Holius	5dc9ab5829	bump revision of dashboards to latest (#1986 )	2021-12-21 12:11:15 +02:00
Aliaksandr Valialkin	ee17516afd	docs/Single-server-VictoriaMetrics.md: mention that recording rules in vmalert can be used for reducing the number of time series	2021-12-20 20:03:42 +02:00
Aliaksandr Valialkin	4701c108ff	docs/CHANGELOG.md: cut v1.71.0	2021-12-20 19:10:24 +02:00
Aliaksandr Valialkin	ad388ecd78	docs: mention that downsampling can be evaluated for free by running enterprise binaries	2021-12-20 15:57:25 +02:00
Yurii Kravets	40073bbcb5	Update FAQ.md (#1765 ) * Update FAQ.md Adding explanation "Why do same metrics have differences in VictoriaMetrics and Prometheus dashboards?" * Update FAQ * Update FAQ.md * Apply suggestions from code review Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-12-20 13:43:04 +02:00
Aliaksandr Valialkin	974d9c0eee	app/vmselect/promql: follow-up after `177e345d8a` * Document changes_prometheus(), increase_prometheus() and delta_prometheus() functions. * Simplify their implementation * Mention these functions in docs/CHANGELOG.md	2021-12-20 13:19:44 +02:00
Aliaksandr Valialkin	d87414c57c	docs/FAQ.md: describe main reasons for high churn rate	2021-12-20 12:30:09 +02:00
Aliaksandr Valialkin	16636a458f	docs/CHANGELOG.md: document `6814cc6809` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1943	2021-12-17 20:16:22 +02:00
Aliaksandr Valialkin	193331d522	app/vmselect: de-duplicate data exported via `/api/v1/export/csv` by default Previously the exported data wasn't de-duplicated. Now it is possible to export the raw data without deduplication by passing reduce_mem_usage=1 query arg to /api/v1/export/csv See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-12-17 10:57:39 +02:00
Roman Khavronenko	f30ed13155	docs: add Benchmarks section (#1950 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-16 19:15:19 +03:00
Roman Khavronenko	8b0d340c18	docs: update `MetricsQL`.`Subquery` section description (#1951 ) * simplify sentences; * fix typo. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-16 19:09:25 +03:00
Aliaksandr Valialkin	a3adf24527	lib/promscrape: allow up to 5 redirects when scraping a target by default See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1945	2021-12-16 00:14:14 +02:00
Aliaksandr Valialkin	5efe377a26	app/vmselect/promql: add `timestamp_with_name(m[d])` function This function works the same as `timestamp()`, but doesn't remove source time series names. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949#issuecomment-995222388	2021-12-15 23:37:07 +02:00
Aliaksandr Valialkin	27a1ae57e5	docs: mention `-storage.minFreeDiskSpaceBytes` command-line flag at `capacity planning` section See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1727 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-12-15 21:41:30 +02:00
Aliaksandr Valialkin	65bef771f6	docs/Cluster-VictoriaMetrics.md: mention about the added downsampling support	2021-12-15 16:40:15 +02:00
Aliaksandr Valialkin	8e1a87491a	docs: document the added dowsnampling support in VictoriaMetrics enterprise Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/36	2021-12-15 16:25:51 +02:00
Aliaksandr Valialkin	4ff647137a	lib/storage: deduplicate samples more thoroughly Previously some duplicate samples may be left on disk for time series with high churn rate. This may result in higher disk space usage.	2021-12-15 15:59:58 +02:00
Aliaksandr Valialkin	acd56603b0	app/victoria-metrics: mention https://docs.victoriametrics.com/#downsampling in the description for -dedup.minScrapeInterval command-line flag	2021-12-15 13:18:04 +02:00
Aliaksandr Valialkin	e1a715b0f5	lib/storage: convert alternate regexps into Graphite wildcards inside `__graphite__` pseudo-label For example, `{__graphite__=~"foo.(bar\|baz)"}` is automatically converted to `{__graphite__=~"foo.{bar,baz}"}` before execution. This allows using multi-value Grafana template variables such as `{__graphite__=~"foo.($app)"}`.	2021-12-14 19:51:49 +02:00
Aliaksandr Valialkin	d456af7499	docs/CHANGELOG.md: link to the issue about `unaligned 64-bit atomic opertion` panic on 32-bit architectures	2021-12-14 15:00:10 +02:00
Aliaksandr Valialkin	80996d916b	docs/CHANGELOG.md: an attempt to properly show $labels.alertname at https://docs.victoriametrics.com/CHANGELOG.html	2021-12-14 14:56:57 +02:00
Yury Molodov	49e6a921df	vmui: custom step (#1942 ) * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * feat: add custom step * update package-lock.json * docs: document that VMUI now supports overriding of `step` query arg, which is passed to `/api/v1/query_range` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-14 14:51:45 +02:00
Yury Molodov	b5b701d590	vmui: minor fixes (#1936 ) * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document bugfixes Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-13 13:42:37 +02:00
Aliaksandr Valialkin	0a157f65bd	docs/Single-server-VictoriaMetrics.md: added a link to Graphite paths and wildcards - https://graphite.readthedocs.io/en/latest/render_api.html#paths-and-wildcards	2021-12-13 12:01:17 +02:00
Aliaksandr Valialkin	c82cc9cd11	docs/CHANGELOG.md: document `7c3b6365f0`	2021-12-12 19:09:20 +02:00
Aliaksandr Valialkin	d1f8915ed1	app/vmselect/promql: preserve the order of time series passed to `limit_offset()` function Previously time series passed to `limit_offset()` were shuffled according to hash for their labels. This was unexpected behaviour for most users. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1920 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/951	2021-12-12 18:04:58 +02:00
Aliaksandr Valialkin	3d4349343d	docs/CHANGELOG.md: document `2851709745` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1921	2021-12-10 12:13:34 +02:00
Aliaksandr Valialkin	b42981c465	docs/Single-server-VictoriaMetrics.md: add a link to https://github.com/denisgolius/victoriametrics-ru-links	2021-12-09 19:42:27 +02:00
Aliaksandr Valialkin	52eb9c99e2	docs: document the ability to investigate correlation between two queries at /vmui This is a follow-up for `c1fd93e8a0`	2021-12-08 17:24:01 +02:00
Yury Molodov	c1fd93e8a0	vmui: multiple queries (#1916 ) * feat: change duration by "enter" * fix: optimize data processing for chart * feat: set minimum step to 1ms * update dependencies * feat: remove save the last query to local storage * fix: handle an error in a table with subqueries * feat: store display type in URL * Revert "feat: store display type in URL" This reverts commit `ccc242c69a`. * feat: store display type in URL * refactor: move the time setting to a folder * refactor: move the query configurator to a folder * refactor: move the auth settings to a folder * feat: improve styles * feat: add multi query * update package-lock * feat: add display multiple queries * feat: add limits for multiple queries * update dependencies * feat: add history for multiple queries * feat: add line type to legend * feat: change style for switch * feat: change the logic for axes limits for multiple queries * update package-lock.json * update dependencies * feat: add the filter to legend * wip * lib/httpserver: add missing 127.0.0.1 hostname to the logged address for http and pprof server if the address starts with ':' This allows copy-pasting the url to http server from logs. * lib/httpserver: add missing 127.0.0.1 hostname to the logged address for http and pprof server if the address starts with ':' This allows copy-pasting the url to http server from logs. Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-08 16:40:15 +02:00
Aliaksandr Valialkin	0288078cfb	docs/Single-server-VictoriaMetrics.md: add LinkedIn public channel	2021-12-08 13:15:24 +02:00
Aliaksandr Valialkin	64da5c2bf6	docs/Release-Guide.md: refresh the list of channels for publishing release notes	2021-12-08 13:15:05 +02:00
Aliaksandr Valialkin	2711d2ea55	docs/Single-server-VictoriaMetrics.md: move features chapter above the `case studies` chapter	2021-12-08 12:49:09 +02:00
Aliaksandr Valialkin	ff15a752c1	app/vmselect: accept optional `extra_filters[]` query args for all the supported Prometheus querying APIs See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2021-12-06 17:07:09 +02:00
Aliaksandr Valialkin	45d082bbe2	app/vminsert: add `-maxLabelValueLen` command-line flag See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1908	2021-12-06 11:40:34 +02:00
Aliaksandr Valialkin	da402fbdfa	lib/workingsetcache: fix `unaligned 64-bit atomic operation` panic on 32-bit architectures The panic has been introduced in `7275ebf91a`	2021-12-03 01:21:51 +02:00
Aliaksandr Valialkin	4888e2c232	docs/Cluster-VictoriaMetrics.md: sync with cluster branch	2021-12-03 00:13:02 +02:00
Aliaksandr Valialkin	06642d97f5	app: allow specifying http and https urls in the following command-line flags * -promscrape.config * -relabelConfig * -remoteWrite.relabelConfig * -remoteWrite.urlRelabelConfig	2021-12-03 00:10:02 +02:00
Aliaksandr Valialkin	62b4efb3e7	app/vmauth: follow-up for `13368bed18` * Document the ability to specify http or https urls in `-auth.config` at docs/CHANGELOG.md * Move the ReadFileOrHTTP to lib/fs, so it can be re-used in other places where a file should be read from the given path. For example, in `-promscrape.config` at `vmagent`.	2021-12-02 23:32:05 +02:00
Aliaksandr Valialkin	7f2f26b25f	docs/CHANGELOG.md: cut v1.70.0	2021-12-02 15:01:25 +02:00
Aliaksandr Valialkin	ed9ef7733b	docs/CHANGELOG.md: document `0afd14a14a`	2021-12-02 14:47:20 +02:00
Aliaksandr Valialkin	394a345ae0	lib/httpserver: expose `/-/healthy` and `/-/ready` endpoints as Prometheus does This improves integration with third-party solutions, which rely on these endpoints. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1833	2021-12-02 14:36:58 +02:00
Aliaksandr Valialkin	03f5ad3060	lib/protoparser/graphite: allow multiple separators between metric name, value and timestamp	2021-12-02 13:43:49 +02:00
Aliaksandr Valialkin	49a18b8660	lib/protoparser/graphite: properly parse Graphite line with whitespace after the timestamp See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1865	2021-12-02 13:33:26 +02:00
Aliaksandr Valialkin	91d8873d86	docs/FAQ.md: mention that VictoriaMetrics can be queried via vmui	2021-12-02 13:16:30 +02:00
Aliaksandr Valialkin	c0cbf0de2a	app/{vmbackup,vmrestore}: export internal metrics at `/metrics` http handler	2021-12-02 11:55:58 +02:00
Aliaksandr Valialkin	7275ebf91a	app/vmstorage: export vm_cache_size_max_bytes metrics for determining capacity of various caches The vm_cache_size_max_bytes metric can be used for determining caches which reach their capacity via the following query: vm_cache_size_bytes / vm_cache_size_max_bytes > 0.9	2021-12-02 10:30:43 +02:00
Aliaksandr Valialkin	2f63dec2e3	lib/fs: add `vm_filestream_read_duration_seconds_total` and `vm_filestream_write_duration_seconds_total` metrics These metrics help determining persistent disk saturation with `rate(vm_filestream_read_duration_seconds_total) > 0.9`	2021-12-02 10:30:42 +02:00
Roman Khavronenko	d052c8c81e	vmalert: adjust topologies docs in README (#1893 ) Commit changes images width and order in topologies section for better readability. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-02 11:27:46 +03:00
Denys Holius	23a03d23aa	added guide-vmcluster-multiple-retention-setup to guides list (#1891 )	2021-12-02 10:10:25 +02:00
Roman Khavronenko	866b6a842b	Vmalert docs upd (#1890 ) * vmalert: add topology examples in docs * vmalert: docs typo fix	2021-12-01 18:33:06 +03:00
Aliaksandr Valialkin	2c41f25fb8	README.md: add a link to https://docs.victoriametrics.com/guides/guide-vmcluster-multiple-retention-setup.html for multi-retention setups	2021-12-01 12:48:30 +02:00
Yurii Kravets	0afec0259b	Create guide-vmcluster-multiple-retention-setup.md (#1888 ) * Create guide-vmcluster-multiple-retention-setup.md * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-01 12:42:16 +02:00
Aliaksandr Valialkin	ed54b27b85	docs/CHANGELOG.md: document `06eff5a72c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/487	2021-12-01 12:28:06 +02:00
Yurii Kravets	5881c4ae48	Add retention-scheme.png	2021-11-30 15:57:44 +02:00
Aliaksandr Valialkin	e625436bca	docs/Articles.md: added a link to https://mist.io/blog/2021-11-26-kubernetes-and-victoriametrics-in-Mist-v4-6	2021-11-30 14:59:38 +02:00
Aliaksandr Valialkin	f06495c50a	docs/Single-server-VictoriaMetrics.md: document that the deduplication is applied only when exporting data in JSON line format The exported data isn't de-duplicated by default due to performance reasons. It is expected that the de-duplication is applied during importing the exported data. The deduplication is applied only when exporting data via /api/v1/export if `reduce_mem_usage=1` query arg isn't passed to the request. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-11-30 13:06:06 +02:00
Aliaksandr Valialkin	10bd8b1d86	docs/CHANGELOG.md: document `852a895b70`	2021-11-30 01:22:37 +02:00
Aliaksandr Valialkin	ca6fc0265e	docs/CHANGELOG.md: document `f05cddd2fc` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1830	2021-11-30 01:15:41 +02:00
Aliaksandr Valialkin	841647643a	docs/CHANGELOG.md: document `9dd650f67f`	2021-11-30 01:09:10 +02:00
Aliaksandr Valialkin	7e79fc6e3c	docs/CHANGELOG.md: document `624ad73705`	2021-11-30 01:05:05 +02:00
Aliaksandr Valialkin	98d244b288	docs/CHANGELOG.md: document `c6d5927281`	2021-11-30 01:00:36 +02:00
Aliaksandr Valialkin	d44c585ca4	lib/protoparser: do not log `connection reset by peer` error when reading the data via InfluxDB, Graphite and OpenTSDB protocols over plain TCP connections This error is expected, so there is no need in spamming the log with this error.	2021-11-29 21:47:56 +02:00
Aliaksandr Valialkin	03509025bc	docs/CHANGELOG.md: document `695cb617b2`	2021-11-29 12:13:11 +02:00
Aliaksandr Valialkin	9bee043ff2	app/vmselect/promql: consistently return zero from `deriv(const)`	2021-11-17 18:02:05 +02:00
Aliaksandr Valialkin	b688960db0	lib/persistentqueue: add vm_persistentqueue_read_duration_seconds_total and vm_persistentqueue_write_duration_seconds_total metrics for determining disk usage saturation at vmagent	2021-11-17 16:41:35 +02:00
Aliaksandr Valialkin	b900560b83	app/vmselect/promql: add `now()` function, which returns the current timestamp as a floating-point value in seconds	2021-11-17 16:35:30 +02:00
Aliaksandr Valialkin	52e19a0577	docs: document -s3ForcePathStyle command-line option This is a follow-up for `b72eed1f5e`	2021-11-17 01:09:32 +02:00
vic	1fb3dbcbda	Update Cluster-VictoriaMetrics.md (#1806 ) replicationFactor flag should be passed to vmselect instead of vminsert for improving query speed:)	2021-11-17 00:59:43 +02:00
Florian Klink	d8c70903ec	docs/vmalert.md: document vmalert url flags a bit more cleanly (#1823 ) Describe remoteWrite.url is used to persist rules and alerts state info, and add an additional paragraph explaining the separation between -remoteRead.url and -datasource.url. Fixes #1810.	2021-11-17 00:54:06 +02:00
Aliaksandr Valialkin	f3ac945d74	app/vmauth: add ability to override the `username` label value for `vmauth_user_requests_total` metric by specifying `name` option in `-auth.config` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1805	2021-11-17 00:47:34 +02:00
Aliaksandr Valialkin	7fda5d52ae	docs/Single-server-VictoriaMetrics.md: add a link to vmalert rules backfilling at `Backfilling` chapter	2021-11-17 00:23:23 +02:00
Aliaksandr Valialkin	5a180c6659	docs/CHANGELOG.md: document the addition of `vm_tenant_used_tenant_bytes` metric, which shows the per-tenant disk usage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1605	2021-11-16 23:36:48 +02:00
Aliaksandr Valialkin	c77ff2d293	docs/Articles.md: add a linkt to OSA Con talk about `how clickhouse inspired us to build victoriametrics`	2021-11-12 14:21:06 +02:00
Aliaksandr Valialkin	8b6c89423d	docs/CHANGELOG.md: document bugfixes in enteprise versions of vmagent and vmalert	2021-11-12 13:24:07 +02:00
Aliaksandr Valialkin	e2f823fffc	docs/Single-server-VictoriaMetrics.md: mention that it is possible to send gzipped data to /api/v1/import/prometheus	2021-11-09 20:45:14 +02:00
Aliaksandr Valialkin	e5d4c7f4a7	app/vmauth: initialize reverse proxy only after flag.Parse() is called This should properly take into accoun the `-maxIdleConnsPerBackend` command-line flag value. Previously it was hardcoded to 100. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1300	2021-11-09 19:22:34 +02:00
Aliaksandr Valialkin	5046efb94b	docs/vmalert.md: improve wording in `Multitenancy` chapter	2021-11-09 14:19:52 +02:00
Aliaksandr Valialkin	a67518fc6d	docs: mention that graphs on the official dashboards contain useful hints	2021-11-08 19:54:10 +02:00
Aliaksandr Valialkin	f39ee8dc95	docs/MetricsQL.md: mention than tlast_over_time() is an alias for timestamp()	2021-11-08 18:29:24 +02:00
Aliaksandr Valialkin	69e655ba7f	docs/CHANGELOG.md: cut v1.69.0	2021-11-08 15:47:36 +02:00
Aliaksandr Valialkin	3419ac1d36	app/vmselect/promql: add `duration_over_time(m[d], max_interval)` function This function calculates the actual lifetime of the time series on the given lookbehdind window `d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 13:14:09 +02:00
Aliaksandr Valialkin	e44137d46b	docs/MetricsQL.md: clarify documentation for `lifetime` function Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 12:35:17 +02:00
Aliaksandr Valialkin	b07010839c	Makefile: add `TAG=v... make publish-release` rule for building and publishing a release for the given TAG	2021-11-08 12:29:10 +02:00
Aliaksandr Valialkin	5edf695bc9	docs/CHANGELOG.md: document b9cdbcb5046315db96e1e7ca9923d09d0f30dc25	2021-11-08 12:11:30 +02:00
João Paulo	47d1612bf8	docs: fix multiple typos (#1787 ) Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-11-05 20:44:02 +02:00
Aliaksandr Valialkin	237885e0d2	docs/vmalert.md: document the addition of -defaultTenant.prometheus and -defaultTenant.graphite command-line options to enterprise version of vmalert	2021-11-05 20:04:09 +02:00
Aliaksandr Valialkin	bf814320b0	app/vmalert: remove `rule.type` config, since it doesnt play well with the upcoming default tenants for -clusterMode It is better from the consistency point of view to set up rule types at group level where tenant config is set up.	2021-11-05 19:52:32 +02:00
Aliaksandr Valialkin	cbfc7b7c92	app/{vminsert,vmagent}: hide passwords and auth tokens by default at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-05 14:41:16 +02:00
Denys Holius	cd966bf552	bumped grafana dashboards revisions for guides (#1784 )	2021-11-05 11:43:26 +02:00
Aliaksandr Valialkin	faa0eb6b52	docs/FAQ.md: mention that VictoriaMetrics can be queried via Graphite API	2021-11-04 22:37:56 +02:00
Aliaksandr Valialkin	a69264e885	app/vmagent: add `-remoteWrite.maxRowsPerBlock` command-line option, which may be used for improving data ingestion performance under high load	2021-11-04 15:39:14 +02:00
Aliaksandr Valialkin	e0d2ba5608	app/vmagent/remotewrite: send data to remote storage systems in parallel This should improve data ingestion speed when many `-remoteWrite.url` command-line flags are configured	2021-11-04 15:04:16 +02:00
Roman Khavronenko	1e84339df0	docs: make link to logos zip absolute (#1782 ) The relative link won't work for github-docs website, so we're changing it to absolute link. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-11-04 11:32:49 +02:00
Aliaksandr Valialkin	aa534c2582	lib/promscrape: add `-promscrape.maxResponseHeadersSize` command-line flag for tuning the maximum http response headers size from Prometheus scrape targets	2021-11-03 22:26:56 +02:00
Aliaksandr Valialkin	27044b84d2	app/vmselect/promql: add `limit_offset(limit, offset, q)` function, which can be used for paging over big number of time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1778	2021-11-03 16:02:27 +02:00
Aliaksandr Valialkin	43a58bd618	app/vmselect/promql: add `label_graphite_group()` function for extracting groups from Graphite metric names	2021-11-03 13:19:08 +02:00
Aliaksandr Valialkin	da2e0e29a4	docs/CHANGELOG.md: document `e3a91b186a`	2021-11-02 18:39:14 +02:00
Aliaksandr Valialkin	d1eb87c831	app/{vmagent,vminsert}: add ability to restrict access to /config page with authKey query arg The authKey can be configured via `-configAuthKey` command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-01 16:44:54 +02:00
Aliaksandr Valialkin	701973877f	docs/Articles.md: add a link to https://valyala.medium.com/how-to-optimize-promql-and-metricsql-queries-85a1b75bf986	2021-10-29 14:02:51 +03:00
Aliaksandr Valialkin	1a16dab9e1	docs/vmauth.md: typo fix	2021-10-28 14:06:00 +03:00
Aliaksandr Valialkin	bb87949d5c	lib/protoparser/influx: automatically detect timestamp precision depending on the number of decimal digits in the timestamp	2021-10-28 12:47:22 +03:00
Aliaksandr Valialkin	acfda6d8fd	app/vmbackupmanager: fix links to images This is a follow-up after `bd6b8f7e31`	2021-10-27 21:35:52 +03:00
Aliaksandr Valialkin	74b8af9891	lib/promscrape: add `collapse` and `expand` buttons per each group of targets from the same scrape job	2021-10-27 20:03:24 +03:00
Aliaksandr Valialkin	1952ab99aa	all: fix build issues and tests for Apple M1 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1653	2021-10-27 15:06:34 +03:00
Aliaksandr Valialkin	9ec0175e83	docs/CHANGELOG.md: mention the issue about missing `proxy_url` config option at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 22:06:35 +03:00
Aliaksandr Valialkin	4821adfd95	lib/promscrape: properly show `proxy_url` option value at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 21:23:54 +03:00
Dima Lazerka	e706fb5686	Fix doc: vmbackup splits by 1 GiB not 100 MB (#1756 ) This is a follow-up for `bdd0a1cdb2`	2021-10-26 19:19:49 +03:00
Aliaksandr Valialkin	a7e3cbd6ad	docs/CHANGELOG.md: document `3dbdf1632e`	2021-10-25 12:16:37 +03:00
Aliaksandr Valialkin	d5825f13d3	docs/Cluster-VictoriaMetrics.md: add links with the explanation of active time series and series churn rate	2021-10-24 18:40:19 +03:00
Aliaksandr Valialkin	6b6a4ca51d	docs/CaseStudies.md: fix a link to AbisoGaming case study	2021-10-24 18:36:58 +03:00
Aliaksandr Valialkin	8d0fafc377	docs/CHANGELOG.md: typo fix	2021-10-22 21:11:54 +03:00
Aliaksandr Valialkin	7f7cac20c1	docs/CHANGELOG.md: cut v1.68.0	2021-10-22 19:37:48 +03:00
Aliaksandr Valialkin	a69f1baa13	docs/vmauth.md: `make docs-sync`	2021-10-22 19:21:34 +03:00
Aliaksandr Valialkin	013d626889	app/vmauth: add ability to specify http headers to send in requests to backends See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1736	2021-10-22 19:10:29 +03:00
Aliaksandr Valialkin	7e88713ca3	docs/CHANGELOG.md: document `43a7984cd8`	2021-10-22 14:00:20 +03:00
Aliaksandr Valialkin	2876137c92	lib/promscrape: reduce memory usage if `-promscrape.noStaleMarkers` command-line flag is passed Do not store in memory the response from the last scrape per each target if -promscrape.noStaleMarkers option is enabled. This should reduce memory usage when the scraped targets return large responses.	2021-10-22 13:10:29 +03:00
Aliaksandr Valialkin	8568003bb1	docs/CHANGELOG.md: document `a3684fe3de`	2021-10-22 12:28:01 +03:00
Yury Molodov	2b266cb87e	vmui: query history (#1732 ) * feat: add query history * fix: change detect keyUp for nav query history * feat: set default query history * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-22 12:21:22 +03:00
Aliaksandr Valialkin	8ad95f0db7	lib/httpserver: expose command-line flags at `/flags` page This should simplify debugging. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-20 00:45:09 +03:00
Aliaksandr Valialkin	35a5eaeeb1	docs/Single-server-VictoriaMetrics.md: add a link to VMUI at VictoriaMetrics playground	2021-10-19 14:41:53 +03:00
Aliaksandr Valialkin	0d48b89afe	docs/CHANGELOG.md: document `146a5b504c`	2021-10-19 11:25:02 +03:00
Aliaksandr Valialkin	c64a134146	docs/CHANGELOG.md: document `cbcc622786`	2021-10-19 08:56:23 +03:00
Yury Molodov	a3e09a57c2	vmui: features (#1711 ) * feat: initial uPlot graph * feat: add zoom/pan for graph * fix: add zoom by ctrl/mac * fix: remove unused code * feat: add toggle cache for fetch * feat: add fix y-axis limits * fix: stop point events while panning * fix: change getting cursor position when scaling * feat: add cursor tooltip to graph * fix: uninstall chart.js * fix: change link for create an issue * fix: set default cache value to true * app/vmalert: follow-up after `0e2486df56` * docs/CHANGELOG.md: document `5416e18007` * app/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-18 15:16:57 +03:00
Alexander Rickardsson	0e2486df56	vmalert: add disablePathAppend to remote read (#1712 ) * vmalert: add disablePathAppend to remoteRead * docs: add docs for remoteRead.disablePathAppend	2021-10-18 10:24:52 +03:00
Aliaksandr Valialkin	c37f285466	lib/promscrape: set `honor_timestamps: true` by default if this option isnt set explicitly in scrape configs This aligns the behavior to Prometheus - see https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config	2021-10-16 20:49:08 +03:00
Aliaksandr Valialkin	dfc719e012	docs/CaseStudies.md: add Smarkets case study	2021-10-16 19:57:23 +03:00
Aliaksandr Valialkin	a1e54fa2c9	docs/CaseStudies.md: add Fly.io case study	2021-10-16 19:45:44 +03:00
Aliaksandr Valialkin	47c6baf5ea	docs/CaseStudies.md: add a case study for Razorpay	2021-10-16 19:36:33 +03:00
Aliaksandr Valialkin	3e9ffb6e33	docs/CaseStudies.md: add AbiosGaming	2021-10-16 19:26:04 +03:00
Aliaksandr Valialkin	ede9dd43e8	docs/CaseStudies.md: add Percona case study	2021-10-16 19:10:38 +03:00
Aliaksandr Valialkin	c055bc478c	lib/promscrape: expose `promscrape_series_limit_max_series` and `promscrape_series_limit_current_series` metrics per each scrape target with the enabled unique series limiter	2021-10-16 18:47:13 +03:00
Aliaksandr Valialkin	9866dd95c1	lib/promscrape: store the full response in stream parsing mode in scrapeWork.lastScrape byte slice This allows sending staleness marks and properly calculate scrape_series_added metric in stream parsing mode at the cost of the increased memory usage, since now the potentially big response is kept in the lastScrape byte slice per each scrapeWork. In practice the memory usage increase shouldn't be big, since the response size is usually much smaller than the parsed metrics from this response after the relabeling, which usually adds a big pile of target-specific labels per each metric.	2021-10-15 15:39:23 +03:00
Aliaksandr Valialkin	0db0410237	docs/FAQ.md: improve wording on why MetricsQL isnt 100% compatible with PromQL	2021-10-14 16:22:43 +03:00
Aliaksandr Valialkin	78425561ce	docs/CHANGELOG.md: document the change at `7fcbd3fa4b`	2021-10-14 14:37:44 +03:00
Aliaksandr Valialkin	1ac12597fa	docs/FAQ.md: add an entry explaining why MetricsQL isn't 100% compatible with PromQL	2021-10-14 12:50:31 +03:00
Aliaksandr Valialkin	bbd34fa15e	lib/promscrape: add `-promscrape.minResponseSizeForStreamParse` command-line option for automatic switching to stream parsing mode when scraping targets with big responses This should reduce memory usage when vmagent scrapes targets with non-uniform response sizes. This is common case in Kubernetes monitoring.	2021-10-14 12:29:35 +03:00
Aliaksandr Valialkin	1a7287c408	lib/promscrape: return error if `sample_limit` or `series_limit` options are set when stream parsing mode is enabled	2021-10-14 12:11:23 +03:00
Aliaksandr Valialkin	1c17fe70e0	docs/CHANGELOG.md: document `e3c8304deb`	2021-10-13 16:00:50 +03:00
Aliaksandr Valialkin	e3c8304deb	lib/promscrape: add ability to show the original labels for discovered targets at /targets page See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1698	2021-10-13 15:59:58 +03:00
Aliaksandr Valialkin	3d61a10367	docs/MetricsQL.md: add missing blank line before the link to github.com/VictoriaMetrics/metricsql package	2021-10-13 15:10:54 +03:00
Aliaksandr Valialkin	9882cda8b9	lib/promscrape: shard targets among cluster nodes after relabeling is applied This guarantees that targets with the same set of labels go to the same vmagent node. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1687#issuecomment-940629495	2021-10-12 17:06:00 +03:00
Aliaksandr Valialkin	5a58c041c2	app/vmagent: expose -promscrape.config contents at /config page as Prometheus does See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-12 16:25:37 +03:00
Aliaksandr Valialkin	4f242980be	docs/FAQ.md: add a solution against high churn rate	2021-10-12 10:32:39 +03:00
Roman Khavronenko	2c6d86226f	docs: mention "PromQL compliance" in MetricsQL docs (#1691 )	2021-10-11 21:21:29 +03:00
Aliaksandr Valialkin	a5001b9c20	app/vmselect/promql: add `atan2` binary operator, which is going to be added in Prometheus 2.31 See https://github.com/prometheus/prometheus/pull/9248	2021-10-11 21:15:53 +03:00
Aliaksandr Valialkin	81c6720392	app/vmselect/promql: add missing trigonometric functions, which are going to be added in Prometheus 2.31 See https://github.com/prometheus/prometheus/issues/9233	2021-10-11 21:01:33 +03:00
Aliaksandr Valialkin	8679ba71dd	docs/MetricsQL.md: clarify docs for union() function	2021-10-11 17:40:44 +03:00
Denys Holius	dd4038f0e5	Added some fixes (#1690 ) * removed not needed description * added some fixes and fixed typos	2021-10-11 11:21:07 +03:00
Aliaksandr Valialkin	986bed8261	docs/MetricsQL.md: add a link to https://medium.com/@romanhavronenko/victoriametrics-promql-compliance-d4318203f51e	2021-10-11 11:00:56 +03:00
Roman Khavronenko	9b557a88fc	docs: add "PromQL compliance" article (#1689 ) * docs: add "PromQL compliance" article * Update docs/Articles.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-11 10:58:34 +03:00
Aliaksandr Valialkin	92b92d4d2c	app/vmselect/promql: consistently return the same set of time series from `limitk()` function This is the expected behaviour by most users.	2021-10-08 19:53:52 +03:00
Aliaksandr Valialkin	001750c239	lib/storage: fix unaligned access on 32-bit architectures. The bug has been introduced at `a171916ef5`	2021-10-08 19:43:03 +03:00
Denys Holius	4b0cefc4bd	Added fixes and improvements (#1677 ) * added guide for VM operator * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Fixed different typos and added improvements from proposals * move remoteWrite.url to other place * fixed typo * rephrased vminsert explanation * remove not needed parameters for default setup Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-10-08 18:57:36 +03:00
Aliaksandr Valialkin	0a3a774202	docs/CHANGELOG.md: cut v1.67.0	2021-10-08 16:00:33 +03:00
Aliaksandr Valialkin	0ff8fcac6a	app/vmui: follow-up after `7bfb44113e` * Run `vmui-update` * Document the changes in README.md and CHANGELOG.md	2021-10-08 15:09:29 +03:00
Aliaksandr Valialkin	cf5cbd1c70	app/{vminsert,vmstorage}: follow-up after `a171916ef5` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-10-08 14:35:49 +03:00
Aliaksandr Valialkin	a19e7c7ce8	app/vminsert: fix uneven distribution of time series among storage nodes Use distinct seed for distribution hash calculations on the second level of vminsert nodes. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1672	2021-10-07 12:23:39 +03:00
Aliaksandr Valialkin	a71c9ad650	docs/guides: follow-up after `05a1396247`	2021-10-06 14:46:46 +03:00
Thomas Danielsson	05a1396247	fix: typo metric_relabel_configs (#1674 ) metric_ralabel_configs -> metric_relabel_configs	2021-10-06 14:45:39 +03:00
Ziqi Zhao	402c995d6d	fix some typos (#1678 ) Co-authored-by: 柘远 <zzq237937@alibaba-inc.com>	2021-10-06 14:43:10 +03:00
Aliaksandr Valialkin	c7c966d0e9	docs/vmagent.md: update docs after 3e9a939a990c8b608414388c96f68eb062364ae7	2021-10-05 10:23:33 +03:00
Aliaksandr Valialkin	9515e58e28	docs/vmagent.md: document how to write data to Kafka	2021-09-30 17:45:53 +03:00
Aliaksandr Valialkin	0e3de5a0cc	app/vmselect/promql: add `topk_last` and `bottomk_last` functions	2021-09-30 13:22:52 +03:00
Aliaksandr Valialkin	6d9f1d4227	app/vminsert: document that -relabelConfig is reloaded on SIGHUP signal	2021-09-29 21:18:58 +03:00
Aliaksandr Valialkin	2b623ae302	docs/CHANGELOG.md: link to Kafka integration docs	2021-09-29 12:31:23 +03:00
Aliaksandr Valialkin	d80d72efec	app/{vmbackup,vmrestore}: switch from `gcs://...` to `gs://...` urls for backups to GCS The `gs://` urls are commonly used, so prefer them instead of `gcs://` urls, while leaving support for `gcs://` urls for backwards compatibility.	2021-09-29 12:10:29 +03:00
Aliaksandr Valialkin	396e233ac1	docs/vmagent.md: update Telegraf config in the section about Kafka	2021-09-29 11:21:15 +03:00
Aliaksandr Valialkin	0e5ab52908	docs/vmagent.md: add docs about reading metrics from Kafka	2021-09-29 01:46:12 +03:00
Aliaksandr Valialkin	ead59bdebf	docs/CHANGELOG.md: document the bugfix from `de810031bf`	2021-09-29 00:41:35 +03:00
Aliaksandr Valialkin	50ec259750	docs/CHANGELOG.md: document `3d17112a7e`	2021-09-29 00:33:08 +03:00
Aliaksandr Valialkin	91b3c601bc	app/{vminsert,vmagent}: add ability to ingest data via DataDog "submit metrics" API See https://docs.datadoghq.com/api/latest/metrics/#submit-metrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/206	2021-09-29 00:13:08 +03:00
Yury Molodov	a64155d91e	vmui: use Chart.js as default engine for graph (#1634 ) * feat: add Plotly as default engine for graph * fix: remove unused components * feat: use Chart.js as default engine graph * fix: correct styles for loader * feat: add zoom/pan for chart * feat: add height for chart * fix: remove unused code * fix: remove empty units from duration * fix: change debounce for pan to 500ms * fix: add utility for plugins register globally * fix: optimize render graph * feat: add buffer data for zoom * fix: add limits for zoom in/out * fix: change update data while zooming * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-09-27 22:26:14 +03:00
Aliaksandr Valialkin	2efe0acfc9	app/vmselect/promql: add `rollup_scrape_interval(m[d])` function It calculates the min, max and avg scrape intervals for m over the given lookbehind window d	2021-09-27 19:21:24 +03:00
Aliaksandr Valialkin	c4c77aa2dd	app/vmselect/promql: follow-up after `526dd93b32` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1625 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-27 18:55:39 +03:00
Aliaksandr Valialkin	1b23224f9c	docs/BestPractices.md docs/BestPractices.md: update the doc	2021-09-27 17:51:21 +03:00
Aliaksandr Valialkin	e564411a62	app/vmselect/promql: align the behavior of `or`, `and` and `unless` operators with `on (labels)` modifier to Prometheus Previously VictoriaMetrics could return unexpected result of the right-hand side operand had multiple time series with the given set of labels mentioned in `on(labels)`. See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1643	2021-09-24 00:46:25 +03:00
Aliaksandr Valialkin	9f19649672	docs/CHANGELOG.md: cut v1.66.2	2021-09-23 22:53:36 +03:00
Aliaksandr Valialkin	718eca33ab	lib/storage: properly handle `{__name__=~"prefix(suffix1\|suffix2)",other_label="..."}` queries They were broken in the commit `00cbb099b6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1644	2021-09-23 21:48:51 +03:00
Aliaksandr Valialkin	c5bb95a417	docs: `make docs-sync`	2021-09-23 20:51:35 +03:00
Aliaksandr Valialkin	f5896b7420	docs/CHANGELOG.md: document `0e35fc9538` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1641	2021-09-23 20:46:23 +03:00
Aaron France	6f061dab19	fix: typo in vmagent.md (#1642 )	2021-09-23 16:51:02 +03:00
Aliaksandr Valialkin	a0313c046b	lib/promscrape: add `vm_promscrape_max_scrape_size_exceeded_errors_total` metric for counting of the failed scrapes due to the exceeded response size Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1639	2021-09-23 14:47:54 +03:00
Aliaksandr Valialkin	d5c2741e8f	docs/CaseStudies.md: add a case study for Grammarly	2021-09-23 13:11:48 +03:00
Aliaksandr Valialkin	73cd74075d	docs/Articles.md: add https://cer6erus.medium.com/superset-bi-with-victoria-metrics-a109d3e91bc6	2021-09-23 10:43:29 +03:00
Aliaksandr Valialkin	99a6c212e8	docs/CaseStudies.md: fix a link to third-party articles	2021-09-22 03:52:35 +03:00
Aliaksandr Valialkin	9b3d1a1996	docs/CHANGELOG.md: cut v1.66.1	2021-09-22 01:47:05 +03:00
Aliaksandr Valialkin	a13c3de36f	docs/CHANGELOG.md: document `9ca1cbced1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1635	2021-09-21 23:17:08 +03:00
Aliaksandr Valialkin	207c5760ce	lib/promrelabel: fix parsing `regex: true` in relabeling rules	2021-09-21 23:00:53 +03:00
Aliaksandr Valialkin	a22aa0608b	app/vmselect: fix accessing `/graphite/*` endpoints	2021-09-21 13:56:35 +03:00
Aliaksandr Valialkin	94148d5ad7	docs/vmagent.md: typo fix	2021-09-20 16:49:20 +03:00
Aliaksandr Valialkin	51657b1e04	docs/vmagent.md: typo fixes in `Prometheus staleness markers` docs	2021-09-20 16:44:09 +03:00
Aliaksandr Valialkin	76811c2f60	docs/CHANGELOG.md: cut v1.66.0	2021-09-20 15:20:25 +03:00
n4mine	1ac8d55147	fix: typo, dddresses -> addresses (#1630 )	2021-09-20 14:28:59 +03:00
Aliaksandr Valialkin	a06ff456f8	docs/Articles.md: add a link to `Open-source strategy at VictoriaMetrics`	2021-09-20 11:46:10 +03:00
Aliaksandr Valialkin	9a3d0c43b5	app/vmselect/promql: add `quantiles_over_time("phiLabel", phi1, ..., phiN, m[d])` function for calculating multiple quantiles at once	2021-09-17 23:35:10 +03:00
Aliaksandr Valialkin	e1e5a20b36	docs/CHANGELOG.md: document `0e09fdb8b0`	2021-09-17 18:47:06 +03:00
Aliaksandr Valialkin	2951dd0a57	app/vmselect/promql: add histogram_quantiles("phiLabel", phi1, ..., phiN, buckets) function This function calculates multiple quantiles over the given buckets at once Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1573	2021-09-17 13:32:39 +03:00
Aliaksandr Valialkin	8c504d6efa	docs/CHANGELOG.md: document the change in enterprise apps, which allows passing `-version` without `-eula` flag See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1621	2021-09-17 12:37:45 +03:00
Aliaksandr Valialkin	948fb638f5	docs/FAQ.md: extend `VictoriaMetrics vs TimescaleDB` section with real user experience See also https://github.com/timescale/promscale/issues/427 , which is mentioned in the https://abiosgaming.com/press/high-cardinality-aggregations/	2021-09-16 20:46:25 +03:00
Roman Khavronenko	f83fa31985	docs: fix indentation for FAQ document (#1620 )	2021-09-16 13:59:22 +03:00
Aliaksandr Valialkin	e60dfc96ff	app/vmselect/promql: add `mad(q)` and `outliers_mad(tolerance, q)` functions to MetricsQL	2021-09-16 13:33:53 +03:00
Aliaksandr Valialkin	44b01fff13	app/{vminsert,vmselect}: automatically add missing port in `-storageNode` lists passed to `vminsert` and `vmselect` This should simplify manual setup of the cluster according to https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#cluster-setup	2021-09-15 18:08:30 +03:00
Aliaksandr Valialkin	06ed694ad9	docs/CHANGELOG.md: document `777ff75874`	2021-09-15 17:45:08 +03:00
Aliaksandr Valialkin	68ea3d18f7	vendor: update github.com/valyala/histogram from v1.1.2 to v1.2.0 This fixes the non-repeatable quantile_over_time() results when the number of input samples exceeds 1000. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-15 09:34:07 +03:00
Roman Khavronenko	84b41e498f	docs: add "Choosing a Time Series Database for High Cardinality Aggregations" article (#1617 )	2021-09-15 01:51:56 +03:00
Aliaksandr Valialkin	3e1683756b	docs/vmalert.md: follow-up after `68721f6e7d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1608	2021-09-14 14:47:47 +03:00
Dima Lazerka	56069a3022	Remove port 3000 and add https to play-grafana link (#1616 ) * Remove port 3000 and add https to play-grafana link * Fix typo Co-authored-by: Dzmitry Lazerka <dlazerka@gmail.com>	2021-09-14 14:24:30 +03:00
Aliaksandr Valialkin	8f685d81c6	lib/storage: follow up after `00cbb099b6`	2021-09-14 14:16:25 +03:00
Aliaksandr Valialkin	adedc83b3b	app/vmauth: do not log invalid auth tokens by default for security reasons The logging can be enabled by passing `-logInvalidAuthTokens` command-line flag to vmauth	2021-09-14 12:20:03 +03:00
Aliaksandr Valialkin	e46bd9e47f	docs/Single-server-VictoriaMetrics.md: link to cardinality limiter docs in vmagent	2021-09-13 21:26:59 +03:00
Aliaksandr Valialkin	07b9c7994f	docs/vmagent.md: mention `out of order sample` errors, which are typically emitted by Thanos, Cortex or Prometheus	2021-09-13 19:36:31 +03:00
Aliaksandr Valialkin	8a6a36429a	app/vminsert/netstorage: disable rerouting by default Production clusters work more stable with the disabled rerouting during rolling restarts and/or during spikes in time series churn rate. So it would be better disabling the rerouting by default. The re-routing can be enabled by passing `-disableRerouting=false` command-line flag to `vminsert` nodes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/791 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1054 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1165	2021-09-13 18:51:56 +03:00
Aliaksandr Valialkin	c4f11a49f8	docs/CHANGELOG.md: document `5494bc02a6`	2021-09-13 17:11:23 +03:00
Aliaksandr Valialkin	7f0a8d4bdb	docs: consistency renaming: Influx -> InfluxDB	2021-09-13 17:05:16 +03:00
Aliaksandr Valialkin	b9727a36dc	docs/vmbackup.md: update the outdated link to vmbackupmanager	2021-09-13 14:16:53 +03:00
Aliaksandr Valialkin	d1a16e0891	app/vmselect/promql: use Prometheus-compatible label value formatting for `count_values` function	2021-09-13 13:48:06 +03:00
Aliaksandr Valialkin	fb6ed0ce19	lib/promscrape/discovery/docker: support host networking mode See https://github.com/prometheus/prometheus/issues/9116	2021-09-13 13:30:16 +03:00
Aliaksandr Valialkin	6295861acd	lib/promscrape/discovery/kubernetes: properly use https scheme for wildcard TLS certificates in ingress target discovery	2021-09-13 13:03:42 +03:00
Aliaksandr Valialkin	728c4c3841	lib/promscrape: generate `scrape_timeout_seconds` metric per each scrape target in the same way as Prometheus 2.30 does See https://github.com/prometheus/prometheus/pull/9247	2021-09-12 15:20:44 +03:00
Aliaksandr Valialkin	48e3e6c8df	lib/promscrape: add ability to configure scrape_timeout and scrape_interval via relabeling See https://github.com/prometheus/prometheus/pull/8911	2021-09-12 13:33:41 +03:00
Aliaksandr Valialkin	f3e89754a9	lib/promscrape: reduce CPU usage for common case when calculating `scrape_series_added` metric Also reduce CPU usage when applying `series_limit` to scrape targets with constant set of metrics. The main idea is to perform the calculations on scrape_series_added and series_limit only if the set of metrics exposed by the target has been changed. Scrape targets rarely change the set of exposed metrics, so this optimization should reduce CPU usage in general case.	2021-09-12 12:53:14 +03:00
Aliaksandr Valialkin	674a6eee6c	docs/Single-server-VictoriaMetrics.md: refer to relabeling section for vmagent This removes duplicate docs about additional relabeling actions supported by VictoriaMetrics components	2021-09-12 11:39:19 +03:00
Aliaksandr Valialkin	77168e3e94	docs/vmagent.md: sync with app/vmagent/README.md by running `make docs-sync`	2021-09-11 11:04:42 +03:00
Aliaksandr Valialkin	9286107e82	lib/promscrape: send stale markers for disappeared metrics like Prometheus does	2021-09-11 10:51:04 +03:00
Aliaksandr Valialkin	cfed015bb6	docs/vmalert.md: typo fix in `Multitenancy` chapter	2021-09-10 17:57:14 +03:00
Aliaksandr Valialkin	f4dead529f	lib/storage: properly search series by multiple tag filters matching empty labels such as foo{bar=~"baz\|",x=~"y\|"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1601 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/395	2021-09-09 21:09:21 +03:00
Aliaksandr Valialkin	ea943911bc	app/vmselect/promql: keep metric name in `rollup_candlestick` results, since they don't change the original series meaning Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1600	2021-09-09 19:21:18 +03:00
Aliaksandr Valialkin	f27980dcb3	docs/CHANGELOG.md: typo fix	2021-09-09 18:57:30 +03:00
Aliaksandr Valialkin	4aeb8db83f	lib/promscrape: add ability to set `series_limit` and `stream_parse` options via relabeling This allows managing these options on a per-target basis. Typical use case: to manage these options for pods via Kubernetes annotations.	2021-09-09 18:49:39 +03:00
Aliaksandr Valialkin	d2708a1fb7	docs/vmagent.md: typo fix in `Relabeling` chapter	2021-09-09 16:39:40 +03:00
Aliaksandr Valialkin	d6bd956930	lib/promrelabel: add `keep_metrics` and `drop_metrics` actions to relabeling rules These actions simlify metrics filtering. For example, - action: keep_metrics regex: 'foo\|bar\|baz' would leave only metrics with `foo`, `bar` and `baz` names, while the rest of metrics will be deleted. The commit also makes possible to split long regexps into multiple lines. For example, the following config is equivalent to the config above: - action: keep_metrics regex: - foo - bar - baz	2021-09-09 16:18:21 +03:00
Aliaksandr Valialkin	3a827b98cd	docs/vmalert.md: `make docs-sync` after `21f022e5f0`	2021-09-09 16:16:25 +03:00
Aliaksandr Valialkin	a8053d9fc6	docs/MetricsQL.md: add a link to VictoriaMetrics github	2021-09-08 00:14:59 +03:00
Aliaksandr Valialkin	e6c9869d86	app/vmalert: follow-up after `21f022e5f0`	2021-09-07 22:43:37 +03:00
Aliaksandr Valialkin	6fbaf8f978	docs/CHANGELOG.md: document `42e07cfaea`	2021-09-07 22:34:39 +03:00
Aliaksandr Valialkin	e34f7081d0	docs/vmagent.md: add API path for Prometheus text exposition format	2021-09-07 16:14:51 +03:00
Aliaksandr Valialkin	0166eae7c4	docs/Articles.md: add a link to case studies	2021-09-06 10:57:59 +03:00
Aliaksandr Valialkin	5e3ef376b5	docs/Articles.md: add an url to https://www.vultr.com/docs/install-and-configure-victoriametrics-on-debian	2021-09-03 11:49:37 +03:00

... 25 26 27 28 29 ...

3625 commits