github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00

Author	SHA1	Message	Date
Aliaksandr Valialkin	c3f8481011	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:20 +03:00
Aliaksandr Valialkin	95d36da358	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_pod_container_image` label in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:23 +03:00
Aliaksandr Valialkin	c4fcd9f1c5	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_service_port_number` label to `role: service` in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:06:34 +03:00
Aliaksandr Valialkin	d335694add	app/vmalert/templates: add `toTime()` template function in the same way as Prometheus 2.38 does See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:31 +03:00
Aliaksandr Valialkin	511805d88d	lib/promscrape/discovery/dns: add support for resolving MX records See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:32:34 +03:00
Aliaksandr Valialkin	e1cb15807e	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 23:53:58 +03:00
Aliaksandr Valialkin	1e4fc20486	docs/CHANGELOG.md: clarify the change at `28441711e6`	2022-08-11 23:49:22 +03:00
Roman Khavronenko	fa51c76ef9	vmalert: follow-up after `28441711e6` (#2972 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 13:30:32 +02:00
Roman Khavronenko	a0e7432e42	lib/storage: prevent excessive loops when storage is in RO (#2962 ) * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:00 +03:00
Aliaksandr Valialkin	ad00f4aaaa	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:58:50 +03:00
Aliaksandr Valialkin	901300aea2	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:00 +03:00
Aliaksandr Valialkin	06b6063a36	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:09 +03:00
Aliaksandr Valialkin	46d7792b72	lib/promscrape: follow-up after `2c553d5a2f` - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:46:26 +03:00
Aliaksandr Valialkin	730c39876e	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:35:25 +03:00
Aliaksandr Valialkin	34f0341b36	docs/CHANGELOG.md: link to the issue with improper handling of `enpoint` option at ec2_sd_configs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:32:50 +03:00
Aliaksandr Valialkin	68c4ec9472	lib/promrelabel: do not split regex into multiple lines if it contains groups Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:15:26 +03:00
Aliaksandr Valialkin	51debcdf6d	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul This is a follow-up for `68de1f4e4a` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:22:31 +03:00
Yury Molodov	3cb013aeb8	vmui: graph action on moush hold and move (#2915 ) * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:55:09 +03:00
Aliaksandr Valialkin	9f37935819	Makefile: remove redundant `-mod=vendor` option when running Go tools The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:39:08 +03:00
Aliaksandr Valialkin	f36de0ecc9	docs: add docs for scrape_configs section	2022-08-07 00:04:31 +03:00
Aliaksandr Valialkin	0ef29ceb14	lib/promscrape/discovery/kubernetes: add missing `__meta_kubernetes_ingress_class_name` label for `role: ingress` See `7e65ad3e43` and `7e1111ff14`	2022-08-05 20:55:00 +03:00
Aliaksandr Valialkin	f2816ef031	lib/promscrape/discovery/ec2: properly handle custom `endpoint` option in ec2_sd_configs This option was ignored since `d289ecded1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:50:02 +03:00
Aliaksandr Valialkin	3e8890e71b	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:11:28 +03:00
Aliaksandr Valialkin	68de1f4e4a	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 14:41:40 +03:00
Aliaksandr Valialkin	0c95d87abd	docs: fixes after `83a4abda3f`	2022-08-05 10:15:00 +03:00
Aliaksandr Valialkin	83a4abda3f	lib/promscrape/discovery/yandexcloud: follow-up after `6e5ac32fba` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:26:43 +03:00
Aliaksandr Valialkin	75c7170624	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:30:50 +03:00
Aliaksandr Valialkin	6b0550c023	app/{vmselect,vmalert}: properly generate http redirects if `-http.pathPrefix` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 12:59:07 +03:00
Aliaksandr Valialkin	de6dd1cd5a	lib/mergeset: optimize mergeInmemoryBlocks() function Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-27 23:58:05 +03:00
Aliaksandr Valialkin	1f6f883016	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for `vmauth` with identical `username` and different `password` values	2022-07-26 19:38:46 +03:00
Aliaksandr Valialkin	92630c1ab4	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on `b596ac3745` Thanks to @zqyzyq for the idea.	2022-07-25 09:18:44 +03:00
Aliaksandr Valialkin	4c2f9a1a2e	lib/promscrape: set `up=0` for partially failed scrape in stream parsing mode This behaviour aligns with Prometheus behavior	2022-07-22 13:29:44 +03:00
Aliaksandr Valialkin	f2326f953b	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 This is a follow-up for `edecd2493c`	2022-07-21 20:57:04 +03:00
Aliaksandr Valialkin	2095421905	docs/CHANGELOG.md: follow-up after `88edb3f6cf`	2022-07-21 20:53:06 +03:00
Aliaksandr Valialkin	4ce5875fa8	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:36:27 +03:00
Roman Khavronenko	88edb3f6cf	vmalert: allow configuring custom headers per group (#2901 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 15:59:55 +02:00
Roman Khavronenko	70a822f3a0	vmalert: allow configuring custom headers for URLs (#2897 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 13:57:53 +02:00
Nikolay	88029c521c	app/vmauth: allow duplicate usernames (#2888 ) Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:33:17 +03:00
Aliaksandr Valialkin	cc7d499bbd	app/vmselect/promql: execute `q1` and `q2` from `q1 op q2` in parallel if labels pushdown cannot be applied This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:27:48 +03:00
Aliaksandr Valialkin	0fd86e2364	lib/promscrape: reload all the scrape configs when the `global` section is changed inside `-promscrape.config` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:07 +03:00
Aliaksandr Valialkin	b5da47bfaf	app/vmselect/promql: properly return `q1` series from `q1 ifnot q2` when `q2` returns nothing	2022-07-18 14:24:54 +03:00
Aliaksandr Valialkin	a4424174bb	docs/CHANGELOG.md: document `2f9668eba5`	2022-07-18 12:36:53 +03:00
Aliaksandr Valialkin	429369f028	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to `$(APP_NAME)-$(GOOS)-$(GOARCH)...` naming	2022-07-18 11:59:45 +03:00
Aliaksandr Valialkin	d3116d9862	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:24 +03:00
Roman Khavronenko	f07bfcf0c9	vmalert: drop support of deprecated `extra_filter_labels` param (#2870 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 15:45:08 +03:00
Aliaksandr Valialkin	cb79c3e765	docs/CHANGELOG.md: formatting fixes for update notes	2022-07-14 12:47:19 +03:00
Yury Molodov	17c33132df	vmui: optimize table view (#2867 ) * feat: optimize table view * fix: add column display setting * app/vmselect: `make vmui-update` Also document the change at docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:15:43 +03:00
Dmytro Kozlov	a0d0ba7219	vmui: update time picker behavior (#2847 ) * vmui: update time picker behavior * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-14 00:05:47 +03:00
Yury Molodov	e4efebf4a4	vmui: change selection from autocomplete (#2862 ) * fix: change selection from autocomplete * update docs/CHANELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:54:56 +03:00
Nikolay	7301aa678c	lib/promscrape: adds azure service discovery (#2743 ) * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:43:18 +03:00
Aliaksandr Valialkin	ed93330e66	all: follow-up for `d99ba3481b`	2022-07-13 16:44:39 +03:00
Aliaksandr Valialkin	765278243b	docs/CHANGELOG.md: document `91faa152a5`	2022-07-13 12:40:35 +03:00
Aliaksandr Valialkin	f7eda4a73c	docs/CHANGELOG.md: mention that the communication protocol between `vmselect` and `vmstorage` nodes is updated in the new release	2022-07-13 12:16:00 +03:00
Aliaksandr Valialkin	cad471037a	app/vmselect/prometheus: follow-up after `3efe33b917`	2022-07-11 20:35:28 +03:00
Dmytro Kozlov	3efe33b917	vmselect/prometeus: Add limit param to api/v1/series api endpoint (#2851 ) * issue-2841: Add limit param to api/v1/series api endpoint * issue-2841: add change log * issue-2841: update logic * issue-2841: simplify logic * issue-2841: simplify logic, add information to documentation	2022-07-11 20:18:30 +03:00
Aliaksandr Valialkin	743ff84863	app/vmselect/netstorage: optimize mergeSortBlocks function - Use binary search instead of linear scan when locating the run of smallest timestamps in blocks with intersected time ranges. This should improve performance when merging blocks with big number of samples - Skip samples with duplicate timestamps. This should increase query performance in cluster version of VictoriaMetrics with the enabled replication.	2022-07-09 00:34:42 +03:00
Roman Khavronenko	e1a41cfab5	metricsql: properly evaluate `timezone_offset` over time interval (#2842 ) * metricsql: properly evaluate `timezone_offset` over time interval https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2771 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Update docs/CHANGELOG.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-08 14:03:56 +03:00
Aliaksandr Valialkin	2e9ae40d56	app/vmselect/vmui: follow-up after `0bf6841140` * Document the bugfix in docs/CHANGELOG.md * Run `make vmui-update` for updating static js files for vmui, which are included into vmselect	2022-07-08 13:14:17 +03:00
Aliaksandr Valialkin	126e32f79a	docs/CHANGELOG.md: clarifications after `e9b977859b`	2022-07-08 13:02:41 +03:00
Aliaksandr Valialkin	08db70fa3e	docs/CHANGELOG.md: recommend clearing caches after the upgrade from v1.78.0 to v1.78.1	2022-07-08 12:49:42 +03:00
Roman Khavronenko	e9b977859b	vmalert: deprecate alert's status link (#2840 ) * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 10:26:13 +02:00
Aliaksandr Valialkin	0713da9e7a	docs/CHANGELOG.md: link to the issue related to multi-level vmselect	2022-07-08 05:23:18 +03:00
Aliaksandr Valialkin	b206bd0aee	docs/CHANGELOG.md: recommend upgrading from v1.78.0 to v1.78.1 because of the bug in v1.78.0	2022-07-08 03:44:26 +03:00
Aliaksandr Valialkin	138ae99602	docs/CHANGELOG.md: cut v1.78.1	2022-07-08 01:02:42 +03:00
Aliaksandr Valialkin	1f1be61b78	docs/CHANGELOG.md: typo fixes	2022-07-07 20:34:08 +03:00
Aliaksandr Valialkin	1828665a64	docs/CHANGELOG.md: link another bugreport related to the bug with per-day inverted index in v1.78.0	2022-07-07 02:34:48 +03:00
Aliaksandr Valialkin	f97355d9fb	lib/promscrape: properly set Host header when sending requests via http proxy Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794	2022-07-07 02:27:52 +03:00
Aliaksandr Valialkin	893ca6f87e	docs/CHANGELOG.md: link to the issue about incorrect per-day index handling in v1.78.0	2022-07-07 02:00:07 +03:00
Aliaksandr Valialkin	10cb67adb5	app/{vmagent,vminsert}: follow-up after `d19e46de55` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:30:58 +03:00
Aliaksandr Valialkin	01f55bc66b	lib/promscrape/discovery/kubernetes: properly populate service-level labels for `role: endpointslice` targets Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2823	2022-07-07 00:32:26 +03:00
Aliaksandr Valialkin	b186b63e07	lib/promscrape/discovery/kubernetes: allow attaching node-level labels to `role: endpoints` and `role: endpointlice` targets in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/10759	2022-07-06 23:18:59 +03:00
Aliaksandr Valialkin	bd5b20445e	app/vmselect: add ability to query `vmselect` from another `vmselect`	2022-07-06 13:30:12 +03:00
Aliaksandr Valialkin	17de8a41c2	all: follow-up after `ed89106274`	2022-07-06 12:44:46 +03:00
Aliaksandr Valialkin	c66f676f3b	lib/promscrape: push `scrape_samples_limit` metric to remote storage if `sample_limit` option is set in `scrape_config` for this target See https://github.com/VictoriaMetrics/operator/issues/497	2022-07-06 12:37:55 +03:00
Roman Khavronenko	ed89106274	vmselect: allow proxying requests to vmalert from single-node (#2834 ) The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:26 +02:00
Aliaksandr Valialkin	edc76286ac	lib/storage: put the (date, metricID) entry in dateMetricIDCache just after the corresponding series is registered in the per-day inverted index Previously the time series could be put into dateMetricIDCache without registering in the per-day inverted index if GetOrCreateTSIDByName finds TSID entry in the global index. This could lead to missing series in query results. The issue has been introduced in the commit `55e7afae3a`, which has been included in VictoriaMetrics v1.78.0	2022-07-05 14:54:03 +03:00
Aliaksandr Valialkin	f3ece83e67	app/vmselect/promql: properly calculate histogram_quantile over unexpected `le` buckets See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:19:24 +03:00
Roman Khavronenko	c7acf36e39	docs: warn about potential issue with read queries for 1.78.0 (#2818 ) * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:03:27 +03:00
Aliaksandr Valialkin	84e373e5c7	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions	2022-06-30 22:39:38 +03:00
Aliaksandr Valialkin	c392d6d173	app/vmagent/remotewrite: add `-remoteWrite.header` command-line flag for setting additional http headers to send to -remoteWrite.url Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:23 +03:00
Aliaksandr Valialkin	e40b40afe6	Revert "lib/promscrape, vmagent: fix path to files (#2801 )" This reverts commit `0a8e35835c`. Reason for revert: it incorrectly fixes the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799#issuecomment-1171392005	2022-06-30 18:23:56 +03:00
Dmytro Kozlov	0a8e35835c	lib/promscrape, vmagent: fix path to files (#2801 ) vmagent: respect `-pathPrefix` flag for static files and links	2022-06-30 16:22:54 +02:00
Aliaksandr Valialkin	836c19f7ba	Revert "follow-up after `bdf9f4669a` (#2803 )" This reverts commit `ec5d3253ff`, because there was a similar commit already - `119dc333e1`	2022-06-30 13:54:33 +03:00
Aliaksandr Valialkin	119dc333e1	docs/CHANGELOG.md: document `bdf9f4669a`	2022-06-30 13:53:59 +03:00
Aliaksandr Valialkin	56622bff73	docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:53:59 +03:00
Roman Khavronenko	ec5d3253ff	follow-up after `bdf9f4669a` (#2803 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-30 12:46:57 +02:00
Aliaksandr Valialkin	a14188dd8e	app/vmselect: expose additional histograms at `/metrics` page, which may help get more insights for the query workload This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:13 +03:00
Aliaksandr Valialkin	a350d1e81c	lib/storage: return marshaled metric names from SearchMetricNames Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:17:15 +03:00
Aliaksandr Valialkin	741dd47273	docs/CHANGELOG.md: document `45f20ad1aa`	2022-06-27 13:52:59 +03:00
Aliaksandr Valialkin	a963b2a0aa	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:45:51 +03:00
Aliaksandr Valialkin	94445e8bd1	docs/CHANGELOG.md: update after `e40d015e9a`	2022-06-24 18:04:55 +03:00
Aliaksandr Valialkin	d2bbbf147c	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:57:43 +03:00
Dmytro Kozlov	bb7f31541f	vmui: added query tracing (#2748 ) * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 22:59:20 +03:00
Nikolay	7f1c73bdaf	app/vmselect: fixes partial response with replicationFactor (#2777 ) * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:19:35 +03:00
Yurii Kravets	86e80428d5	docs: Update CHANGELOG Update notes (#2776 ) * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 15:46:51 +02:00
Aliaksandr Valialkin	52eadb729e	lib/promscrape: always send stale markers with the real scrape timestamp This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:34:18 +03:00
Aliaksandr Valialkin	1c4f67c5d2	lib/promauth: add ability to send additional http headers in requests to scrape targets This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:39:43 +03:00
Aliaksandr Valialkin	51362f9333	app/vmselect: add `-search.setLookbackToStep` command-line flag for making the gap filling algorithm similar to InfluxDB data model This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:19:30 +03:00
Aliaksandr Valialkin	091408be62	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:10:38 +03:00
Aliaksandr Valialkin	3837b50f37	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:36:41 +03:00
Aliaksandr Valialkin	49586566a3	docs: follow-up after `e4d6b750f6`	2022-06-20 17:14:43 +03:00
Nikolay	e4d6b750f6	lib/httpserver: adds flagsAuthKey command-line flag (#2758 ) * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:09:32 +03:00
Artem Navoiev	954a7a6fc6	docs: replace bash code block type with console (#2746 )	2022-06-19 22:57:53 +03:00
Aliaksandr Valialkin	c022c4af0a	docs/CHANGELOG.md: document `ef7f52e0e6`	2022-06-19 22:48:39 +03:00
Aliaksandr Valialkin	5fb45173ae	lib/storage: do not register new series if `-storage.maxHourlySeries` or `-storage.maxDailySeries` limits are exceeded Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:42:09 +03:00
Aliaksandr Valialkin	62e2371a67	lib/storage: reset metric id caches for the previous and the current hour Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:42:09 +03:00
Dmytro Kozlov	10454d1735	vmui: added focusLabel, enable cardinality app configuratior (#2736 ) * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:03:02 +03:00
Roman Khavronenko	723d90536c	vmselect: limit `end` param max value by 2d in future (#2729 ) * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:46:31 +03:00
Aliaksandr Valialkin	c18f8cccfa	lib/promrelabel: support `action: graphite` relabeling Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:24:22 +03:00
Aliaksandr Valialkin	0f889497b5	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:40:59 +03:00
Aliaksandr Valialkin	e8214ed4e8	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:04 +03:00
Aliaksandr Valialkin	de2be31275	docs/CHANGELOG.md: document `99dbe7f9d4`	2022-06-13 10:01:48 +03:00
Yury Molodov	879670418f	vmui: enhancements (#2638 ) (#2717 ) * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:43:37 +03:00
Aliaksandr Valialkin	55a0d34be5	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added The optimization has been added in `374beb350e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:45 +03:00
Aliaksandr Valialkin	374beb350e	app/vmselect: optimize `/api/v1/labels` and `/api/v1/label/.../values` handlers when `match[]` query arg is passed to them	2022-06-12 04:32:13 +03:00
Aliaksandr Valialkin	89b778902b	app/vmselect: add optional `limit` query arg to `/api/v1/labels` and `/api/v1/label_values` endpoints This arg allows limiting the number of sample values returned from these APIs	2022-06-10 09:50:33 +03:00
Roman Khavronenko	48a60eb593	vmalert: followup for `76f05f8670` (#2706 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 08:58:25 +02:00
Aliaksandr Valialkin	8888e2b955	docs: add a link to cardinality explorer playground	2022-06-08 19:39:36 +03:00
Dmytro Kozlov	018d2303c4	Cardinality explorer (#2625 ) * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:43:05 +03:00
Aliaksandr Valialkin	46d8fb03d1	docs/CHANGELOG.md: document `63b538ecd1`	2022-06-07 15:52:32 +03:00
Aliaksandr Valialkin	a93deb307f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:13 +03:00
Aliaksandr Valialkin	cbb64c824d	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage The changes are related to the added query tracing in `afced37c0b` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:35 +03:00
Aliaksandr Valialkin	638ba4614a	docs/CHANGELOG.md: document `e755d0ec3f`	2022-06-07 15:16:48 +03:00
Aliaksandr Valialkin	b022f1f113	docs/CHANGELOG.md: document `1ee1e986da`	2022-06-07 15:02:22 +03:00
Aliaksandr Valialkin	8608dd093c	all: follow-up after `8edb390e21` - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 00:57:09 +03:00
Aliaksandr Valialkin	6f0a0e3072	lib/promscrape/discovery/kubernetes: follow-up after `006b8c7534` - make more clear error logs - simplify testing for newKubeConfig by passing only the path to kube_config file instead of SDConfig struct	2022-06-06 14:40:52 +03:00
Aliaksandr Valialkin	0922ed2b7e	lib/promscrape: add `-promscrape.cluster.name` command-line flag This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 00:37:01 +03:00
Dmytro Kozlov	8edb390e21	lib/promscrape: adds service discovery visualization for /targets page(#2675 ) * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-03 15:38:45 +02:00
Nikolay	a18914abee	lib/promscrape/discovery/kubernetes: follow-up after `0b5c874911` (#2672 )	2022-06-01 20:44:45 +02:00
Aliaksandr Valialkin	ca689fec54	docs/CHANGELOG.md: follow-up after `2177089f94`	2022-06-01 14:51:26 +03:00
Aliaksandr Valialkin	ea06d2fd3c	lib/storage: stop background merge when storage enters read-only mode This should prevent from `no space left on device` errors when VictoriaMetrics under-estimates the additional disk space needed for background merge. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2603	2022-06-01 14:36:45 +03:00
Roman Khavronenko	642eb1c534	lib/storage: make `indexdb/tagFilters` cache size configurable (#2667 ) The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 10:07:53 +02:00
Roman Khavronenko	2177089f94	promrelabel: add support of `lowercase` and `uppercase` relabeling actions (#2665 ) * promrelabel: add support of `lowercase` and `uppercase` relabeling actions https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2664 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/storage: make golangci-lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 10:02:37 +02:00
Aliaksandr Valialkin	41958ed5dd	all: add initial support for query tracing See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:29:23 +03:00
Aliaksandr Valialkin	89c0172778	docs/CHANGELOG.md: follow-up after `11f91532c5` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:27:56 +03:00
Dmytro Kozlov	11f91532c5	issue-2594: use embedded for static files (#2650 ) embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 01:55:28 +02:00
Aliaksandr Valialkin	796804e4b0	lib/promscrape: add -promscrape.suppressScrapeErrorsDelay command-line flag This flag can be used for reducing the amounts of logs when scraping unreliable scrape targets. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2575 The patch is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2576 . Thanks to @jelmd .	2022-05-25 22:59:36 +03:00
Aliaksandr Valialkin	f6d11a49aa	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag This is a follow-up for `0fbf59199a` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:05:29 +03:00
Aliaksandr Valialkin	bfe96a3cb4	docs/CHANGELOG.md: document `9e343faa41`	2022-05-25 15:03:46 +03:00
Aliaksandr Valialkin	7747708ca7	app: expose `/api/v1/status/config` endpoint in the same way as Prometheus does This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 09:57:13 +03:00
Aliaksandr Valialkin	2d2d15b0d0	docs/CHANGELOG.md: cut v1.77.2	2022-05-21 02:26:15 +03:00
Aliaksandr Valialkin	9854fc4dd5	docs/CHANGELOG.md: group vmalert features together	2022-05-21 01:52:01 +03:00
Aliaksandr Valialkin	cf05750d40	docs/CHANGELOG.md: document `2cf586da78`	2022-05-21 01:12:32 +03:00
Roman Khavronenko	d5eb6afe26	lib/promscrape/discovery/kubernetes: fixes kubernetes service discovery (#2615 ) * lib/promscrape/discovery/kubernetes: properly updates discovered scrape works previously, added or updated scrapeworks may override previuosly discovered. it happens because swosByKey may contain small subset of kubernetes objects with it's labels. It happens for objectsUpdated and objectsAdded maps, which include only changed elements * Properly calculate vm_promscrape_discovery_kubernetes_scrape_works Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-21 01:01:37 +03:00
Aliaksandr Valialkin	6b5979cd76	docs/CHANGELOG.md: document `3df8caca15`	2022-05-20 14:22:48 +03:00
Aliaksandr Valialkin	667e018a7e	docs/CHANGELOG.md: formatting fixes	2022-05-20 14:22:47 +03:00
Aliaksandr Valialkin	832623516b	docs/CHANGELOG.md: formatting fix for the issue url https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607	2022-05-20 14:22:47 +03:00
Aliaksandr Valialkin	65227b88a6	docs/CHANGELOG.md: link to the feature request about reusable templates in vmalert Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2510	2022-05-20 14:22:46 +03:00
Roman Khavronenko	34116882b4	vmalert: support `scalar` type in response (#2610 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-18 09:50:46 +02:00
Roman Khavronenko	1fad4dc919	vmalert: support strings in `humanize.*` templates (#2606 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-17 15:38:54 +02:00

1 2 3 4 5 ...

965 commits