5447 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Aliaksandr Valialkin	874a925310	vendor: make vendor-update	2022-12-19 13:07:52 -08:00
Aliaksandr Valialkin	9330da3195	lib/promscrape/discovery/consul: expose service tags in individual labels __meta_consul_tag_<tagname> ... This simplifies copying service tags to target labels with the following relabeling rule: - action: labelmap regex: __meta_consul_tag_(.+) See https://stackoverflow.com/questions/44339461/relabeling-in-prometheus	2022-12-19 13:02:56 -08:00
Aliaksandr Valialkin	11bd290201	lib/storage: search for TSIDs for the given metricIDs in the previous indexdb if they aren't found in the current indexdb ... The issue triggers after the indexdb rotation for time series, which stop receiving new samples. This results in missing data for such time series in query responses. This commit should address the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3502 The issue has been introduced in 2dd93449d8	2022-12-19 11:56:49 -08:00
Aliaksandr Valialkin	8c08d625ee	lib/storage: optimize partSearch.searchBHS() for common case when the TSID for the current block header is bigger or equal to the current tsid ... This should help improving performance at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3425	2022-12-19 10:31:39 -08:00
Aliaksandr Valialkin	512c73cef9	lib/storage: properly set buf capacity inside marshalMetricID ... Previously it was always set to 0. In theory this could result into incorrect marshaling of metricIDs. The issue has been introduced in 5e4dfe50c6	2022-12-19 10:31:38 -08:00
Aliaksandr Valialkin	2fad03d85e	lib/logger: follow-up for 72f8fce107 ... - Document the change at docs/CHANELOG.md - Log fatal errors if the -loggerJSONFields contains unexpected values - Rename -loggerJsonFields to -loggerJSONFields for the sake of consistency naming commonly used in Go Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2348	2022-12-16 17:44:05 -08:00
Michal Kralik	cffd2f79a1	lib/logger: support for renaming json fields (#3488)	2022-12-16 17:43:39 -08:00
Aliaksandr Valialkin	70c720d640	lib/logger: follow-up for 72f8fce107 ... - Document the change at docs/CHANELOG.md - Log fatal errors if the -loggerJSONFields contains unexpected values - Rename -loggerJsonFields to -loggerJSONFields for the sake of consistency naming commonly used in Go Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2348	2022-12-16 17:42:31 -08:00
Aliaksandr Valialkin	2a229a319e	docs/vmalert.md: mention latency_offset query arg, which has been added in 86dae56bd0 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3481	2022-12-16 17:20:51 -08:00
Aliaksandr Valialkin	8d7d8f0125	app/vmselect/prometheus: follow-up after 86dae56bd0 ... Return error if the provided latency_offset query arg cannot be parsed. This should simplify debugging in production. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3481	2022-12-16 17:16:26 -08:00
Roman Khavronenko	f8a3514e99	vmselect: support overriding of -search.latencyOffset (#3489) ... support overriding of `-search.latencyOffset` value via URL param `latency_offset`. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3481 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-16 17:14:23 -08:00
Aliaksandr Valialkin	2e597555ec	lib/promscrape: stop dropping metric name if relabeling rules do not instruct to do this on the /metric-relabel-debug page	2022-12-16 16:44:12 -08:00
Roman Khavronenko	9b82eebc3e	dashboards: respect $job var in sub-vars for cluster dash (#3487) ... Previously, $job_select, $job_storage and $job_insert didn't respect the $job filter. This change updates the variable queries to account for set $job variable. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-16 16:44:10 -08:00
Aliaksandr Valialkin	c8942f819f	docs/keyConcepts.md: update the list of supported data ingestion protocols ... - Add DataDog protocol - Remove native protocol, since it isn't intended for general-purpose usage by external clients	2022-12-15 12:02:51 -08:00
Aliaksandr Valialkin	fbeebe4869	lib/storage: skip missing tsids in the current block header by using binary search ... This improves performance by up to 10x when big number of the requested TSIDs are missing in the searched parts. This should help https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3425	2022-12-14 22:07:55 -08:00
Aliaksandr Valialkin	1a88fe5b1f	lib/flagutil/bytes.go: properly handle values bigger than 2GiB on 32-bit architectures ... This fixes handling of values bigger than 2GiB for the following command-line flags: - -storage.minFreeDiskSpaceBytes - -remoteWrite.maxDiskUsagePerURL	2022-12-14 19:29:57 -08:00
Aliaksandr Valialkin	3a28a52667	lib/flagutil: support for TB and TiB suffixes for command-line flags, which accept byte sizes	2022-12-14 17:53:18 -08:00
Aliaksandr Valialkin	f8e008f5ad	app/vmselect: show the link to /expand-with-exprs at /select/0/ page	2022-12-14 16:23:19 -08:00
Aliaksandr Valialkin	6d13ca2b88	app/vmselect: add /select/0/prometheus/expand-with-exprs page	2022-12-14 16:23:17 -08:00
Aliaksandr Valialkin	dafa819c54	.wwhrd.yml: add ISC license, which is used by github.com/davecgh/go-spew ... This license is compatible with Apache2 See https://github.com/davecgh/go-spew/blob/master/LICENSE	2022-12-14 14:56:06 -08:00
Aliaksandr Valialkin	ed7d204274	docs/vmagent.md: small formatting fix	2022-12-14 14:25:46 -08:00
Aliaksandr Valialkin	97a9d2eb04	docs/CHANGELOG.md: fix the link to the issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466	2022-12-14 14:17:27 -08:00
Aliaksandr Valialkin	5a288e98bf	docs/CHANGELOG.md: add release date for v1.85.1	2022-12-14 14:12:35 -08:00
Aliaksandr Valialkin	5da63d1ae7	vendor: make vendor-update	2022-12-14 12:14:01 -08:00
Aliaksandr Valialkin	7f022e03f9	app/vmselect/vmui: make vmui-update	2022-12-14 12:02:05 -08:00
Aliaksandr Valialkin	e3675d3679	docs/CHANGELOG.md: cut v1.85.1	2022-12-14 11:57:57 -08:00
Aliaksandr Valialkin	7d1d82d094	docs/Cluster-VictoriaMetrics.md: mention the vm_storage_is_read_only metric, which can help debugging readonly mode at vmstorage	2022-12-14 09:32:21 -08:00
Aliaksandr Valialkin	cca16cb498	docs/vmagent.md: clarify that relabeling is actually a debugging at relabel debug section	2022-12-13 15:46:30 -08:00
Aliaksandr Valialkin	03ff3be993	docs/CHANGELOG.md: document the bugfix at a50120a212	2022-12-13 09:36:37 -08:00
Zakhar Bessarab	1e58eabde6	lib/backup/azremote: fix copying for parts larger than 256M by using async copy (#3479) ... * lib/backup/azremote: fix copying for parts larger than 256M by using async copy * lib/backup/azremote: add description of an error for log message	2022-12-13 09:36:36 -08:00
Yury Molodov	cf8ddc67ec	fix: prevent run query when selecting autocomplete option (#3480)	2022-12-13 09:30:33 -08:00
Aliaksandr Valialkin	ea7940e5a7	lib/mergeset: reduce the parts threshold before starting assisted merges ... This should improve query speed in general case. This is a follow-up for d1af6046c7	2022-12-13 09:14:08 -08:00
Aliaksandr Valialkin	d66d28f917	app/vmselect/vmui: make vmui-update	2022-12-12 17:49:07 -08:00
Yury Molodov	664f8e0e12	vmui: minor enhancements (#3471) ... * update package-lock.json * fix: correct handle click by "action" on cardinality page * fix: correct styles for icons width * feat: add layout with copyright * feat: add website and issue to footer	2022-12-12 17:49:05 -08:00
Dima Lazerka	b410e53897	Add Anomaly Detection to enterprise features list (#3476) ... * Add Anomaly Detection to enterprise features list * Update docs/enterprise.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-12-12 17:43:16 -08:00
Aliaksandr Valialkin	2a190f6451	lib/{mergeset,storage}: do not block small merges by pending big merges - assist with small merges instead ... Blocked small merges may result into big number of small parts, which, in turn, may result in increased CPU and memory usage during queries, since queries need to inspect all the existing small parts. The issue has been introduced in 8189770c50 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2022-12-12 17:01:33 -08:00
Aliaksandr Valialkin	f3e5c9c246	lib/bytesutil: cache results for all the input strings, which were passed during the last 5 minutes from FastStringMatcher.Match(), FastStringTransformer.Transform() and InternString() ... Previously only up to 100K results were cached. This could result in sub-optimal performance when more than 100K unique strings were actually used. For example, when the relabeling rule was applied to a million of unique Graphite metric names like in the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466 This commit should reduce the long-term CPU usage for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3466 after all the unique Graphite metrics are registered in the FastStringMatcher.Transform() cache. It is expected that the number of unique strings, which are passed to FastStringMatcher.Match(), FastStringTransformer.Transform() and to InternString() during the last 5 minutes, is limited, so the function results fit memory. Otherwise OOM crash can occur. This should be the case for typical production workloads.	2022-12-12 14:47:00 -08:00
Zakhar Bessarab	600023a8f3	{app/{vmbackup/vmrestore}: update path example to use Azure terminology for consistency (#3475)	2022-12-12 14:43:25 -08:00
Roman Khavronenko	a44af871d3	vmalert: support $for or .For template variables (#3474) ... support `$for` or `.For` template variables in alert's annotations. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3246 Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-12 14:42:16 -08:00
Roman Khavronenko	4917c9ad8a	dashboards: add VersionChange annotation (#3473) ... The new annotation is hidden by default and suppose to show component `short_version` label change on the panels. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-12-12 14:41:46 -08:00
Aliaksandr Valialkin	87390443d1	lib/protoparser/datadog: do not re-use previously parsed field values if they are missing in the currently parsed message ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3432	2022-12-11 13:09:41 -08:00
Aliaksandr Valialkin	87723ef0e1	vendor: update github.com/klauspost/compress from v1.15.12 to v1.15.13	2022-12-11 02:12:07 -08:00
Aliaksandr Valialkin	77aedb6008	docs/CHANGELOG.md: cut v1.85.0	2022-12-11 02:01:20 -08:00
Aliaksandr Valialkin	c135ea36c7	docs/CHANGELOG.md: document changes at v1.79.6	2022-12-11 01:51:48 -08:00
Aliaksandr Valialkin	2e1a44cfd0	docs/CHANGELOG.md: document 461158a437 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3427	2022-12-10 23:42:29 -08:00
Aliaksandr Valialkin	7d996ced51	app/{vmagent,vminsert}/datadog: make the host label optional in DataDog data ingestion protocol ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3432	2022-12-10 23:33:17 -08:00
Aliaksandr Valialkin	808ce815e4	app/vmselect/promql: allow passing inf arg into functions, which accept numeric limit on the number of output time series ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3461	2022-12-10 22:48:01 -08:00
Aliaksandr Valialkin	afa232eebb	docs/CHANGELOG.md: add a link to the issue related to reduced CPU and memory usage at vmalert ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3464 The related commit - b97bd01605	2022-12-10 22:21:58 -08:00
Aliaksandr Valialkin	b472fbc737	vendor: make vendor-update	2022-12-10 21:47:18 -08:00
Aliaksandr Valialkin	00d953ab66	docs: clarify that single-node VictoriaMetrics also provides functionality for relabel debugging ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3407	2022-12-10 20:50:51 -08:00