8210 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
XLONG96	88b9088499	lib/logstorage: avoid panic when parsing regex with stream filter (#5897)	2024-02-29 15:32:25 +02:00
Aliaksandr Valialkin	7310605c27	docs/CHANGELOG.md: clarify the description for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5859 ... This is a follow-up for 3c74aa6b3d Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5888	2024-02-29 15:28:52 +02:00
Aliaksandr Valialkin	9d5a385973	app/{vmalert,vmctl}: consistently use http.NewRequestWithContext() instead of http.NewRequest() + req.WithContext()	2024-02-29 15:25:36 +02:00
Aliaksandr Valialkin	0d2d1897c2	app/vmbackupmanager: follow-up after f2885a5c41dfaeecfecba0aceb8ae65b15e15d1c ... - Document the change at docs/CHANGELOG.md - Give more clear name for maxHealthChecksRetries constant - Improve logging when storage isn't reachable - Use http.NewRequestWithContext() instead of setting up a request without context and then creating a new request with context vi req.WithContext() call. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5859 Updates https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/735	2024-02-29 15:17:57 +02:00
Hui Wang	99acc5bbba	caseStudies: add NetEaseCloudMusic post (#5891)	2024-02-29 14:58:15 +02:00
Artem Navoiev	3d9f947e42	docs: update statistic per tenant, add use cases section (#5892) ... * docs: update statistic per tenant, add use cases section Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * prettify Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * Update docs/PerTenantStatistic.md --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2024-02-29 14:55:55 +02:00
Aliaksandr Valialkin	38b42489c6	docs/anomaly-detection/guides: bump alertmanager version from v0.25.0 to v0.27.0 after 3723c809a1	2024-02-29 14:51:39 +02:00
Aliaksandr Valialkin	7832d0800e	app/{vminsert,vmagent}: follow-up after 67a55b89a4 ... - Document the ability to read OpenTelemetry data from Amazon Firehose at docs/CHANGELOG.md - Simplify parsing Firehose data. There is no need in trying to optimize the parsing with fastjson and byte slice tricks, since OpenTelemetry protocol is really slooow because of over-engineering. It is better to write clear code for better maintanability in the future. - Move Firehose parser from /lib/protoparser/firehose to lib/protoparser/opentelemetry/firehose, since it is used only by opentelemetry parser. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5893	2024-02-29 14:47:20 +02:00
Denys Holius	e55d9b7b61	docker-compose: bump alertmanager version from v0.25.0 to the latest v0.27.0 for VictroiaMetrics Single/Cluster/vmanomaly (#5890) ... see https://github.com/prometheus/alertmanager/releases/tag/v0.27.0	2024-02-29 14:47:06 +02:00
Andrii Chubatiuk	60cf0c9656	{vmagent,vminsert}: added firehose http destination opentelemetry data ingestion support (#5893) ... Co-authored-by: Andrii Chubatiuk <wachy@Andriis-MBP-2.lan> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2024-02-29 14:46:16 +02:00
Github Actions	33a65d6988	Automatic update operator docs from VictoriaMetrics/operator@9f1c910 (#5895)	2024-02-29 13:56:31 +02:00
Aliaksandr Valialkin	4e5cbc5dc6	deployment/docker: downgrade Go builder from 1.22.0 to 1.21.7 ... Go1.22.0 contains the bug https://github.com/golang/go/issues/65705 , which prevents vmagent from normal operation.	2024-02-29 13:52:58 +02:00
Aliaksandr Valialkin	cb9b46be54	app/vmselect/prometheus: add -search.ignoreExtraFiltersAtLabelsAPI command-line flag for ignoring extra_filters and extra_label args at /api/v1/labels, /api/v1/label/.../values and /api/v1/series	2024-02-29 13:00:24 +02:00
Aliaksandr Valialkin	8187244153	lib/streamaggr: make the BenchmarkAggregatorsPushByJobAvg closer to production case with long list of labels per sample	2024-02-29 02:41:48 +02:00
Artem Navoiev	53c1c603d2	dashboards: update statistic per tenant dashbaord. Change to timeseries panel, add churn rate over 24h and query duration, add billing section ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-02-29 02:41:27 +02:00
Hui Wang	d6ecfffa17	chore: add actual request size in error message (#5889)	2024-02-29 02:40:57 +02:00
lzfhust	2821993c9c	add xiaohongshu in Case studies (#5885)	2024-02-29 02:40:00 +02:00
Aliaksandr Valialkin	1d6ebe6404	app/vminsert/netstorage: rename storageNode.broken to storageNode.isBroken for the sake of consistency with storageNode.isReadOnly	2024-02-27 14:42:45 +02:00
Aliaksandr Valialkin	be3f5d1c64	app/vminsert/netstorage: log the error message when pending data wasn't sent to vmstorage nodes because they were unavailable at graceful shutdown	2024-02-27 14:15:15 +02:00
Aliaksandr Valialkin	7d619deacc	docs/Release-Guide.md: https://github.com/VictoriaMetrics/victoriametrics-lts-rpm should contain the latest release ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5811	2024-02-27 13:14:25 +02:00
Roman Khavronenko	baa32adc47	deployment: create a separate env for VictoriaLogs (#5857) ... * deployment: create a separate env for VictoriaLogs The new environment consists of the following components: * VictoriaLogs * fluentbit for collecting logs and sending to VictoriaLogs * VictoriaMetrics for scraping and storing metrics from fluentbit and VictoriaLogs * Grafana with VictoriaLogs datasource for monitoring ----------------- The motivation for creating a separate environment is to simplify existing environments and make it easier to update or modify them in future. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-02-27 13:13:42 +02:00
Aliaksandr Valialkin	05f56c411e	app/vminsert/netstorage: prevent from infinite loop when the re-routing is enabled and all the vmstorage nodes are unavailable	2024-02-25 03:24:51 +02:00
Aliaksandr Valialkin	1109521806	vendor: retain v0.46.0 for github.com/prometheus/common , since v0.48.0 leads to build error ... The error is: vendor/github.com/prometheus/client_golang/prometheus/testutil/promlint/promlint.go:71:38: undefined: expfmt.FmtText	2024-02-25 02:20:45 +02:00
Aliaksandr Valialkin	b3dbbc22b9	app/vmselect/promql: properly handle args in count_values_over_time() function ... Prevsiously they were swapped - the first arg should be the label name and the second arg should be label filters This is a follow-up for e389b7b959e8144fdff5075bf7a5a39b2b0c6dd3 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5847	2024-02-25 01:48:37 +02:00
Aliaksandr Valialkin	3519c055d5	vendor: run make vendor-update	2024-02-24 03:23:56 +02:00
Aliaksandr Valialkin	63d635a5e4	app: consistently use atomic.* types instead of atomic.* functions ... See ea9e2b19a5	2024-02-24 03:06:14 +02:00
Aliaksandr Valialkin	d845edc24b	lib: consistently use atomic.* types instead of atomic.* functions ... See ea9e2b19a5	2024-02-24 02:10:04 +02:00
Aliaksandr Valialkin	61519f6c22	lib/backup/actions: expose vm_backups_downloaded_bytes_total metric in order to be consistent with vm_backups_uploaded_bytes_total metric	2024-02-24 01:14:57 +02:00
Aliaksandr Valialkin	510e3d9cda	lib/backup/actions: update vm_backups_uploaded_bytes_total metric along the file upload instead of after the file upload ... This solves two issues: 1. The vm_backups_uploaded_bytes_total metric will grow more smoothly 2. This prevents from int overflow at metrics.Counter.Add() when uploading files bigger than 2GiB	2024-02-24 01:08:34 +02:00
Aliaksandr Valialkin	0ac1c533dc	lib/backup/actions: consistently use atomic.* types instead of atomic.* functions ... See ea9e2b19a5	2024-02-24 01:02:37 +02:00
Aliaksandr Valialkin	6fd6d4c2de	lib/storage: replace the remaining atomic.* functions with atomic.* types for the sake of consistency ... See ea9e2b19a5	2024-02-24 00:51:03 +02:00
Aliaksandr Valialkin	a1baf25c2e	lib/storage: consistently use atomic.* types instead of atomic.* function calls on ordinary types ... See ea9e2b19a5	2024-02-24 00:33:07 +02:00
Aliaksandr Valialkin	ca1e78bd16	lib/logstorage: consistently use atomic.* types instead of atomic.* functions on regular types ... See ea9e2b19a5	2024-02-24 00:29:39 +02:00
Aliaksandr Valialkin	d0538d11d3	lib/mergeset: consistently use atomic.* types instead of atomic.* function calls on ordinary types ... See ea9e2b19a5	2024-02-24 00:29:12 +02:00
Aliaksandr Valialkin	92e098012a	lib/logstorage: consistently use atomic.* type for refCount and mustDrop fields in datadb and storage structs in the same way as it is used in lib/storage ... See ea9e2b19a5 and a204fd69f1	2024-02-24 00:28:56 +02:00
Aliaksandr Valialkin	7fa700a41c	lib/mergeset: consistently use atomic.* type for refCount and mustDrop fields in table struct in the same way as it is used in lib/storage ... See ea9e2b19a5 and a204fd69f1	2024-02-24 00:28:37 +02:00
Aliaksandr Valialkin	e7dfcdfff6	lib/storage: consistently use atomic.* type for refCount and mustDrop fields in indexDB, table and partition structs ... See ea9e2b19a5	2024-02-24 00:26:26 +02:00
Aliaksandr Valialkin	e2b0cc873b	lib/storage: convert dedupsDuringMerge from uint64 to atomic.Uint64 ... This should simplify code maintenance by gradually converting to atomic.* types instead of calling atomic.* functions on int and bool types. See ea9e2b19a5	2024-02-24 00:25:44 +02:00
Aliaksandr Valialkin	1eb3346ecc	lib/{storage,mergeset}: properly fix 'unaligned 64-bit atomic operation' panic on 32-bit architectures ... The issue has been introduced in bace9a2501 The improper fix was in the d4c0615dcd , since it fixed the issue just by an accident, because Go comiler aligned the rawRowsShards field by 4-byte boundary inside partition struct. The proper fix is to use atomic.Int64 field - this guarantees that the access to this field won't result in unaligned 64-bit atomic operation. See https://github.com/golang/go/issues/50860 and https://github.com/golang/go/issues/19057	2024-02-24 00:25:08 +02:00
Aliaksandr Valialkin	dc5b1e4dc1	lib/httpserver: return back the default value for -http.connTimeout to 2 minutes ... It has been appeared that there are VictoriaMetrics users, who rely on the fact that VictoriaMetrics components were closing incoming connections to -httpListenAddr every 2 minutes by default. So let's return back this value by default in order to fix the breaking change made at d8c1db7953 . See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1304#issuecomment-1961891450 .	2024-02-24 00:20:11 +02:00
Aliaksandr Valialkin	2f0b2b942b	docs/Troubleshooting.md: add Too much disk space used chapter`	2024-02-24 00:19:51 +02:00
hagen1778	0ac2df6e66	docs: mention missing change 521f9ffb430edf6aea7720a966b5b079cf15e34e ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-02-24 00:19:13 +02:00
hagen1778	ab4fae9dc2	lib/storage: cleanup after d4c0615dcd ... Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit c8d1d2ab72)	2024-02-23 18:55:40 +01:00
Dmytro Kozlov	eb22083924	lib/storage: fix aligning (#5860) ... (cherry picked from commit d4c0615dcd)	2024-02-23 18:55:39 +01:00
Roman Khavronenko	ce4fcd07ce	deployment: add topology visualizations (#5858) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 840ab60111)	2024-02-23 18:55:39 +01:00
Aliaksandr Valialkin	fe545dfc85	app/vmstorage: remove unused import after 2a5c6e1cd5	2024-02-23 04:53:42 +02:00
Aliaksandr Valialkin	2a5c6e1cd5	app/vmstorage: deprecate -snapshotCreateTimeout command-line flag ... Creating snapshot shouldn't time out under normal conditions. The timeout was related to the bug, which has been fixed in 6460475e3b . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3551	2024-02-23 04:51:57 +02:00
Aliaksandr Valialkin	42437e05c7	lib/storage: do not drop (date, metricID) entries for the date older than 2 days if samples are ingested at this date ... Previously the (date, metricID) entries for dates older than the last 2 days were removed. This could lead to slow check for the (date, metricID) entry in the indexdb during ingesting historical data (aka backfilling). The issue has been introduced in 431aa16c8d	2024-02-23 04:06:54 +02:00
Aliaksandr Valialkin	83217b7473	app/vmselect: add -search.maxLabelsAPIDuration and -search.maxLabelsAPISeries options for fine-tuning CPU and RAM usage for /api/v1/series , /api/v1/labels and /api/v1/label/.../values ... This commit returns back limits for these endpoints, which have been removed at 5d66ee88bd , since it has been appeared that missing limits result in high CPU usage, while the introduced concurrency limiter results in failed lightweight requests to these endpoints because of timeout when heavyweight requests are executed. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5055	2024-02-23 02:56:58 +02:00
Aliaksandr Valialkin	0e08dee8a1	app/{vmselect,vlselect}/vmui: run make vmui-update vmui-logs-update after recent changes to app/vmui	2024-02-23 01:40:57 +02:00