3572 commits

Author	SHA1	Message	Date
Artem Navoiev	75920ab3b1	docs add docs titles ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:28:54 +02:00
Artem Navoiev	c8fc813e00	vmanonamly docs fix sorting for jekill as far it doesnt support of sorting the folders ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:28:17 +02:00
Artem Navoiev	f3b4ca6a77	vmanomaly remove unused pages from menu ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:27:49 +02:00
Artem Navoiev	7eff777467	vmanomly specify the right menu parent for overview page ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:27:26 +02:00
Artem Navoiev	0ec4134ab6	docs vmanmoly fix sorting ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:26:59 +02:00
Artem Navoiev	b5363ffab2	Move vmanomaly page to its own section (#5646) ... * docs: move vmanomaly overview page to its section Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * add alias for backward compatibility Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * fix links Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * change title Signed-off-by: Artem Navoiev <tenmozes@gmail.com> --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:26:37 +02:00
Roman Khavronenko	fe4934f0ec	app/vmui: send step param for instant queries (#5639) ... The change reverts https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3896 due to reasons explained in https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3896#issuecomment-1896704401 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-22 00:25:31 +02:00
Fred Navruzov	3b8f4714c3	docs: vmanomaly slight improvements (#5637) ... * - better messaging - update links to dockerhub in guides - added anomaly_score to FAQ - improve model section (sort + use cases) - slight refactor of a guide * rename guide & change refs * change wording in installation options * - update remaining text reference - add cross-link to component sections in guide * add docs/.jekyll-metadata to .gitignore	2024-01-22 00:24:39 +02:00
hagen1778	a99d26633b	docs: remove slug from Grafana dashboard URLs ... Each Grafana dashboard has unique ID which can be used to fetch the dashboard from grafana.com: https://grafana.com/grafana/dashboards/11176 The same dashboard can be accessed via URL with slug: https://grafana.com/grafana/dashboards/11176-victoriametrics-cluster/ But using slug implies that any change to dashboard name will break the link. So it is better to just use ID, so the dashboard URL will never break. This is follow-up for ff33e60a3d Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-22 00:23:30 +02:00
Artem Navoiev	70743c7014	fix link for grafana dashbaord for single node after its renaming ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:21:57 +02:00
Artem Navoiev	79b308fa54	docs: vmanomaly update vmanomaly + vmalert guide (#5636) ... * docs: vmanomaly update vmanomaly + vmalert guide Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * docs: vmanomaly update vmanomaly + vmalert guide. Update docker compose and monitoring section Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * typos and fixes Signed-off-by: Artem Navoiev <tenmozes@gmail.com> --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-22 00:19:15 +02:00
Artem Navoiev	8154d16420	docs: changelog fix the link to cluster ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-21 23:54:08 +02:00
Artem Navoiev	b1fe59df8b	vmanomaly docs fix broken relative links ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-21 23:53:39 +02:00
Artem Navoiev	547b62a807	docs/anomaly-detection/components/models.md add sort:1 ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-21 23:53:10 +02:00
Artem Navoiev	7c62010d04	vmanonaly docs add .html for the section document models ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-21 23:52:41 +02:00
Artem Navoiev	b66b059231	vmanomaly docs simplify the strcuture (#5634) ... * vmanomaly docs simplify the strcuture Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * fix links Signed-off-by: Artem Navoiev <tenmozes@gmail.com> --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-21 23:52:07 +02:00
hagen1778	07a55a484a	docs/setup-size: rm tolerable churn rate % ... It is likely this value was borrowed from panel `Slow inserts` panel from Grafana dasbhoard for VM single/cluster installations. This is a mistake. There is no such thing as "tolerable churn rate", as tolerancy depends on the amount of allocated resources. Although, it is unclear what is meant by 5%. If it refers to 5% of new time series per second, then such churn rate is extremely high. It would mean that the avg life of a time series is 20s. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-21 23:48:24 +02:00
Roman Khavronenko	148e14b3f2	app/vmselect: properly calculate start param for queries with too big look-behind window (#5630) ... Properly determine time range search for instant queries with too big look-behind window like `foo[100y]`. Previously, such queries could return empty responses even if `foo` is present in database. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5553 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-21 23:47:09 +02:00
Aliaksandr Valialkin	ecb0a3d27d	docs/keyConcepts.md: typo fixes after b7ffee2644 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5555	2024-01-17 13:27:37 +02:00
Aliaksandr Valialkin	b7ffee2644	docs/keyConcepts.md: document /internal/force_flush handler ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5555	2024-01-17 13:23:46 +02:00
Aliaksandr Valialkin	014bba6d8e	docs/CHANGELOG*: move changes for 2023 year to docs/CHANGELOG_2023.md	2024-01-17 13:12:58 +02:00
hagen1778	d4ae2cb5d0	docs/troubleshooting: mention query latency in unexpected query results ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5555 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-17 13:12:35 +02:00
Aliaksandr Valialkin	a130b86533	docs/CHANGELOG.md: document v1.93.10 LTS release ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.93.10	2024-01-17 01:45:22 +02:00
Aliaksandr Valialkin	dc5066368a	docs/{vmbackup,vmbackupmanager}.md: clarify why storing backups to S3 Glacier can be time-consuming and expensive ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5614 This is a follow-up for e14e3d9c8c	2024-01-17 01:06:51 +02:00
hagen1778	a2d3fce05f	deployment/dashboards: change title VictoriaMetrics to VictoriaMetrics - single-node ... The new title should provide better understanding of this dashboard purpose. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-17 01:06:07 +02:00
Aliaksandr Valialkin	0b1c2f70a5	docs/CHANGELOG.md: document v1.87.13 LTS release ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.87.13	2024-01-17 01:04:26 +02:00
Aliaksandr Valialkin	1340ab1c07	docs/CHANGELOG.md: fix a link in the description of 70cd09e736 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5581	2024-01-17 00:16:17 +02:00
Aliaksandr Valialkin	8d13b543ba	docs/Single-server-VictoriaMetrics.md: explain why staleness markers are treated as an ordinary values during de-duplication ... This is a follow-up for d374595e31 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5587	2024-01-17 00:15:18 +02:00
Aliaksandr Valialkin	c819e85904	docs/vmagent.md: mention the minumum value for -remoteWrite.vmProtoCompressLevel ... Recommend using the default value for -remoteWrite.vmProtoCompressLevel This is a follow-up for 095d982976 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5575	2024-01-17 00:14:08 +02:00
Artem Navoiev	bdf4f0f1e2	docs: vmanomaly fix font matter ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-17 00:12:05 +02:00
Artem Navoiev	a1ae06cc04	docs: vmanomaly remove commented text ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-17 00:07:36 +02:00
Aliaksandr Valialkin	b7fcdb1985	deployment/docker: update Go builder from Go1.21.5 to Go1.21.6	2024-01-17 00:05:24 +02:00
Aliaksandr Valialkin	f673039e86	lib/storage: follow-up for 4b8088e377 ... - Clarify the bugfix description at docs/CHANGELOG.md - Simplify the code by accessing prefetchedMetricIDs struct under the lock instead of using lockless access to immutable struct. This shouldn't worsen code scalability too much on busy systems with many CPU cores, since the code executed under the lock is quite small and fast. This allows removing cloning of prefetchedMetricIDs struct every time new metric names are pre-fetched. This should reduce load on Go GC, since the cloning of uin64set.Set struct allocates many new objects.	2024-01-16 22:38:57 +02:00
Hui Wang	2f40ed3aac	exit vmagent if there is config syntax error in scrape_config_files when -promscrape.config.strictParse=true (#5560)	2024-01-16 22:35:18 +02:00
hagen1778	343176438e	deployment/alerts: add job label to DiskRunsOutOfSpace alerting rule ... So it is easier to understand to which installation the triggered instance belongs. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 22:21:34 +02:00
Aliaksandr Valialkin	6ba2fd3312	app/vmselect/promql: follow-up for ce4f26db02 ... - Document the bugfix at docs/CHANGELOG.md - Filter out NaN values before sorting as suggested at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5509#discussion_r1447369218 - Revert unrelated changes in lib/filestream and lib/fs - Use simpler test at app/vmselect/promql/exec_test.go Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5509 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5506	2024-01-16 22:13:13 +02:00
Aliaksandr Valialkin	015c0a4d1a	app/vmselect/promql: consistently sort results of a or b query ... Previously the order of results returned from `a or b` query could change with each request because the sorting for such query has been disabled in order to satisfy https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4763 . This commit executes `a or b` query as `sortByMetricName(a) or sortByMetricName(b)`. This makes the order of returned time series consistent across requests, while maintaining the requirement from https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4763 , e.g. `b` results are consistently put after `a` results. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5393	2024-01-16 22:12:15 +02:00
Artem Navoiev	55a03ff454	docs: vmanomaly fix image size ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:56:25 +02:00
Artem Navoiev	83287bde1c	vmanomly: guide add diagramm ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:55:59 +02:00
Artem Navoiev	f3364bbd8b	docs: vmanomaly fix formatting and remove unnecessary elements ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:55:42 +02:00
Artem Navoiev	6370ae2d88	vmanomaly - models a bit pretify docs (#5618) ... * vmanomaly - models a bit pretify docs Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * typi Signed-off-by: Artem Navoiev <tenmozes@gmail.com> * fix formatting Signed-off-by: Artem Navoiev <tenmozes@gmail.com> --------- Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:54:33 +02:00
Artem Navoiev	a90c9bf8c9	vmanomaly guides - fix formating, add missing piece, clarify statement, use common languagefor VM ecosystem (#5620) ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:53:59 +02:00
Artem Navoiev	44ff8b3647	clarify cluster multitenacy in vmanomaly docs (#5619) ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:53:30 +02:00
Artem Navoiev	f032f4347e	docs: fix markdown in how-to-monitor-k8s ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 21:52:59 +02:00
Roman Khavronenko	c69d5041bb	docs: mention requirements for latest backups (#5614) ... Add docs to explain that `latest` backup folder can be accessed more frequently than others. Hence, it is recommended to keep it on storages with low access price. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 21:28:27 +02:00
Aliaksandr Valialkin	9e5e514faf	lib/pushmetrics: wait until the background goroutines, which push metrics, are stopped at pushmetrics.Stop() ... Previously the was a race condition when the background goroutine still could try collecting metrics from already stopped resources after returning from pushmetrics.Stop(). Now the pushmetrics.Stop() waits until the background goroutine is stopped before returning. This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5549 and the commit fe2d9f6646 . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5548	2024-01-16 21:18:22 +02:00
Aleksandr Stepanov	3a6e3adc7d	vmagent: added hetzner sd config (#5550) ... * added hetzner robot and hetzner cloud sd configs * remove gettoken fun and update docs * Updated CHANGELOG and vmagent docs * Updated CHANGELOG and vmagent docs --------- Co-authored-by: Nikolay <nik@victoriametrics.com>	2024-01-16 21:13:20 +02:00
Roman Khavronenko	d562d772a8	lib/storage: properly check for storage/prefetchedMetricIDs cache expiration deadline (#5607) ... Before, this cache was limited only by size. Cache invalidation by time happens with jitter to prevent thundering herd problem. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 21:08:59 +02:00
rbizos	62db64e71b	Handling negative index in Graphite groupByNode/aliasByNode (#5581) ... Handeling the error case with -1 Signed-off-by: Raphael Bizos <r.bizos@criteo.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2024-01-16 20:55:27 +02:00
Aliaksandr Valialkin	063ea8c773	app/vmalert/remotewrite: properly calculate vmalert_remotewrite_dropped_rows_total ... It was calculating the number of dropped time series instead of the number of dropped samples. While at it, drop vmalert_remotewrite_dropped_bytes_total metric, since it was inconsistently calculated - at one place it was calculating raw protobuf-encoded sample sizes, while at another place it was calculating the size of snappy-compressed prompbmarshal.WriteRequest protobuf message. Additionally, this metric has zero practical sense, so just drop it in order to reduce the level of confusion.	2024-01-16 20:47:13 +02:00
Aliaksandr Valialkin	9eef72bce9	lib/protoparser/datadogv2: add support for reading protobuf-encoded requests at /api/v2/series endpoint ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4451 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5094	2024-01-16 20:32:15 +02:00
Dmytro Kozlov	b95d6f5f5e	app/vmctl: add insecure skip verify flags for source and destination addresses for native protocol (#5606) ... https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5595	2024-01-16 20:29:41 +02:00
Zakhar Bessarab	178d64cc51	docs: explicitly mention "delete_series" endpoint accepts any HTTP method (#5605) ... See: #5552 Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2024-01-16 20:14:04 +02:00
hagen1778	af47f96177	docs: make docs-sync ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 20:12:47 +02:00
Dan Dascalescu	59ab3efc2b	docs: fix English in keyConcepts.md, add instant query use case (#5547)	2024-01-16 19:54:09 +02:00
Fred Navruzov	2b372de326	docs: vmanomaly chapter hotfixes (#5583) ... * update link to book a demo for AD & RCA * fix invalid refs in components/model * - fix staging -> prod links - replace capitalized FAQ headers - change the section order on main page - replace :latest tag with current stable	2024-01-16 19:53:25 +02:00
Fred Navruzov	99c545bff8	- fix 404 in /guides page (#5582) ... - change back AD section title	2024-01-16 19:50:01 +02:00
Artem Navoiev	821ac6e374	docs: properly close diff ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 19:48:36 +02:00
Denys Holius	74c99549d6	docs/anomaly-detection/guides/README.md: fixed markdown link to the vmanomaly guide (#5578)	2024-01-16 19:12:50 +02:00
Artem Navoiev	54723fc94e	docs: vmanomaly add list of guides to guides page ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 19:12:04 +02:00
Artem Navoiev	77570d83ee	docs: change sorting of anomaly deteciton ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 19:10:56 +02:00
Fred Navruzov	2b404742e2	docs: vmanomaly part 1 (#5558) ... * add `AD` section, fix links, release docs and changelog * - connect sections, refactor structure * - resolve suggestions - add FAQ section - fix dead links * - fix incorrect render of tables for Writer - comment out internal readers/writers - fix page ordering to some extent * - link licensing requirements from v1.5.0 to main page --------- Co-authored-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 19:09:37 +02:00
Denys Holius	c9b7452a86	CHANGELOG.md: fixed wrong links to vmalert-tool documentation page (#5570)	2024-01-16 19:07:35 +02:00
Artem Navoiev	9152f91f49	docs: specify right link to grafana operator docs ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-01-16 17:45:21 +02:00
hagen1778	bcc3c9c12e	docs: fix typo in VictoriaLogs upgrading procedure ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 17:43:59 +02:00
hagen1778	583bbed48e	docs: docs-sync after 52692d001a ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 17:42:48 +02:00
hagen1778	14b9f7d71f	docs: add link to sandbox to the Grafana section ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-16 17:36:11 +02:00
Aliaksandr Valialkin	0114ade5eb	docs/keyConcepts.md: clarify which values can be stored in VictoriaMetrics without precision loss ... This is a follow-up for 43d7de4afe Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5485 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5503	2024-01-16 15:50:28 +02:00
hagen1778	2a7207f38a	app/all: follow-up after 84d710beab ... https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5548 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-01-09 13:17:09 +01:00
Artem Navoiev	5f10055f67	docs: vmagent specify default value for the compression level and its maximum. The question appers too often in our channel (#5575) ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com> (cherry picked from commit 095d982976)	2024-01-08 20:15:05 +01:00
Dmytro Kozlov	37a76de800	app/vmui: fix broken link for the statistic inaccuracy explanation (#5568) ... (cherry picked from commit 105c6b2eb7)	2024-01-08 20:15:04 +01:00
Dan Dascalescu	068610ac61	Link to start/end timestamp formats in url-examples (#5531) ... (cherry picked from commit 33df9bee22)	2024-01-08 20:15:04 +01:00
hagen1778	12acea2584	dashboards: update cluster dashboard ... * add panels for detailed visualization of traffic usage between vmstorage, vminsert, vmselect components and their clients. New panels are available in the rows dedicated to specific components. * update "Slow Queries" panel to show percentage of the slow queries to the total number of read queries served by vmselect. The percentage value should make it more clear for users whether there is a service degradation. Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 463455665b)	2024-01-08 11:58:56 +01:00
Hui Wang	c14e229b20	vmalert: automatically add exported_ prefix for original evaluation… (#5398) ... automatically add `exported_` prefix for original evaluation result label if it's conflicted with external or reserved one, previously it was overridden. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5161 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 1f477aba41)	2023-12-22 16:10:33 +01:00
Daria Karavaieva	372553479a	docs: vmanomaly guide v1.7.0 changes (#5505) ... (cherry picked from commit be20501376)	2023-12-22 16:10:32 +01:00
Dmytro Kozlov	2c0cbafc0c	docs: clarify information about values (#5503) ... (cherry picked from commit 43d7de4afe)	2023-12-22 16:10:32 +01:00
hagen1778	b04bb9b140	docs: fix unauthorizedAccessConfig filed names for operator ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5520 Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 8ba483eca3)	2023-12-22 16:10:31 +01:00
Aliaksandr Valialkin	6feef14095	lib/protoparser: add missing /datadog/ prefix to the /api/v2/series path in the description for -datadog.maxInsertRequestSize command-line flag	2023-12-21 21:05:24 +02:00
Aliaksandr Valialkin	d145c68c5c	docs/CHANGELOG.md: typo fix after fb90a56de2: supperted -> supported	2023-12-21 21:01:54 +02:00
Aliaksandr Valialkin	62a105d9e9	app/{vminsert,vmagent}: preliminary support for /api/v2/series ingestion from new versions of DataDog Agent ... This commit adds only JSON support - https://docs.datadoghq.com/api/latest/metrics/#submit-metrics , while recent versions of DataDog Agent send data to /api/v2/series in undocumented Protobuf format. The support for this format will be added later. Thanks to @AndrewChubatiuk for the initial implementation at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5094 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4451	2023-12-21 20:50:27 +02:00
Aliaksandr Valialkin	3a9cf13aaa	app/{vmagent,vmalert}: add the ability to set OAuth2 endpoint params via the corresponding *.oauth2.endpointParams command-line flags ... This is a follow-up for 5ebd5a0d7b Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5427	2023-12-20 21:38:16 +02:00
Morgan	64e96fccd9	Expose OAuth2 Endpoint Parameters to cli (#5427) ... The user may which to control the endpoint parameters for instance to set the audience when requesting an access token. Exposing the parameters as a map allows for additional use cases without requiring modification.	2023-12-20 21:38:13 +02:00
Aliaksandr Valialkin	c5f6ca268c	docs/Articles.md: add two articles about VictoriaMetrics from zetablogs.medium.com	2023-12-20 21:36:15 +02:00
Aliaksandr Valialkin	c888d76c4b	app/vmselect/netstorage: make sure that at least a single result is collected from every storage group before deciding whether it is OK to skip results from the remaining storage nodes	2023-12-20 19:53:49 +02:00
Nikolay	46a335aa1d	lib/awsapi: properly assume role with webIdentity token (#5495) ... * lib/awsapi: properly assume role with webIdentity token introduce new irsaRoleArn param for config. It's only needed for authorization with webIdentity token. First credentials obtained with irsa role and the next sts assume call for an actual roleArn made with those credentials. Common use case for it - cross AWS accounts authorization https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3822 * wip --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-12-20 19:07:04 +02:00
Dmytro Kozlov	7afec3d813	docs: remove default value from the maxConcurrentInserts flag (#5494)	2023-12-20 14:15:20 +02:00
Aliaksandr Valialkin	0a99c819bf	all: add -metrics.exposeMetadata command-line flag, which can be used for adding TYPE and HELP metadata for metrics exposed at /metrics page ... This may be needed for systems, which require this metadata such as Google Cloud Managed Prometheus. See https://cloud.google.com/stackdriver/docs/managed-prometheus/troubleshooting#missing-metric-type	2023-12-19 03:26:02 +02:00
Artem Navoiev	738a71b865	docs: vmalert exapand HA abbreviation ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-12-19 03:24:53 +02:00
hagen1778	49bd8adbc3	docs: mention Splitting data streams in Multi-retention guide ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-19 03:24:12 +02:00
hagen1778	0bb65bc83e	docs: add example for Splitting data streams among multiple systems ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-19 03:23:24 +02:00
Aliaksandr Valialkin	9540d29154	lib/pushmetrics: add -pushmetrics.header and -pushmetrics.disableCompression command-line flags	2023-12-17 19:58:14 +02:00
Aliaksandr Valialkin	cbd8a62ba4	docs/CHANGELOG.md: typo fix: use proper backtick closing quote instead of single quote	2023-12-17 19:28:22 +02:00
Roman Khavronenko	bcb2b8247c	vmctl: rename vm-native-disable-retries to vm-native-disable-per-metric-migration (#5476) ... The change supposed to better reflect the meaning of this flag. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-17 19:19:22 +02:00
Aliaksandr Valialkin	76b120e355	lib/protoparser/opentelemetry: allow ingesting metrics without resource labels ... Some clients may ingest samples via OpenTelemetry protocol without Resource labels. Previously VictoriaMetrics was silently dropping such samples. The commit 317834f876 added vm_protoparser_rows_dropped_total{type="opentelemetry",reason="resource_not_set"} counter for tracking of such dropped samples. See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5459 It is better from usability PoV to accept such samples instead of dropping them and incrementing the corresponding counter.	2023-12-17 19:16:43 +02:00
Aliaksandr Valialkin	bed19a0b20	docs/CHANGELOG.md: move the description of the bugfix from 9253c24dd6 into correct place ... The description of the bugfix was incorrectly placed in already released v1.96.0, while it should be placed in tip. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5450	2023-12-17 19:16:42 +02:00
Roman Khavronenko	5f14fa94dd	vmctl: retry requests that failed in the very end for vm-native (#5475) ... Before, retries happened only on writes into a network connection between source and destination. But errors returned by server after all the data was transmitted were logged, but not retried. Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 664fa5cb78)	2023-12-15 11:54:08 +01:00
Hui Wang	ed4f77575f	vmalert: validate schema for -external.url (#5450) ... Requests with wrong or no schema in `-external.url` could be rejected by alertmanager. So we validate schema on start up. (cherry picked from commit 9253c24dd6)	2023-12-15 11:54:07 +01:00
Artem Navoiev	c86e0fdc24	add link to RELEX solutions case study to home and signle pages ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-12-14 20:54:55 +02:00
nemobis	ac48e4dc9f	Add RELEX Solutions to case studies (#5469) ... Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2023-12-14 20:53:15 +02:00
Aliaksandr Valialkin	42629dead1	app/vmstorage: addd missing -inmemoryDataFlushInterval command-line flag ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3337	2023-12-14 20:47:49 +02:00
Aliaksandr Valialkin	8bc87acfb9	docs/CHANGELOG.md: document the bugfix at 66c76a4d4d ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5414	2023-12-14 12:49:03 +02:00
Aliaksandr Valialkin	51acf0179c	app/vmauth: add ability to route requests to different backends depending on the request host	2023-12-14 00:47:00 +02:00
Aliaksandr Valialkin	a57f125c67	docs/Single-server-VictoriaMetrics.md: cross-link HA docs with the corresponding chapter at vmauth docs	2023-12-13 23:07:09 +02:00
Aliaksandr Valialkin	b2dcb94322	deployment: update VictoriaMetrics images from v1.95.1 to v1.96.0 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v1.96.0	2023-12-13 01:21:12 +02:00
Aliaksandr Valialkin	d59ee93d04	docs/CHANGELOG.md: cut v1.96.0 release	2023-12-13 00:43:04 +02:00
Yury Molodov	e76c44c5b4	vmui: autocomplete usability improvements (#5422) ... * vmui: add show quick tip for autocomplete * vmui: auto-completion usability improvements #5348 * vmui: add const for min symbols in autocomplete * Use proper queries to VictoriaMetrics * vmui: fix comments for autocomplete * app/vmselect: run `make vmui-update` --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2023-12-13 00:33:27 +02:00
Aliaksandr Valialkin	e4bb2808f1	app/vmselect: add support for vmstorage groups with independent -replicationFactor per group ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5197 See https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#vmstorage-groups-at-vmselect Thanks to @zekker6 for the initial pull request at https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/718	2023-12-13 00:14:34 +02:00
hagen1778	3b841fe9ce	app/vmctl: follow-up after 6af732b6f7 ... Make docs more clear about new feature. Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 242472086b)	2023-12-12 13:45:35 +01:00
Dmytro Kozlov	63fc200f16	app/vmctl: enable range steps in reverse order (#5444) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5376 (cherry picked from commit 6af732b6f7)	2023-12-12 13:45:35 +01:00
hagen1778	14117f2f90	lib/promscrape: comsetic changes after e373bb84d5 ... * fix typos in docs * add `shard-` prefix to generated links when `-promscrape.cluster.memberURLTemplate` is enabled Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit e0fc5ef140)	2023-12-12 13:45:34 +01:00
hagen1778	c2ca6cb84d	docs: fix formatting after a list in CHANGELOG.md ... Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 1e02efd511)	2023-12-12 13:45:34 +01:00
hagen1778	307bcb8d4d	app/vmctl: follow-up after 27668c9d01 ... * remove duplications in error messages * mention the change in CHANGELOG.md 27668c9d01 Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 39c405ed4d)	2023-12-11 15:38:22 +01:00
hagen1778	73f843a70e	docs: mention alerts change in CHANGELOG.md ... Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit e13dc04fbf)	2023-12-11 15:38:18 +01:00
Aliaksandr Valialkin	050e15d85b	docs/CHANGELOG.md: document v1.93.9 LTS release	2023-12-11 10:39:38 +02:00
Aliaksandr Valialkin	09fe1255ca	docs/CHANGELOG.md: document v1.87.12	2023-12-10 14:30:30 +02:00
Aliaksandr Valialkin	842aba3f46	deployment/docker: update base Docker image from alpine:3.18.5 to alpine:3.19.0 ... See https://www.alpinelinux.org/posts/Alpine-3.19.0-released.html	2023-12-10 02:28:31 +02:00
Aliaksandr Valialkin	de1b394af8	docs: sync -help output for VictoriaMetrics components after recent changes	2023-12-10 01:13:51 +02:00
Aliaksandr Valialkin	3d6517b05e	app/vmselect: add -search.maxResponseSeries command-line flag for limiting the number of time series a single response can return ... This limit can be used for preventing from high memory usage at Grafana when the response returns too many series. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5372	2023-12-10 00:54:32 +02:00
Aliaksandr Valialkin	55eb48f5ee	app: make more clear that -tls enables https at -httpListenAddr	2023-12-10 00:25:23 +02:00
Aliaksandr Valialkin	6203c1a745	docs: follow-up after 49552eaa15 ... Link to the related issue - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4792 Fix heading for `Modifying HTTP headers` chapter at docs/vmagent.md	2023-12-08 23:56:40 +02:00
Aliaksandr Valialkin	49552eaa15	app/vmauth: add support for hot standby mode via first_available load balancing policy ... vmauth in `hot standby` mode sends requests to the first url_prefix while it is available. If the first url_prefix becomes unavailable, then vmauth falls back to the next url_prefix. This allows building highly available setup as described at https://docs.victoriametrics.com/vmauth.html#high-availability Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4893 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4792	2023-12-08 23:32:10 +02:00
Roman Khavronenko	276e9301f4	app/vmalert: sanitize label names before sending to Alertmanager (#5442) ... Before, vmalert would send notifications with labels containing characters not supported by Alertmanager validator, resulting into validation errors like `msg="Failed to validate alerts" err="invalid label set: invalid name "foo.bar"` Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-08 18:09:07 +02:00
hagen1778	21c5bc5a98	docs: mentioned that re-routing increases number of active time series ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-08 18:08:08 +02:00
Aliaksandr Valialkin	2f02c87b02	docs: run make docs-images-to-webp after 02a0a7f428 ... This reduces added image sizes by 3x Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5437 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5370	2023-12-07 16:42:16 +02:00
Alexander Marshalov	e9cf39f519	added field version to the response for /api/v1/status/buildinfo API for using more efficient API in Grafana for receiving label values, added additional info about setup Grafana datasource (#5370) (#5437)	2023-12-07 16:41:56 +02:00
Aliaksandr Valialkin	9074ab68d4	lib/promscrape: add -promscrape.cluster.memberURLTemplate command-line flag for creating direct links to vmagent instances at /service-discovery page ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4018#issuecomment-1843811569	2023-12-07 16:05:03 +02:00
Aliaksandr Valialkin	9f79342e6a	app/vmselect/prometheus: properly encode Prometheus label values at /federate endpoint ... Prometheus spec says that only \, \n and " must be escaped inside label values. See 995743836e/content/docs/instrumenting/exposition_formats.md (L90) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5431	2023-12-07 15:36:50 +02:00
hagen1778	77b9047a40	docs: fix wrong link in Troubleshooting.md ... Signed-off-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit cb90d09c9d)	2023-12-07 12:55:19 +01:00
Aliaksandr Valialkin	e500b5ef8c	docs/vmagent.md: mention that vmagent displays up to -promscrape.maxDroppedTargets at /service-discovery page ... Suggest increasing `-promscrape.maxDroppedTargets` command-line flag value if /service-discovery page misses some dropped targets. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5389 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4018	2023-12-07 00:34:26 +02:00
Aliaksandr Valialkin	896a0f32cd	lib/promscrape: show -promscrape.cluster.memberNum values for vmagent instances, which scrape the given dropped target at /service-discovery page ... The /service-discovery page contains the list of all the discovered targets after the commit 487f6380d0 on all the vmagent instances in cluster mode ( https://docs.victoriametrics.com/vmagent.html#scraping-big-number-of-targets ). This commit improves debuggability of targets in cluster mode by providing a list of -promscrape.cluster.memberNum values per each target at /service-discovery page, which has been dropped becasue of sharding, e.g. if this target is scraped by other vmagent instances in the cluster. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5389 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4018	2023-12-07 00:11:30 +02:00
Aliaksandr Valialkin	12e94f10cc	deployment/docker: update Go builder from Go1.21.4 to Go1.21.5 ... See https://github.com/golang/go/issues?q=milestone%3AGo1.21.5+label%3ACherryPickApproved	2023-12-06 22:33:27 +02:00
Dmytro Kozlov	6a41e1ec0c	app/vmalert: replace error metrics for gauges with counter metrics (#5217) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5160 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: hagen1778 <roman@victoriametrics.com> (cherry picked from commit 935bec447b)	2023-12-06 19:41:34 +01:00
Aliaksandr Valialkin	8b6bce61e4	lib/promscrape: follow-up for 97373b7786 ... Substitute O(N^2) algorithm for exposing the `vm_promscrape_scrape_pool_targets` metric with O(N) algorithm, where N is the number of scrape jobs. The previous algorithm could slow down /metrics exposition significantly when -promscrape.config contains thousands of scrape jobs. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5311 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5335	2023-12-06 17:36:48 +02:00
Aliaksandr Valialkin	509339bf63	app/vmselect: properly adjust the lower bound for the time range where raw samples must be selected for default_rollup() function ... Previously the lower bound could be too small, which could result in missing values at the beginning of the graph for default_rollup() function. This function is automatically applied to all the series selectors if they aren't explicitly wrapped into a rollup function - see https://docs.victoriametrics.com/MetricsQL.html#implicit-query-conversions While at it, properly take into account `-search.minStalenessInterval` command-line flag when adjusting the lower bound for the selected time range. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5388	2023-12-06 14:46:18 +02:00
Hui Wang	065f5a7f9e	vmagent: add vm_promscrape_scrape_pool_targets for scrape jobs like… (#5335) ... * vmagent: export `vm_promscrape_scrape_pool_targets` metric to track the number of targets that each scrape_job discovers * add extra panel for new metric	2023-12-06 14:46:02 +02:00
Artem Navoiev	716dee5de7	fix anchor in docs ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-12-06 14:40:41 +02:00
Aliaksandr Valialkin	559e4db512	Revert "add datadog /api/v2/series and /api/beta/sketches support (#5094)" ... This reverts commit d6b4c8e4ef. Reason for revert: https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5094#issuecomment-1839789080	2023-12-05 02:30:40 +02:00
Aliaksandr Valialkin	61db92cdc7	Revert "lib/protoparser/datadog: follow-up after 543f218fe96574b9b2189c8350bb09afa349e3bb" ... This reverts commit 73d18fbc7a. Reason for revert: https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5094#issuecomment-1839789080	2023-12-05 02:29:00 +02:00
Aliaksandr Valialkin	bf187b2dc9	app/vmagent: add -enableMultitenantHandlers command-line flag ... This flag allows converting tenant id to (vm_account_id, vm_project_id) labels. this flag deprecates `-remoteWrite.multitenantURL` command-line flag, because `-enableMultitenantHandlers` is easier to use and combine with multitenant url at vminsert - https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#multitenancy-via-labels See https://docs.victoriametrics.com/vmagent.html#multitenancy Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1505	2023-12-05 01:35:59 +02:00
Aliaksandr Valialkin	5388d7ba12	docs/vmagent.md: mention that it may be useful to disable on-disk data persistence when reading data from Kafka or Google PubSub ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2110	2023-12-04 23:13:23 +02:00
Aliaksandr Valialkin	85fcefaa34	app/vmagent: code cleanup for Kafka and Google PubSub consumers / producers ... - Add links to relevant docs into descriptions for every -kafka.* and -gcp.pubsub.* command-line flags. - Wait until message processing goroutines are stopped before returning from gcppubsub.Stop(). - Prevent from multiple calls to Init() without Stop(). - Drop message if tenantID cannot be parsed properly. - Take into account tenantID for all the supported message formats. - Support gzip-compressed messages for graphite format. - Use exponential backoff sleep when the message cannot be pushed to remote storage systems because of disabled on-disk persistence - https://docs.victoriametrics.com/vmagent.html#disabling-on-disk-persistence - Unblock from sleep as soon as Stop() is called. Previously the sleep could take up to 2 seconds after Stop() is called. - Remove unused globalCtx and initContext from app/vmagent/remotewrite/gcppubsub - Mention Google PubSub support at docs/enterprise.md - Make Google PubSub docs more clear at docs/vmagent.md This is a follow-up for commits 115245924a5f096c5a3383d6cc8e8b6fbd421984 and e6eab781ce42285a6a1750dc01eba6801dd35516 . Updates https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/717 Updates https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/713	2023-12-04 22:51:04 +02:00
Dmytro Kozlov	6770bad207	app/vmalert: expose /vmalert/api/v1/rule and /api/v1/rule API which returns rule status in JSON format (#5397) ... * app/vmalert: expose `/vmalert/api/v1/rule` and `/api/v1/rule` API which returns rule status in JSON format * app/vmalert: hide updates if query param not set * app/vmalert: fix panic (recursion call) * app/vmalert: add needed group name and file name * app/vmalert: fix comment, update behavior * app/vmalert: fix description * app/vmalert: simplify API for /api/v1/rule Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmalert: simplify API for /api/v1/rule Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmalert: simplify API for /api/v1/rule Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmalert: simplify API for /api/v1/rule Signed-off-by: hagen1778 <roman@victoriametrics.com> * app/vmalert: simplify API for /api/v1/rule Signed-off-by: hagen1778 <roman@victoriametrics.com> --------- Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: hagen1778 <roman@victoriametrics.com>	2023-12-04 22:49:39 +02:00
xzchaoo	758922e656	docs: fix the typo in vmctl.md (#5419) ... fix the typo in vmctl.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2023-12-04 18:17:53 +02:00
Aliaksandr Valialkin	a3d0bbfcda	deployment/docker: update backe Docker image from alpine 3.18.4 to 3.18.5 ... See https://www.alpinelinux.org/posts/Alpine-3.15.11-3.16.8-3.17.6-3.18.5-released.html	2023-12-04 18:17:07 +02:00
hagen1778	fd8731ed90	docs: fix formatting for datadog example ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-12-04 18:16:32 +02:00
Aliaksandr Valialkin	d868155751	app/vmselect: do not limit concurrency for static and fast queries ... Previously concurrency for static and fast queries was limited with the -search.maxConcurrentRequests command-line flag. This could complicate identifying heavy queries via `vmui` at `Top queries` and `Active queries` pages, since `vmui` and these pages couldn't be opened on overloaded vmselect. Thanks to @f41gh7 for the idea.	2023-12-04 18:14:29 +02:00
Aliaksandr Valialkin	b6d6a3a530	lib/promscrape: show dropped targets because of sharding at /service-discovery page ... Previously the /service-discovery page didn't show targets dropped because of sharding ( https://docs.victoriametrics.com/vmagent.html#scraping-big-number-of-targets ). Show also the reason why every target is dropped at /service-discovery page. This should improve debuging why particular targets are dropped. While at it, do not remove dropped targets from the list at /service-discovery page until the total number of targets exceeds the limit passed to -promscrape.maxDroppedTargets . Previously the list was cleaned up every 10 minutes from the entries, which weren't updated for the last minute. This could complicate debugging of dropped targets. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5389	2023-12-04 17:42:46 +02:00
Zakhar Bessarab	2992682f6c	lib/backup/s3remote: remove prev object versions for recursive delete (#719) ... * lib/backup/s3remote: remove prev object versions for recursive delete - fix error caused by sending empty objects list to be deleted. This was possible in case old versions of objects where deleted, but root-level entries where still available. This caused paginator to return an empty page which wasn't skipped. - delete previous versions of objects recursively for S3 remote Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * docs/changelog: add vmbackupmanager fix entry Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * lib/backup/s3remote: unify path construction for S3 objects Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> --------- Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-12-04 17:01:09 +02:00
Aliaksandr Valialkin	9f352f1b93	app/vminsert/newrelic: simplify the code a bit after 1fb8dc0092 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5416 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5421	2023-12-04 16:26:52 +02:00
Dmytro Kozlov	1fb8dc0092	app/vminsert: fix newrelic ingestion in cluster version (#5421) ... Properly pass tenant ID to ingested data from newrelic. Before tenant ID was mistakenly skipped.	2023-12-04 09:38:32 +01:00