189 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	9aee303ca1	docs/Cluster-VictoriaMetrics.md: improve docs for dns+srv service discovery	2022-10-28 14:24:48 +03:00
Aliaksandr Valialkin	a72c5f76eb	app/{vminsert,vmselect}: add support for automatic discovery and update of vmstorage nodes ... Thanks to @dmitryk-dk for the initial implemenation at https://github.com/VictoriaMetrics/VictoriaMetrics-enterprise/pull/446	2022-10-28 13:13:45 +03:00
Aliaksandr Valialkin	518c340ae3	lib/envtemplate: allow referring env vars from other env vars via %{ENV_VAR} syntax ... This is a follow-up for 02096e06d0	2022-10-26 14:49:33 +03:00
Aliaksandr Valialkin	685433b8da	docs/Cluster-VictoriaMetrics.md: update docs about env vars usage in command-line flags ... This is a follow-up for 02096e06d0	2022-10-26 01:54:15 +03:00
Aliaksandr Valialkin	c52c23c272	docs/enterprise.md: describe all the enteprise features in a short doc at https://docs.victoriametrics.com/enterprise.html	2022-10-24 18:02:03 +03:00
Aliaksandr Valialkin	8e998aa1a1	lib/storage: add support for retention filters (aka multiple retentions for distinct sets of time series) ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/143 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/289	2022-10-24 16:40:20 +03:00
Aliaksandr Valialkin	5e4dfe50c6	lib/storage: subsitute searchTSIDs functions with more lightweight searchMetricIDs function ... The searchTSIDs function was searching for metricIDs matching the the given tag filters and then was locating the corresponding TSID entries for the found metricIDs. The TSID entries aren't needed when searching for time series names (aka MetricName), so this commit removes the uneeded TSID search from the implementation of /api/v1/series API. This improves perfromance of /api/v1/series calls. This commit also improves performance a bit for /api/v1/query and /api/v1/query_range calls, since now these calls cache small metricIDs instead of big TSID entries in the indexdb/tagFilters cache (now this cache is named indexdb/tagFiltersToMetricIDs) without the need to compress the saved entries in order to save cache space. This commit also removes concurrency limiter during searching for matching time series, which was introduced in 8f16388428, since the concurrency for all the read queries is already limited with -search.maxConcurrentRequests command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/648	2022-10-23 12:23:47 +03:00
Aliaksandr Valialkin	04a05f161c	app/vmselect: return back the logic for limits the amounts of memory occupied by concurrently executed queries if -search.maxMemoryPerQuery isn't set ... This is needed for preserving backwards compatibility with the previous releases of VictoriaMetrics. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-10 21:45:13 +03:00
Aliaksandr Valialkin	8e1ccecd97	docs: mention -search.maxMemoryPerQuery in the description to -search.maxConcurrentQueries command-line flag ... This is a follow-up for 5138eaeea0 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-09 13:56:59 +03:00
Aliaksandr Valialkin	8f8ce5e238	docs: add description for -search.maxMemoryPerQuery command-line flag	2022-10-08 01:16:55 +03:00
Aliaksandr Valialkin	5138eaeea0	app/vmselect: allow limiting per-query memory usage via -search.maxMemoryPerQuery command-line flag ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3203	2022-10-08 01:08:05 +03:00
Aliaksandr Valialkin	7812761ab4	docs/Cluster-VictoriaMetrics.md: add a security note for multitenant support via labels	2022-10-01 18:57:28 +03:00
Nikolay	33f40f4a5f	app/vminsert: allows parsing tenant id from labels (#3009) ... * app/vminsert: allows parsing tenant id from labels it should help mitigate issues with vmagent's multiTenant mode, which works incorrectly at heavy load and it cannot handle more then 100 different tenants. This functional hidden with flag and do not change vminsert default behaviour https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2970 * Update docs/Cluster-VictoriaMetrics.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip * app/vminsert/netstorage: clean remaining labels in order to free up GC * docs/Cluster-VictoriaMetrics.md: typo fix * wip * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-30 18:35:53 +03:00
nemobis	6a818dbddf	docs: fix typo in Cluster-VictoriaMetrics.md (#3172)	2022-09-28 09:18:29 +02:00
Dmytro Kozlov	6ab1cede62	lib/{httpserver,netutil}: allow to define min and max TLS version of the http server (#3109) ... * lib/{httpserver,netutil}: allow to define min and max TLS version of the http server * lib/httpserver: added descriptions about tls supported versions * lib/netutil: check minimal tls version, added supported tls versions to error * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-09-26 17:35:45 +03:00
Aliaksandr Valialkin	7c2474dac7	lib/protoparser/datadog: sanitize metric names by default in the same way as DataDog does ... This commit is based on the pull request https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3105 Thanks to @PerGon for the idea and initial implementation.	2022-09-26 13:57:23 +03:00
Aliaksandr Valialkin	fcffdba9dc	app/{vmagent,vminsert}: add -usePromCompatibleNaming command-line flag for normalizing metric names and label names in the ingested samples ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3113 Thanks to @erkexzcx for the idea and the initial pull request at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/3146	2022-09-26 13:11:39 +03:00
Roman Khavronenko	03d54ac890	docs: mention VictoriaMetrics Monitoring blog post (#3152) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-23 07:12:15 +02:00
Roman Khavronenko	5714a68ac6	deployment/docker: move cluster compose env to master branch (#3130) ... * deployment/docker: move cluster compose env to master branch The change supposed to simplify the process of maintaining for single/cluster docker-compose envs, alerts, dashboards. It also supposes to reduce confusion for users when looking for cluster related alerts/configs. Signed-off-by: hagen1778 <roman@victoriametrics.com> * deployment/docker: move cluster compose env to master branch Review updates. Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-09-21 11:48:38 +03:00
Aliaksandr Valialkin	455002922e	docs/Cluster-VictoriaMetrics.md: update -help output after explicit marking of enterprise flags	2022-09-15 13:22:58 +03:00
Aliaksandr Valialkin	022bb62fa1	docs: clarify why cluster version is recommended to use for serving high loads	2022-08-31 00:22:30 +03:00
Dmytro Kozlov	463ea6897b	vmselect/promql: enable search.maxPointsSubqueryPerTimeseries for sub-queries (#2963) ... * vmselect/promql: enable search.maxPointsPerTimeSeriesSubquery for sub-queries * vmselect/promql: cleanup * vmselect/promql: rename config flag * vmselect/promql: add tests * vmselect/promql: use test object instead of log * vmselect/promql: fix posible panic is subquery has more points. add description * vmselect/promql: update tests descriptions * vmselect/promql: update doInternal validation * vmselect/promql: fix linter * vmselect/promql: fix linter * vmselect/promql: update documentation and release notes * wip - Properly apply -search.maxPointsSubqueryPerTimeseries limit to subqueries. Previously the -search.maxPointsPerTimeseries limit was unexpectedly applied to subqueries if it was smaller than the -search.maxPointsSubqueryPerTimeseries . - Clarify docs for -search.maxPointsSubqueryPerTimeseries command-line flag . - Document -search.maxPointsPerTimeseries and -search.maxPointsSubqueryPerTimeseries flags at https://docs.victoriametrics.com/#resource-usage-limits . - Update docs/CHANGELOG.md . Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2922 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-24 15:25:18 +03:00
Aliaksandr Valialkin	3d12ee47f9	docs: mention that it is safe sharing the collected profiles from security PoV ... The collected profiles do not contain sensitive information	2022-08-24 14:07:36 +03:00
Aliaksandr Valialkin	796aa310c2	app/vmstorage: expose vm_{hourly,daily}_series_limit_{max,current}_series metrics if -storage.max{Hourly,Daily}Series limits are set ... These metrics allow alerting when the number of unique series approach the limit. For example, the following query alerts when the number of series reaches 90% of the configured limit: vm_hourly_series_limit_current_series / vm_hourly_series_limit_max_series > 0.9	2022-08-24 13:44:04 +03:00
Ivan Dudin	f69990ba10	Update Cluster-VictoriaMetrics.md (#3005) ... Flags `-search.maxTagKeys` and `-search.maxTagValues` are present at vmstorage and not at vmselect ``` # ./vmselect-prod -h | egrep 'search.maxTagKeys|search.maxTagValues' # ./vmstorage-prod -h | egrep 'search.maxTagKeys|search.maxTagValues' -search.maxTagKeys int -search.maxTagValues int ```	2022-08-21 23:28:40 +03:00
Aliaksandr Valialkin	22aa07b8c9	docs/Cluster-VictoriaMetrics.md: document the best strategies for cluster update / upgrade	2022-08-21 23:21:02 +03:00
Aliaksandr Valialkin	f2043d53ad	docs: change links to Prometheus docs about instant and range queries to links to VictoriaMetrics docs	2022-08-21 19:01:54 +03:00
Aliaksandr Valialkin	c6736a3ad2	docs/Cluster-VictoriaMetrics.md: clarify required conditions for cluster availability	2022-08-20 09:40:34 +03:00
Yurii Kravets	4ca189bf94	doc: udpate Cluster-VictoriaMetrics (#3003) ... added note about resource usage for data re-routing	2022-08-20 09:37:27 +03:00
Aliaksandr Valialkin	7b8bc8ad59	all: bump the minimum supported version of Go from 1.17 to 1.18 ... This is needed because some dependencies uses generics, which have been appeared in Go1.18 This is a follow-up for caf3dd4fa2	2022-08-08 13:39:38 +03:00
Aliaksandr Valialkin	752a3008b4	docs: fix the recommended url for -vmalert.proxyURL accroding to 8667307d73	2022-08-04 17:56:07 +03:00
Aliaksandr Valialkin	da11056d85	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:24:24 +03:00
Aliaksandr Valialkin	d19a368aff	docs/Cluster-VictoriaMetrics.md: update after fe68bb3ba7	2022-07-21 20:36:28 +03:00
Aliaksandr Valialkin	814bb1685f	all: fix other typos in the same way as 6f4d9b2a48 does	2022-07-18 12:08:15 +03:00
Aliaksandr Valialkin	8851cf68e1	docs: make more clear the relation between replication and deduplication ... This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:22:15 +03:00
Aliaksandr Valialkin	20df81f1aa	docs: sync after recent changes	2022-07-07 02:44:17 +03:00
Aliaksandr Valialkin	ef62da3750	app/vmselect: add -clusternative.tls* options for mTLS setup in multi-level clusters	2022-07-06 13:49:07 +03:00
Aliaksandr Valialkin	bd5b20445e	app/vmselect: add ability to query vmselect from another vmselect	2022-07-06 13:30:12 +03:00
Aliaksandr Valialkin	c030d920dd	docs/Cluster-VictoriaMetrics.md: sync with cluster branch after f51bc07d97	2022-07-06 13:00:34 +03:00
Aliaksandr Valialkin	234901b36c	docs/Cluster-VictoriaMetrics.md: mention about -storage.maxDailySeries and -storage.maxHourlySeries options in resource usage limits chapter	2022-06-30 23:17:50 +03:00
Aliaksandr Valialkin	56622bff73	docs: add Troubleshooting doc ... This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:53:59 +03:00
Aliaksandr Valialkin	51362f9333	app/vmselect: add -search.setLookbackToStep command-line flag for making the gap filling algorithm similar to InfluxDB data model ... This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:19:30 +03:00
Aliaksandr Valialkin	6a1e0692f6	docs/Cluster-VictoriaMetrics.md: small fixes	2022-06-22 13:42:43 +03:00
Aliaksandr Valialkin	cfc99e12da	docs: update docs after e4d6b750f6 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:12 +03:00
Artem Navoiev	954a7a6fc6	docs: replace bash code block type with console (#2746)	2022-06-19 22:57:53 +03:00
Aliaksandr Valialkin	7b3c9c50a8	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:00 +03:00
Roman Khavronenko	97183e4ec5	docs: reduce free disk recommendation from 30% to 20% (#2728) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:54:39 +03:00
Dmytro Kozlov	fda8da297e	docs: fixed typos (#2680) ... * docs: fixed typos * Update README.md * Update docs/README.md * Update docs/Single-server-VictoriaMetrics.md * docs: added examples with start and end params in request * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 14:47:15 +03:00
Aliaksandr Valialkin	f9d22e2ad3	docs/Cluster-VictoriaMetrics.md: run make docs-sync after 1c96dce367	2022-06-07 14:30:43 +03:00
Dima Lazerka	4c3b35a5ca	Change img urls to the same domain (#2649)	2022-05-30 12:23:48 +03:00