2942 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	d0a943c487	docs/CHANGELOG.md: clarifications after e9b977859b	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	a5588bc6f4	docs/CHANGELOG.md: recommend clearing caches after the upgrade from v1.78.0 to v1.78.1	2022-07-08 13:05:11 +03:00
Roman Khavronenko	b29fafa86b	vmalert: deprecate alert's status link (#2840) ... * vmalert: deprecate alert's status link Deprecate alert's status link `/api/v1/<groupID>/<alertID>/status` in favour of `api/v1/alerts?group_id=<group_id>&alert_id=<alert_id>"`. The change was needed for simplifying logic in vmselect for proxying vmalert's requests. The old alert's status link will be still supported for a few versions but will be removed in the future. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: fix review comments Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-08 13:05:11 +03:00
Aliaksandr Valialkin	9ccae66337	docs/CHANGELOG.md: link to the issue related to multi-level vmselect	2022-07-08 05:23:51 +03:00
Aliaksandr Valialkin	e855744871	docs/CHANGELOG.md: recommend upgrading from v1.78.0 to v1.78.1 because of the bug in v1.78.0	2022-07-08 03:45:06 +03:00
Aliaksandr Valialkin	5a5c8534d1	docs/CHANGELOG.md: cut v1.78.1	2022-07-08 01:03:04 +03:00
Aliaksandr Valialkin	69718a6c16	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:22:02 +03:00
Aliaksandr Valialkin	2a53b8961e	docs/vmagent.md: typo fixes after ef2eeeb642	2022-07-07 21:17:13 +03:00
Aliaksandr Valialkin	372ecc5c0e	docs/vmagent.md: actualize docs	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	1ff2b8ed0e	docs/Single-server-VictoriaMetrics.md: actualize vmui docs according to recent changes	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	d8483f599e	docs/CHANGELOG.md: typo fixes	2022-07-07 20:37:20 +03:00
Aliaksandr Valialkin	3d0ce901cb	docs: sync after recent changes	2022-07-07 02:44:24 +03:00
Aliaksandr Valialkin	f03d4b2aa2	docs/CHANGELOG.md: link another bugreport related to the bug with per-day inverted index in v1.78.0	2022-07-07 02:35:35 +03:00
Aliaksandr Valialkin	5794886662	lib/promscrape: properly set Host header when sending requests via http proxy ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2794	2022-07-07 02:28:47 +03:00
Aliaksandr Valialkin	9dd5d3a431	docs/CHANGELOG.md: link to the issue about incorrect per-day index handling in v1.78.0	2022-07-07 02:00:58 +03:00
Aliaksandr Valialkin	95add1e8e4	app/{vmagent,vminsert}: follow-up after d19e46de55 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:32:11 +03:00
Roman Khavronenko	218dfe7956	docs: mention deduplication issue for HA vmalert topology (#2838) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-07 01:13:56 +03:00
Aliaksandr Valialkin	4d03ac90fc	lib/promscrape/discovery/kubernetes: properly populate service-level labels for role: endpointslice targets ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2823	2022-07-07 00:36:25 +03:00
Aliaksandr Valialkin	c4cc45d7f8	lib/promscrape/discovery/kubernetes: allow attaching node-level labels to role: endpoints and role: endpointlice targets in the same way as Prometheus does ... See https://github.com/prometheus/prometheus/pull/10759	2022-07-07 00:36:24 +03:00
Aliaksandr Valialkin	eee384c9c9	app/vmselect: add -clusternative.tls* options for mTLS setup in multi-level clusters	2022-07-06 13:48:21 +03:00
Aliaksandr Valialkin	195dccf678	app/vmselect: add ability to query vmselect from another vmselect	2022-07-06 13:19:45 +03:00
Aliaksandr Valialkin	ea4ab0df36	docs: sync with single-node branch after ed89106274	2022-07-06 13:02:05 +03:00
Aliaksandr Valialkin	714958deab	all: follow-up after ed89106274	2022-07-06 12:48:52 +03:00
Aliaksandr Valialkin	498c6d6e72	lib/promscrape: push scrape_samples_limit metric to remote storage if sample_limit option is set in scrape_config for this target ... See https://github.com/VictoriaMetrics/operator/issues/497	2022-07-06 12:46:23 +03:00
Roman Khavronenko	f51bc07d97	vmselect: allow proxying requests to vmalert (#2833) ... The change allows to proxy requests with prefix `/vmalert` to the vmalert component if `-vmalert.proxyURL` is set. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2825 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2831 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-06 10:47:51 +02:00
Aliaksandr Valialkin	78f9a8aafd	lib/storage: put the (date, metricID) entry in dateMetricIDCache just after the corresponding series is registered in the per-day inverted index ... Previously the time series could be put into dateMetricIDCache without registering in the per-day inverted index if GetOrCreateTSIDByName finds TSID entry in the global index. This could lead to missing series in query results. The issue has been introduced in the commit 55e7afae3a, which has been included in VictoriaMetrics v1.78.0	2022-07-05 14:56:55 +03:00
Aliaksandr Valialkin	8516670582	app/vmselect/promql: properly calculate histogram_quantile over unexpected le buckets ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2819	2022-07-05 13:20:41 +03:00
Artem Navoiev	82581ab728	Docs: Operator Additional Scrape Configuration - update docs (#2826) ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2022-07-05 13:20:41 +03:00
Aliaksandr Valialkin	24fc96dc1f	docs/Troubleshooting.md: add a link to Monitoring chapter added at 41d1834a99	2022-07-04 11:57:14 +03:00
Roman Khavronenko	51209c114a	docs: update Troubleshooting guide (#2809) ... Follow-up after a4d9388ecb Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:57:12 +03:00
Roman Khavronenko	78da4b5f5e	docs: warn about potential issue with read queries for 1.78.0 (#2818) ... * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: warn about potential issue with read queries for 1.78.0 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-04 11:47:41 +03:00
Aliaksandr Valialkin	f3b905dde1	docs/Cluster-VictoriaMetrics.md: mention about -storage.maxDailySeries and -storage.maxHourlySeries options in resource usage limits chapter	2022-06-30 23:17:14 +03:00
Aliaksandr Valialkin	fa08220d27	app/vmselect/promql: properly handle partial counter resets in rate(), irate(), increase() and remove_resets() functions ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2787	2022-06-30 22:40:26 +03:00
Aliaksandr Valialkin	0f6c17ed06	app/vmagent/remotewrite: clarify descriptions for -remoteWrite.* options, which must be set per each -remoteWrite.url	2022-06-30 20:18:42 +03:00
Aliaksandr Valialkin	7fc03a1deb	app/vmagent/remotewrite: add -remoteWrite.header command-line flag for setting additional http headers to send to -remoteWrite.url ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:59 +03:00
Dmytro Kozlov	67753cc6f0	vmui: update render logic for nested component (#2795) ... * vmui: update render logic for nested component, avoid rerender, remove local storage usage for tracing flag * docs/url-examples.md: fix various documentation issues there * docs: add Troubleshooting doc This doc contains troubleshooting guides for typical problems with VictoriaMetrics. * docs/Troubleshooting.md: add troubleshooting guide for cluster instability * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-30 15:48:22 +03:00
Aliaksandr Valialkin	2a70a9296e	docs/Troubleshooting.md: refer to subqueries doc, since this is the most frequent source of improperly consutructed queries	2022-06-30 15:10:02 +03:00
Aliaksandr Valialkin	edf39f9281	docs/Troubleshooting.md: refer to capacity planning docs	2022-06-30 15:00:21 +03:00
Aliaksandr Valialkin	47f3c4b12b	docs/Troubleshooting.md: various typo fixes and clarifications	2022-06-30 14:57:05 +03:00
Aliaksandr Valialkin	7c54cc2123	docs/Troubleshooting.md: formatting fixes	2022-06-30 14:39:15 +03:00
Aliaksandr Valialkin	74338ef300	docs/Troubleshooting.md: add troubleshooting guide for cluster instability	2022-06-30 14:36:18 +03:00
Aliaksandr Valialkin	da3179667e	docs/CHANGELOG.md: document bdf9f4669a	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	92e6c55b75	docs: add Troubleshooting doc ... This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:52:44 +03:00
Aliaksandr Valialkin	0b76d07c21	docs/url-examples.md: fix various documentation issues there	2022-06-29 11:58:34 +03:00
Aliaksandr Valialkin	daefb64f38	app/vmselect: expose additional histograms at /metrics page, which may help get more insights for the query workload ... This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2792	2022-06-28 20:18:31 +03:00
Aliaksandr Valialkin	5e22e6046d	docs/Single-server-VictoriaMetrics.md: mention about -search.maxTagValueSuffixesPerSearch command-line flag in resource limits docs	2022-06-28 18:17:49 +03:00
Aliaksandr Valialkin	7d5d33fd71	lib/storage: return marshaled metric names from SearchMetricNames ... Previously SearchMetricNames was returning unmarshaled metric names. This wasn't great for vmstorage, which should spend additional CPU time for marshaling the metric names before sending them to vmselect. While at it, remove possible duplicate metric names, which could occur when multiple samples for new time series are ingested via concurrent requests. Also sort the metric names before returning them to the client. This simplifies debugging of the returned metric names across repeated requests to /api/v1/series	2022-06-28 18:16:32 +03:00
Aliaksandr Valialkin	1af6efd737	docs/Single-server-VictoriaMetrics.md: mention about -search.maxTagValueSuffixesPerSearch command-line flag in resource limits docs	2022-06-27 14:02:01 +03:00
Aliaksandr Valialkin	a38568ddfe	docs/CHANGELOG.md: document 45f20ad1aa	2022-06-27 13:53:26 +03:00
Aliaksandr Valialkin	6386f117c8	all: show timeRange in traces in human-readable format instead of timestamps in milliseconds	2022-06-27 13:42:57 +03:00
Aliaksandr Valialkin	ea2aa617e5	docs/CHANGELOG.md: update after e40d015e9a	2022-06-24 18:03:56 +03:00
Aliaksandr Valialkin	94b81165d0	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries ... Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:58:47 +03:00
hagen1778	e40d015e9a	vmselect: make vm_partial_results_total consistent ... Metrics `vm_partial_results_total` and `vm_requests_total` serving the similar purpose, but contain inconsistent set of labels. This change updates `vm_partial_results_total` labels to be consistent with `vm_requests_total`. The change breaks backward compatibility with assumption that `vm_partial_results_total` wasn't widely used, since it is not documented and absent in the alerts and dashboards. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-24 13:50:26 +02:00
Dmytro Kozlov	f28cbcc7b5	vmui: added query tracing (#2748) ... * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 23:00:45 +03:00
Nikolay	ee5c502446	app/vmselect: fixes partial response with replicationFactor (#2777) ... * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:17:24 +03:00
Yurii Kravets	f0c1edb175	docs: Update CHANGELOG Update notes (#2776) ... * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 19:40:20 +03:00
Aliaksandr Valialkin	71b0dfdefa	lib/promscrape: always send stale markers with the real scrape timestamp ... This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:49:13 +03:00
Denys Holius	d7c4b01472	Adds a list of supported architectures (#2769) ... * add list of supported architectures * Update docs/BestPractices.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-06-22 22:01:29 +03:00
Aliaksandr Valialkin	3ae6300497	lib/promauth: add ability to send additional http headers in requests to scrape targets ... This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:40:50 +03:00
Aliaksandr Valialkin	7429dfbe9e	app/vmselect: add -search.setLookbackToStep command-line flag for making the gap filling algorithm similar to InfluxDB data model ... This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:20:02 +03:00
Aliaksandr Valialkin	3e0f364489	docs/Cluster-VictoriaMetrics.md: small fixes	2022-06-22 13:42:07 +03:00
Roman Khavronenko	54f0f2d384	docs: follow-up for 197d3cdd74 (#2766) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 13:18:03 +03:00
云原生驿站	67e5833ced	docs: supplement vmalert downsampling docs (#2765) ... Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 13:18:03 +03:00
Denys Holius	432b261c13	url-examples: added curl output after deleting metrics (#2764) ... docs: add more details to url-examples for series deleting	2022-06-21 17:56:00 +03:00
Aliaksandr Valialkin	9362da2e7f	docs: update -help output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:26 +03:00
Aliaksandr Valialkin	597bce4f55	docs: update docs after e4d6b750f6 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:25 +03:00
Aliaksandr Valialkin	24097f2417	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:11:04 +03:00
Aliaksandr Valialkin	a1629bd3be	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful ... If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:33:54 +03:00
Aliaksandr Valialkin	45e9732764	docs: follow-up after e4d6b750f6	2022-06-20 17:15:52 +03:00
Nikolay	15662c0f29	lib/httpserver: adds flagsAuthKey command-line flag (#2758) ... * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:15:51 +03:00
Aliaksandr Valialkin	0abf46d66a	docs/Articles.md: add a link to https://www.sobyte.net/post/2022-05/victoriametrics-bloomfilter/	2022-06-20 14:44:11 +03:00
Roman Khavronenko	3ada676879	docs: reference links from key concepts (#2745) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:14:30 +03:00
Artem Navoiev	42c69ae74e	docs: replace bash code block type with console (#2746)	2022-06-19 23:02:00 +03:00
Aliaksandr Valialkin	4ae1c5655f	docs/CHANGELOG.md: document ef7f52e0e6	2022-06-19 22:49:11 +03:00
Aliaksandr Valialkin	88e1221b35	lib/storage: do not register new series if -storage.maxHourlySeries or -storage.maxDailySeries limits are exceeded ... Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:03:02 +03:00
Aliaksandr Valialkin	c5ac176153	lib/storage: reset metric id caches for the previous and the current hour ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:02:51 +03:00
Aliaksandr Valialkin	149c5c9381	docs: update docs on how to add tags to metrics collected by DataDog agent ... Follow-up for f16072c3c1	2022-06-17 13:12:21 +03:00
Dmytro Kozlov	5bc13e2fe8	vmui: added focusLabel, enable cardinality app configuratior (#2736) ... * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:04:09 +03:00
Dmytro Kozlov	82440e76c5	doc: added workaround for datadog agent (#2712) ... * Added workaround for datadog agent * docs: update datadog workaround * doc: update doc description * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 22:24:17 +03:00
Roman Khavronenko	287bb96758	docs: mention sandbox update in release procedure (#2724) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:51:41 +03:00
Roman Khavronenko	cbe39bbb8d	vmselect: limit end param max value by 2d in future (#2729) ... * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	cda3ce09e5	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	450aa0ae5a	lib/promrelabel: support action: graphite relabeling ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:25:49 +03:00
Roman Khavronenko	ba7ece02c4	docs: add multiple-remote-writes topology to vmalert (#2738) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:21:12 +03:00
Aliaksandr Valialkin	b4e75a0b89	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:41:26 +03:00
Aliaksandr Valialkin	14ce7b0e25	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:23 +03:00
Aliaksandr Valialkin	45fa9d798d	app/vmselect: accept focusLabel query arg at /api/v1/status/tsdb	2022-06-14 18:39:00 +03:00
Aliaksandr Valialkin	fb77843639	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:34:13 +03:00
Aliaksandr Valialkin	ce953d5e95	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:23 +03:00
Roman Khavronenko	0065b13243	docs: reduce free disk recommendation from 30% to 20% (#2728) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:55:41 +03:00
Aliaksandr Valialkin	12618925fc	docs/guides/migrate-from-influx.md: suggest more real-world value for -search.maxStalenessInterval ... Suggest `-search.maxStalenessInterval=10s` instead of `-search.maxStalenessInterval=1ms`, since `1ms` would result in empty graphs in most cases, since the interval between data points on the graph is usually much higher than 1ms. For example, if the graph shows time range of one hour and it contains 1000 points, then the interval between points on the graph would equal to 3600s/1000=3.6 seconds.	2022-06-14 12:51:35 +03:00
Roman Khavronenko	9873001539	docs: migrating from influx (#2720) ... Mention `-search.maxStalenessInterval` flag and its effect on query engine. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:51:33 +03:00
Aliaksandr Valialkin	b48ca34e05	docs/Single-server-VictoriaMetrics.md: recommend running all the VictoriaMetrics components behind auth proxy in Security chapter	2022-06-13 10:30:52 +03:00
Aliaksandr Valialkin	c846d0db01	docs/CHANGELOG.md: document 99dbe7f9d4	2022-06-13 10:07:19 +03:00
Roman Khavronenko	81b6efea9e	Readme cleanup (#2715) ... * docs: minor styling and wording changes Changes made after reading https://developers.google.com/tech-writing Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: set proper types for code blocks Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: add `copy` wrapper for some commands Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: sync Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: resolve conflicts Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-13 09:49:59 +03:00
Yury Molodov	65107a4585	vmui: enhancements (#2638) (#2717) ... * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:49:58 +03:00
Aliaksandr Valialkin	9d8c37d280	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added ... The optimization has been added in 374beb350e Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:57 +03:00
Aliaksandr Valialkin	61e03f172b	app/vmselect: optimize /api/v1/labels and /api/v1/label/.../values handlers when match[] query arg is passed to them	2022-06-12 14:06:24 +03:00
Aliaksandr Valialkin	4a94cd81ce	app/vmselect: add optional limit query arg to /api/v1/labels and /api/v1/label_values endpoints ... This arg allows limiting the number of sample values returned from these APIs	2022-06-10 10:24:07 +03:00
Roman Khavronenko	3c09d25039	vmalert: followup for 76f05f8670 (#2706) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 13:15:35 +03:00
Howie	4afd7aa695	feat: rule limit (#2676) ... vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 13:15:33 +03:00
Aliaksandr Valialkin	a9ea3fee38	lib/querytracer: make it easier to use by passing trace context message to New and NewChild ... The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:16:12 +03:00
Aliaksandr Valialkin	5524d13a03	docs/Single-server-VictoriaMetrics.md: explain why free disk space shortage may negatively impact VictoriaMetrics performance	2022-06-08 20:04:30 +03:00
Aliaksandr Valialkin	2520b8efb8	docs: add a link to cardinality explorer playground	2022-06-08 19:40:12 +03:00
Aliaksandr Valialkin	8d98b8ae10	docs: refer to cardinality explorer ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:18:31 +03:00
Dmytro Kozlov	f2754c3e90	Cardinality explorer (#2625) ... * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:54:27 +03:00
Aliaksandr Valialkin	ba406ff28c	docs/CHANGELOG.md: document 63b538ecd1	2022-06-07 15:53:08 +03:00
Aliaksandr Valialkin	c07f99cd4f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:53 +03:00
Aliaksandr Valialkin	c7ff4505d2	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage ... The changes are related to the added query tracing in afced37c0b See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:58 +03:00
Aliaksandr Valialkin	2b72d21840	docs/CHANGELOG.md: document e755d0ec3f	2022-06-07 15:21:10 +03:00
Aliaksandr Valialkin	0b4f767c53	docs/CHANGELOG.md: document 1ee1e986da	2022-06-07 15:02:57 +03:00
Aliaksandr Valialkin	33afaa49d9	docs: run make docs-sync after fda8da297e	2022-06-07 14:51:32 +03:00
Dmytro Kozlov	50393d0024	docs: fixed typos (#2680) ... * docs: fixed typos * Update README.md * Update docs/README.md * Update docs/Single-server-VictoriaMetrics.md * docs: added examples with start and end params in request * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 14:51:31 +03:00
Aliaksandr Valialkin	933f4ae148	docs/Cluster-VictoriaMetrics.md: run make docs-sync after 1c96dce367	2022-06-07 14:30:09 +03:00
Aliaksandr Valialkin	b4909351c5	docs: run make docs-sync after a439e887a3	2022-06-07 14:27:37 +03:00
Aliaksandr Valialkin	68b6ddfb14	all: follow-up after 8edb390e21 ... - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 01:05:53 +03:00
Aliaksandr Valialkin	3dbb19d624	lib/promscrape/discovery/kubernetes: follow-up after 006b8c7534 ... - make more clear error logs - simplify testing for newKubeConfig by passing only the path to kube_config file instead of SDConfig struct	2022-06-06 14:41:28 +03:00
Aliaksandr Valialkin	6d2832f413	docs/Articles.md: add a link to https://percona.community/blog/2022/06/02/long-time-keeping-metrics-victoriametrics/	2022-06-06 13:15:42 +03:00
Aliaksandr Valialkin	6c2fb9d8c4	lib/promscrape: add -promscrape.cluster.name command-line flag ... This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 01:11:23 +03:00
Dmytro Kozlov	ce8aade80e	lib/promscrape: adds service discovery visualization for /targets page(#2675) ... * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-04 01:11:23 +03:00
Nikolay	72e43ef2fe	lib/promscrape/discovery/kubernetes: follow-up after 0b5c874911 (#2672)	2022-06-04 01:11:23 +03:00
Aliaksandr Valialkin	70bb84739d	docs/Single-server-VictoriaMetrics.md: small clarification about custom cache size tuning	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	cc226e6ebe	docs/CHANGELOG.md: follow-up after 2177089f94	2022-06-01 14:57:39 +03:00
Roman Khavronenko	e9ee043879	lib/storage: make indexdb/tagFilters cache size configurable (#2667) ... The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Roman Khavronenko	bca90d7148	promrelabel: add support of lowercase and uppercase relabeling actions (#2665) ... * promrelabel: add support of `lowercase` and `uppercase` relabeling actions https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2664 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/storage: make golangci-lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	fedfc9e686	lib/storage: stop background merge when storage enters read-only mode ... This should prevent from `no space left on device` errors when VictoriaMetrics under-estimates the additional disk space needed for background merge. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2603	2022-06-01 14:22:12 +03:00
Aliaksandr Valialkin	afced37c0b	all: add initial support for query tracing ... See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:31:44 +03:00
Aliaksandr Valialkin	e83b96366f	docs/CHANGELOG.md: follow-up after 11f91532c5 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Dmytro Kozlov	cd1fa2e4cd	issue-2594: use embedded for static files (#2650) ... embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Howie	9c5f998438	fix: docs (#2658) ... Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-05-30 12:27:19 +03:00
Roman Khavronenko	4f84afb032	docs: add more details to the key concepts (#2648) ... - data modification - more applications for gauges - recommendations for instrumenting app with metrics Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-30 12:26:37 +03:00
Dima Lazerka	3299865620	Change img urls to the same domain (#2649)	2022-05-27 20:13:49 +02:00
Aliaksandr Valialkin	f149d56ac2	lib/promscrape: add -promscrape.suppressScrapeErrorsDelay command-line flag ... This flag can be used for reducing the amounts of logs when scraping unreliable scrape targets. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2575 The patch is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2576 . Thanks to @jelmd .	2022-05-25 23:00:30 +03:00
Roman Khavronenko	d367a65707	docs: update single version docs by adding extra links and formatting (#2643) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 23:00:28 +03:00
Aliaksandr Valialkin	38beb9fe04	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag ... This is a follow-up for 0fbf59199a See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:07:14 +03:00
Aliaksandr Valialkin	05e47482a5	docs/CHANGELOG.md: document 9e343faa41	2022-05-25 15:05:42 +03:00
Roman Khavronenko	cd8e58d0ae	docs: mention guide for migrating from inlfux in vmctl readme (#2640) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 15:05:12 +03:00
Aliaksandr Valialkin	df9ffa6854	app: expose /api/v1/status/config endpoint in the same way as Prometheus does ... This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 10:00:00 +03:00
Aliaksandr Valialkin	090c331c12	docs/Single-server-VictoriaMetrics.md: mention Cardinality limiter docs at Resource usage limits section	2022-05-23 10:55:42 +03:00
Nikolay	754d3b1f93	Updates operator docs (#2622) ... * docs/operator: adds information about VMAgent statefulMode * docs/operator: adds description for alertmanager configuration * docs/operator: adds description for configuration syncronization https://github.com/VictoriaMetrics/operator/issues/124 Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-23 10:55:42 +03:00
Roman Khavronenko	d597cdd06f	vmalert: mention how to build a custom image (#2626) ... Thanks to @f41gh7 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-23 10:55:42 +03:00
Aliaksandr Valialkin	513f9537a9	docs/CHANGELOG.md: cut v1.77.2	2022-05-21 02:26:29 +03:00
Aliaksandr Valialkin	cdbee6f470	docs/CHANGELOG.md: group vmalert features together	2022-05-21 01:52:13 +03:00
Aliaksandr Valialkin	35ed63f32e	docs/CHANGELOG.md: document 2cf586da78	2022-05-21 01:17:49 +03:00
Roman Khavronenko	7406665fc3	lib/promscrape/discovery/kubernetes: fixes kubernetes service discovery (#2615) ... * lib/promscrape/discovery/kubernetes: properly updates discovered scrape works previously, added or updated scrapeworks may override previuosly discovered. it happens because swosByKey may contain small subset of kubernetes objects with it's labels. It happens for objectsUpdated and objectsAdded maps, which include only changed elements * Properly calculate vm_promscrape_discovery_kubernetes_scrape_works Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-21 01:17:21 +03:00
Yurii Kravets	a723de6ae1	Update README.md (#2624)	2022-05-21 01:07:04 +03:00
Aliaksandr Valialkin	aba00b8cb2	docs: update the description for command-line flags according to recent changes	2022-05-20 15:11:37 +03:00
Aliaksandr Valialkin	4ca5d97459	docs/CHANGELOG.md: document 3df8caca15	2022-05-20 14:24:36 +03:00
Roman Khavronenko	e9165b041e	docs: add migration guide for influxdb (#2619) ... docs: add migration guide for influxdb Co-authored by @denisgolius Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:24:35 +03:00
Aliaksandr Valialkin	386ef69124	docs/CHANGELOG.md: formatting fixes	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	98123e95dd	docs/CHANGELOG.md: formatting fix for the issue url https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	c5765dd6ad	docs/CHANGELOG.md: link to the feature request about reusable templates in vmalert ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2510	2022-05-20 14:21:35 +03:00
Roman Khavronenko	f71d15c79e	docs: follow-up after 4b3eb40658 (#2602) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:21:09 +03:00
Roman Khavronenko	dcd8387601	docs: fix a typo of mentioning scrape support for vmselect (#2617) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:20:37 +03:00
Roman Khavronenko	2aeb00f98f	vmalert: support scalar type in response (#2610) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:08:19 +03:00
Roman Khavronenko	a07ddf9b65	vmalert: support strings in humanize.* templates (#2606) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:05:53 +03:00
Yurii Kravets	40c614dc4e	Update vmalert.md (#2580) ... docs: update vmalert/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-20 14:02:34 +03:00
Roman Khavronenko	a616e0b997	docs: quickstart update (#2572) ... docs: update docs for beginners QuickStart page was updated with more relevant information. Key Concepts was added to cover basics for the VictoriaMetrics.	2022-05-20 14:00:43 +03:00
Roman Khavronenko	87e4e76537	vmalert: support /rules path for Grafana's ngalert requests (#2593) ... Unexpectedly, Grafana makes an extra request to `/rules` handler in addition to `/api/v1/rules` calls in alerts UI. This happens only for Grafana versions older than 8.5.*. Apparently, this is related to support of other monitoring systems. Prometheus responds with `text/html` content for UI page `/rules` to such requests. Actually, returning just a blank page with SC=200 works as well. Returning actual response of `/api/v1/rules` results in error in Grafana since it expects a `yaml` (?) in response. So we add a placeholder to `vmalert`. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2583 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:53:55 +03:00
Roman Khavronenko	ee1f8bae2e	docs: fix liquid syntax errors (#2592) ... For liquid text processor double braces `{{` `}}` are special chars for templating. Since we use them in some of our docs with different purpose, we must escape them to avoid syntax errors from liquid. For escaping curly braces we use bult-in plugin which helps to enclose sections of text via `{% raw %}` and `{% endraw %}`. This approach prevents liquid syntax errors and makes render correct. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:42:47 +03:00
Roman Khavronenko	6e5ba1921d	vmalert: fix readme formatting (#2587) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:40:41 +03:00
Roman Khavronenko	0790ba5e26	vmalert: follow-up after 0ac1cdfff5 (#2586) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 12:25:13 +03:00
Andrii Chubatiuk	7789c47e41	added reusable templates support (#2532) ... Signed-off-by: Andrii Chubatiuk <andrew.chubatiuk@gmail.com>	2022-05-20 12:25:11 +03:00
Aliaksandr Valialkin	83ff4c411d	app/vmalert: apply -remoteRead.disablePathAppend to -datasource.url in the same way as for the -remoteRead.url ... This is a follow-up for 0e2486df56 The related pull requests: - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1536 - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1712	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	c1dd458f56	docs/CHANGELOG.md: document 3f0ecee128 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2577	2022-05-13 16:59:16 +03:00
Yurii Kravets	d55791f59f	Update docs (#2566) ... * deployment/docker: pass `-buildvs=false` to `go build` for production builds This should resolve the `error obtaining VCS status: exit status 128` error when the environment contains incorrect version of git or has incorrect access rights to the directory with VictoriaMetrics source code. See the following links for additional info: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508#issuecomment-1117126702 , - https://github.com/google/ko/issues/672 - https://github.com/golang/go/issues/49004 * lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552 * docs/CHANGELOG.md: document c8af625bcc See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146 * docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by` * docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits * docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect * Update root Readme and root vmagent readme Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	116c0b8f2e	docs/vmagent.md: typo fix in the description for -promscrape.cluster.replicationFactor command-line flag	2022-05-12 18:51:20 +03:00
Aliaksandr Valialkin	a47717f2ab	docs/Cluster-VictoriaMetrics.md: the /api/v1/label/.../values query can take CPU and ram at both vmstorage and vmselect	2022-05-11 20:00:36 +03:00
Aliaksandr Valialkin	7830448a36	docs: add resource usage limits docs, which describe fine-grained tuning for various resource usage limits	2022-05-11 19:53:19 +03:00
Aliaksandr Valialkin	6048e2e82c	docs/Cluster-VictoriaMetrics.md: typo fix: by by -> by	2022-05-11 18:05:05 +03:00
Aliaksandr Valialkin	e35e488220	docs/CHANGELOG.md: document c8af625bcc ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146	2022-05-11 14:33:06 +03:00
Denys Holius	f3ac421413	docs: fixed typos in CHANGELOG.md (#2565)	2022-05-11 14:30:45 +03:00
Aliaksandr Valialkin	d8a276fbe4	lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() ... This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552	2022-05-11 14:11:06 +03:00
Aliaksandr Valialkin	68bfa05437	app/vmselect/promql: do not return values from label_value() if the original time series has no values at the selected timestamps	2022-05-09 17:58:39 +03:00
Aliaksandr Valialkin	d5efd3949b	docs/CHANGELOG.md: document 8f4f5f1d68	2022-05-09 17:33:04 +03:00
Aliaksandr Valialkin	86d344f6c0	docs/Release-Guide.md: typo fix: signle->single	2022-05-09 15:27:57 +03:00
Manuel Polo	2cc5486248	docs: fix typo in quickstart	2022-05-09 15:27:55 +03:00
Artem Navoiev	7197de0c8c	docs: add flags list to vmbackupmanager (#2554) ... docs: add flags list to vmbackupmanager docs Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: tenmozes <artem@victoriametrics.com>	2022-05-09 15:26:24 +03:00
Aliaksandr Valialkin	e3819d3e8d	docs/CHANGELOG.md: cut v1.77.1	2022-05-07 01:49:21 +03:00
Aliaksandr Valialkin	e613ca9ba8	app/vminsert/netstorage: re-route samples from readonly vmstorage nodes to healthy nodes if -dropSamplesOnOverload command-line flag is set	2022-05-07 01:40:02 +03:00
Aliaksandr Valialkin	e961aec551	app/vmstorage: do not allow to set -retentionPeriod smaller than one day ... VictoriaMetrics doesn't support retention periods smaller than one day, so do not allow to set it to small values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2496	2022-05-07 00:54:42 +03:00
Aliaksandr Valialkin	810dd74fb9	lib/promscrape: properly implement ScrapeConfig.clone() ... Previously ScrapeConfig.clone() was improperly copying promauth.Secret fields - their contents was replaced with `<secret>` value. This led to inability to use passwords and secrets in `-promscrape.config` file. The bug has been introduced in v1.77.0 in the commit 67b10896d2 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2551	2022-05-07 00:06:19 +03:00
Aliaksandr Valialkin	994c06cb84	docs/CHANGELOG.md: document e726340914	2022-05-06 18:11:16 +03:00
Dmytro Kozlov	8b5a819266	vmbackup: Prevent save backups to the same folder where TSDB data is (#2547) ... * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip * vmbackup: Prevent save backups to the same folder where TSDB data is * Apply suggestions from code review * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-06 18:04:58 +03:00
Aliaksandr Valialkin	7cd416f5e6	docs/Cluster-VictoriaMetrics.md: typo fix: bandidth -> bandwidth	2022-05-06 16:34:44 +03:00
Roman Khavronenko	fe697a9253	vmctl: add tip about safety flags during for native data export (#2540) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-06 16:28:24 +03:00
Aliaksandr Valialkin	925fa9a7de	docs/Cluster-VictoriaMetrics.md: make the description for -rpc.disableCompression command-line flag more clear	2022-05-06 16:24:56 +03:00
Aliaksandr Valialkin	983b465757	app/vmagent: add missing _total suffix to vmagent_remotewrite_global_rows_pushed_before_relabel_total counter ... This is a follow up for c536139d0b	2022-05-06 15:51:34 +03:00
Aliaksandr Valialkin	af0da45d3e	lib/promscrape: rename promscrape_stale_samples_created_total metric to vm_promscrape_stale_samples_created_total, so its name is consistent with the rest of vm_promscrape_ metrics	2022-05-06 15:33:43 +03:00
Aliaksandr Valialkin	2baa9e8f48	app/vmagent: expose vmagent_remotewrite_global_rows_pushed_before_relabel and vmagent_remotewrite_rows_pushed_after_relabel_total metrics	2022-05-06 15:30:10 +03:00
Aliaksandr Valialkin	9c89ea1c90	app/vmagent: rename vmagent_remote_write_rate_limit_reached_total to vmagent_remotewrite_rate_limit_reached_total for the sake of consistency with other vmagent_remotewrite_ metrics	2022-05-06 15:02:18 +03:00
Aliaksandr Valialkin	9d40bb7137	lib/promscrape/discovery/ec2: add ability to filter Availability Zones in ec2_sd_config via az_filters section	2022-05-06 12:44:01 +03:00
Aliaksandr Valialkin	8babb4aebc	app/vmselect/vmui: make vmui-update after 450d879eaa	2022-05-05 22:11:41 +03:00
Denis Fondras	53b68eb254	Fix typo (#2538)	2022-05-05 21:16:39 +03:00
Aliaksandr Valialkin	c5e47929c3	docs/Cluster-VictoriaMetrics.md: update cluster scalability tips	2022-05-05 21:09:17 +03:00
Aliaksandr Valialkin	0634a894a9	docs/CHANGELOG.md: document bf5e3774cc	2022-05-05 13:38:44 +03:00
Aliaksandr Valialkin	0ad5b64930	docs/CHANGELOG.md: cut v1.77.0	2022-05-05 00:16:31 +03:00
Aliaksandr Valialkin	2213eef6b7	docs/vmbackup.md: added missing -storageDataPath argument in the command for creating daily backups	2022-05-04 22:50:18 +03:00
Aliaksandr Valialkin	4ae1a8514a	docs/vmbackup.md: acutalize docs ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2503	2022-05-04 22:44:40 +03:00
Aliaksandr Valialkin	9fea63d1c8	app/vmagent: rename -remoteWrite.useSigv4 command-line flag to -remoteWrite.aws.useSigv4, so its name is consistent with the other -remoteWrite.aws.* command-line flags	2022-05-04 20:41:45 +03:00
Aliaksandr Valialkin	358fa99af2	app/vmalert: run make quicktemplate-gen from the root directory after the commit f6dcfbcdd6	2022-05-04 20:28:37 +03:00
Nikolay	7e58cba6cf	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458) ... * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:28:37 +03:00
Dmytro Kozlov	0aeefeb5f1	vmalert/tpl: fixed truncating alerts expression in table (#2494) ... vmalert: improve `/groups` UI visual The change also fixes truncated rules expressions in UI https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2484	2022-05-04 20:28:37 +03:00
Aliaksandr Valialkin	a297315ff1	docs/guides/multi-regional-setup-dedicated-regions.md: clarify wording on vmagent configuration	2022-05-04 18:50:37 +03:00
Aliaksandr Valialkin	4dfd84c505	docs/Cluster-VictoriaMetrics.md: move environment variables entry closer to cluster setup section	2022-05-04 18:41:44 +03:00
Aliaksandr Valialkin	9dc9e03a14	docs/CHANGELOG.md: yet another typo fix: present -> pressed	2022-05-04 18:20:58 +03:00
Aliaksandr Valialkin	c2610e4186	docs/CHANGELOG.md: typo fixes	2022-05-04 18:19:05 +03:00
Aliaksandr Valialkin	47010a9875	docs/CHANGELOG.md: document 8639e79d38	2022-05-04 10:46:32 +03:00
Aliaksandr Valialkin	4fa3cd701c	docs/Cluster-VictoriaMetrics.md: typo fix: serparated -> separated	2022-05-03 15:20:11 +03:00
Aliaksandr Valialkin	25266d2194	docs/CHANGELOG.md: document 3575aabeaf	2022-05-03 14:01:58 +03:00
Aliaksandr Valialkin	ec3a37896f	all: add -cluster.tlsInsecureSkipVerify command-line option to vminsert, vmselect and vmstorage components in order to be able to disable TLS certificate verification in mTLS mode ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2490	2022-05-03 13:13:43 +03:00
Aliaksandr Valialkin	7291c81f0d	docs/Cluster-VictoriaMetrics.md: refer to the doc on how to set up mTLS	2022-05-03 11:54:05 +03:00
Aliaksandr Valialkin	ccf44e810c	docs/CHANGELOG.md: document 488c34f5e1	2022-05-03 11:01:27 +03:00
Aliaksandr Valialkin	d384997657	docs/CHANGELOG.md: document d0706c8c95	2022-05-02 22:25:47 +03:00
Aliaksandr Valialkin	361b08c30e	lib/storage: leave the last sample per each discrete interval during the deduplicaton ... This aligns better with staleness logic in Prometheus - https://prometheus.io/docs/prometheus/latest/querying/basics/#staleness	2022-05-02 21:59:31 +03:00
Aliaksandr Valialkin	7ca32c21c8	app/vmui: execute query by pressing enter in the same way as Prometheus does ... Multi-line query can be entered via `shift-enter` in the query input field	2022-05-02 20:24:43 +03:00
Aliaksandr Valialkin	58e4e16588	docs/Cluster-VictoriaMetrics.md: move here the deduplication docs related to cluster version	2022-05-02 15:54:48 +03:00
Max Golionko	be81a0a327	added details about deduplication (#2527) ... * added details about deduplication * Update docs/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Apply suggestions from code review * Update docs/README.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-02 15:54:46 +03:00
Aliaksandr Valialkin	a70ac35ac7	docs/CHANGELOG.md: document 3616337812 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2514	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	75f4adab40	docs/CHANGELOG.md: document 32a6b67e6c ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1761	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	693e1838b3	docs/CHANGELOG.md: document b2294d1cf1	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	190c8b463c	lib/netutil: close connections in ConnPool if they are idle for more than 30 seconds ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508	2022-05-02 15:01:52 +03:00
Artem Navoiev	11db05a4ff	lib/{storage,flagutil} - Add option for snapshot autoremoval (#2487) ... * lib/{storage,flagutil} - Add option for snapshot autoremoval - add prometheus-like duration as command flag - add option to delete stale snapshots - update duration.go flag to re-use own code * wip * lib/flagutil: re-use Duration.Set() call in NewDuration * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-02 11:24:12 +03:00
Peter Dupej	9e193fb764	Update MetricsQL.md (#2519) ... remove typo from label_replace doc.	2022-05-02 09:43:57 +03:00
Aliaksandr Valialkin	eaae544238	docs/CHANGELOG.md: document c7aad8d441	2022-04-29 13:02:43 +03:00
Dima Lazerka	e6ee235707	Export "null" in jsonl instead of NaN (#2518) ... * Export "null" in jsonl instead of NaN The NaN appeared because of staleness markers that were added for compatibility. I think it's better to use json `null`, implemented here. Also maybe it also makes sense to add a flag like `?skip-staleness-markers=true` to `/export`, to skip nulls at all? * Update app/vmselect/prometheus/export.qtpl * app/vmselect/prometheus/export.qtpl.go: `make quicktemplate-gen` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-29 12:51:03 +03:00
Aliaksandr Valialkin	83db416567	docs/MetricsQL.md: clarify keep_metric_names docs	2022-04-27 11:25:02 +03:00
Aliaksandr Valialkin	6eb1580158	app/vmselect/promql: add tlast_change_over_time(m[d]) function, which returns the timestamp for the last change of m on the given lookbehind window d	2022-04-27 10:58:40 +03:00
Aliaksandr Valialkin	917bb702ef	app/vmagent: substitute hard-to-read 500000000 with 500MB in -remoteWrite.maxDiskUsagePerURL description	2022-04-26 15:48:44 +03:00
Yury Molodov	eae6f68be2	vmui: add support relative time (#2504) ... * feat: add support relative time * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-26 15:46:47 +03:00
Aliaksandr Valialkin	7d9d790bfb	docs/Cluster-VictoriaMetrics.md: remove incorrect and misleading instructions for passing -replicationFactor flag to vmselect nodes in multi-level setup. ... The `-replicationFactor` passed to top-level `vmselect` nodes mustn't exceed the `-replicationFactor` passed to top-level `vminsert` nodes	2022-04-26 15:13:08 +03:00
Aliaksandr Valialkin	cd4d1599cb	docs/CHANGELOG.md: document 4c1fbcd6b0 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2368	2022-04-26 15:09:57 +03:00
Aliaksandr Valialkin	374212333f	docs/CHANGELOG.md: typo fix: may result -> could result	2022-04-23 00:31:47 +03:00
Aliaksandr Valialkin	4c3cd96db5	lib/promauth: add support for min_version option at tls_config section in the same way as Prometheus does	2022-04-23 00:24:11 +03:00
Aliaksandr Valialkin	808a2f3b61	lib/promauth: add support for proxy_url option at oauth2 section in the same way as Prometheus does	2022-04-23 00:01:53 +03:00
Aliaksandr Valialkin	4ade8511e2	lib/promauth: add support for tls_config section at oauth2 config in the same way as Prometheus does	2022-04-23 00:01:52 +03:00
Aliaksandr Valialkin	a89e31b304	lib/promscrape/discovery/kubernetes: allow attaching node-level labels and annotations to discovered pod targets in the same way as Prometheus 2.35 does ... See https://github.com/prometheus/prometheus/issues/9510 and https://github.com/prometheus/prometheus/pull/10080	2022-04-22 20:15:34 +03:00
Aliaksandr Valialkin	a69dabf709	docs/Cluster-VictoriaMetrics.md: mention that enterprise binaries are available for evaluation	2022-04-21 15:57:13 +03:00
Aliaksandr Valialkin	c341a46745	docs/Single-server-VictoriaMetrics.md: refer to the docs on how to set up multiple vmagent instances for scraping the same set of targets	2022-04-21 15:52:22 +03:00
Aliaksandr Valialkin	dac24aa342	app/vmselect/promql: properly handle scalar default vector, scalar if vector and scalar ifnot vector queries ... Previously `vector` time series could be unexpectedly returned from such queries	2022-04-21 15:34:14 +03:00
Aliaksandr Valialkin	a5cfe5d13e	app/vmselect/promql: add drop_common_labels() function	2022-04-21 14:20:36 +03:00
Aliaksandr Valialkin	ed1b394a1a	app/vmstorage: expose vm_indexdb_items_added_total and vm_indexdb_items_added_size_bytes_total counters at /metrics page ... These counters can be used for monitoring the rate of addition of new entries in indexdb (aka inverted index). See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2471	2022-04-21 13:19:42 +03:00
Aliaksandr Valialkin	25b841c6ed	app/vmselect/promql: fix duplicate time series error on joins against time series filtered by values ... This should prevent from `duplicate time series` errors when executing the following query: kube_pod_container_resource_requests{resource="cpu"} * on (namespace,pod) group_left() (kube_pod_status_phase{phase=~"Pending|Running"}==1) where `kube_pod_status_phase{phase=~"Pending|Running"}==1` filters out diplicate time series	2022-04-20 22:21:20 +03:00
Aliaksandr Valialkin	90db923662	docs/CHANGELOG.md: document that the service discovery speed now scales with the number of CPU cores	2022-04-20 16:22:50 +03:00
Aliaksandr Valialkin	45385a5dc6	lib/promscrape: optimize getScrapeWork() function ... Reduce the number of memory allocations in this function. This improves its performance by up to 50%. This should improve service discovery speed when big number of potential targets with big number of meta-labels are generated by service discovery. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2270	2022-04-20 15:34:18 +03:00
Aliaksandr Valialkin	d0bac8e224	all: typo fix: Kuberntes -> Kubernetes	2022-04-20 10:51:41 +03:00
Dmytro Kozlov	17552dba8b	lib/promscrape: Enable filters for endpoint and labels (#2466) ... * lib/promscrape: Enable filters for endpoint and labels * lib/promscrape: cleanup * lib/promscrape: update template * lib/promscrape: move logic filter logic to backend * lib/promscrape: updated placeholder * lib/promscrape: updated placeholder * lib/promscrape: use two different fields for filters, updated form, added error on parsing queries * lib/promscrape: rename functions * lib/promscrape: removed unused values * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-19 18:27:44 +03:00
Nikolay	628905f080	lib/promscrape: adds job restart method (#2455) ... * lib/promscrape: adds job restart method it must restart only ScrapeConfig with changed content this change greatly reduce time, that needed for job restart and it should decrease possible data loss when config frequently changed at kubernetes based deployments Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 20:29:33 +03:00
Yury Molodov	60c4e0022a	fix: prevent graph hiding without data (#2456) ... * fix: prevent graph hiding without data * fix: add yaxis labels default * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 17:16:17 +03:00
Aliaksandr Valialkin	944070eafa	docs/Cluster-VictoriaMetrics.md: sync docs	2022-04-16 16:59:42 +03:00
Aliaksandr Valialkin	7debf57ca6	lib/httpserver: clarify that -tls flag enables TLS for http requests to -httpListenAddr	2022-04-16 16:59:41 +03:00
Aliaksandr Valialkin	a7689e1b0c	app/vmstorage: add support for mTLS cipher suites via -cluster.tlsCipherSuites command-line flag ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2404	2022-04-16 16:36:38 +03:00
Aliaksandr Valialkin	0156a8b1e1	docs/Cluster-VictoriaMetrics.md: update docs after 26ae50ec26	2022-04-16 16:04:32 +03:00
Aliaksandr Valialkin	6bd032a6d3	docs: sync docs with the latest changes	2022-04-16 16:00:27 +03:00
Aliaksandr Valialkin	27e74f25d6	lib/httpserver: follow up after def0032c7d	2022-04-16 15:52:44 +03:00
Aliaksandr Valialkin	c50e48a74c	lib/promscrape: follow-up after baa1c24b36	2022-04-16 14:26:38 +03:00
Aliaksandr Valialkin	f6fed6637d	docs/Cluster-VictoriaMetrics.md: clarify the issue with multi-level cluster, which may result in data gaps at some AZs	2022-04-16 13:03:39 +03:00
Aliaksandr Valialkin	ef86cbabcc	docs/Cluster-VictoriaMetrics.md: improve docs on cluster setup, resizing and scalability	2022-04-15 15:04:10 +03:00
Aliaksandr Valialkin	437a12cb64	docs/Cluster-VictoriaMetrics.md: mention about possible issues with multi-level cluster setup	2022-04-15 14:26:01 +03:00
Aliaksandr Valialkin	564996da14	docs/CHANGELOG.md: document 45fcaa33e8	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	951b2a0067	docs/CHANGELOG.md: document f7e4c5a628	2022-04-13 14:14:25 +03:00
Roman Khavronenko	56cd2b918a	vmalert: add DNS service discovery (#2465) ... https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2460 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-13 14:14:25 +03:00
Anton Bystrov	af96e6594c	Update CHANGELOG.md (#2463) ... May be mispint here?	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	4a6b56e5be	docs/CHANGELOG.md: cut v1.76.1	2022-04-12 16:21:06 +03:00
Aliaksandr Valialkin	3e2a4c07cd	app/vmui: further improvements for number display on graphs ... This is a follow-up for c4d2cd8336 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2409	2022-04-12 16:02:37 +03:00
Aliaksandr Valialkin	50a6354a03	docs/CHANGELOG.md: link to the bug related to improper handling of maxSeries limit passed from vmselect to vmstorage	2022-04-12 16:02:37 +03:00
Yurii Kravets	488d300d8b	Update Quick-Start (#2422) ... * Update Quick-Start * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * update Quick-Start.md added "Starting VM-Cluster via Docker" + Anchor fixes * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-12 14:27:36 +03:00
Roman Khavronenko	e48a59eaa6	docs: add managed vm documentation section (#2437) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-12 13:04:11 +03:00
Aliaksandr Valialkin	70ad171070	lib/promscrape: follow-up after 7e79adfb55	2022-04-12 12:37:03 +03:00
Yurii Kravets	e5b8a5210e	url-examples.md (#2435) ... * url-examples.md added 1 more example * Update url-examples.md	2022-04-12 11:30:53 +03:00
Aliaksandr Valialkin	81b7a31cb1	app/vmstorage: properly handle maxSeries limit passed from vmselect to vmstorage	2022-04-12 11:19:07 +03:00
Aliaksandr Valialkin	e3bf464f11	lib/protoparser/native: follow-up after fe01f4803d	2022-04-11 19:27:53 +03:00
Aliaksandr Valialkin	b3a3e9990f	vendor: update github.com/VictoriaMetrics/metricsql from v0.40.0 to v0.41.0 ... This allows using built-in function names as with template names	2022-04-11 18:32:18 +03:00
Aliaksandr Valialkin	5b265b3031	docs/Single-server-VictoriaMetrics.md: clarify that ingestion protocol means data ingestion protocol	2022-04-11 12:57:55 +03:00
Aliaksandr Valialkin	3c27bde77e	docs/CHANGELOG.md: document ed364a42e3	2022-04-11 12:12:07 +03:00
Aliaksandr Valialkin	e1b274d26c	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics supports data ingestion in Graphite protocol at Graphite API usage chapter	2022-04-10 16:21:19 +03:00
Aliaksandr Valialkin	cf9d261038	docs/Cluster-VictoriaMetrics.md: update docs after b843f0e229	2022-04-10 16:17:57 +03:00
Yurii Kravets	ace7dfe5d1	Update url-examples (#2410)	2022-04-08 13:07:06 +03:00
Aliaksandr Valialkin	4f5622b6fa	docs/Cluster-VictoriaMetrics.md: clarify high availability docs	2022-04-08 12:51:49 +03:00
Aliaksandr Valialkin	ce02d086d0	docs/CHANGELOG.md: document backwards-incompatible changes in cluster version of v1.76.0	2022-04-08 12:06:49 +03:00
Dmytro Kozlov	2aeb221691	docs/guides: Multi-regional setup with VictoriaMetrics (#2416) ... * docs/guides: Multi-regional setup with VictoriaMetrics * docs/guides: cleanup	2022-04-08 11:49:04 +03:00
Aliaksandr Valialkin	d7557b12ab	docs/CHANGELOG.md: document the bugfix in hitCount function	2022-04-08 11:48:36 +03:00
Aliaksandr Valialkin	949bf25a87	docs/CHANGELOG.md: typo fix	2022-04-07 17:20:20 +03:00
Aliaksandr Valialkin	e59019d088	docs/CHANGELOG.md: cut v1.76.0	2022-04-07 15:34:12 +03:00
Aliaksandr Valialkin	f082e64e0c	app/vmagent: reduce the probability of TLS handshake timeout when dialing the remote storage ... The following actions are taken: - Increase the TLS hashdshake timeout from 5 seconds to 10 seconds - Increase dial timeout from 5 seconds to 30 seconds - Specify DialContext instead of Dial in http.Transport. This allows properly handling the Context arg during dialing the remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1699	2022-04-06 12:35:14 +03:00
Aliaksandr Valialkin	087609a12b	docs/Release-Guide.md: add missing steps	2022-04-06 11:41:42 +03:00
Aliaksandr Valialkin	c24c5b8926	docs/CHANGELOG.md: document 0c0efc7781	2022-04-05 19:22:08 +03:00
Nikolay	7eb49d204f	vmctl verify-blocks command (#2390) ... * lib/protoparser: changes ParseStream for native format uses reader instead of http.Request updates app/vmagent and app/vmagent method usage * app/vmctl: add verify-block subcommand it allows to check exported from VictoriaMetrics data block in native format https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2362 Update app/vmctl/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-04-05 17:46:36 +03:00
Aliaksandr Valialkin	8752cce157	app/vminsert: reduce the max packet size, which vminsert can send to vmstorage ... This reduces the max memory usage for vminsert and vmstorage under heavy ingestion rate by up to 50% on production workload	2022-04-05 15:39:58 +03:00
Roman Khavronenko	ce1629b70a	vmalert: add flag for disabling long-lived connections (keepalive) (#2395) ... The new flag `datasource.disableKeepAlive` allows disabling keepalive connections. This may be useful if there are multiple datasource replicas (e.g. vmselects) behind the HTTP balancer to avoid uneven load spread because of long-lived connections. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-04 13:08:06 +03:00
Aliaksandr Valialkin	816085a652	docs/CHANGELOG.md: document 70bb0d2708	2022-04-04 13:02:41 +03:00
Aliaksandr Valialkin	676c1f4fd7	docs/CHANGELOG.md: document 173073364e1bb1e0259ddc873dbd96ce62b07543	2022-04-04 12:56:11 +03:00
Artem Navoiev	23614d752a	Update release process. Actualize helm-charts release process. Add re… (#2397) ... * Update release process. Actualize helm-charts release process. Add release guide for ansible playbooks * add step to Ansible steps	2022-04-04 12:56:11 +03:00
Ross Dougherty	4df09074d3	fix object selectors link (#2391) ... * fix object selectors link * update kustomize url	2022-04-01 12:41:28 +03:00
Dima Lazerka	e756eae06d	Fix typo "vmanomapy"	2022-04-01 12:26:53 +03:00
Aliaksandr Valialkin	157555b022	docs/CHANGELOG.md: document a57e3807537914396ee3eb378648a464fa9e1b97	2022-04-01 12:25:54 +03:00
Aliaksandr Valialkin	151a00189e	docs/CHANGELOG.md: document 0989649ad0	2022-04-01 12:03:41 +03:00
Yurii Kravets	bd0068254d	url-examples (#2389)	2022-04-01 12:03:41 +03:00
Roman Khavronenko	d907e0d9f0	docs: fix typo in vmalert's API (#2380) ... The API handler was changed in 1.75 but docs still contain the old address. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2366 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-01 12:03:41 +03:00
Roman Khavronenko	5b367ad594	docs: update increase_prometheus desc (#2381) ... Remove note that this func is supported by PromQL.	2022-03-28 12:29:41 +03:00
Roman Khavronenko	44fa461e77	docs: escape chars for /label/values endpoint (#2379) ... Without escaping the part wrapped with `<` `>` chars won't be rendered properly.	2022-03-28 12:29:41 +03:00
Aliaksandr Valialkin	7c81ce296d	docs/CHANGELOG.md: cut v1.75.1	2022-03-28 12:28:27 +03:00
Yury Molodov	7cbf19812d	vmui: predefined panels (#2243) ... * feat: add basic components for predefined dashboards * fix: change display alert * feat: add autosize and unit for axes * feat: add component for CircularProgress * feat: change layout for predefined dashboards * feat: add override step for predefined panels * feat: add override step for predefined panels * feat: change yaxis limits for predefined panels * fix: rename flag for hide legend * feat: add formatted panel description * feat: add README.md for dashboard setup * feat: validate dashboard settings * feat: add unit for y-ticks * fix: correct display error for dashboards * fix: disable auto refresh after route change * update package-lock.json * fix: add basename for BrowserRouter * fix: add dynamic basename for routing * update packages * feat: add a pre-defined dashboard "per-job resource usage" * feat: display unit in the hover-tooltip * fix: change routing and home layout * fix: change axis width calc * updated packages * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-26 13:05:21 +02:00
Aliaksandr Valialkin	b843f0e229	app/vmselect: add fine-grained limits for the number of returned/scanned time series for various APIs	2022-03-26 11:28:14 +02:00
Dima Lazerka	6e8e385375	VMAnomaly docs fixes (#2361) ... * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Squeeze vmanomaly after vmbackupmanager before Case Studies Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-25 12:09:05 +02:00
Aliaksandr Valialkin	b7b06fb50e	Revert "docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0" ... This reverts commit 1e18c1c1ae. The bugfix has been alread mentioned in the commit 9290605891	2022-03-24 19:21:15 +02:00
Aliaksandr Valialkin	1e18c1c1ae	docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0	2022-03-24 19:20:42 +02:00
Dima Lazerka	50bc179dce	Add vmanomaly docs section (#2356) ... * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-24 11:57:07 +02:00
Yurii Kravets	b8d9c071e9	Update url-examples (#2358) ... * Update url-examples Add federate example * Update docs/url-examples.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-24 11:57:06 +02:00
Aliaksandr Valialkin	c3d7522c19	docs: a follow-up after 76a477c609	2022-03-23 19:39:58 +02:00
Yurii Kravets	5f41e22cb1	Update Single-server-VictoriaMetrics.md (#2357) ... * Update Single-server-VictoriaMetrics.md Adding /federate link * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-23 19:39:57 +02:00
Yurii Kravets	a8b55103aa	Update url-examples.md (#2297) ... * Update url-examples.md +additional examples * Update * Update url-examples Some changes requested by Roman. * Update url-examples.md * Update url-example * Update url-examples Additional info and marking for /labels part * Update url-example Added example with complex query which needs encoding: How to execute the query similar to - sum(increase(foo{status="bar"}[5m])) by (status) * Update url-samples Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-22 15:12:36 +02:00
Aliaksandr Valialkin	8f678411cc	docs/Cluster-VictoriaMetrics.md: clarify mTLS protection docs	2022-03-22 14:01:06 +02:00
Arash Hatami	2e01691d5d	A good change for MD files (#2353) ... * Lint YAML * Remove extra comment * Fix command problem * Format MD files * Format & fix problem of MD files for docs * Another fix for MD files	2022-03-22 14:01:04 +02:00
Roman Khavronenko	bb594b34b8	docs: update release notes (#2349) ... Warn about memory issue introduced in releases 1.73 - 1.74	2022-03-21 15:41:25 +02:00
Aliaksandr Valialkin	84b3234f3d	docs/CHANGELOG.md: document a1e17e91f8	2022-03-21 15:37:03 +02:00
hagen1778	7c7436b584	docs: add update note to v1.75.0 release note ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-21 15:37:01 +02:00
Aliaksandr Valialkin	7e67d61fdf	docs/CHANGELOG.md: cut v1.75.0	2022-03-18 19:54:13 +02:00
Aliaksandr Valialkin	85695faa94	app/vmselect/bufferedwriter: suppress trivial network errors, which can be generated by remote side ... These errors include `broken pipe` and `reset by peer`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2334	2022-03-18 19:27:33 +02:00
Aliaksandr Valialkin	9d91ad7124	app/vmagent/remotewrite: prevent from infinite recursion panic when pushing a time series with big number of samples to remote storage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2335	2022-03-18 19:07:27 +02:00
Aliaksandr Valialkin	ab966f8a7a	docs: document 20bb5e703c	2022-03-18 18:42:09 +02:00
Aliaksandr Valialkin	e35c9124b7	lib/storage: reduce the interval for checking for free disk space from 30 seconds to 1 second ... This should reduce the probability of out of disk space panics when -storage.minFreeDiskSpaceBytes is set to low values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2305	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	7c92aaeaa4	lib/blockcache: properly release memory occupied by deleted entries ... Proviously the deleted entries could remain referenced via lastAccessHeap for long time. This could lead to increased memory usage for the following caches starting from v1.73.0: * indexdb/indexBlocks * indexdb/dataBlocks * storage/indexBlocks Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2242 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	85a4b805e1	docs/CHANGELOG.md: document e5868b9c29 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/546 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2255	2022-03-18 13:08:56 +02:00
Aliaksandr Valialkin	3b7aefade2	docs/vmalert.md: sync after 11ae1ae924	2022-03-17 20:18:07 +02:00
Aliaksandr Valialkin	e1f70af14e	docs/CHANGELOG.md: document 11ae1ae924	2022-03-17 20:09:18 +02:00
Aliaksandr Valialkin	f0e96a84db	docs: document the addition of mTLS communication between cluster components	2022-03-17 20:00:14 +02:00
Aliaksandr Valialkin	9290605891	docs/CHANGELOG.md: document c1d07e7c52f0a2ab892921b0639cd42677aa33a8	2022-03-16 14:25:38 +02:00
Aliaksandr Valialkin	c175afbe02	docs/CHANGELOG.md: document changes from fb6eab03a2	2022-03-16 13:28:29 +02:00
Aliaksandr Valialkin	5b53373154	docs/CHANGELOG.md: document 565bd08c43 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1824	2022-03-16 13:28:29 +02:00
Aliaksandr Valialkin	bf131a4990	docs: make docs-sync	2022-03-16 13:28:29 +02:00
hagen1778	fd0f521bb9	docs: add update details for some releases ... Some of the releases could negatively affect performance for a limited period of time due to some changes in core. Update details are meant to warn users about expected changes in peformance after the update. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 13:03:36 +02:00
Roman Khavronenko	ec48d022df	docs: fix broken links (#2303) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 13:01:46 +02:00
Dmytro Kozlov	7f0212f964	Issue-1824: added flags and different auth types support (#2287) ... * vmalert/notifier: added flags and different auth types support Co-authored-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 12:52:01 +02:00
Ted Robertson	d4f2dd2a71	Clarify lack of support for InfluxQL (#2273)	2022-03-16 12:25:09 +02:00
Bastien Dronneau	da722e462e	docs(vmalert): typo in path (#2278)	2022-03-16 12:24:12 +02:00
Aliaksandr Valialkin	e7a0b4e095	docs/CHANGELOG.md: cut v1.74.0	2022-03-03 19:30:53 +02:00
Aliaksandr Valialkin	419f109f88	docs: make docs-sync after 702aa4948b	2022-03-03 18:37:07 +02:00
Dan Dascalescu	e15b27b792	docs: clarify Retention, improve English (#2266)	2022-03-03 18:37:07 +02:00
nemobis	cd522dee14	Fix typo, sentence flow in operator description (#2251)	2022-03-03 18:37:07 +02:00
Aliaksandr Valialkin	0b5ec1780d	docs/CHANGELOG.md: document performance improvements when registering new time series	2022-03-03 17:12:25 +02:00
Nikolay	d5ba1249f8	fixes incorrect step for calculation for MovingWindow functions (#283) ... * fixes incorrect step for calculation for MovingWindow functions https://victoriametrics.zendesk.com/agent/tickets/99 * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-25 13:53:48 +02:00
Aliaksandr Valialkin	1bde8b4e22	docs/CHANGELOG.md: document cfc6c14dc48ae9dd35e65f1a6e5c7af8ccb9f029	2022-02-25 13:53:09 +02:00
Aliaksandr Valialkin	02a922b53f	lib/storage: properly handle series selector matching multiple metric names plus a negative filter ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2238 This is a follow-up for 00cbb099b6	2022-02-24 12:11:53 +02:00
Aliaksandr Valialkin	2431c9cf81	lib/promrelabel: add support for conditional relabeling via if filter ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1998	2022-02-24 02:35:13 +02:00
Nikolay	54221297d1	fixes jwt token parse with correct base64Url decoding (#281) ... * fixes jwt token parse with correct base64Url decoding it must be applied according to jwt RFC that requires token to be URL safe added slow path for decoding tokens with std base64 decoding adds error logging for vmgateway * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-23 13:57:54 +02:00
Aliaksandr Valialkin	244c23ea2c	lib/workingsetcache: reduce the default cache rotation period from hour to 20 minutes ... This should reduce memory usage under high time series churn rate	2022-02-23 13:42:27 +02:00
Aliaksandr Valialkin	cb100ce2af	docs/CHANGELOG.md: cut v1.73.1	2022-02-22 21:11:55 +02:00
Aliaksandr Valialkin	1ff42a0080	docs/CHANGELOG.md: link to the feature request for X-Influxdb-Version response header ... Follow-up for 71ef3155c8 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2209	2022-02-22 20:34:03 +02:00
Yurii Kravets	538114cd7c	Update URL examples (#2207) ... added div with copy function	2022-02-22 20:09:27 +02:00
Denys Holius	fc6f71fba8	Added minimal supported version of AlertManager (#2237) ... * added minimal supported version of supported AlertManager * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-22 20:09:26 +02:00
Aliaksandr Valialkin	89ead3daca	app/vmselect/netstorage: report vmstorage errors to vmselect clients even if partial responses are allowed ... If a vmstorage is reachable and returns an application-level error to vmselect, then such error must be returned to the caller even if partial responses are allowed, since it usually means cluster mis-configuration. Partial responses may be returned only if some vmstorage nodes are temporarily unavailable. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1941 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/678	2022-02-21 21:17:05 +02:00
Roman Khavronenko	5a4b16794d	Consul SD - update services on the watcher's start (#2202) ... * lib/discovery/consul: update services on the watcher's start Previously, watcher's start was only initing goroutines for discovery but not waiting for the first iteration to end. It means first Consul discovery wasn't returning discovered targets until the next iteration. The change makes the watcher's start blocking until we get first discovery iteration done and all registries updated. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: remove workarounds for consul SD Now when consul SD lib properly updates services on the first start, we don't need workarounds in vmalert. Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/discovery/consul: update after review Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 15:33:33 +02:00
Aliaksandr Valialkin	4a658cf955	app/vmagent: add -influxDBLabel in the same way as for app/vminsert ... This is a follow-up for 3d19fa6932	2022-02-21 14:09:40 +02:00
Roman Khavronenko	bd7837d524	lib: allow to configure cache size by type (#2206) ... * lib: allow to configure cache size by type https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1940 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 13:55:51 +02:00
Pablo Ley	4606d00d7d	Added missing inlineScrapeConfig field to the VMAgentSpec docs	2022-02-21 13:55:50 +02:00
Aliaksandr Valialkin	47b93a1337	docs: make docs-sync	2022-02-18 12:26:35 +02:00
Roman Khavronenko	f59685e5ff	docs: make profiling commands more copy-friendly (#2213) ... * docs: make profiling commands more copy-friendly The change adds `copy text` snippet to code examples and replaces hostname placeholders with `0.0.0.0`. Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-18 12:26:35 +02:00
Aliaksandr Valialkin	ce91456982	app/vminsert: add X-Influxdb-Version response header for InfluxDB API requests ... This is needed for some clients, which expect this header. See https://github.com/ntop/ntopng/issues/5449#issuecomment-1005347597	2022-02-17 12:49:24 +02:00
Aliaksandr Valialkin	8aaeffa7b4	docs: document 3d19fa6932	2022-02-16 23:30:52 +02:00
Aliaksandr Valialkin	ee066aa0d5	lib/storage: use binary search instead of full scan for skipping artificial tags when searching for tag names or tag values ... This should improve performance for /api/v1/labels and /api/v1/label/<label_name>/values See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2200	2022-02-16 18:17:27 +02:00
Aliaksandr Valialkin	f227712d7d	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics doesnt check DD_API_KEY when accepting data via DataDog protocol	2022-02-16 14:40:01 +02:00
匠心零度	cbba78e091	Correct URL:How to delete time series (#2201) ... Co-authored-by: lirenzuo <lirenzuo@shein.com>	2022-02-16 14:39:59 +02:00
Aliaksandr Valialkin	eaf29a5e8e	docs/url-examples.md: formatting fixes	2022-02-15 21:25:09 +02:00
Aliaksandr Valialkin	bb113efeb4	docs/CHANGELOG.md: document 2efa46a11c	2022-02-15 21:13:32 +02:00
Denys Holius	7e73fafc6f	Update revisions of dashboards (#2199) ... * update revision of vmcluster for operator guide * update revision of vmcluster for vmcluster guide	2022-02-15 21:13:32 +02:00
Yurii Kravets	759ea64b85	Create url-examples.md	2022-02-15 21:13:32 +02:00
Aliaksandr Valialkin	5aa3c896a8	docs/Single-server-VictoriaMetrics.md: clarify that the data is imported into VictoriaMetrics at how to import data section	2022-02-15 21:07:04 +02:00
Aliaksandr Valialkin	7e8596edb8	docs: update -help output for VictoriaMetrics components	2022-02-15 21:02:36 +02:00
Oct	c7c45bf842	docs: correct address in the docs (#2189) ... * docs/FAQ.md:fix 404 url * app/vmui/packages/vmui/README.md:rm 404 url	2022-02-15 12:59:50 +02:00
Aliaksandr Valialkin	e2be41f4dd	docs/CHANGELOG.md: document ad6bdd78d0	2022-02-15 12:48:23 +02:00
Aliaksandr Valialkin	38c73a00db	docs/CHANGELOG.md: cut v1.73.0	2022-02-14 17:54:53 +02:00
Aliaksandr Valialkin	5d8ea8c918	docs/CHANGELOG.md: document 3d890e89f1	2022-02-14 17:42:33 +02:00
Nikolay	48a9e068be	adds release build for macos darwin amd64 and arm64 (#2185) ... * adds release build for macos darwin amd64 and arm64 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1896 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1851 * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-14 17:42:33 +02:00
Aliaksandr Valialkin	fc0771a888	docs/CHANGELOG.md: document c90c1c4d54	2022-02-14 13:13:03 +02:00
Aliaksandr Valialkin	31b42e9c57	lib/promscrape: add expand all and collapse all buttons to /targets page ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2021	2022-02-12 18:42:01 +02:00
Aliaksandr Valialkin	989668beba	app/vmselect/promql: return at most one time series from absent_over_time() in the same way as Prometheus does ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2130	2022-02-12 15:46:43 +02:00
Aliaksandr Valialkin	216b13186d	docs/vmagent.md: add unsupported Prometheus config sections chapter	2022-02-12 01:08:34 +02:00
Aliaksandr Valialkin	3ab4aef140	docs/CHANGELOG.md: document ea153e5f90	2022-02-12 00:48:40 +02:00
Roman Khavronenko	d107f86fbc	lib/index: reduce read/write load after indexDB rotation (#2177) ... * lib/index: reduce read/write load after indexDB rotation IndexDB in VM is responsible for storing TSID - ID's used for identifying time series. The index is stored on disk and used by both ingestion and read path. IndexDB is stored separately to data parts and is global for all stored data. It can't be deleted partially as VM deletes data parts. Instead, indexDB is rotated once in `retention` interval. The rotation procedure means that `current` indexDB becomes `previous`, and new freshly created indexDB struct becomes `current`. So in any time, VM holds indexDB for current and previous retention periods. When time series is ingested or queried, VM checks if its TSID is present in `current` indexDB. If it is missing, it checks the `previous` indexDB. If TSID was found, it gets copied to the `current` indexDB. In this way `current` indexDB stores only series which were active during the retention period. To improve indexDB lookups, VM uses a cache layer called `tsidCache`. Both write and read path consult `tsidCache` and on miss the relad lookup happens. When rotation happens, VM resets the `tsidCache`. This is needed for ingestion path to trigger `current` indexDB re-population. Since index re-population requires additional resources, every index rotation event may cause some extra load on CPU and disk. While it may be unnoticeable for most of the cases, for systems with very high number of unique series each rotation may lead to performance degradation for some period of time. This PR makes an attempt to smooth out resource usage after the rotation. The changes are following: 1. `tsidCache` is no longer reset after the rotation; 2. Instead, each entry in `tsidCache` gains a notion of indexDB to which they belong; 3. On ingestion path after the rotation we check if requested TSID was found in `tsidCache`. Then we have 3 branches: 3.1 Fast path. It was found, and belongs to the `current` indexDB. Return TSID. 3.2 Slow path. It wasn't found, so we generate it from scratch, add to `current` indexDB, add it to `tsidCache`. 3.3 Smooth path. It was found but does not belong to the `current` indexDB. In this case, we add it to the `current` indexDB with some probability. The probability is based on time passed since the last rotation with some threshold. The more time has passed since rotation the higher is chance to re-populate `current` indexDB. The default re-population interval in this PR is set to `1h`, during which entries from `previous` index supposed to slowly re-populate `current` index. The new metric `vm_timeseries_repopulated_total` was added to identify how many TSIDs were moved from `previous` indexDB to the `current` indexDB. This metric supposed to grow only during the first `1h` after the last rotation. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-12 00:34:44 +02:00
Roman Khavronenko	791cad8c2e	lib/promscrape: support prometheus-like duration in scrape configs (#2169) ... * lib/promscrape: support prometheus-like duration in scrape configs The change allows to specify duration values like `1d`, `1w` for fields `scrape_interval`, `scrape_timeout`, etc. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/817#issuecomment-1033384766 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/blockcache: make linter happy Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/promscrape: support prometheus-like duration in scrape configs * add support for extra fields `scrape_align_interval` and `scrape_offset`; * support Prometheus duration parsing for `__scrape_interval__` and `__scrape_duration__` labels; Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip * docs/CHANGELOG.md: document the feature Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 16:17:51 +02:00
Aliaksandr Valialkin	727b29d4a3	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_endpointslice_{label,annotation}* labels to be consistent with other role values for Kubernetes service discovery	2022-02-11 14:56:10 +02:00
Nikolay	265938a385	fixes service discovery for kubernetes (#2173) ... * fixes service discovery for kubernetes now it must take in account all pods that belong to the discovered endpoint and endpointslice adds simple test for endpoints https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2134 * wip * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 13:35:34 +02:00
Aliaksandr Valialkin	6cb2954612	docs/CHANGELOG.md: document 4e722c459b ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2167	2022-02-10 12:21:05 +02:00
Aliaksandr Valialkin	718342a806	docs/Articles.md: add an article from Asserts.io, which mentions VictoriaMetrics components	2022-02-10 12:21:05 +02:00
Aliaksandr Valialkin	b81e6ba403	docs/CHANGELOG.md: add instructions on how to build VictoriaMetrics components from source code in order to test tip changes	2022-02-08 16:44:20 +02:00
Nikolay	feefbbab48	adds CGO build for arm64 (#2102) ... * adds CGO build for arm64 it must improve performance for arm64 based deployments of vmstorage and vmsingle for 15-20% it depends on gozstd package update for correct musl gozstd vendoring * typo fixes * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 16:26:55 +02:00
Roman Khavronenko	763cb68a67	docs: add Storage section to docs (#2155) ... * docs: add Storage section to docs https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2151 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 16:00:18 +02:00
Aliaksandr Valialkin	eed66b6640	lib/promscrape: set -promscrape.config.strictParse to true by default ... This allows detecting long-living silent errors in -promscrape.config	2022-02-08 15:42:33 +02:00
Aliaksandr Valialkin	6e05e3308e	docs/Single-server-VictoriaMetrics.md: add a link to exlanation on how downsampling works	2022-02-08 15:11:27 +02:00
Aliaksandr Valialkin	2149805886	docs/CHANGELOG.md: add links to issues, which could benefit from improved re-routing algorithm	2022-02-07 16:54:27 +02:00
Aliaksandr Valialkin	eb466e0c4e	docs: fix links to FAQ.md entries after they have been changed in ccf04239e6	2022-02-07 16:01:34 +02:00
Aliaksandr Valialkin	5da7f08be6	docs: cross-link downsampling docs from deduplication and vmalert docs	2022-02-07 14:53:50 +02:00
Aliaksandr Valialkin	c738739494	app/vminsert: add -dropSamplesOnOverload command-line flag ... Drop incoming samples if the destination vmstorage node is unavailable and/or accepts data at slower rate than other vmstorage nodes	2022-02-07 12:32:18 +02:00
Aliaksandr Valialkin	021ee53ba8	app/vminsert: improve re-routing logic in order to spread rows more evenly among the available storage nodes	2022-02-06 20:20:02 +02:00
Aliaksandr Valialkin	d24e5d9efd	lib/promscrape: show the total number of scrapes and the total number of scrape errors per target at /targets page ... This information may be useful when debugging unreliable scrape targets	2022-02-03 20:23:27 +02:00
Aliaksandr Valialkin	678b3e71db	lib/promscrape: provide the ability to fetch target responses on behalf of vmagent or single-node VictoriaMetrics ... This feature may be useful when debugging metrics for the given target located in isolated environment	2022-02-03 19:02:12 +02:00
Aliaksandr Valialkin	10367d7e4c	app/vmselect/promql: do not push down filters, which enumerate more than 10k unique values ... Such filters may slow down time series search, so just skip them. This is a follow-up for e7f1ceeb84 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1827	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	97b7b94f91	docs/CHANGELOG.md: document 55e3bbd4cc ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1567	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	dbead4813e	docs: updates after 5da71eb685 ... * Mention about the ability to configure vmalert notifiers via files in docs/CHANGELOG.md * Mention about the ability to use Consul service discovery for vmalert notifiers in docs/CHANGELOG.md * Run `make docs-sync` in order to sync app/vmalert/README.md to docs/vmalert.md	2022-02-02 23:42:25 +02:00
Pablo Ley	66271bfeee	Added missing links in EmbeddedHPA API docs	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	566e12874d	lib/cgroup: expose process_cpu_cores_available metric ... This metric shows the number of CPU cores available to the process. This allows creating alerting rules on CPU saturation with the following query: rate(process_cpu_seconds_total[5m]) / process_cpu_cores_available > 0.9 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2107	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	04d6596298	app/vmselect/promql: optimize queries, which join on _info metrics. ... Automatically add common filters from one side of binary operation to the other side before sending the query to storage subsystem. See https://grafana.com/blog/2021/08/04/how-to-use-promql-joins-for-more-effective-queries-of-prometheus-metrics-at-scale/ and https://www.robustperception.io/exposing-the-software-version-to-prometheus	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	ad5d646e4e	docs/Release-Guide.md: add instructions on how to create signed release tags	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	35164d4dcf	docs/CHANGELOG.md: document 6a519896db	2022-01-31 12:42:27 +02:00
Aliaksandr Valialkin	069880fd3c	docs/vmauth.md: mention that backend services must be accessible only via vmauth	2022-01-28 12:07:12 +02:00
Denys Holius	9e7d6a585b	FAQ update (#2111) ... * FAQ update: how downsampling and deduplication will work at the same time * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-01-27 20:36:15 +02:00
jaysony	3e22537248	correct VMAgentStatus description (#2109) ... correct VMAgentStatus description from VMAlert to VMAgent.	2022-01-27 20:18:37 +02:00
Aliaksandr Valialkin	0ac2a51682	vendor: update github.com/VictoriaMetrics/metricsql from v0.37.0 to v0.38.0 ... This adds more optimization cases for https://utcc.utoronto.ca/~cks/space/blog/sysadmin/PrometheusLabelNonOptimization For example: * Multi-level transform functions. For example, abs(round(foo{a="b"})) + bar{x="y"} is now optimized to abs(round(foo{a="b",x="y"})) + bar{a="b",x="y"} * Binary operations with `on()`, `without()`, `group_left()` and `group_right()` modifiers. For example, foo{a="b"} on (a) + bar is now optimized to foo{a="b"} on (a) + bar{a="b"} * Multi-level binary operations. For example, foo{a="b"} + bar{x="y"} + baz{z="q"} is now optimized to foo{a="b",x="y",z="q"} + bar{a="b",x="y",z="q"} + baz{a="b",x="y",z="q"} * Aggregate functions. For example, sum(foo{a="b"}) by (c) + bar{c="d"} is now optimized to sum(foo{a="b",c="d"}) by (c) + bar{c="d"}	2022-01-27 19:04:45 +02:00
Aliaksandr Valialkin	4911c0c045	docs/operator: fix links to Operator API docs	2022-01-25 17:38:41 +02:00
Aliaksandr Valialkin	49650fe6aa	lib/logger/throttler.go: show the original location of the error and warning message ... Previously the location inside LogThrottler implementation was shown. This could complicate debugging.	2022-01-23 13:55:48 +02:00
f41gh7	2f56f484af	updates operator docs	2022-01-23 13:15:37 +02:00
Yury Molodov	196bef8348	vmui: fixed display type switching (#2088) ... * fix: correct switch display type * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 16:57:14 +02:00
Yurii Kravets	4b7650832e	Created Operator folder in docs (#2034) ... * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed	2022-01-21 12:06:41 +02:00
Yury Molodov	034012c80f	vmui: fix time range selector (#2085) ... * fix: add date validate for time range * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 12:03:41 +02:00
Aliaksandr Valialkin	93cadb4a16	all: update link to EULA from https://victoriametrics.com/assets/VM_EULA.pdf to https://victoriametrics.com/legal/eula/	2022-01-20 22:22:44 +02:00
Aliaksandr Valialkin	6ae584b9b3	lib/{mergeset,storage}: properly limit cache sizes for indexdb ... Previously these caches could exceed limits set via `-memory.allowedPercent` and/or `-memory.allowedBytes`, since limits were set independently per each data part. If the number of data parts was big, then limits could be exceeded, which could result to out of memory errors. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-01-20 18:45:03 +02:00
Aliaksandr Valialkin	c2abd6a702	docs/CHANGELOG.md: document the bugfix for highestMax() function is Graphite render API	2022-01-20 12:16:12 +02:00
Aliaksandr Valialkin	d9ab623c5b	docs/Release-Guide.md: update instructions for exporting snapcraft login to ~/.snap/login.json	2022-01-19 15:21:49 +02:00
Aliaksandr Valialkin	6233e7c40c	docs/CHANGELOG.md: add missing parens in example for @ modifier	2022-01-19 13:05:29 +02:00
Oct	9cd8aa8444	docs: Correct some urls in the docs (#2081) ... * docs:update Swift S3 api url * docs/vmbackup.md: update Swift S3 api url * docs: update KairosDB docs url * docs: update thanos docs url	2022-01-19 11:57:02 +02:00
Aliaksandr Valialkin	2eaf7a7c46	docs/CHANGELOG.md: fix incorrect link to the issue ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2022-01-19 00:08:31 +02:00
Aliaksandr Valialkin	f3196e48e1	docs/CHANGELOG.md: cut v1.72.0	2022-01-18 22:43:34 +02:00
Aliaksandr Valialkin	0c9cf79e51	docs/vmbackup.md: make docs-sync after ca11def2a5	2022-01-18 22:30:23 +02:00
Roman Khavronenko	c71a05a528	docs: update retention docs with additional details (#2060) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-01-18 22:30:23 +02:00
Yury Molodov	1d19303f35	fix: remove buffer period (#2078) ... * fix: remove buffer period * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the implemented feature Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2064 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 22:23:40 +02:00
Yury Molodov	5b286a4728	vmui: correct url encoding (#2067) ... * fix: correct encode multi-line queries * fix: change autocomplete for correct arrows work * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2039 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 21:32:30 +02:00
Oct	cb5d8a8633	docs: Correct config URL (#2077) ... docs: update incorrect links	2022-01-18 21:27:26 +02:00
Aliaksandr Valialkin	ce55b31d2e	docs/CHANGELOG.md: document 8e3f9c1fbb	2022-01-18 21:27:26 +02:00
Aliaksandr Valialkin	7dabfbee45	docs/CHANGELOG.md: document fcd33fc409	2022-01-18 12:47:02 +02:00
Aziz Köksal	f3f764fe8b	docs: proofread FAQ.md (#2062) ... * Added missing articles. * Changed minus characters to long dashes. * Rephrased some words. * Corrected grammar mistakes. * Set correct possessive apostrophes. * "setup" -> "set up" * "no need in" -> "no need for" * "comparing" -> "compared" * "less" -> "fewer" * "additionally" -> "in addition to"	2022-01-18 12:40:43 +02:00
Aliaksandr Valialkin	b020bf4e3f	docs/CHANGELOG.md: document that vmgateway now supports extra_filters option ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:38:24 +02:00
Aliaksandr Valialkin	4f3ed98ea4	docs/vmgateway.md: update docs, since vmgateway now supports extra_filters ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:38:23 +02:00
Aliaksandr Valialkin	5a1e4a140f	app/vmselect/promql: implement keep_metric_names modifier for transform and rollup functions ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949	2022-01-14 04:15:35 +02:00
Aliaksandr Valialkin	53c9a81f2b	app/vmselect/promql: add stale_samples_over_time() function	2022-01-14 01:49:24 +02:00
Aliaksandr Valialkin	410905e2ed	docs/CHANGELOG.md: yet another attempt to fix formatting for yaml snippet	2022-01-14 01:15:15 +02:00
Aliaksandr Valialkin	2eb9ec4476	docs/CHANGELOG.md: fix formatting for scrape_configs example	2022-01-14 01:03:02 +02:00
Aliaksandr Valialkin	da95516a1f	lib/promscrape: expose promscrape_stale_samples_created_total metric for monitoring the number of created stale samples	2022-01-14 01:00:40 +02:00
Aliaksandr Valialkin	755779adb7	app/vmalert: add parseDuration function in the same way as Prometheus does ... See https://github.com/prometheus/prometheus/pull/8817	2022-01-13 23:30:56 +02:00
Aliaksandr Valialkin	dd91759f1f	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_node_provider_id label for discovered Kubernetes nodes in the same way as Prometheus does ... See https://github.com/prometheus/prometheus/pull/9603	2022-01-13 23:17:24 +02:00
Aliaksandr Valialkin	0f81ecd7df	app/vmalert: add stripPort template function in the same way as Prometheus does ... See https://github.com/prometheus/prometheus/pull/10002	2022-01-13 22:54:46 +02:00
Aliaksandr Valialkin	bc18368c15	lib/promscrape/discovery/kubernetes: add the ability to limit service discovery to the current namespace ... See https://github.com/prometheus/prometheus/issues/9782 and https://github.com/prometheus/prometheus/pull/9881	2022-01-13 22:44:59 +02:00
Aliaksandr Valialkin	0580a58feb	app/vmselect/promql: add support for @ modifier ... Add support for `@` modifier in MetricsQL according to https://prometheus.io/docs/prometheus/latest/querying/basics/#modifier Extend the support with the following features: * Allow using `@` modifier everywhere in the query. For example, `sum(foo) @ end()` * Allow using arbitrary expression as `@` modifier. For example, `foo @ (end() - 1h)` returns `foo` value at `end - 1 hour` timestamp on the selected time range `[start ... end]` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1348	2022-01-13 22:15:19 +02:00
Aliaksandr Valialkin	de8299f465	lib/promscrape/discovery/dockerswarm: follow up after 68a117a25a ... - Document the bugfix at docs/CHANGELOG.md - Set __address__ field after copying commonLabels to the resulting map of discovered labels. This makes sure that the correct __address__ label is used.	2022-01-11 09:22:03 +02:00
Aliaksandr Valialkin	21e5e90d75	docs/CHANGELOG.md: document 77bfa8181d	2022-01-11 08:56:02 +02:00
Dmitry Tolstoy	56fa9ede65	docs: Correct config URL (#2051) ... Missed /guides folder	2022-01-11 08:55:57 +02:00
Aliaksandr Valialkin	7509780cc0	docs/CHANGELOG.md: add release dates for every release	2022-01-07 12:28:01 +02:00
Aliaksandr Valialkin	fa89f3e5a5	lib/promscrape: do not send staleness markers on graceful shutdown ... This follows Prometheus behavior. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2013#issuecomment-1006994079	2022-01-07 01:19:06 +02:00
Aliaksandr Valialkin	32ef62b18f	docs/vmctl.md: make docs-sync	2022-01-07 01:19:04 +02:00
Aliaksandr Valialkin	c6abaa824d	docs/FAQ.md: add what is the difference between vmagent and Prometheus agent chapter	2022-01-06 23:14:22 +02:00
Aliaksandr Valialkin	13c36e5e54	docs: follow-up after ae89b4e818	2022-01-05 16:32:56 +02:00
Denys Holius	3a522c591a	Old links replaced for newest (#2033) ... * replaced old links to the website * fixed deletion main README.md file * fix: added docs files after docs-sync	2022-01-05 16:32:54 +02:00
Aliaksandr Valialkin	c91df022cc	docs/CHANGELOG.md: clarify the issue description, which is fixed by 38bf5fc136	2022-01-05 16:19:32 +02:00
Aliaksandr Valialkin	80fc3fda07	lib/storage: follow-up for 38bf5fc136	2022-01-05 16:02:17 +02:00
Aliaksandr Valialkin	c29ce8acef	docs/CHANGELOG.md: document 60266078ca	2022-01-04 11:48:23 +02:00
Aliaksandr Valialkin	276cccb888	docs/CHANGELOG.md: document ac47733044	2022-01-03 21:16:19 +02:00
Aliaksandr Valialkin	22c78de2f2	docs/Quick-Start.md: simplify quick start guide	2022-01-03 17:29:10 +02:00
Yurii Kravets	f6e2e0dbd1	Update README.md (#1996) ... * Update README.md go 1.16 -> 1.17 * Update README.md * Update README.md * Update Cluster-VictoriaMetrics.md * Update Single-server-VictoriaMetrics.md * Update vmauth.md * Update vmbackup.md * Update vmrestore.md * Update vmagent.md * Update vmctl.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md	2021-12-23 12:11:30 +02:00
Aliaksandr Valialkin	b18d80c247	docs/CHANGELOG.md: document 543bd0ea0c ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1999	2021-12-23 12:08:41 +02:00
Aliaksandr Valialkin	c1722003a2	lib/promscrape: scrape replicated targets at different offsets in vmagent replicated clustering mode ... This guarantees that the deduplication consistently leaves samples from the same vmagent replica. See https://docs.victoriametrics.com/vmagent.html#scraping-big-number-of-targets	2021-12-23 00:21:41 +02:00
Aliaksandr Valialkin	419ea376a6	docs/FAQ.md: link to managed VictoriaMetrics at AWS ... See https://docs.victoriametrics.com/FAQ.html#what-is-the-pricing-for-victoriametrics	2021-12-22 23:17:00 +02:00
Nikolay	6cdc934c3d	adds restore.lock (#1988) ... * adds restore.lock it must prevent from running storage after incomplete restore process https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 * return back flock file deletion * Apply suggestions from code review * wip * docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-22 13:10:56 +02:00
Aliaksandr Valialkin	c61aa01c71	docs/CHANGELOG.md: document 34fdc8881b ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2021-12-21 16:42:38 +02:00
Denys Holius	e24f7884e2	bump revision of dashboards to latest (#1986)	2021-12-21 12:11:52 +02:00
Aliaksandr Valialkin	41c2657f23	docs/Single-server-VictoriaMetrics.md: mention that recording rules in vmalert can be used for reducing the number of time series	2021-12-20 20:04:21 +02:00
Aliaksandr Valialkin	28a0d3faaa	docs/CHANGELOG.md: cut v1.71.0	2021-12-20 19:10:38 +02:00
Aliaksandr Valialkin	996c3b0957	docs: mention that downsampling can be evaluated for free by running enterprise binaries	2021-12-20 15:57:52 +02:00
Yurii Kravets	3638e096f3	Update FAQ.md (#1765) ... * Update FAQ.md Adding explanation "Why do same metrics have differences in VictoriaMetrics and Prometheus dashboards?" * Update FAQ * Update FAQ.md * Apply suggestions from code review Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-12-20 13:43:40 +02:00
Aliaksandr Valialkin	3396f08874	app/vmselect/promql: follow-up after 177e345d8a ... * Document changes_prometheus(), increase_prometheus() and delta_prometheus() functions. * Simplify their implementation * Mention these functions in docs/CHANGELOG.md	2021-12-20 13:15:06 +02:00
Aliaksandr Valialkin	b1196e594b	docs/FAQ.md: describe main reasons for high churn rate	2021-12-20 12:30:42 +02:00
Aliaksandr Valialkin	c446858d08	docs/CHANGELOG.md: document 6814cc6809 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1943	2021-12-17 20:17:09 +02:00
Aliaksandr Valialkin	d9f075622b	app/vmselect: de-duplicate data exported via /api/v1/export/csv by default ... Previously the exported data wasn't de-duplicated. Now it is possible to export the raw data without deduplication by passing reduce_mem_usage=1 query arg to /api/v1/export/csv See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-12-17 11:52:42 +02:00
Roman Khavronenko	e7cca46479	docs: add Benchmarks section (#1950) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-17 11:52:42 +02:00
Roman Khavronenko	a92f53486a	docs: update MetricsQL.Subquery section description (#1951) ... * simplify sentences; * fix typo. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-17 11:52:42 +02:00
Aliaksandr Valialkin	5bd4e47a9e	lib/promscrape: allow up to 5 redirects when scraping a target by default ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1945	2021-12-16 00:14:45 +02:00
Aliaksandr Valialkin	c170841951	app/vmselect/promql: add timestamp_with_name(m[d]) function ... This function works the same as `timestamp()`, but doesn't remove source time series names. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949#issuecomment-995222388	2021-12-15 23:38:09 +02:00
Aliaksandr Valialkin	5b4cb65138	docs: mention -storage.minFreeDiskSpaceBytes command-line flag at capacity planning section ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1727 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-12-15 21:43:21 +02:00
Aliaksandr Valialkin	946769a828	docs/Cluster-VictoriaMetrics.md: mention about the added downsampling support	2021-12-15 16:39:35 +02:00
Aliaksandr Valialkin	3b8a300588	docs: document the added dowsnampling support in VictoriaMetrics enterprise	2021-12-15 16:25:32 +02:00
Aliaksandr Valialkin	d36fdbe537	lib/storage: deduplicate samples more thoroughly ... Previously some duplicate samples may be left on disk for time series with high churn rate. This may result in higher disk space usage.	2021-12-15 16:00:30 +02:00
Aliaksandr Valialkin	68cafdcf0b	app/victoria-metrics: mention https://docs.victoriametrics.com/#downsampling in the description for -dedup.minScrapeInterval command-line flag	2021-12-15 13:18:45 +02:00
Aliaksandr Valialkin	c922c7af9a	lib/storage: convert alternate regexps into Graphite wildcards inside __graphite__ pseudo-label ... For example, `{__graphite__=~"foo.(bar|baz)"}` is automatically converted to `{__graphite__=~"foo.{bar,baz}"}` before execution. This allows using multi-value Grafana template variables such as `{__graphite__=~"foo.($app)"}`.	2021-12-14 19:55:59 +02:00
Aliaksandr Valialkin	eedc2aac08	docs/CHANGELOG.md: link to the issue about unaligned 64-bit atomic opertion panic on 32-bit architectures	2021-12-14 15:00:46 +02:00
Aliaksandr Valialkin	d02553831d	docs/CHANGELOG.md: an attempt to properly show $labels.alertname at https://docs.victoriametrics.com/CHANGELOG.html	2021-12-14 14:57:03 +02:00
Yury Molodov	b3389ce26b	vmui: custom step (#1942) ... * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * feat: add custom step * update package-lock.json * docs: document that VMUI now supports overriding of `step` query arg, which is passed to `/api/v1/query_range` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-14 14:52:44 +02:00
Yury Molodov	28655e8eb8	vmui: minor fixes (#1936) ... * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document bugfixes Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-13 13:44:32 +02:00
Aliaksandr Valialkin	24d0bb7c2a	docs/Single-server-VictoriaMetrics.md: added a link to Graphite paths and wildcards - https://graphite.readthedocs.io/en/latest/render_api.html#paths-and-wildcards	2021-12-13 13:30:02 +02:00
Aliaksandr Valialkin	7b38507fc1	docs/CHANGELOG.md: document 7c3b6365f0	2021-12-12 19:10:58 +02:00
Aliaksandr Valialkin	addae7fc6a	app/vmselect/promql: preserve the order of time series passed to limit_offset() function ... Previously time series passed to `limit_offset()` were shuffled according to hash for their labels. This was unexpected behaviour for most users. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1920 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/951	2021-12-12 18:07:15 +02:00
Aliaksandr Valialkin	988003536d	docs/CHANGELOG.md: document 2851709745 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1921	2021-12-10 12:14:18 +02:00
Aliaksandr Valialkin	e267355706	docs/Single-server-VictoriaMetrics.md: add a link to https://github.com/denisgolius/victoriametrics-ru-links	2021-12-09 19:43:28 +02:00
Aliaksandr Valialkin	d91adcba3c	docs: document the ability to investigate correlation between two queries at /vmui ... This is a follow-up for c1fd93e8a0	2021-12-08 17:24:55 +02:00
Aliaksandr Valialkin	38f5bc7451	lib/httpserver: add missing 127.0.0.1 hostname to the logged address for http and pprof server if the address starts with ':' ... This allows copy-pasting the url to http server from logs.	2021-12-08 16:15:12 +02:00
Aliaksandr Valialkin	ddd2f531bc	docs/Single-server-VictoriaMetrics.md: add LinkedIn public channel	2021-12-08 13:16:10 +02:00
Aliaksandr Valialkin	e21d1353f4	docs/Release-Guide.md: refresh the list of channels for publishing release notes	2021-12-08 13:16:09 +02:00
Aliaksandr Valialkin	1c09881cf7	docs/Single-server-VictoriaMetrics.md: move features chapter above the case studies chapter	2021-12-08 12:49:50 +02:00
Aliaksandr Valialkin	54d4a1c959	app/vmselect: accept optional extra_filters[] query args for all the supported Prometheus querying APIs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2021-12-06 17:33:49 +02:00
Aliaksandr Valialkin	9aa9b081a4	app/vminsert: add -maxLabelValueLen command-line flag ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1908	2021-12-06 11:42:24 +02:00
Aliaksandr Valialkin	51f2eb3c46	lib/workingsetcache: fix unaligned 64-bit atomic operation panic on 32-bit architectures ... The panic has been introduced in 7275ebf91a	2021-12-03 01:22:30 +02:00
Aliaksandr Valialkin	d40441947a	app: allow specifying http and https urls in the following command-line flags ... * -promscrape.config * -relabelConfig * -remoteWrite.relabelConfig * -remoteWrite.urlRelabelConfig	2021-12-03 00:11:47 +02:00
Aliaksandr Valialkin	daaea1eb2c	app/vmauth: follow-up for 13368bed18 ... * Document the ability to specify http or https urls in `-auth.config` at docs/CHANGELOG.md * Move the ReadFileOrHTTP to lib/fs, so it can be re-used in other places where a file should be read from the given path. For example, in `-promscrape.config` at `vmagent`.	2021-12-02 23:34:15 +02:00
Aliaksandr Valialkin	0f9aaf9cec	docs/CHANGELOG.md: cut v1.70.0	2021-12-02 15:01:39 +02:00
Aliaksandr Valialkin	8abf415225	docs/CHANGELOG.md: document 0afd14a14a	2021-12-02 14:51:57 +02:00
Aliaksandr Valialkin	b885a3b6e9	lib/httpserver: expose /-/healthy and /-/ready endpoints as Prometheus does ... This improves integration with third-party solutions, which rely on these endpoints. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1833	2021-12-02 14:37:50 +02:00
Aliaksandr Valialkin	d1289383eb	lib/protoparser/graphite: allow multiple separators between metric name, value and timestamp	2021-12-02 13:44:01 +02:00
Aliaksandr Valialkin	37a2bea072	lib/protoparser/graphite: properly parse Graphite line with whitespace after the timestamp ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1865	2021-12-02 13:33:50 +02:00
Aliaksandr Valialkin	ca9827fecc	docs/FAQ.md: mention that VictoriaMetrics can be queried via vmui	2021-12-02 13:16:34 +02:00
Aliaksandr Valialkin	2b7dee15dd	app/{vmbackup,vmrestore}: export internal metrics at /metrics http handler	2021-12-02 11:56:34 +02:00
Roman Khavronenko	fc4e59ec1d	vmalert: adjust topologies docs in README (#1893) ... Commit changes images width and order in topologies section for better readability. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-02 10:33:47 +02:00
Denys Holius	60a83fefbc	added guide-vmcluster-multiple-retention-setup to guides list (#1891)	2021-12-02 10:33:47 +02:00
Roman Khavronenko	6823818843	Vmalert docs upd (#1890) ... * vmalert: add topology examples in docs * vmalert: docs typo fix	2021-12-02 10:33:47 +02:00
Aliaksandr Valialkin	ab4be24397	app/vmstorage: export vm_cache_size_max_bytes metrics for determining capacity of various caches ... The vm_cache_size_max_bytes metric can be used for determining caches which reach their capacity via the following query: vm_cache_size_bytes / vm_cache_size_max_bytes > 0.9	2021-12-02 10:30:01 +02:00
Aliaksandr Valialkin	d4655beae8	lib/fs: add vm_filestream_read_duration_seconds_total and vm_filestream_write_duration_seconds_total metrics ... These metrics help determining persistent disk saturation with `rate(vm_filestream_read_duration_seconds_total) > 0.9`	2021-12-02 09:13:20 +02:00
Aliaksandr Valialkin	22e7b3c95a	README.md: add a link to https://docs.victoriametrics.com/guides/guide-vmcluster-multiple-retention-setup.html for multi-retention setups	2021-12-01 12:49:05 +02:00
Yurii Kravets	8e4aa91475	Create guide-vmcluster-multiple-retention-setup.md (#1888) ... * Create guide-vmcluster-multiple-retention-setup.md * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-01 12:42:56 +02:00
Yurii Kravets	38c9981a98	Add retention-scheme.png	2021-12-01 12:30:06 +02:00
Aliaksandr Valialkin	d0c0c599a5	docs/CHANGELOG.md: document 06eff5a72c ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/487	2021-12-01 12:30:03 +02:00
Aliaksandr Valialkin	bf6eb624f0	docs/Articles.md: added a link to https://mist.io/blog/2021-11-26-kubernetes-and-victoriametrics-in-Mist-v4-6	2021-11-30 15:00:05 +02:00
Aliaksandr Valialkin	5af9480e8e	docs/Single-server-VictoriaMetrics.md: document that the deduplication is applied only when exporting data in JSON line format ... The exported data isn't de-duplicated by default due to performance reasons. It is expected that the de-duplication is applied during importing the exported data. The deduplication is applied only when exporting data via /api/v1/export if `reduce_mem_usage=1` query arg isn't passed to the request. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-11-30 13:06:50 +02:00
Aliaksandr Valialkin	7b88daf2ec	docs/CHANGELOG.md: document 852a895b70	2021-11-30 01:22:59 +02:00
Aliaksandr Valialkin	fdca152322	docs/CHANGELOG.md: document f05cddd2fc ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1830	2021-11-30 01:16:16 +02:00
Aliaksandr Valialkin	cc773ac199	docs/CHANGELOG.md: document 9dd650f67f	2021-11-30 01:09:30 +02:00
Aliaksandr Valialkin	b7eb4bb6cb	docs/CHANGELOG.md: document 624ad73705	2021-11-30 01:05:29 +02:00
Aliaksandr Valialkin	e4c329f5a8	docs/CHANGELOG.md: document c6d5927281	2021-11-30 01:00:56 +02:00
Aliaksandr Valialkin	4ad397188e	lib/protoparser: do not log connection reset by peer error when reading the data via InfluxDB, Graphite and OpenTSDB protocols over plain TCP connections ... This error is expected, so there is no need in spamming the log with this error.	2021-11-29 21:58:11 +02:00
Aliaksandr Valialkin	4c466b27f1	docs/CHANGELOG.md: document 695cb617b2	2021-11-29 12:13:39 +02:00
Aliaksandr Valialkin	84decc4254	app/vmselect/promql: consistently return zero from deriv(const)	2021-11-17 18:01:58 +02:00
Aliaksandr Valialkin	e93f46187d	lib/persistentqueue: add vm_persistentqueue_read_duration_seconds_total and vm_persistentqueue_write_duration_seconds_total metrics for determining disk usage saturation at vmagent	2021-11-17 16:42:12 +02:00
Aliaksandr Valialkin	aa6d11a33f	app/vmselect/promql: add now() function, which returns the current timestamp as a floating-point value in seconds	2021-11-17 16:42:11 +02:00
Aliaksandr Valialkin	5610207549	docs: document -s3ForcePathStyle command-line option ... This is a follow-up for b72eed1f5e	2021-11-17 01:10:24 +02:00
vic	273fbc2e8a	Update Cluster-VictoriaMetrics.md (#1806) ... replicationFactor flag should be passed to vmselect instead of vminsert for improving query speed:)	2021-11-17 01:01:08 +02:00
Florian Klink	89650de497	docs/vmalert.md: document vmalert url flags a bit more cleanly (#1823) ... Describe remoteWrite.url is used to persist rules and alerts state info, and add an additional paragraph explaining the separation between -remoteRead.url and -datasource.url. Fixes #1810.	2021-11-17 00:56:52 +02:00
Aliaksandr Valialkin	71082c7df8	app/vmauth: add ability to override the username label value for vmauth_user_requests_total metric by specifying name option in -auth.config ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1805	2021-11-17 00:48:14 +02:00
Aliaksandr Valialkin	8fabca9f5d	docs/Single-server-VictoriaMetrics.md: add a link to vmalert rules backfilling at Backfilling chapter	2021-11-17 00:24:05 +02:00
Aliaksandr Valialkin	f1c0e9db25	docs/CHANGELOG.md: document the addition of vm_tenant_used_tenant_bytes metric, which shows the per-tenant disk usage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1605	2021-11-16 23:35:48 +02:00
Aliaksandr Valialkin	471c0ddd88	docs/Articles.md: add a linkt to OSA Con talk about how clickhouse inspired us to build victoriametrics	2021-11-12 14:21:42 +02:00
Aliaksandr Valialkin	82917398b9	docs/CHANGELOG.md: document bugfixes in enteprise versions of vmagent and vmalert	2021-11-12 13:24:37 +02:00
Aliaksandr Valialkin	fd4d665079	docs/Single-server-VictoriaMetrics.md: mention that it is possible to send gzipped data to /api/v1/import/prometheus	2021-11-09 20:45:54 +02:00
Aliaksandr Valialkin	305507930c	app/vmauth: initialize reverse proxy only after flag.Parse() is called ... This should properly take into accoun the `-maxIdleConnsPerBackend` command-line flag value. Previously it was hardcoded to 100. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1300	2021-11-09 19:23:44 +02:00
Aliaksandr Valialkin	bc357d7132	docs/vmalert.md: improve wording in Multitenancy chapter	2021-11-09 14:20:30 +02:00
Aliaksandr Valialkin	57aaf914ac	docs: mention that graphs on the official dashboards contain useful hints	2021-11-08 19:54:25 +02:00
Aliaksandr Valialkin	a352b59b7e	docs/MetricsQL.md: mention than tlast_over_time() is an alias for timestamp()	2021-11-08 18:29:59 +02:00
Aliaksandr Valialkin	b1de180886	docs/CHANGELOG.md: cut v1.69.0	2021-11-08 15:47:48 +02:00
Aliaksandr Valialkin	3a1ac218ba	app/vmselect/promql: add duration_over_time(m[d], max_interval) function ... This function calculates the actual lifetime of the time series on the given lookbehdind window `d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 13:14:57 +02:00
Aliaksandr Valialkin	62edbcdb23	docs/MetricsQL.md: clarify documentation for lifetime function ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 12:35:45 +02:00
Aliaksandr Valialkin	7cbb81c2a6	Makefile: add TAG=v... make publish-release rule for building and publishing a release for the given TAG	2021-11-08 12:29:24 +02:00
Aliaksandr Valialkin	2e237a6e8c	docs/CHANGELOG.md: document b9cdbcb5046315db96e1e7ca9923d09d0f30dc25	2021-11-08 12:13:32 +02:00
João Paulo	5bd3518e4d	docs: fix multiple typos (#1787) ... Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-11-05 20:46:06 +02:00
Aliaksandr Valialkin	9aa40fc0c3	docs/vmalert.md: document the addition of -defaultTenant.prometheus and -defaultTenant.graphite command-line options to enterprise version of vmalert	2021-11-05 20:04:53 +02:00
Aliaksandr Valialkin	31ac507bee	app/vmalert: remove rule.type config, since it doesnt play well with the upcoming default tenants for -clusterMode ... It is better from the consistency point of view to set up rule types at group level where tenant config is set up.	2021-11-05 19:52:41 +02:00
Aliaksandr Valialkin	847004fa77	app/{vminsert,vmagent}: hide passwords and auth tokens by default at /config page ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-05 14:42:13 +02:00
Denys Holius	a3182bc541	bumped grafana dashboards revisions for guides (#1784)	2021-11-05 11:50:41 +02:00
Aliaksandr Valialkin	c8b9d9e96e	docs/FAQ.md: mention that VictoriaMetrics can be queried via Graphite API	2021-11-04 22:38:33 +02:00
Aliaksandr Valialkin	63c29099ba	app/vmagent: add -remoteWrite.maxRowsPerBlock command-line option, which may be used for improving data ingestion performance under high load	2021-11-04 15:39:55 +02:00
Aliaksandr Valialkin	5f13ba8631	app/vmagent/remotewrite: send data to remote storage systems in parallel ... This should improve data ingestion speed many `-remoteWrite.url` options are configured	2021-11-04 15:04:02 +02:00
Roman Khavronenko	c78496d536	docs: make link to logos zip absolute (#1782) ... The relative link won't work for github-docs website, so we're changing it to absolute link. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-11-04 12:16:55 +02:00
Aliaksandr Valialkin	d445d22c0c	lib/promscrape: add -promscrape.maxResponseHeadersSize command-line flag for tuning the maximum http response headers size from Prometheus scrape targets	2021-11-03 22:27:55 +02:00
Aliaksandr Valialkin	a102fca4ac	app/vmselect/promql: add limit_offset(limit, offset, q) function, which can be used for paging over big number of time series ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1778	2021-11-03 16:03:10 +02:00
Aliaksandr Valialkin	43bf0333eb	app/vmselect/promql: add label_graphite_group() function for extracting groups from Graphite metric names	2021-11-03 13:20:34 +02:00
Aliaksandr Valialkin	8a490bf375	docs/CHANGELOG.md: document e3a91b186a	2021-11-02 18:39:52 +02:00
Aliaksandr Valialkin	551a94ba7f	app/{vmagent,vminsert}: add ability to restrict access to /config page with authKey query arg ... The authKey can be configured via `-configAuthKey` command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-01 16:47:30 +02:00
Aliaksandr Valialkin	7cf069ddfd	docs/Articles.md: add a link to https://valyala.medium.com/how-to-optimize-promql-and-metricsql-queries-85a1b75bf986	2021-10-29 14:03:27 +03:00
Aliaksandr Valialkin	94d9c06fc1	docs/vmauth.md: typo fix	2021-10-28 14:06:28 +03:00
Aliaksandr Valialkin	6873d6d893	lib/protoparser/influx: automatically detect timestamp precision depending on the number of decimal digits in the timestamp	2021-10-28 12:48:34 +03:00
Aliaksandr Valialkin	38cbae006a	app/vmbackupmanager: fix links to images ... This is a follow-up after bd6b8f7e31	2021-10-27 21:36:25 +03:00
Aliaksandr Valialkin	b626d6d606	lib/promscrape: add collapse and expand buttons per each group of targets from the same scrape job	2021-10-27 20:04:03 +03:00
Aliaksandr Valialkin	99784b21c1	all: fix build issues and tests for Apple M1 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1653	2021-10-27 15:07:19 +03:00
Aliaksandr Valialkin	f86dba1f5c	docs/CHANGELOG.md: mention the issue about missing proxy_url config option at /config page ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 22:07:07 +03:00
Aliaksandr Valialkin	ad445a06cd	lib/promscrape: properly show proxy_url option value at /config page ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 21:24:22 +03:00
Dima Lazerka	464f5d0910	Fix doc: vmbackup splits by 1 GiB not 100 MB (#1756) ... This is a follow-up for bdd0a1cdb2	2021-10-26 19:21:25 +03:00
Aliaksandr Valialkin	9e8697c6c3	docs/CHANGELOG.md: document 3dbdf1632e	2021-10-25 14:46:52 +03:00
Aliaksandr Valialkin	2d7d67372f	docs/Cluster-VictoriaMetrics.md: add links with the explanation of active time series and series churn rate	2021-10-24 18:39:16 +03:00
Aliaksandr Valialkin	30ade321a6	docs/CaseStudies.md: fix a link to AbisoGaming case study	2021-10-24 18:37:19 +03:00
Aliaksandr Valialkin	7ec253a3da	docs/CHANGELOG.md: typo fix	2021-10-22 21:13:03 +03:00
Aliaksandr Valialkin	1bdfa475f3	docs/CHANGELOG.md: cut v1.68.0	2021-10-22 19:38:01 +03:00
Aliaksandr Valialkin	1780c25e05	docs/vmauth.md: make docs-sync	2021-10-22 19:28:27 +03:00
Aliaksandr Valialkin	559dd996c4	app/vmauth: add ability to specify http headers to send in requests to backends ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1736	2021-10-22 19:11:35 +03:00
Aliaksandr Valialkin	fcdb0c415e	docs/CHANGELOG.md: document 43a7984cd8	2021-10-22 14:00:50 +03:00
Aliaksandr Valialkin	a8bcc3c276	lib/promscrape: reduce memory usage if -promscrape.noStaleMarkers command-line flag is passed ... Do not store in memory the response from the last scrape per each target if -promscrape.noStaleMarkers option is enabled. This should reduce memory usage when the scraped targets return large responses.	2021-10-22 13:22:08 +03:00
Aliaksandr Valialkin	ad40e70d39	docs/CHANGELOG.md: document a3684fe3de	2021-10-22 12:29:27 +03:00
Yury Molodov	3ccc37a98b	vmui: query history (#1732) ... * feat: add query history * fix: change detect keyUp for nav query history * feat: set default query history * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-22 12:29:27 +03:00
Aliaksandr Valialkin	5705f4b6d1	lib/httpserver: expose command-line flags at /flags page ... This should simplify debugging. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-20 00:46:54 +03:00
Aliaksandr Valialkin	5df7ef323f	docs/Single-server-VictoriaMetrics.md: add a link to VMUI at VictoriaMetrics playground	2021-10-19 14:42:35 +03:00
Aliaksandr Valialkin	948e9b8f50	docs/CHANGELOG.md: document 146a5b504c	2021-10-19 11:24:44 +03:00
Aliaksandr Valialkin	a7de3712e6	docs/CHANGELOG.md: document cbcc622786	2021-10-19 09:00:05 +03:00
Yury Molodov	744f6a98eb	vmui: features (#1711) ... * feat: initial uPlot graph * feat: add zoom/pan for graph * fix: add zoom by ctrl/mac * fix: remove unused code * feat: add toggle cache for fetch * feat: add fix y-axis limits * fix: stop point events while panning * fix: change getting cursor position when scaling * feat: add cursor tooltip to graph * fix: uninstall chart.js * fix: change link for create an issue * fix: set default cache value to true * app/vmalert: follow-up after 0e2486df56 * docs/CHANGELOG.md: document 5416e18007 * app/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-18 15:19:01 +03:00
Aliaksandr Valialkin	f87d43a5e4	docs/CHANGELOG.md: document 5416e18007	2021-10-18 15:08:44 +03:00
Aliaksandr Valialkin	9273b83cd0	app/vmalert: follow-up after 0e2486df56	2021-10-18 15:08:42 +03:00
Alexander Rickardsson	0e1dbcd039	vmalert: add disablePathAppend to remote read (#1712) ... * vmalert: add disablePathAppend to remoteRead * docs: add docs for remoteRead.disablePathAppend	2021-10-18 14:59:17 +03:00
Aliaksandr Valialkin	fbcc8b5c7d	lib/promscrape: set honor_timestamps: true by default if this option isnt set explicitly in scrape configs ... This aligns the behavior to Prometheus - see https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config	2021-10-16 20:48:53 +03:00
Aliaksandr Valialkin	102dd91ddd	docs/CaseStudies.md: add Smarkets case study	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	6e1d7d3c9c	docs/CaseStudies.md: add Fly.io case study	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	043c7119c8	docs/CaseStudies.md: add a case study for Razorpay	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	3e12eeaa3b	docs/CaseStudies.md: add AbiosGaming	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	24ffb606be	docs/CaseStudies.md: add Percona case study	2021-10-16 19:14:15 +03:00
Aliaksandr Valialkin	0a9be5ef9d	lib/promscrape: expose promscrape_series_limit_max_series and promscrape_series_limit_current_series metrics per each scrape target with the enabled unique series limiter	2021-10-16 19:14:13 +03:00
Aliaksandr Valialkin	0452a8d4e8	lib/promscrape: store the full response in stream parsing mode in scrapeWork.lastScrape byte slice ... This allows sending staleness marks and properly calculate scrape_series_added metric in stream parsing mode at the cost of the increased memory usage, since now the potentially big response is kept in the lastScrape byte slice per each scrapeWork. In practice the memory usage increase shouldn't be big, since the response size is usually much smaller than the parsed metrics from this response after the relabeling, which usually adds a big pile of target-specific labels per each metric.	2021-10-15 15:26:24 +03:00
Aliaksandr Valialkin	72c79d7689	docs/FAQ.md: improve wording on why MetricsQL isnt 100% compatible with PromQL	2021-10-14 16:23:17 +03:00
Aliaksandr Valialkin	ae1ee5ba4a	docs/CHANGELOG.md: document the change at 7fcbd3fa4b	2021-10-14 14:38:14 +03:00
Aliaksandr Valialkin	1beb38d476	docs/FAQ.md: add an entry explaining why MetricsQL isn't 100% compatible with PromQL	2021-10-14 12:50:24 +03:00
Aliaksandr Valialkin	25421fa2ae	lib/promscrape: add -promscrape.minResponseSizeForStreamParse command-line option for automatic switching to stream parsing mode when scraping targets with big responses ... This should reduce memory usage when vmagent scrapes targets with non-uniform response sizes. This is common case in Kubernetes monitoring.	2021-10-14 12:30:55 +03:00
Aliaksandr Valialkin	bee130cc78	lib/promscrape: return error if sample_limit or series_limit options are set when stream parsing mode is enabled	2021-10-14 12:30:54 +03:00
Aliaksandr Valialkin	73dbad3c2a	docs/CHANGELOG.md: document e3c8304deb	2021-10-13 16:44:34 +03:00
Aliaksandr Valialkin	5b7d90d178	lib/promscrape: add ability to show the original labels for discovered targets at /targets page ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1698	2021-10-13 16:44:34 +03:00
Aliaksandr Valialkin	9568961054	docs/MetricsQL.md: add missing blank line before the link to github.com/VictoriaMetrics/metricsql package	2021-10-13 15:11:46 +03:00
Aliaksandr Valialkin	c3a729d458	lib/promscrape: shard targets among cluster nodes after relabeling is applied ... This guarantees that targets with the same set of labels go to the same vmagent node. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1687#issuecomment-940629495	2021-10-12 17:06:37 +03:00
Aliaksandr Valialkin	aeedfe2fe2	app/vmagent: expose -promscrape.config contents at /config page as Prometheus does ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-12 16:27:37 +03:00
Aliaksandr Valialkin	1e56d19c09	docs/FAQ.md: add a solution against high churn rate	2021-10-12 10:33:08 +03:00
Roman Khavronenko	49a7ff62df	docs: mention "PromQL compliance" in MetricsQL docs (#1691)	2021-10-11 21:52:28 +03:00
Aliaksandr Valialkin	48c3668b3d	app/vmselect/promql: add atan2 binary operator, which is going to be added in Prometheus 2.31 ... See https://github.com/prometheus/prometheus/pull/9248	2021-10-11 21:17:23 +03:00
Aliaksandr Valialkin	b3d28f3872	app/vmselect/promql: add missing trigonometric functions, which are going to be added in Prometheus 2.31 ... See https://github.com/prometheus/prometheus/issues/9233	2021-10-11 21:17:21 +03:00
Aliaksandr Valialkin	d00f8b8800	docs/MetricsQL.md: clarify docs for union() function	2021-10-11 17:41:10 +03:00
Denys Holius	6199bd28a2	Added some fixes (#1690) ... * removed not needed description * added some fixes and fixed typos	2021-10-11 12:42:18 +03:00
Aliaksandr Valialkin	f17c4b74c5	docs/MetricsQL.md: add a link to https://medium.com/@romanhavronenko/victoriametrics-promql-compliance-d4318203f51e	2021-10-11 11:02:03 +03:00
Roman Khavronenko	de4fbe9402	docs: add "PromQL compliance" article (#1689) ... * docs: add "PromQL compliance" article * Update docs/Articles.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-11 11:01:59 +03:00
Aliaksandr Valialkin	f1e1d20ac4	app/vmselect/promql: consistently return the same set of time series from limitk() function ... This is the expected behaviour by most users.	2021-10-08 19:55:29 +03:00
Aliaksandr Valialkin	a7a1305395	lib/storage: fix unaligned access on 32-bit architectures. ... The bug has been introduced at a171916ef5	2021-10-08 19:38:20 +03:00
Denys Holius	d1ecffb0f6	Added fixes and improvements (#1677) ... * added guide for VM operator * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Fixed different typos and added improvements from proposals * move remoteWrite.url to other place * fixed typo * rephrased vminsert explanation * remove not needed parameters for default setup Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-10-08 18:58:42 +03:00
Aliaksandr Valialkin	aae6f7dfd0	docs/CHANGELOG.md: cut v1.67.0	2021-10-08 16:00:43 +03:00
Aliaksandr Valialkin	cf87050d83	app/vmui: follow-up after 7bfb44113e ... * Run `vmui-update` * Document the changes in README.md and CHANGELOG.md	2021-10-08 15:11:09 +03:00
Aliaksandr Valialkin	4fddcf4c83	app/{vminsert,vmstorage}: follow-up after a171916ef5 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-10-08 14:09:51 +03:00
Aliaksandr Valialkin	64b6f3f1c8	app/vminsert: fix uneven distribution of time series among storage nodes ... Use distinct seed for distribution hash calculations on the second level of vminsert nodes. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1672	2021-10-07 12:22:39 +03:00
Aliaksandr Valialkin	cea79d2013	docs/guides: follow-up after 05a1396247	2021-10-06 14:47:28 +03:00
Thomas Danielsson	8d26b0f3f5	fix: typo metric_relabel_configs (#1674) ... metric_ralabel_configs -> metric_relabel_configs	2021-10-06 14:47:26 +03:00
Ziqi Zhao	1db3aeab36	fix some typos (#1678) ... Co-authored-by: 柘远 <zzq237937@alibaba-inc.com>	2021-10-06 14:43:56 +03:00
Aliaksandr Valialkin	89700433cc	docs/vmagent.md: update docs after 3e9a939a990c8b608414388c96f68eb062364ae7	2021-10-05 10:23:37 +03:00
Aliaksandr Valialkin	a9420317d9	docs/vmagent.md: document how to write data to Kafka	2021-09-30 17:46:23 +03:00
Aliaksandr Valialkin	ec6eb03d65	app/vmselect/promql: add topk_last and bottomk_last functions	2021-09-30 13:23:27 +03:00
Aliaksandr Valialkin	d51118e226	app/vminsert: document that -relabelConfig is reloaded on SIGHUP signal	2021-09-29 21:17:25 +03:00
Aliaksandr Valialkin	ae76ceb5f1	docs/CHANGELOG.md: link to Kafka integration docs	2021-09-29 12:31:59 +03:00
Aliaksandr Valialkin	8dcf814c48	app/{vmbackup,vmrestore}: switch from gcs://... to gs://... urls for backups to GCS ... The `gs://` urls are commonly used, so prefer them instead of `gcs://` urls, while leaving support for `gcs://` urls for backwards compatibility.	2021-09-29 12:12:37 +03:00
Aliaksandr Valialkin	f35f9188bc	docs/vmagent.md: update Telegraf config in the section about Kafka	2021-09-29 12:01:46 +03:00
Aliaksandr Valialkin	16d7ee7b44	docs/vmagent.md: add docs about reading metrics from Kafka	2021-09-29 01:46:40 +03:00
Aliaksandr Valialkin	428c03c3b8	docs/CHANGELOG.md: document the bugfix from de810031bf	2021-09-29 00:42:21 +03:00
Aliaksandr Valialkin	2577e7c306	docs/CHANGELOG.md: document 3d17112a7e	2021-09-29 00:33:41 +03:00
Aliaksandr Valialkin	4e65bfcc00	app/{vminsert,vmagent}: add ability to ingest data via DataDog "submit metrics" API ... See https://docs.datadoghq.com/api/latest/metrics/#submit-metrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/206	2021-09-29 00:12:26 +03:00
Yury Molodov	80df31b2ee	vmui: use Chart.js as default engine for graph (#1634) ... * feat: add Plotly as default engine for graph * fix: remove unused components * feat: use Chart.js as default engine graph * fix: correct styles for loader * feat: add zoom/pan for chart * feat: add height for chart * fix: remove unused code * fix: remove empty units from duration * fix: change debounce for pan to 500ms * fix: add utility for plugins register globally * fix: optimize render graph * feat: add buffer data for zoom * fix: add limits for zoom in/out * fix: change update data while zooming * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-09-27 22:27:49 +03:00
Aliaksandr Valialkin	4b3951fd86	app/vmselect/promql: add rollup_scrape_interval(m[d]) function ... It calculates the min, max and avg scrape intervals for m over the given lookbehind window d	2021-09-27 19:21:55 +03:00
Aliaksandr Valialkin	eff31c10ec	app/vmselect/promql: follow-up after 526dd93b32 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1625 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-27 18:57:03 +03:00
Aliaksandr Valialkin	a957d420f4	docs/BestPractices.md ... docs/BestPractices.md: update the doc	2021-09-27 17:51:57 +03:00
Aliaksandr Valialkin	1115c2f235	app/vmselect/promql: align the behavior of or, and and unless operators with on (labels) modifier to Prometheus ... Previously VictoriaMetrics could return unexpected result of the right-hand side operand had multiple time series with the given set of labels mentioned in `on(labels)`. See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1643	2021-09-24 00:56:35 +03:00
Aliaksandr Valialkin	6fbfa026ca	docs/CHANGELOG.md: cut v1.66.2	2021-09-23 22:53:27 +03:00
Aliaksandr Valialkin	d15d036a5a	lib/storage: properly handle {__name__=~"prefix(suffix1|suffix2)",other_label="..."} queries ... They were broken in the commit 00cbb099b6 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1644	2021-09-23 21:52:31 +03:00
Aliaksandr Valialkin	f93146c81e	docs: make docs-sync	2021-09-23 20:55:29 +03:00
Aliaksandr Valialkin	7edb65a9a3	docs/CHANGELOG.md: document 0e35fc9538 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1641	2021-09-23 20:47:56 +03:00
Aaron France	e398d83829	fix: typo in vmagent.md (#1642)	2021-09-23 20:47:56 +03:00
Aliaksandr Valialkin	d8de26bbfd	lib/promscrape: add vm_promscrape_max_scrape_size_exceeded_errors_total metric for counting of the failed scrapes due to the exceeded response size ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1639	2021-09-23 14:48:16 +03:00
Aliaksandr Valialkin	9b76515216	docs/CaseStudies.md: add a case study for Grammarly	2021-09-23 13:12:20 +03:00
Aliaksandr Valialkin	e128915c6e	docs/Articles.md: add https://cer6erus.medium.com/superset-bi-with-victoria-metrics-a109d3e91bc6	2021-09-23 10:44:14 +03:00
Aliaksandr Valialkin	5e5d5fa8fb	docs/CaseStudies.md: fix a link to third-party articles	2021-09-22 03:53:08 +03:00
Aliaksandr Valialkin	47422e9918	docs/CHANGELOG.md: cut v1.66.1	2021-09-22 01:47:26 +03:00
Aliaksandr Valialkin	25361d176d	docs/CHANGELOG.md: document 9ca1cbced1 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1635	2021-09-21 23:17:26 +03:00
Aliaksandr Valialkin	c3e1f87048	lib/promrelabel: fix parsing regex: true in relabeling rules	2021-09-21 23:01:40 +03:00
Aliaksandr Valialkin	3f1104ea74	app/vmselect: fix accessing /graphite/* endpoints	2021-09-21 14:06:18 +03:00
Aliaksandr Valialkin	e8700b57b9	docs/vmagent.md: typo fix	2021-09-20 16:49:32 +03:00
Aliaksandr Valialkin	233c6a8a82	docs/vmagent.md: typo fixes in Prometheus staleness markers docs	2021-09-20 16:44:42 +03:00
Aliaksandr Valialkin	d43ebb8314	docs/CHANGELOG.md: cut v1.66.0	2021-09-20 15:20:36 +03:00
n4mine	a5fcc9e356	fix: typo, dddresses -> addresses (#1630)	2021-09-20 14:27:34 +03:00
Aliaksandr Valialkin	4150772ef8	docs/Articles.md: add a link to Open-source strategy at VictoriaMetrics	2021-09-20 11:46:38 +03:00
Aliaksandr Valialkin	76c650bbda	app/vmselect/promql: add quantiles_over_time("phiLabel", phi1, ..., phiN, m[d]) function for calculating multiple quantiles at once	2021-09-17 23:35:04 +03:00
Aliaksandr Valialkin	727521d20a	docs/CHANGELOG.md: document 0e09fdb8b0	2021-09-17 18:47:39 +03:00
Aliaksandr Valialkin	81d24045c2	app/vmselect/promql: add histogram_quantiles("phiLabel", phi1, ..., phiN, buckets) function ... This function calculates multiple quantiles over the given buckets at once Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1573	2021-09-17 13:39:06 +03:00
Aliaksandr Valialkin	9333c4111e	docs/CHANGELOG.md: document the change in enterprise apps, which allows passing -version without -eula flag ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1621	2021-09-17 12:38:22 +03:00
Aliaksandr Valialkin	f9910113b5	docs/FAQ.md: extend VictoriaMetrics vs TimescaleDB section with real user experience ... See also https://github.com/timescale/promscale/issues/427 , which is mentioned in the https://abiosgaming.com/press/high-cardinality-aggregations/	2021-09-16 20:47:15 +03:00
Roman Khavronenko	cec67a3129	docs: fix indentation for FAQ document (#1620)	2021-09-16 14:01:22 +03:00
Aliaksandr Valialkin	3f8de4f82f	app/vmselect/promql: add mad(q) and outliers_mad(tolerance, q) functions to MetricsQL	2021-09-16 13:35:38 +03:00
Aliaksandr Valialkin	7ad54041fe	app/{vminsert,vmselect}: automatically add missing port in -storageNode lists passed to vminsert and vmselect ... This should simplify manual setup of the cluster according to https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#cluster-setup	2021-09-15 18:04:30 +03:00
Aliaksandr Valialkin	9ebccddfc2	docs/CHANGELOG.md: document 777ff75874	2021-09-15 17:45:18 +03:00
Aliaksandr Valialkin	e67b4fca11	vendor: update github.com/valyala/histogram from v1.1.2 to v1.2.0 ... This fixes the non-repeatable quantile_over_time() results when the number of input samples exceeds 1000. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-15 09:35:40 +03:00
Roman Khavronenko	45cce85bf4	docs: add "Choosing a Time Series Database for High Cardinality Aggregations" article (#1617)	2021-09-15 09:35:38 +03:00
Aliaksandr Valialkin	63fb5a5ca5	docs/vmalert.md: follow-up after 68721f6e7d ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1608	2021-09-14 14:48:45 +03:00
Dima Lazerka	5a256970d6	Remove port 3000 and add https to play-grafana link (#1616) ... * Remove port 3000 and add https to play-grafana link * Fix typo Co-authored-by: Dzmitry Lazerka <dlazerka@gmail.com>	2021-09-14 14:27:16 +03:00
Aliaksandr Valialkin	1493461244	lib/storage: follow up after 00cbb099b6	2021-09-14 14:23:02 +03:00
Aliaksandr Valialkin	5e5ce27df7	app/vmauth: do not log invalid auth tokens by default for security reasons ... The logging can be enabled by passing `-logInvalidAuthTokens` command-line flag to vmauth	2021-09-14 12:20:17 +03:00
Aliaksandr Valialkin	d3289bf276	docs/Single-server-VictoriaMetrics.md: link to cardinality limiter docs in vmagent	2021-09-13 21:27:25 +03:00
Aliaksandr Valialkin	a8f1b614e5	docs/vmagent.md: mention out of order sample errors, which are typically emitted by Thanos, Cortex or Prometheus	2021-09-13 19:36:09 +03:00
Aliaksandr Valialkin	a1b298a842	app/vminsert/netstorage: disable rerouting by default ... Production clusters work more stable with the disabled rerouting during rolling restarts and/or during spikes in time series churn rate. So it would be better disabling the rerouting by default. The re-routing can be enabled by passing `-disableRerouting=false` command-line flag to `vminsert` nodes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/791 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1054 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1165	2021-09-13 18:50:47 +03:00
Aliaksandr Valialkin	2932f495f3	docs/CHANGELOG.md: document 5494bc02a6	2021-09-13 17:14:45 +03:00
Aliaksandr Valialkin	184e145570	docs: consistency renaming: Influx -> InfluxDB	2021-09-13 17:14:45 +03:00
Aliaksandr Valialkin	b721110902	docs/vmbackup.md: update the outdated link to vmbackupmanager	2021-09-13 14:17:53 +03:00
Aliaksandr Valialkin	19516aedb5	app/vmselect/promql: use Prometheus-compatible label value formatting for count_values function	2021-09-13 13:48:18 +03:00
Aliaksandr Valialkin	b684624f67	lib/promscrape/discovery/docker: support host networking mode ... See https://github.com/prometheus/prometheus/issues/9116	2021-09-13 13:30:55 +03:00
Aliaksandr Valialkin	6ed9f10da5	lib/promscrape/discovery/kubernetes: properly use https scheme for wildcard TLS certificates in ingress target discovery ... See https://github.com/prometheus/prometheus/issues/8902	2021-09-13 13:04:43 +03:00
Aliaksandr Valialkin	d90834da70	lib/promscrape: generate scrape_timeout_seconds metric per each scrape target in the same way as Prometheus 2.30 does ... See https://github.com/prometheus/prometheus/pull/9247	2021-09-12 15:21:26 +03:00
Aliaksandr Valialkin	6c97388dde	lib/promscrape: add ability to configure scrape_timeout and scrape_interval via relabeling ... See https://github.com/prometheus/prometheus/pull/8911	2021-09-12 13:35:20 +03:00
Aliaksandr Valialkin	09670479cd	lib/promscrape: reduce CPU usage for common case when calculating scrape_series_added metric ... Also reduce CPU usage when applying `series_limit` to scrape targets with constant set of metrics. The main idea is to perform the calculations on scrape_series_added and series_limit only if the set of metrics exposed by the target has been changed. Scrape targets rarely change the set of exposed metrics, so this optimization should reduce CPU usage in general case.	2021-09-12 12:53:45 +03:00
Aliaksandr Valialkin	2b64c1c95e	docs/Single-server-VictoriaMetrics.md: refer to relabeling section for vmagent ... This removes duplicate docs about additional relabeling actions supported by VictoriaMetrics components	2021-09-12 11:40:23 +03:00
Aliaksandr Valialkin	def0430318	docs/vmagent.md: sync with app/vmagent/README.md by running make docs-sync	2021-09-11 11:05:12 +03:00
Aliaksandr Valialkin	5aaaa686a4	lib/promscrape: send stale markers for disappeared metrics like Prometheus does	2021-09-11 11:02:56 +03:00
Aliaksandr Valialkin	e1632dc0df	docs/vmalert.md: typo fix in Multitenancy chapter	2021-09-10 17:57:43 +03:00
Aliaksandr Valialkin	c2f37f049b	lib/storage: properly search series by multiple tag filters matching empty labels such as foo{bar=~"baz|",x=~"y|"} ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1601 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/395	2021-09-09 21:12:53 +03:00
Aliaksandr Valialkin	9b07cb2988	app/vmselect/promql: keep metric name in rollup_candlestick results, since they don't change the original series meaning ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1600	2021-09-09 19:24:10 +03:00
Aliaksandr Valialkin	09edcfd21c	docs/CHANGELOG.md: typo fix	2021-09-09 18:58:03 +03:00
Aliaksandr Valialkin	d613a018c8	lib/promscrape: add ability to set series_limit and stream_parse options via relabeling ... This allows managing these options on a per-target basis. Typical use case: to manage these options for pods via Kubernetes annotations.	2021-09-09 18:51:23 +03:00
Aliaksandr Valialkin	986807ebd9	docs/vmagent.md: typo fix in Relabeling chapter	2021-09-09 16:39:34 +03:00
Aliaksandr Valialkin	75c3514c5c	lib/promrelabel: add keep_metrics and drop_metrics actions to relabeling rules ... These actions simlify metrics filtering. For example, - action: keep_metrics regex: 'foo|bar|baz' would leave only metrics with `foo`, `bar` and `baz` names, while the rest of metrics will be deleted. The commit also makes possible to split long regexps into multiple lines. For example, the following config is equivalent to the config above: - action: keep_metrics regex: - foo - bar - baz	2021-09-09 16:25:09 +03:00
Aliaksandr Valialkin	708ebd59ad	docs/vmalert.md: make docs-sync after 21f022e5f0	2021-09-09 16:25:08 +03:00
Aliaksandr Valialkin	2b19dd8601	docs/MetricsQL.md: add a link to VictoriaMetrics github	2021-09-08 00:15:34 +03:00
Aliaksandr Valialkin	608ed19655	app/vmalert: follow-up after 21f022e5f0	2021-09-07 22:45:47 +03:00
Aliaksandr Valialkin	9be7294331	docs/CHANGELOG.md: document 42e07cfaea	2021-09-07 22:32:01 +03:00
Aliaksandr Valialkin	304661c547	docs/vmagent.md: add API path for Prometheus text exposition format	2021-09-07 16:15:28 +03:00
Aliaksandr Valialkin	c5e030dfc4	docs/Articles.md: add a link to case studies	2021-09-06 10:58:48 +03:00
Aliaksandr Valialkin	52b44945a0	docs/Articles.md: add an url to https://www.vultr.com/docs/install-and-configure-victoriametrics-on-debian	2021-09-03 11:50:23 +03:00
Aliaksandr Valialkin	9f816dfee8	docs/Single-server-VictoriaMetrics.md: fix a link multitenancy docs for cluster version in VictoriaMetrics	2021-09-02 17:44:22 +03:00
Aliaksandr Valialkin	a88b02287d	docs/CHANGELOG.md: cut v1.65.0	2021-09-01 17:12:44 +03:00
Aliaksandr Valialkin	41af6a73fe	docs/FAQ.md: add questions on how to migrate data from various systems (Prometheus, InfluxDB, OpenTSDB, Graphite) to VictoriaMetrics	2021-09-01 16:48:05 +03:00
Aliaksandr Valialkin	5c58c8d55e	docs: update -help output for victoria-metrics and vmagent after f77dde837a	2021-09-01 16:35:18 +03:00
Aliaksandr Valialkin	c4df601f43	lib/promscrape: add the ability to limit the number of unique series per each scrape target ... The number of series per target can be limited with the following options: * Global limit with `-promscrape.maxSeriesPerTarget` command-line option. * Per-target limit with `max_series: N` option in `scrape_config` section. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1561	2021-09-01 16:08:12 +03:00
Aliaksandr Valialkin	835efb111e	docs: make docs-sync	2021-09-01 12:25:17 +03:00
Aliaksandr Valialkin	816d4b6095	docs/CHANGELOG.md: document eff940aa76	2021-09-01 12:25:11 +03:00
Aliaksandr Valialkin	22bb18a449	docs/CHANGELOG.md: document 7c70dcbe3b ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1471	2021-09-01 12:25:04 +03:00
Nikolay	210c76b51e	adds external_labels per group for vmalert (#1485) ... * adds external_label per group for vmalert https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1471	2021-09-01 12:19:49 +03:00
Aliaksandr Valialkin	9723ac30dd	docs/Single-server-VictoriaMetrics.md: remove outdated link to VictoriaMetrics wiki ... VictoriaMetrics wiki became outdated after publishing all the docs at https://docs.victoriametrics.com	2021-08-31 11:53:38 +03:00
Aliaksandr Valialkin	b3d240f7b4	docs/CHANGELOG.md: add a link to Prometheus staleness tracking	2021-08-31 11:53:38 +03:00
Aliaksandr Valialkin	146c14d879	lib/promscrape/discovery/kubernetes: return back support role: endpointslices, since it is used by VictoriaMetrics operator ... This is a follow up commit after 31b42b30b6	2021-08-29 12:37:36 +03:00
Aliaksandr Valialkin	18d7adf731	lib/protoparser/opentsdb: follow-up after 8ee75ca45a	2021-08-29 11:50:01 +03:00
Aliaksandr Valialkin	ca61d7c82b	lib/promscrape/discovery/kubernetes: rename role: endpointslices to role: endpointslice to be consistent with Prometheus ... See 2ec6c7dbb8/discovery/kubernetes/kubernetes.go (L99)	2021-08-29 11:23:59 +03:00
Aliaksandr Valialkin	327034b54f	lib/promscrape/discovery/kubernetes: use v1 API instead of v1beta1 API for role: ingress and role: endpointslices ... This should fix service discovery for these roles in Kubernetes v1.22 and newer versions. See https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122 The corresponding change in Prometheus - https://github.com/prometheus/prometheus/pull/9205	2021-08-29 11:23:58 +03:00
Aliaksandr Valialkin	0e809bd4b6	docs/Single-server-VictoriaMetrics.md: mention that downsampling doesnt improve query performance on high churn rate	2021-08-27 18:51:28 +03:00
Aliaksandr Valialkin	39bb6bdd79	app/vmselect/promql: add quantile("phiLabel", phi1, ..., phiN, q) aggregate function to MetricsQL ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1573	2021-08-27 18:40:25 +03:00
Aliaksandr Valialkin	14d4b5aa83	app/vmselect: add -search.disableAutoCacheReset command-line option for disabling automatic cache reset when a sample with old timestamp outside -search.cacheTimestampOffset is inserted ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1570	2021-08-27 17:17:43 +03:00
Aliaksandr Valialkin	6e5864b014	docs/{vmgateway,vmbackupmanager}: mention that enterprise binaries are free for download and evaluation	2021-08-27 14:53:48 +03:00
Aliaksandr Valialkin	adf71a415e	docs: link to active time series, churn rate and high cardinality questions	2021-08-27 14:45:36 +03:00
Aliaksandr Valialkin	1a7646c142	docs/CHANGELOG.md: document the bugfix for possible timeout error in vmbackupmanager when making snapshots ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1571	2021-08-27 13:04:33 +03:00
Aliaksandr Valialkin	125a94e6ca	docs: mention that enterprise binaries can be downloaded and evaluated for free	2021-08-27 12:48:51 +03:00
Aliaksandr Valialkin	102ab795f8	docs/vmagent.md: document the ability to load scrape configs from multiple files ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1559	2021-08-26 09:13:54 +03:00
Aliaksandr Valialkin	7fdb4db73d	lib/promscrape: add ability to load scrape configs from multiple files ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1559	2021-08-26 08:51:53 +03:00
Aliaksandr Valialkin	8d843d0754	docs/CHANGELOG.md: document 48f33d098b	2021-08-25 13:32:05 +03:00
Aliaksandr Valialkin	874660a4ae	docs/Cluster-VictoriaMetrics.md: mention that the -replicationFactor at vmselect is an optional parameter	2021-08-25 13:10:31 +03:00
Aliaksandr Valialkin	4a2d7aec7f	lib/promscrape: expose promscrape_discovery_http_errors_total metric for tracking errors per each http_sd config	2021-08-25 13:05:29 +03:00
Aliaksandr Valialkin	b885bd9b7d	lib/{mergeset,storage}: improve the detection of the needed free space for background merge ... This should prevent from possible out of disk space crashes during big merges. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1560	2021-08-25 10:01:09 +03:00
Aliaksandr Valialkin	ae8ec78c63	docs/FAQ.md: add more entries for frequently asked questions ... The following topics are covered: * Active time series * High cardinality * High churn rate * Slow inserts	2021-08-24 11:34:31 +03:00
Aliaksandr Valialkin	9b39e078c0	docs/MetricsQL.md: typo fix: histogram_qunatile -> histogram_quantile	2021-08-23 23:08:28 +03:00
Aliaksandr Valialkin	3eca49c4a6	docs/MetricsQL.md: fix the indentation for median function	2021-08-23 12:04:43 +03:00
Aliaksandr Valialkin	a4948d92b5	docs/MetricsQL.md: typo fix: convesions->conversions	2021-08-23 12:01:34 +03:00
Aliaksandr Valialkin	8b9dc45c3c	docs/MetricsQL.md: typo fixes	2021-08-23 12:00:17 +03:00
Aliaksandr Valialkin	5917c72ddd	docs/MetricsQL.md: rehaul the documentation on MetricsQL ... * Document all the functions supported by MetricsQL, including PromQL functions * Group functions by their type: rollup functions, transform functions, label manipulation functions and aggregate functions. * Document implicit query transformations.	2021-08-23 11:46:30 +03:00
Aliaksandr Valialkin	40b06e84f8	app/vmselect/promql: rename sign() function to sgn() in order to be consistent with Prometheus ... See https://github.com/prometheus/prometheus/pull/8457 for details.	2021-08-23 11:46:29 +03:00
Aliaksandr Valialkin	8493159eed	deployment/docker: update Go builder from Go1.16.7 to Go1.17.0 ... This improves data ingestion and query performance by up to 5% according to benchmarks. See https://go.dev/blog/go1.17	2021-08-21 22:22:31 +03:00
Aliaksandr Valialkin	67bc407747	lib/promscrape: reduce memory and CPU usage when Prometheus staleness tracking is enabled for metrics from deleted / disappeared scrape targets ... Store the scraped response body instead of storing the parsed and relabeld metrics. This should reduce memory usage, since the response body takes less memory than the parsed and relabeled metrics. This is especially true for Kubernetes service discovery, which adds many long labels for all the scraped metrics. This should also reduce CPU usage, since the marshaling of the parsed and relabeld metrics has been substituted by response body copying. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526	2021-08-21 21:24:07 +03:00
Aliaksandr Valialkin	ff4c7c1a3d	docs/vmalert.md: run make docs-sync after 9ee3d0378f	2021-08-21 20:25:26 +03:00
Aliaksandr Valialkin	388e07b37f	docs/CHANGELOG.md: document 9ee3d0378f	2021-08-21 20:23:22 +03:00
Aliaksandr Valialkin	3454f25e0f	docs/CHANGELOG.md: document b5d6a0e499	2021-08-19 14:07:00 +03:00
Aliaksandr Valialkin	2e1eb33bfd	docs/CHANGELOG.md: clarify the change, which adds -search.noStaleMarkers command-line flag	2021-08-19 13:55:43 +03:00
Aliaksandr Valialkin	ee1f3414d1	app/vmselect/promql: do not override [d] at last_over_time(m[d]) if [d] is smaller than scrape_interval ... Since most users do not expect the overriding of explicitly set `[d]`.	2021-08-19 10:33:10 +03:00
Aliaksandr Valialkin	47a37b8cfc	docs/CHANGELOG.md: cut v1.64.1 ... This is mostly bugfix release, which includes fixes for staleness handling and a security update for Alpine base image	2021-08-18 22:07:05 +03:00
Aliaksandr Valialkin	8ee575dee9	lib/promscrape: send stale markers for the previously scraped metrics on failed scrapes like Prometheus does	2021-08-18 22:00:46 +03:00
Aliaksandr Valialkin	355690a719	docs/CHANGELOG.md: document 06bf21c21b	2021-08-18 14:01:42 +03:00
Aliaksandr Valialkin	5d92fafc40	app/vmselect: add -search.noStaleMarkers command-line flag for disabling stale markers handling in queries ... This option allows reducing CPU usage a bit when VictoriaMetrics is used for collecting and processing non-Prometheus data. For example, InfluxDB line protocol, Graphite, OpenTSDB, CSV, etc.	2021-08-18 13:58:06 +03:00
Aliaksandr Valialkin	f21fad53b4	lib/promscrape: add ability to disable sending Prometheus staleness markers with -promscrape.disableStaleMarkers command-line flag ... This option can be useful when vmagent consumes too much additional memory for staleness markers functionality and when staleness markers aren't needed.	2021-08-18 13:58:05 +03:00
Aliaksandr Valialkin	49886ecbc8	app/vmselect/promql: add bitmap_and(), bitmap_or() and bitmap_xor() functions to MetricsQL ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1541	2021-08-17 13:22:15 +03:00
Aliaksandr Valialkin	130a5cab7e	docs/Single-server-VictoriaMetrics.md: mention that vmctl can migrate data from OpenTSDB to VictoriaMetrics	2021-08-17 11:17:38 +03:00
Aliaksandr Valialkin	db34c40aec	lib/promscrape: stop scrapers for the removed targets before starting scrapers for the added targets ... This should prevent from possible time series overlap when old target is substituted by new target (for example, during Kubernetes deployments). Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1530 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/748 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1509	2021-08-17 01:00:40 +03:00
Aliaksandr Valialkin	fe8c462044	app/vmalert: mention -remoteWrite.disablePathAppend in the description for -remoteWrite.url	2021-08-16 15:23:39 +03:00
Aliaksandr Valialkin	21974cb571	app/vmalert: follow-up for 2400f85761	2021-08-16 15:20:35 +03:00
Aliaksandr Valialkin	a47c1a734a	docs/CHANGELOG.md: update urls to Prometheus 2.29 release ... Previously these urls were pointing to rc0 release	2021-08-16 14:58:05 +03:00
Aliaksandr Valialkin	f05e827757	docs/CHANGELOG.md: typo fix: satureated -> saturated	2021-08-16 14:58:05 +03:00
Alexander Rickardsson	d27dc3721b	vmalert: enable configuring explicit path (#1536) ... * vmalert: allow to disable automatically added path to remote write address via disablePathAppend flag * docs: update docs to include remoteWrite.disablePathAppend	2021-08-16 14:58:05 +03:00
Aliaksandr Valialkin	75a0345215	docs/CHANGELOG.md: cut v1.64.0	2021-08-15 23:52:24 +03:00
Aliaksandr Valialkin	5f13c519ee	lib/promscrape: restore red highlighting for DOWN targets at /targets page ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1461	2021-08-15 16:04:33 +03:00
Aliaksandr Valialkin	175727dace	docs/CHANGELOG.md: mention the bugfix when more than 27 time series are selected at /vmui	2021-08-15 15:11:13 +03:00
Aliaksandr Valialkin	b09b035d3e	docs/CHANGELOG.md: mention that VMUI automatically fills Server URL field ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1506	2021-08-15 14:45:59 +03:00
Aliaksandr Valialkin	48920bdef8	app/vmagent/remotewrite: expose vmagent_remotewrite_send_duration_seconds_total metric ... This metric can be used for determining high saturation of every connection to remote storage with an alerting query `rate(vmagent_remotewrite_send_duration_seconds_total) > 0.9s`. This query triggers when a connection is satureated by more than 90%	2021-08-15 13:34:07 +03:00
Aliaksandr Valialkin	c1f81f08d4	all: add support for Prometheus staleness markers ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/748 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1509 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1530 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/845	2021-08-13 12:13:15 +03:00
Aliaksandr Valialkin	7feb62eea9	docs/Cluster-VictoriaMetrics.md: meniton that vmagent can be used for replicating the data among multiple clusters ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1491	2021-08-12 12:47:08 +03:00
Denys Holius	1491767a9e	added guide for HA monitoring setup in K8s via VM Cluster (#1523) ... * added guide for HA monitoring setup in K8s via VM Cluster * fixed missed divs * fixed different typos * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-08-11 13:42:53 +03:00
Aliaksandr Valialkin	9eb828b2c2	app/vminsert: add vm_rpc_send_duration_seconds_total metric per each vminsert->vmstorage link ... This metric is useful for determining high link saturation with the following alerting rule: rate(vm_rpc_send_duration_seconds_total) > 0.9s	2021-08-11 11:42:33 +03:00
Aliaksandr Valialkin	3df6550153	docs/Cluster-VictoriaMetrics.md: update -help output for cluster components after the d375d9b878	2021-08-11 11:39:09 +03:00
Aliaksandr Valialkin	518d0aba18	docs: make docs-sync after e0ee69797d	2021-08-11 10:54:28 +03:00
Aliaksandr Valialkin	90efb5831b	lib/envflag: add a link to docs for -envflag.enable	2021-08-11 10:32:40 +03:00
Aliaksandr Valialkin	d5ca07bd71	docs/CHANGELOG.md: document new metrics added to vmalert at 7416fdaa8b	2021-08-05 10:12:53 +03:00
Aliaksandr Valialkin	13d438d808	app/vmagent: typo fix in the description for -remoteWrite.queues	2021-08-05 10:00:58 +03:00
Aliaksandr Valialkin	b877538622	app/vmagent: follow-up after fe445f753b ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1491	2021-08-05 09:51:00 +03:00
Aliaksandr Valialkin	44bf4cabea	docs/Articles.md: actualize links and re-order some links	2021-08-03 16:11:30 +03:00
Aliaksandr Valialkin	77bb9e1656	lib/promscrape/discovery/gce: add __meta_gce_interface_ipv4_<name> labels as in Prometheus 2.29 ... See https://github.com/prometheus/prometheus/pull/8978	2021-08-03 15:51:45 +03:00
Aliaksandr Valialkin	336a2aa2e0	lib/promscrape/discovery/ec2: add __meta_ec2_availability_zone_id label as Prometheus 2.29 does	2021-08-03 13:28:13 +03:00
Aliaksandr Valialkin	60cfa5f100	app/vmselect/promql: add present_over_time(m[d]) function, which will be available starting from Prometheus 2.29.0 ... See https://github.com/prometheus/prometheus/releases/tag/v2.29.0-rc.0 and https://github.com/prometheus/prometheus/pull/9097	2021-08-03 12:21:53 +03:00
Roman Khavronenko	51329d9e1e	docs: add "Scaling to trillions of metric data points" to articles (#1517)	2021-08-03 11:14:57 +03:00
Roman Khavronenko	e127dcf013	docs: mention "Push Prometheus metrics to VictoriaMetrics or other exporters" article (#1511)	2021-08-02 17:23:45 +03:00
Roman Khavronenko	8e15c96004	docs: fix indentation for guide articles (#1512)	2021-08-02 17:17:24 +03:00
Aliaksandr Valialkin	d9810a7403	docs/CaseStudies.md: typo fix: hed->had	2021-07-30 18:49:17 +03:00
Aliaksandr Valialkin	c2df339eb2	docs/CHANGELOG.md: typo fix	2021-07-30 12:35:28 +03:00
Aliaksandr Valialkin	3389f1e474	docs/CHANGELOG.md: document d05cac6c98 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1486	2021-07-30 12:26:34 +03:00
Aliaksandr Valialkin	99004a6a40	app/vmselect/netstorage: unpack time series data in mostly local big chunks ... This should improve performance on multi-CPU systems for queries selecting time series with big number of raw samples	2021-07-30 12:26:33 +03:00
Aliaksandr Valialkin	b709fa387a	app/vmselect: follow-up for ed95bc9531 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1493	2021-07-29 09:48:47 +03:00
Aliaksandr Valialkin	c582d95cf0	docs: remove SampleSizeCalculations.md, since it is outdated and no longer used ... There was a reference to this doc from the old victoriametrics.com site	2021-07-28 19:25:45 +03:00
Denys Holius	113df2f3b7	Added new guide for monitoring k8s via VictoriaMetrics cluster (#1476) ... * renamed and moved screenshots * fixed cluster guide, updated helm chart versions, added values.yaml for vm single * renamed guide files * fixed typo * add some fixes * fixed typos,added guide k8s-monitoring-via-vm-cluster * added fixes for yamls	2021-07-28 18:06:50 +03:00
Aliaksandr Valialkin	49bf3abf67	app/vmselect: follow-up for 626073bca8 ... * Rename -search.maxMetricsPointSearch to -search.maxSamplesPerQuery, so it is more consistent with the existing -search.maxSamplesPerSeries * Move the -search.maxSamplesPerQuery from vmstorage to vmselect, so it could effectively limit the number of raw samples obtained from all the vmstorage nodes * Document the -search.maxSamplesPerQuery in docs/CHANGELOG.md	2021-07-28 18:00:04 +03:00
Aliaksandr Valialkin	857fa4e28a	docs/CHANGELOG.md: document 9d45b46f4c	2021-07-27 12:39:10 +03:00
Aaron France	3c22b5c41e	fix: typo in metrics.md docs	2021-07-27 10:53:02 +03:00
Aliaksandr Valialkin	3921d8afae	app/vmselect: prevent from possible deadlock when f callback blocks inside RunParallel	2021-07-26 15:50:45 +03:00
Aliaksandr Valialkin	349d45bbbe	docs/Articles.md: add links to new articles	2021-07-23 21:09:00 +03:00
Aliaksandr Valialkin	b047feeb8b	app/vmselect/promql: properly handle (a op b) default N if (a op b) returns NaN series ... The result should be a series with `N` values and `a op b` labels. Previously such series has been removed from the result.	2021-07-16 01:44:24 +03:00
Aliaksandr Valialkin	df117f85bd	app/vmselect: do not track queries with less than 1ms execution time at /api/v1/status/top_queries ... This should improve the readability and usefullness of the /api/v1/status/top_queries when debugging slow queries or queries that take too much cpu time.	2021-07-15 16:53:35 +03:00
Aliaksandr Valialkin	5830ce2706	app/vmselect/netstorage: add -search.maxSamplesPerSeries command-line option for limiting the number of samples a query can process per each series ... This should prevent from out of memory crashes like in https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1067	2021-07-15 16:53:35 +03:00
Aliaksandr Valialkin	f847677513	docs/CHANGELOG.md: typo fix: suffxies->suffixes	2021-07-15 15:02:55 +03:00
Aliaksandr Valialkin	4ec57102e6	docs/CHANGELOG.md: cut v1.63.0	2021-07-15 14:02:45 +03:00
Aliaksandr Valialkin	e992754e79	lib/storage: remove cache directory if it contains reset_cache_on_startup file ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1447	2021-07-13 17:59:51 +03:00
Aliaksandr Valialkin	ee7e9795ec	docs: clarify why spare CPU and RAM resources are needed in capacity planning	2021-07-13 15:49:38 +03:00
Aliaksandr Valialkin	03f1c0b58a	docs/Cluster-VictoriaMetrics.md: clarify the docs about the needed values for -dedup.minScrapeInterval at vmselect during replication when the data is pushed from HA pair	2021-07-13 15:29:43 +03:00
Aliaksandr Valialkin	e6edb85fa2	lib/httpserver: add is_set label to flag metrics ... This label allows determining the set flags with the query `flag{is_set="true"}`	2021-07-13 15:10:18 +03:00
Aliaksandr Valialkin	9add9d86a6	app/vmselect/promql: duration handling improvements in MetricsQL queries ... - Support durations anywhere in MetricsQL queries. E.g. sum_over_time(m[1h])/1h is equivalent to sum_over_time(m[1h])/3600 - Support durations without suffix. E.g. rate(m[300]) is equivalent to rate(m[5m])	2021-07-12 17:19:32 +03:00
Aliaksandr Valialkin	390a31ccfa	docs/CHANGELOG.md: document the change from bfba4c28a4	2021-07-12 12:42:42 +03:00
Aliaksandr Valialkin	253fe7699c	docs: update http://slack.victoriametrics.com to https://slack.victoriametrics.com	2021-07-12 10:58:19 +03:00
Aliaksandr Valialkin	0b98f6c7ff	app/vmselect: expose vmui at /vmselect/<accountID>/vmui/ instead of /vmselect/<accountID>/prometheus/vmui/ ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-10 12:32:21 +03:00
Aliaksandr Valialkin	98e049ba6d	app/vmui: move source code from https://github.com/VictoriaMetrics/vmui to app/vmui ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-09 17:13:51 +03:00
Aliaksandr Valialkin	9900a1f563	docs: clarify what does "workload" mean in capacity planning docs	2021-07-09 12:50:51 +03:00
Aliaksandr Valialkin	2c5e1cd893	app/vmselect: move web ui from /ui to /select/<accountID>/prometheus/ui ... This way the UI is available for every tenant (aka accountID) and the UI can automatically determine the needed per-tenant datasource path from page referer. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-08 13:14:50 +03:00
Aliaksandr Valialkin	acb7a95c64	app/vmselect: follow-up after aa11ef6d3b ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4	2021-07-07 17:45:09 +03:00
Aliaksandr Valialkin	6f8dd85deb	docs/Cluster-VictoriaMetrics.md: improve capacity planning recommendations	2021-07-07 16:21:59 +03:00
Aliaksandr Valialkin	41754e12f8	lib/mergeset: cache indexBlock items only on the second request ... This should reduce the indexdb/indexBlocks cache size, since it won't contain one-time-wonders items.	2021-07-07 15:24:37 +03:00
Aliaksandr Valialkin	9c19719ad6	app/{vminsert,vmselect}: export vminsert_request_duration_seconds and vmselect_request_duration_seconds histograms	2021-07-07 13:27:23 +03:00
Aliaksandr Valialkin	ceda2b1df4	lib/httpserver: print full requestURI in httpserver.Errorf ... This should simplify debugging.	2021-07-07 13:11:29 +03:00
Aliaksandr Valialkin	4e87638877	docs: clarify capacity planning docs	2021-07-07 12:48:07 +03:00
Roman Khavronenko	0541e3108a	add option to add Copy button for code snippets (#1433) ... To add a Copy button wrap code snippet with the following element: ``` <div class="with-copy" markdown="1"> <your-code-snippet> </div> ``` See the changes to `Kubernetes monitoring with VictoriaMetrics Single` for details.	2021-07-06 10:54:37 +03:00
Roman Khavronenko	e2b5f93170	move github-pages docs to the main repo (#1432) ... * move github-pages docs to the main repo * rm github actions for copying docs to VictoriaMetrics/VictoriaMetrics.github.io	2021-07-05 15:20:29 +03:00
Aliaksandr Valialkin	4b25e627f8	lib/workingsetcache: properly switch to whole mode ... Previously the switch from `split` to `whole` mode had been performed too early, e.g. when the current cache size became bigger than 1/4 of the allowed cache size. Now it is performed when the current cache size becomes bigger than 1/2 of the allowed cache size. This change can reduce memory usage for data ingestion path when big number of active time series are ingested.	2021-07-05 15:15:39 +03:00
Aliaksandr Valialkin	28a778dc9f	docs/CHANGELOG.md: document the bugfix for vm_merge_need_free_disk_space metric at 9a83e9018d	2021-07-05 12:01:24 +03:00
Aliaksandr Valialkin	2386829ad6	docs/Articles.md: add an url to https://medium.com/ibm-garage/monitoring-of-multiple-openshift-clusters-with-victoriametrics-d4f0979e2544	2021-07-05 11:52:18 +03:00
Aliaksandr Valialkin	44855f0c9b	app/{vmselect,vmstorage}: clarify the description for -dedup.minScrapeInterval command-line flag ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1426	2021-07-02 15:06:41 +03:00
Aliaksandr Valialkin	4b4e69791f	docs/Cluster-VictoriaMetrics.md: typo fix: siplify -> simplify	2021-07-02 10:50:26 +03:00
Aliaksandr Valialkin	9ec08213be	docs/Cluster-VictoriaMetrics.md: add a chapter describing a toy cluster setup on a single host ... While at it, refer to available tools, which can simplify cluster setup	2021-07-02 10:48:13 +03:00
Aliaksandr Valialkin	1c12c0f79c	lib/promauth: reload TLS certificates from disk on every mTLS connection as Prometheus does ... This allows updating client certificates without the need to restart vmagent and/or single-node VictoriaMetrics. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1420 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/470	2021-07-01 15:43:43 +03:00
Aliaksandr Valialkin	c1b15c7764	docs/CHANGELOG.md: document ae485c2bfd	2021-07-01 11:52:47 +03:00
Aliaksandr Valialkin	71c856beb8	lib/workingsetcache: reset the cache mode when the cache is reset ... This should reduce memory usage if the working set is reduced after the cache reset.	2021-07-01 11:52:47 +03:00
Aliaksandr Valialkin	0c4c630839	lib/promscrape: typo fix in /targets output ... The typo has been introduced in fb72a2133f Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1408	2021-06-28 21:27:22 +03:00
Aliaksandr Valialkin	4d8ab5d9fa	docs/vmagent.md: mention about docker_sd_config support	2021-06-25 20:53:09 +03:00
Aliaksandr Valialkin	db66ea9a5f	docs/CHANGELOG.md: cut v1.62.0	2021-06-25 13:29:48 +03:00
Aliaksandr Valialkin	97d1ccfc8e	lib/promscrape: split docker and dockerswarm service discovery code bases, since they have very little in common ... This is a follow up after c85a5b7fcb	2021-06-25 13:22:16 +03:00
Aliaksandr Valialkin	01af676436	docs: consistently put the link to articles and slides about VictoriaMetrics after the links to case studies	2021-06-24 15:38:49 +03:00
Aliaksandr Valialkin	634f2128d8	docs/CaseStudies.md: add a case study for DFKI	2021-06-24 15:25:19 +03:00
Aliaksandr Valialkin	b054563703	Add case study for Groove X	2021-06-24 15:06:19 +03:00
Aliaksandr Valialkin	65576ebb5b	docs/CaseStudies.md: add Sensedia case study	2021-06-24 14:35:47 +03:00
Aliaksandr Valialkin	1b6850bab3	docs/CHANGELOG.md: document the bugfix in increase_pure() function from the commit fb4f758715	2021-06-24 12:06:15 +03:00
Aliaksandr Valialkin	b84aea1e6e	lib/protoparser/clusternative: do not pool unmarshalWork structs, since they can occupy big amounts of memory (more than 100MB per each struct) ... This should reduce memory usage for vmstorage under high ingestion rate when the vmstorage runs on a system with big number of CPU cores	2021-06-23 15:45:08 +03:00
Aliaksandr Valialkin	856aecae05	app/vmselect/promql: return the last timestamp for the max / min value from tmax_over_time() and tmin_over_time() function as most users expect	2021-06-23 14:18:37 +03:00
Aliaksandr Valialkin	dffa2afefe	docs/CHANGELOG.md: document the bugfix for incorrect stats collection for concurrently executed tag filter ... Follow up for c22114c6f0	2021-06-23 14:06:33 +03:00
Aliaksandr Valialkin	c18017a9c3	app/vminsert/netstorage: sort the -storageNode list passed to vminsert nodes ... This should reduce resource usage (CPU, RAM, disk IO) at vmstorage nodes if the addresses of vmstorage nodes are passed in random order to vminsert nodes.	2021-06-23 14:00:08 +03:00
Aliaksandr Valialkin	4adf6c9766	lib/promscrape/discovery/http: follow up after e307bbb29a	2021-06-22 13:42:10 +03:00
Nikolay	e03a3d3a36	adds http_sd (#1399) ... * adds http_sd * adds X-Prometheus-Refresh-Interval-Seconds header * Update lib/promscrape/discovery/http/api.go Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2021-06-22 13:42:09 +03:00
Aliaksandr Valialkin	3ab3902f17	lib/promscrape/discovery: support generic auth configs in Consul service discovery in the same way as Prometheus 2.28 does	2021-06-22 13:18:51 +03:00
Aliaksandr Valialkin	61fc9b98e5	docs/CHANGELOG.md: document the support for Consul namepsace ... See 58a2989fe7	2021-06-22 12:56:12 +03:00
Aliaksandr Valialkin	a575882ca2	docs/PerTenantStatistic.md: document that the per-tenant statistic is a part of cluster version of VictoriaMetrics	2021-06-22 12:43:30 +03:00
Aliaksandr Valialkin	23fcafd437	docs/CHANGELOG.md: typo fixes	2021-06-18 19:15:29 +03:00
Aliaksandr Valialkin	b92d110cad	app/vmselect: log slow requests to all the /api/v1/* handlers if their execution time exceeds -search.logSlowQueryDuration	2021-06-18 19:07:03 +03:00
Aliaksandr Valialkin	d29e130181	docs/Single-server-VictoriaMetrics.md: mention that it is recommended to use a single scrape_interval across all the scrape targets	2021-06-18 15:41:35 +03:00
Aliaksandr Valialkin	4acc4602b3	app/vmctl: limit JSON line size by 10K samples (#1394) ... This should reduce the maximum memory usage at VictoriaMetrics when importing time series with big number of samples.	2021-06-18 15:41:34 +03:00
Aliaksandr Valialkin	3ec3705943	docs/Cluster-VictoriaMetrics.md: clarify docs about VictoriaMetrics cluster architecture	2021-06-18 14:35:55 +03:00
Aliaksandr Valialkin	cd697b88c5	docs/CHANGELOG.md: document the reduced disk write IO usage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1338	2021-06-18 14:03:42 +03:00
Aliaksandr Valialkin	f9069ba32a	lib/promscrape: show jobs with empty scrape targets on /targets page	2021-06-18 10:54:12 +03:00
Aliaksandr Valialkin	60bc35f550	docs/{vmgateway,vmbackupmanager}: explicitly mention that these components are a part of an enterprise package	2021-06-17 17:19:13 +03:00
Aliaksandr Valialkin	90c3606269	docs/vmagent.md: sync with app/vmagent/README.md via make docs-sync	2021-06-16 12:37:55 +03:00
Aliaksandr Valialkin	644102b03b	docs/CHANGELOG.md: document the changed -remoteWrite.queues value ... This is a follow-up for 0a796f7c3a See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1385	2021-06-16 12:37:55 +03:00
Aliaksandr Valialkin	234152d66e	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics works great with APM workloads (aka Application Performance Monitoring)	2021-06-15 17:33:41 +03:00
Aliaksandr Valialkin	b133de1e37	lib/storage: move deletedMetricIDs set from indexDB to Storage ... This makes consitent the list of deleted metricIDs when it is used from both the current indexDB and the previous indexDB (aka extDB). This should fix the issue, which could lead to storing new samples under deleted metricIDs after indexDB rotation. See more details at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1347#issuecomment-861232136 . Thanks to @tangqipengleoo for the initial analysis and the pull request - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1383 . This commit resolves the issue in more generic way compared to https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1383 . The downside of the commit is the deletedMetricIDs set isn't cleaned from the metricIDs outside the retention. It needs app restart. This should be OK in most cases.	2021-06-15 15:07:54 +03:00
Aliaksandr Valialkin	5f91a701fa	lib/promscrape: show the number of samples collected during the last scrape at /targets and /api/v1/targets pages ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1377	2021-06-14 14:04:35 +03:00
Aliaksandr Valialkin	5cd50d840f	docs/CHANGELOG.md: document the addition of DigitalOcean service discovery ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1367	2021-06-14 13:19:31 +03:00
Nikolay	e42da47608	adds digital ocean sd (#1376) ... * adds digital ocean sd config * adds digital ocean sd https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1367 * typo fix	2021-06-14 13:19:29 +03:00
Aliaksandr Valialkin	357dbe092c	docs/Cluster-VictoriaMetrics.md: add lists for command-line flags for cluster components	2021-06-14 12:21:22 +03:00
Aliaksandr Valialkin	52efd5a05c	docs/vmalert.md: follow-up after 6d5a8c28cd	2021-06-14 11:43:02 +03:00
Aliaksandr Valialkin	541429a9af	docs/CHANGELOG.md: cut v1.61.1	2021-06-11 13:02:04 +03:00
Aliaksandr Valialkin	ce10bdc82a	lib/storage: reset cache on disk during series deletion and during indexdb rotation ... This should prevent from inconsistent behavior (aka partially missing data for some time series) after unclean shutdown. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1347	2021-06-11 12:54:36 +03:00
Aliaksandr Valialkin	d5973d3180	docs/CHANGELOG.md: document the bugfix from 7adfe878e1	2021-06-11 11:30:07 +03:00
John Belmonte	3e79f3994e	spelling fix: synonym (#1363)	2021-06-11 10:58:48 +03:00
Aliaksandr Valialkin	83adc2f3ac	docs/CHANGELOG.md: cut v1.61.0	2021-06-09 19:04:59 +03:00
Aliaksandr Valialkin	c7efd5b43f	docs/FAQ.md: add a chapter comparing VictoriaMetrics to QuestDB	2021-06-09 19:03:47 +03:00
Aliaksandr Valialkin	203d883b2b	docs/Articles.md: update the broken link to https://nordicapis.com/api-monitoring-with-prometheus-grafana-alertmanager-and-victoriametrics/	2021-06-09 16:40:39 +03:00
Aliaksandr Valialkin	247b2a5a08	app/vmauth: improve readability for a config with multiple src_paths	2021-06-09 15:38:09 +03:00
Aliaksandr Valialkin	1e13deaa2c	docs/CHANGELOG.md: document the enterprise bugfix for the target property in Graphite Render API	2021-06-09 13:51:32 +03:00
Aliaksandr Valialkin	490783696a	docs/CHANGELOG.md: document improvements in re-routing handling in vminsert ... See the following commits: * 1c09e71f5b * 0d067eb112 * 2c6b917749	2021-06-09 13:42:12 +03:00
Aliaksandr Valialkin	520d62ade2	docs/vmagent.md: mention that vmagent supports scrape targets sharding	2021-06-09 12:30:54 +03:00
Aliaksandr Valialkin	f3749dedba	docs: document rules replay feature for vmalert ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/836 This is a follow-up for 2a259ef5e7	2021-06-09 12:30:54 +03:00
Aliaksandr Valialkin	8ad445474a	docs/CHANGELOG.md: document the bugfix, which prevents panics for aborted http requests in vmauth ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1353 This is a follow-up for 6b29b955c0	2021-06-09 12:12:47 +03:00
Aliaksandr Valialkin	269e35d676	app/{vmagent,vminsert}: follow-up after 2fe045e2a4 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1343	2021-06-04 20:33:22 +03:00
jelmd	d8b46908db	new feature: debug relabeling (#1344) ... * new feature: relabel logging Use scrape_configs[x].relabel_debug = true to log metric names inkl. labels before and after relabeling. After relabeling related metrics get dropped, i.e. not submitted to servers. * vminsert wants relabel logging, too.	2021-06-04 20:33:21 +03:00
Aliaksandr Valialkin	67cfc07004	docs/CHANGELOG.md: document the bugfix from 6f19bb23a1	2021-06-04 11:56:06 +03:00
Aliaksandr Valialkin	c53a90e5fc	docs/CHANGELOG.md: document that it is possible to build VictoriaMetrics components for Solaris ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322 This is a follow-up for ddc8022702	2021-06-04 04:41:12 +03:00
Aliaksandr Valialkin	1c09e71f5b	app/vminsert: add -disableRerouting command-line flag for disabling re-routing if some vmstorage nodes have lower performance than the others ... Refactor the rerouting mechanism and make it more resilient to cases when some of vmstorage nodes are temporarily unavailable. Reduce the probability of rerouting storm. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/791 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1054 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1165	2021-06-04 04:33:52 +03:00
Aliaksandr Valialkin	8cdecfc52c	app/vmauth: allow balancing the load among multiple backend nodes by specifying multiple urls in url_prefix config	2021-05-29 01:04:22 +03:00
Aliaksandr Valialkin	bf9f77d74d	docs/Articles.md: add a link to https://www.percona.com/blog/2021/05/26/compiling-a-percona-monitoring-and-management-v2-client-in-arm-raspberry-pi-3/	2021-05-28 14:34:06 +03:00
Aliaksandr Valialkin	c97212ea63	docs/MetricsQL.md: add a link to technical details about rate() and increase() calculations in Prometheus and VictoriaMetrics	2021-05-28 13:14:23 +03:00
Aliaksandr Valialkin	734074e8a6	docs/Single-server-VictoriaMetrics.md: remove misleading wording about querying Graphite metrics with MetricsQL	2021-05-28 02:40:02 +03:00
Aliaksandr Valialkin	97de72054e	docs: document f0c21b6300	2021-05-27 15:04:13 +03:00
Aliaksandr Valialkin	6c4921b3bd	docs: make docs-sync after 2bbb1cc7c1	2021-05-26 12:33:01 +03:00
Roman Khavronenko	b42f7fc185	Docs review (#1330) ... * re-order components by prioritizing Cluster-VictoriaMetrics.md * drop Home.md since it just duplicates other links	2021-05-26 12:32:59 +03:00
Aliaksandr Valialkin	820ac6cd0c	docs/CHANGELOG.md: document changes from 2233d6ed8a and d210958fd0	2021-05-26 12:24:28 +03:00
Dan Fredell	e05c03cf00	Fix quote difference on label_move example (#1321) ... Fix quote difference on label_move example	2021-05-25 12:13:39 +03:00
Aliaksandr Valialkin	25ed1f0c4f	docs/CHANGELOG.md: cut v1.60.0	2021-05-24 15:55:31 +03:00
Aliaksandr Valialkin	65b4ae95e3	docs/Single-server-VictoriaMetrics.md: clarify that the storage size depends on the number of samples per series	2021-05-24 15:48:45 +03:00
Aliaksandr Valialkin	c9229e3c0b	docs/vmalert.md: sync with app/vmalert/README.md via make docs-sync	2021-05-24 15:48:44 +03:00
Aliaksandr Valialkin	402a8ca710	lib/storage: do not populate MetricID->MetricName cache during data ingestion ... This cache isn't needed during data ingestion, so there is no need in spending RAM on it. This reduces RAM usage on data ingestion path by 30%	2021-05-24 03:06:40 +03:00
Aliaksandr Valialkin	68c3901ebd	docs/CHANGELOG.md: small typo fix	2021-05-23 14:15:49 +03:00
Aliaksandr Valialkin	8ec3e876be	docs/CHANGELOG.md: document the addition of extra_filter_labels at 84cc0513e1	2021-05-23 14:15:49 +03:00
Aliaksandr Valialkin	71ff7ee18d	lib/promauth: follow-up after 5b8176c68e	2021-05-22 18:02:03 +03:00
Aliaksandr Valialkin	23355ca34c	lib/fs: wait for a while before giving up on NFS file removal if the removal queue is full ... This should reduce the probability of the panic on a highly loaded VictoriaMetrics accepting millions of samples per second. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1313	2021-05-21 17:21:35 +03:00
Aliaksandr Valialkin	e9a63a5942	docs/MetricsQL.md: add a link to a list of supported timezones that can be passed to timezone_offset() function ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1306	2021-05-21 16:56:07 +03:00
Aliaksandr Valialkin	f664f7fb1d	docs/CHANGELOG.md: mention the bugfix from d626c5c2a9 ... Updates https://github.com/VictoriaMetrics/operator/issues/243	2021-05-21 16:38:20 +03:00
Aliaksandr Valialkin	d77db9d813	all: do not skip SIGHUP signal during service initialization ... This can lead to stale or incomplete configs like in the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-05-21 16:38:20 +03:00
Aliaksandr Valialkin	45849886a3	docs/FAQ.md: re-order questions to be more attractive to visitors	2021-05-20 19:50:57 +03:00
Aliaksandr Valialkin	6139f6ed6d	app/vmauth: add ability to protect /-/reload endpoint with authKey	2021-05-20 18:48:34 +03:00
Aliaksandr Valialkin	9aa22cccf0	docs/CHANGELOG.md: move tip to proper place	2021-05-20 17:58:24 +03:00
Aliaksandr Valialkin	4a7aef4707	docs/FAQ.md: add a question on how to run VictoriaMetrics on FreeBSD ... The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	429ae37863	docs/FAQ.md: add can I use VictoriaMetrics instead of Prometheus? ... The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	6d987971e3	docs/FAQ.md: add a question about memory limits for VictoriaMetrics components ... The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	26dc52cbde	docs/FAQ.md: add a question about multi-tenancy ... The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 15:52:17 +03:00
Aliaksandr Valialkin	165a9f9200	app/vmstorage: add ability to limit series cardinality via -storage.maxHourlySeries and -storage.maxDailySeries command-line flags	2021-05-20 15:31:57 +03:00
Aliaksandr Valialkin	7aad5c3f76	app/vmagent: add ability to limit series cardinality on a per-hour and per-day basis	2021-05-20 15:31:57 +03:00
Aliaksandr Valialkin	a613be1518	docs/CHANGELOG.md: document the bugfix in vmctl import for InfluxDB lines with identical names for field and tag ... See dcf8803bbd Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1299	2021-05-20 12:07:15 +03:00
Aliaksandr Valialkin	2cc5567ab8	docs/CHANGELOG.md: refer to the issue related to timezone_offset() function	2021-05-20 12:02:32 +03:00
Aliaksandr Valialkin	180829b8c2	app/vmselect/promql: add timezone_offset(tz) function ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1306	2021-05-20 11:54:06 +03:00
Neo He	c5ab00ebee	app/{vmbackup,vmrestore},docs/vmrestore.md: typo fix: vbackup -> vmbackup (#1305)	2021-05-18 16:38:15 +03:00
Aliaksandr Valialkin	74ef40034c	lib/httpserver: typo fix in -http.shutdownDelay command-line flag description: servier -> server	2021-05-18 16:25:27 +03:00
Aliaksandr Valialkin	1668280e67	docs/vmalert.md: document multitenant support ... https://github.com/VictoriaMetrics/VictoriaMetrics/issues/740	2021-05-18 16:25:21 +03:00
Aliaksandr Valialkin	7fe362deb1	app/vmauth: reload -auth.config on the request to /-/reload ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1194	2021-05-18 02:24:37 +03:00
Aliaksandr Valialkin	25ca108642	docs/vmbackup.md: typo fix: snaphosts -> snapshots ... Thanks to @jelmd - see 1ab27582a3 (r50884395)	2021-05-18 01:14:01 +03:00
Aliaksandr Valialkin	6ea191d196	docs: dealay -> delay	2021-05-18 01:07:32 +03:00
Aliaksandr Valialkin	bae4d61ef2	docs/CHANGELOG.md: document b38edec7ee ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1293	2021-05-17 01:58:18 +03:00
Roman Khavronenko	c47825c255	Docs update from victoriaMetrics.github.io (#1302) ... * port change from 11ca65677b * port change from afb41dfa43 * port change from f82e3733c9 * port change from d499ab0502	2021-05-17 01:51:54 +03:00
Aliaksandr Valialkin	e08287f017	lib/promscrape: reload auth tokens from files every second ... Previously auth tokens were loaded at startup and couldn't be updated without vmagent restart. Now there is no need in vmagent restart. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1297	2021-05-14 20:03:35 +03:00
Aliaksandr Valialkin	f13fb6e867	docs/Articles.md: add a link to https://fly.io/blog/measuring-fly/	2021-05-14 20:03:34 +03:00
Aliaksandr Valialkin	30e8ba63f1	docs/vmauth.md: sync with app/vmauth/README.md after 10a47af631	2021-05-14 18:13:35 +03:00
Aliaksandr Valialkin	a6cb4f10a7	app/{vmalert,vmauth}: explicitly set MaxIdleConnsPerHost in net/http.Client.Transport ... By default MaxIdleConnsPerHost is set to 2. This limits the possibility to re-use http keep-alive connections. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1300	2021-05-14 18:13:34 +03:00
Aliaksandr Valialkin	d274dae73f	docs/Single-server-VictoriaMetrics.md: document how to reduce memory usage when importing too long JSON lines into VictoriaMetrics ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1295	2021-05-14 17:22:51 +03:00
Denys Holius	ac5a28db9a	Fix Cortex typo	2021-05-13 17:40:19 +03:00
Aliaksandr Valialkin	e3f61d540b	lib/promscrape: limit scrape_timeout by scrape_interval like Prometheus does ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1281	2021-05-13 16:10:42 +03:00
Aliaksandr Valialkin	76e03b46df	docs/CHANGELOG.md: document the bugfix from b4f5be8bd8	2021-05-13 11:19:31 +03:00
Aliaksandr Valialkin	f13585dc5d	vendor: update github.com/VictoriaMetrics/fasthttp from v1.0.14 to v1.0.15 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1289	2021-05-13 10:47:09 +03:00
Aliaksandr Valialkin	66c6976723	lib/cgroup: document the ability to detect cgroup v2 memory and cpu limits. This is follow-up for b50024812e	2021-05-13 09:27:35 +03:00
Aliaksandr Valialkin	ad04c29a35	docs/Single-server-VictoriaMetrics.md: typo fix: retuns->returns	2021-05-12 17:23:27 +03:00
Nikolay	be87be34a4	Adds tsdb match filters (#1282) ... * init work on filters * init propose for status filters * fixes tsdb status adds test * fix bug * removes checks from test	2021-05-12 17:16:58 +03:00
Aliaksandr Valialkin	56b08390f6	app/vmselect/promql: allow to use 2x more memory for query processing in cluster mode compared to single-node mode ... `vmselect` has no `vmstorage`-related caches. So it can use more memory for query processing compared to single-node VictoriaMetrics.	2021-05-12 14:43:49 +03:00
Aliaksandr Valialkin	f1317f7c6c	lib/httpserver: return X-Server-Hostname http header in all the responses for better debuggability	2021-05-11 22:04:41 +03:00
Aliaksandr Valialkin	cca9670573	docs/CHANGELOG.md: document -datasource.roundDigits added at 5c448126dc	2021-05-10 11:18:58 +03:00
Aliaksandr Valialkin	f551b99082	docs/CHANGELOG.md: document vmalert fix for state restoration on startup	2021-05-10 11:10:34 +03:00
Aliaksandr Valialkin	2dddd68feb	docs/vmagent.md: add stream parsing mode chapter	2021-05-08 23:14:47 +03:00
Aliaksandr Valialkin	4128c4db16	docs/CHANGELOG.md: mention the comment, which gives an example of multi-level vminsert setup	2021-05-08 22:50:40 +03:00
Aliaksandr Valialkin	9c505d27dd	lib/ingestserver: properly close incoming connections during graceful shutdown	2021-05-08 19:53:45 +03:00
Aliaksandr Valialkin	4a5f45c77e	app/vminsert: add support for data ingestion via other vminsert nodes	2021-05-08 19:53:45 +03:00
Aliaksandr Valialkin	c656b589a1	docs/Single-server-VictoriaMetrics.md: add links to vmauth and vmgateway as auth proxy examples	2021-05-07 10:46:47 +03:00
Aliaksandr Valialkin	e8478e1e97	app/vmbackup: make sure that -snapshotName isnt set if -snapshot.createURL is set	2021-05-07 08:44:44 +03:00
Aliaksandr Valialkin	3108cdb930	docs/CHANGELOG.md: document 904bbffc7f ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-05-05 20:34:00 +03:00
Aliaksandr Valialkin	326c7995c1	docs/CHANGELOG.md: document 9cdd4696fe ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1252	2021-05-05 20:33:59 +03:00
Aliaksandr Valialkin	ec6becd3f5	lib/httpserver: stop the process on panics in request handlers ... Panics may leave the process in inconsistent state. That's why it is better to stop the process after the panic instead of recovering from the panic. Unfortunately, the standard net/http.Server recovers panics in request handlers. See https://github.com/golang/go/issues/16542 . That's lib/httpserver must stop the process on itself after the panic.	2021-05-03 12:00:44 +03:00
Aliaksandr Valialkin	a302f79e5e	docs/CHANGELOG.md: document the bugfix for proper removal of stale parts (477369b62f)	2021-05-03 11:38:38 +03:00
Aliaksandr Valialkin	9aa44a2760	docs/CHANGELOG.md: cut v1.59.0	2021-05-01 09:43:35 +03:00
Aliaksandr Valialkin	b43ba6d85f	lib/storage: log dropped labels if the number of labels in a metric exceeds -maxLabelsPerTimeseries command-line flag value ... This should improve debuggability for this case.	2021-05-01 09:29:56 +03:00
Aliaksandr Valialkin	0a2e746175	docs/vmalert.md: update docs after afca7b430c	2021-04-30 11:49:40 +03:00
Aliaksandr Valialkin	131e9912eb	docs/Cluster-VictoriaMetrics.md: document api/v1/series/count endpoint	2021-04-30 11:41:45 +03:00
Aliaksandr Valialkin	daf2778025	docs/CHANGELOG.md: document the change from f3a048288e ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1232	2021-04-30 09:56:47 +03:00
Aliaksandr Valialkin	8be1cb297b	app/vmagent: list user-visible endpoints at http://vmagent:8429/ ... While at it, use common WriteAPIHelp function for the listing in vmagent, vmalert and victoria-metrics	2021-04-30 09:38:23 +03:00
Aliaksandr Valialkin	2d1d60118d	lib/mergeset: split rows ingestion among multiple shards ... This improves rows ingestion on systems with many CPU cores by reducing lock contention. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1244 Thanks to @waldoweng for the original idea and draft implementation at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1243	2021-04-27 15:45:11 +03:00
Aliaksandr Valialkin	f14412321b	lib/persistentqueue: eliminate possible data race when obtaining vm_persistentqueue_bytes_pending metric value	2021-04-27 00:26:32 +03:00
Roman Khavronenko	2357e21024	docs: update per tenant stats page (#1246)	2021-04-27 00:16:44 +03:00
Aliaksandr Valialkin	97424c05c0	docs: ordering fix	2021-04-24 02:29:30 +03:00
Aliaksandr Valialkin	2bd99046a1	docs: update docs order	2021-04-24 01:28:13 +03:00
Aliaksandr Valialkin	fecc300e3c	docs/Single-server-VictoriaMetrics.md: mention that the native export format can change between releases ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1203	2021-04-24 01:28:12 +03:00
Aliaksandr Valialkin	cbf545f3af	docs: sync with master branch	2021-04-23 22:05:36 +03:00
Aliaksandr Valialkin	320983f650	lib/promscrape: apply scrape_timeout on receiving the first response byte for stream_parse: true scrape targets ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1017#issuecomment-767235047	2021-04-23 22:05:00 +03:00
Aliaksandr Valialkin	db27dbab5e	lib/promscrape/discovery/kubernetes: refresh endpoints and endpointslices targets on service object update like Prometheus does ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-04-23 20:12:22 +03:00
Aliaksandr Valialkin	8a6bf55a9b	docs: add missing images for vmbackupmanager.md	2021-04-22 14:46:40 +03:00
Aliaksandr Valialkin	7f573a9564	docs/vmbackupmanager.md: sync with app/vmbackupmanager/README.md	2021-04-22 14:45:31 +03:00
Aliaksandr Valialkin	ab8008d6d7	lib/{storage,mergeset}: remove empty directories on startup. Such directories can be left after unclean shutdown on NFS storage ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1142	2021-04-22 13:03:29 +03:00
Denys Holius	c1fa465fe0	fixed typo; added example of usage vmbackup in docker-compose (#1237)	2021-04-22 11:18:12 +03:00
Aliaksandr Valialkin	6dc5d3b357	all: rename https://victoriametrics.github.io to https://docs.victoriametrics.com	2021-04-20 20:20:01 +03:00
Aliaksandr Valialkin	64f1ddefe5	all: consistency renaming Victoria Metrics -> VictoriaMetrics ... VMInsert -> vminsert VMSelect -> vmselect VMStorage -> vmstorage	2021-04-20 11:45:02 +03:00
Aliaksandr Valialkin	8d869d112b	app/vmauth: follow-up for 6a81a89b3d	2021-04-20 10:59:22 +03:00
Aliaksandr Valialkin	b0bd2c0d61	docs/Cluster-VictoriaMetrics.md: sync with cluster README.md	2021-04-19 13:31:23 +03:00
Denys Holius	9896b51ee5	Added some explanation to vmctl docs (#1217) ... Added explanation that vmctl do not make snapshot from Prometheus when run migration data	2021-04-16 10:58:51 +03:00
dereksfoster99	1b6d2467ff	Update PerTenantStatistic.md	2021-04-16 10:58:51 +03:00
Aliaksandr Valialkin	6ea174e78a	docs/Cluster-VictoriaMetrics.md: mention that sometimes -replicationFactor shouldnt be set at vmselect nodes ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1207	2021-04-14 13:06:49 +03:00
f41gh7	b493937815	updates per-tenant stats docs ... changes docs order changes per-tenant-stats pic	2021-04-14 12:31:51 +03:00
Artem Navoiev	39b5de9f24	[draft] per tenant statistic (#121) ... * [draft] per tenant statistic * updates metric name update graph adds link and example config * quick fix * adds grafana dashboard adds example alert Co-authored-by: f41gh7 <nik@victoriametrics.com>	2021-04-14 11:23:41 +03:00
Aliaksandr Valialkin	c872ba45b9	docs: update -help output after the commit 77be3e3a82	2021-04-12 12:35:39 +03:00
Aliaksandr Valialkin	2190fd2148	docs: make docs-sync	2021-04-10 19:55:05 +03:00
Artem Navoiev	ddf3f17887	update vmgateway.md (#1201)	2021-04-10 19:55:04 +03:00
Roman Khavronenko	46e6fdb131	Docs update (#1199) ... * docs: drop table of contents for `vmctl` We already have it autogenerated on .github.io, so no need to keep it. * docs: mention OpenTSDB migration feature for vmctl * docs: sync docs for `vmalert`	2021-04-10 15:47:52 +03:00
Aliaksandr Valialkin	c3893805f2	docs/Single-server-VictoriaMetrics.md: recommend using the official alerts for VictoriaMetrics in Monitoring section	2021-04-08 12:14:28 +03:00
Aliaksandr Valialkin	3e4f063afc	docs/CHANGELOG.md: cut v1.58.0	2021-04-08 00:48:46 +03:00
Aliaksandr Valialkin	3d5f1f779f	app/vmselect: do not sort series returned from topk* and bottomk* functions, since these series are already sorted in user-expected order ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1189	2021-04-07 14:16:02 +03:00
Aliaksandr Valialkin	18cad589d7	docs/Cluster-VictoriaMetrics.md: follow-up after c6a8ebb11f	2021-04-07 13:46:56 +03:00
Roman Khavronenko	ff3711eea2	docs: update docs ordering and formatting (#1192) ... The major change is adding `sort` directive to docs. For those docs which are copied from internal packages `sort` is added via makefile command. For the rest it is added manually since they're updated manually as well. The rest of changes is connected with markdown formatting. For example, changing headers in some files (`##` => `#`) makes navigation on .github.io to look better. This especially useful for `changelog` docs. Table of contents for `vmctl` is dropped, since we already have it autogenerated on .github.io. No link changes expected. The corresponding PR to `cluster` branch will be made in follow-up PR.	2021-04-07 13:43:01 +03:00
Aliaksandr Valialkin	59ccc43e3a	lib/storage: properly handle big time ranges passed to /api/v1/labels and /api/v1/label/<labelName>/values ... It should be faster querying all the labels and/or all the values instead of querying per-day labels/values on time ranges exceeding maxDaysForPerDaySearch	2021-04-07 13:33:10 +03:00
Aliaksandr Valialkin	2585058a5f	Makefile: prepare arm64 and amd64 release archives for cluster version on make release command	2021-04-05 23:01:45 +03:00
Aliaksandr Valialkin	4d6a3aba4d	lib/persistentqueue: delete corrupted persistent queue instead of throwing a fatal error ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1030	2021-04-05 19:26:51 +03:00
Aliaksandr Valialkin	fe084fdd33	lib/promscrape/discovery/kubernetes: synchronously load Kubernetes objects on first access ... Remove async registration of apiWatchers, since it breaks discovering `role: endpoints` and `role: endpointslices` targets, which depend on pod and service objects. There is no need in reloading `endpoints` and `endpointslices` targets if the referenced `pod` or `service` objects change, since in this case the corresponding `endpoints` and `endpointslices` objects should also change because they contain ResourceVersion of the referenced `pod` or `service` objects, which is modified on object update. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1182	2021-04-05 14:37:07 +03:00
Aliaksandr Valialkin	e0b687171b	lib/proxy: add support for socks5 over tls proxy	2021-04-05 13:00:42 +03:00
Aliaksandr Valialkin	90da332ea0	lib/promscrape: pass X-Prometheus-Scrape-Timeout-Seconds header to scrape targets as Prometheus does	2021-04-05 12:15:14 +03:00
Aliaksandr Valialkin	c229e10619	docs/CHANGELOG.md: explain why -sortLabels is set to false by default	2021-04-04 01:59:19 +03:00
Aliaksandr Valialkin	92d4c80639	docs/vmagent.md: mention that vmagent supports scraping via socks5 proxy	2021-04-04 01:45:46 +03:00
Aliaksandr Valialkin	afb139c244	docs/CHANGELOG.md: document the ability to use socks5 proxy ... Follow-up for a4c6a3b3e1 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1177	2021-04-04 01:44:01 +03:00
Aliaksandr Valialkin	ab9e1eb41f	lib/promscrape: support for simple HTTP proxies without CONNECT method support such as https://github.com/prometheus-community/PushProx ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1179	2021-04-04 00:40:58 +03:00
Aliaksandr Valialkin	4aa59cae7c	app/vmselect/promql: do not delete dst_label if src_label is empty in label_copy(q, src_label, dst_label) and label_move(q, src_label, dst_label)	2021-04-03 22:06:50 +03:00
Aliaksandr Valialkin	8b2c4fe0ff	docs/CHANGELOG.md: document the change from 3055ab0115 (add ability to pass "label=value" to the third argument to topk_* and bottomk_* functions	2021-04-03 21:42:23 +03:00
Aliaksandr Valialkin	1d88c8523d	docs/Single-server-VictoriaMetrics.md: add missing link in heading to Graphite Render API usage chapter	2021-04-03 21:34:57 +03:00
Aliaksandr Valialkin	dfec690548	docs/vmgateway.md: update docs	2021-04-03 00:29:57 +03:00
Aliaksandr Valialkin	e1347a91b0	docs/CHANGELOG.md: yet another typo fix	2021-04-03 00:26:02 +03:00
Aliaksandr Valialkin	6b2e496baf	docs/CHANGELOG.md: typo fix	2021-04-03 00:24:05 +03:00
Aliaksandr Valialkin	b9469de410	app/vmselect/promql: add ability to set label value additionally to label name for the remaining sum of time series returned from topk_* and bottomk_* functions in the form: topk_min(N, m, "label=value")	2021-04-02 23:56:30 +03:00
Aliaksandr Valialkin	262da1c2e5	docs/{vmauth,vmgateway}.md: small fixes	2021-04-02 23:15:40 +03:00
Aliaksandr Valialkin	5edec0e57e	app/vmgateway: publish docs	2021-04-02 23:10:10 +03:00
Aliaksandr Valialkin	89771d082d	app/vmauth: add support for authorization via Authorization: Bearer <token>	2021-04-02 22:15:07 +03:00
Aliaksandr Valialkin	6c6174271a	docs/vmagent.md: mention about proxy_authorization section	2021-04-02 21:24:52 +03:00
Aliaksandr Valialkin	87700f1259	lib/promscrape: add support for authorization config in -promscrape.config as Prometheus 2.26 does ... See https://github.com/prometheus/prometheus/pull/8512	2021-04-02 21:20:37 +03:00
Aliaksandr Valialkin	2825a1e86d	lib/promscrape: add follow_redirect option to scrape_configs section like Prometheus does ... See https://github.com/prometheus/prometheus/pull/8546	2021-04-02 21:20:37 +03:00
Aliaksandr Valialkin	eee860f83d	lib/promscrape/discovery/kubernetes: properly discover targets in multiple namespaces ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1170	2021-04-02 14:29:24 +03:00
Aliaksandr Valialkin	4e685fb0df	docs/CHANGELOG.md: mention about AWS IAM roles for tasks support for EC2 service discovery ... Follow-up for fdb8995642	2021-04-02 13:11:05 +03:00
Aliaksandr Valialkin	512addc608	app/{vminsert,vmagent}: add -sortLabels command-line option for sorting time series labels before ingesting them in the storage ... This option can be useful when samples for the same time series are ingested with distinct order of labels. For example, metric{k1="v1",k2="v2"} and metric{k2="v2",k1="v1"}.	2021-03-31 23:27:21 +03:00
Aliaksandr Valialkin	ae1c653d55	lib/storage: reduce memory usage when ingesting samples for the same time series with distinct order of labels	2021-03-31 21:22:40 +03:00
Aliaksandr Valialkin	392ba94d1d	app/vmagent/remotewrite: reduce memory usage when -remoteWrite.queues is set to a big value ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1167	2021-03-31 16:17:23 +03:00
Aliaksandr Valialkin	6712173ce3	docs/Articles.md: add a link to https://blog.kintone.io/entry/2021/03/31/175256	2021-03-31 15:34:57 +03:00
Aliaksandr Valialkin	108bf68a91	docs/Single-server-VictoriaMetrics.md: update victoria-metrics -help output after e7fdea5953	2021-03-30 21:47:12 +03:00
Aliaksandr Valialkin	c237a5f0d1	docs/CHANGELOG.md: cut v1.57.1	2021-03-30 15:40:23 +03:00
Aliaksandr Valialkin	4fa8ae1621	docs/CHANGELOG.md: mention about returned back type label for vm_tenant_inserted_rows_total metric ... See 9b4e608199	2021-03-30 15:16:33 +03:00
Aliaksandr Valialkin	ecfd6fe78d	app/vmselect: remove -search.storageTimeout command-line flag, since it has the same meaning as -search.maxQueryDuration ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2021-03-30 14:54:36 +03:00
Aliaksandr Valialkin	7bafaad46d	app/vmselect: prevent from possible incomplete query results after timed out query ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2021-03-30 13:34:57 +03:00
Aliaksandr Valialkin	a9e0c09be0	Makefile: build vmutils for arm on make release-vmutils ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1147	2021-03-29 23:16:30 +03:00
Aliaksandr Valialkin	0a8f0a4e2f	all: increase minimum supported Go version for building VictoriaMetrics components from v1.14 to v1.15 ... This is needed after the commit c0ac740f93, which uses URL.Redacted() method, which has been added in v1.15. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1147	2021-03-29 23:06:36 +03:00
Aliaksandr Valialkin	6bfac94995	docs/CHANGELOG.md: cut v1.57.0	2021-03-29 19:15:01 +03:00
Aliaksandr Valialkin	8c957f0483	docs/CHANGELOG.md: typo fixes	2021-03-29 15:47:03 +03:00
Aliaksandr Valialkin	842c5a6202	docs/CHANGELOG.md: mention about logging of metrics with too old timestamps in a single-node VictoriaMetrics ... This is a follow up for aa81039b42	2021-03-29 15:43:27 +03:00
Aliaksandr Valialkin	3b8894e51e	docs/CHANGELOG.md: mention Graphite Render API fixes	2021-03-29 14:28:25 +03:00
Aliaksandr Valialkin	3fdc43a1c9	docs/CHANGELOG.md: mention optimized query performance on systems with many CPU cores	2021-03-29 13:55:46 +03:00
Aliaksandr Valialkin	8a3939e93e	docs: document that vmagent drops data blocks when remote storage replies with 400 and 409 http status codes ... This is a follow up for 1b7dc1e5a5. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1149	2021-03-26 14:43:41 +02:00
Aliaksandr Valialkin	a920e71809	lib/promscrape/discovery/kubernetes: properly handle too old resource version error message from Kubernetes watch API	2021-03-26 12:28:35 +02:00
Aliaksandr Valialkin	c5618949a0	docs/Cluster-VictoriaMetrics.md: mention that vmselect doesnt serve partial responses from export API ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1148	2021-03-25 21:03:32 +02:00
Aliaksandr Valialkin	b91e18af0e	docs/vmagent.md: add an example for -remoteWrite.label	2021-03-25 17:59:30 +02:00
Aliaksandr Valialkin	82047be90b	docs: add a link to the repository from build instruction for all the VictoriaMetrics components	2021-03-25 17:16:55 +02:00
Aliaksandr Valialkin	6de36b4e21	docs/vmagent.md: cosmetic fixes	2021-03-25 17:11:10 +02:00
Aliaksandr Valialkin	1b13d02728	docs/vmagent.md: cosmetic fixes	2021-03-25 16:54:37 +02:00
Aliaksandr Valialkin	155cd90fc8	docs/vmagent.md: typo fix: tupically -> typically	2021-03-25 16:48:27 +02:00
Aliaksandr Valialkin	450e23533d	docs/vmalert.md: remove misleading -evaluationInterval=3s from example config args ... 3s evaluation interval is too small for practical setups. It can result in increased load on datasource. So it is better to remove it from example config args, which are usually copy-pasted by novice users.	2021-03-25 15:31:10 +02:00
Aliaksandr Valialkin	b473c21915	app/vmselect/promql: do not merge time series during requests to /api/v1/query ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1141	2021-03-25 13:56:23 +02:00
Aliaksandr Valialkin	6b1f807418	app/vmagent: add -promscrape.consul.waitTime command-line flag for configuring Consul service discovery wait time ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1144	2021-03-23 19:34:12 +02:00
Aliaksandr Valialkin	3bcad1c513	docs/CHANGELOG.md: mention the feature from 44a6cc5eca	2021-03-23 19:00:51 +02:00
Aliaksandr Valialkin	d1e773266f	app/vmselect/graphite: accept and enforce extra_label in all the Graphite APIs	2021-03-23 15:30:15 +02:00
Aliaksandr Valialkin	e01bf33485	docs/Single-server-VictoriaMetrics.md: sync with README.md	2021-03-22 17:52:14 +02:00
Aliaksandr Valialkin	020b031bc3	docs/Articles.md: add https://blog.cybozu.io/entry/2021/03/18/115743	2021-03-22 17:52:13 +02:00
Aliaksandr Valialkin	799461d8bf	app/vmselect/graphite: follow-up after 529d7be26b	2021-03-18 16:33:00 +02:00
Aliaksandr Valialkin	ff6fe0698b	docs/Single-server-VictoriaMetrics.md: remove outdated message about experimental mode for -pure builds	2021-03-18 16:16:33 +02:00
Aliaksandr Valialkin	4443254fb9	lib/storage: prevent from infinite loop if {__graphite__="..."} filter matches a metric name with *, [ or { chars ... The idea has been borrowed from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1137	2021-03-18 14:57:39 +02:00
Aliaksandr Valialkin	156b4c2490	vendor: update github.com/VictoriaMetrics/metrics from v1.16.0 to v1.17.0	2021-03-17 23:22:40 +02:00
Aliaksandr Valialkin	93a318d1bf	vendor: update github.com/VictoriaMetrics/metrics from v1.15.3 to v1.16.0 ... This adds the following new metrics for each VictoriaMetrics app: * process_resident_memory_anonymous_bytes - the RSS share for memory allocated by the process itself. This share cannot be freed by the OS, so it must be taken into account by OOM killer. * process_resident_memory_pagecache_bytes - the RSS share for page cache memory (aka memory-mapped files). This share can be freed by the OS at any time, so it must be ignored by OOM killer.	2021-03-17 17:59:31 +02:00
Aliaksandr Valialkin	a3b3d434a3	docs/CHANGELOG.md: cut v1.56.0	2021-03-17 02:05:10 +02:00
Aliaksandr Valialkin	265ac5f695	docs/CHANGELOG.md: do not mention reduction in query duration ... There was a signficant refactoring in the code responsible for time series search, so it can result in both speed ups and slow downs depending on used queries.	2021-03-17 01:58:34 +02:00
Aliaksandr Valialkin	8ef1184adf	app/vmstorage: add vm_index_search_duration_seconds histogram for monitoring the performance of index search	2021-03-17 01:13:15 +02:00
Aliaksandr Valialkin	8005ba26b9	lib/netutil: enable IPv6 UDP listening if -enableTCP6 command-line flag is passed to VictoriaMetrics ... This is a follow-up for 18cfc4be7b See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1131	2021-03-17 00:19:30 +02:00
Aliaksandr Valialkin	3caac5edd4	Makefile: prepare vmutils-windows-*.zip archive on make release-vmutils command ... The archive contains the following executables for Windows: * vmagent * vmalert * vmauth * vmctl Other components - vmbackup, vmrestore, victoria-metrics - aren't supported for Windows yet	2021-03-16 20:54:10 +02:00
Aliaksandr Valialkin	f54ece438d	app/vmselect/promql: do not crash if histogram_over_time() function name contains uppercase letters such as Histogram_over_time()	2021-03-16 12:23:55 +02:00
Aliaksandr Valialkin	5c28e76ef8	docs/Articles.md: added a link to https://www.youtube.com/watch?v=QgLMztnj7-8	2021-03-15 23:02:35 +02:00
Aliaksandr Valialkin	d074326970	app/vmstorage: add -logNewSeries command-line flag for determining the source of series churn rate	2021-03-15 22:40:28 +02:00
Aliaksandr Valialkin	e2717d84c0	all: various fixes in command-line flag descriptions	2021-03-15 22:03:49 +02:00
Aliaksandr Valialkin	776b8b32ca	app/{vminsert,vmagent}: a follow-up for b1aa8c3d8f ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1124	2021-03-15 22:03:49 +02:00
Nikolay	a843dc0219	adds fake response for telegraph queries (#1130) ... https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1124	2021-03-15 22:03:49 +02:00
Aliaksandr Valialkin	b7ce96548c	docs/CHANGELOG.md: typo fix: FATURE -> FEATURE	2021-03-15 14:59:40 +02:00
Aliaksandr Valialkin	6b9bba7448	app/vmselect: add round_digits query arg to /api/v1/query and /api/v1/query_range handlers for limiting the number of decimal digits after the point	2021-03-15 12:38:59 +02:00
Aliaksandr Valialkin	1f2a7c3863	docs/Cluster-VictoriaMetrics.md: sync with cluster README.md	2021-03-15 11:51:03 +02:00
Aliaksandr Valialkin	b6dcb37fca	app/vmselect/prometheus: do not include datapoints with timestamps matching t-d when returning results from /api/v1/query?query=m[d]&time=t as Prometheus does	2021-03-12 12:18:37 +02:00
Aliaksandr Valialkin	a12d2013d5	docs/CaseStudies.md: fix incorrect number of active time series for Zhihu	2021-03-12 11:45:52 +02:00
Aliaksandr Valialkin	60e0280a94	lib/promscrape: add ability to configure proxy options via proxy_tls_config, proxy_basic_auth, proxy_bearer_token and proxy_bearer_token_file ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1116	2021-03-12 03:36:11 +02:00
Aliaksandr Valialkin	b240d41ede	docs/Articles.md: add https://www.sensedia.com/post/monitoring-with-prometheus-alertmanager	2021-03-12 01:23:22 +02:00
Aliaksandr Valialkin	ccfe944ce7	docs/ExttendedPromQL.md: remove outdated doc	2021-03-11 12:42:57 +02:00
Brensted	03c8438099	Update BestPractices.md (#1123) ... update lists, hyperlinks fixed.	2021-03-11 12:42:56 +02:00
Aliaksandr Valialkin	bd8b7a88a7	lib/httpserver: export vm_available_memory_bytes and vm_available_cpu_cores metrics ... These metrics are useful for tracking the available memory and CPU cores for VictoriaMetrics apps.	2021-03-10 12:08:26 +02:00
Ihor Borodin	933de6b9b1	Fixing examples of external.alert.source in documentation (#1120) ... * Fixing examples of external.alert.source in documentation	2021-03-10 12:08:22 +02:00
Aliaksandr Valialkin	f05f7831b8	docs/BestPractices.md: initial add	2021-03-10 12:08:17 +02:00
Aliaksandr Valialkin	9dfa71ad15	docs/CHANGELOG.md: mention about the bugfix from 787242d7b0	2021-03-09 20:56:48 +02:00
Aliaksandr Valialkin	9d8223eafb	lib/proxy: set missing ServerName in TLS config for proxy_url. ... While at it, allow setting Proxy-Authorization for `proxy_url` via `basic_auth` and `bearer_token` configs.	2021-03-09 19:01:14 +02:00
Aliaksandr Valialkin	0554430d7e	lib/promscrape: apply sample_limit after metric relabeling is applied as Prometheus does ... See the description for `sample_limit` option from Prometheus docs: Per-scrape limit on number of scraped samples that will be accepted. If more than this number of samples are present after metric relabeling the entire scrape will be treated as failed. 0 means no limit. https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config	2021-03-09 15:52:41 +02:00
Aliaksandr Valialkin	058aa0de75	docs/CHANGELOG.md: mention about improved query performance at 18fe0ff14b	2021-03-09 13:12:18 +02:00
Aliaksandr Valialkin	942890b1bb	app/vmselect/promql: follow up for 433fff0006	2021-03-09 12:54:23 +02:00
Aliaksandr Valialkin	2c5ac00231	vendor: update github.com/VictoriaMetrics/fasthttp from 1.0.12 to 1.0.13 ... This should fix a bug in vmagent with high CPU usage during failed scrapes with small `scrape_timeout`.	2021-03-09 11:44:44 +02:00
John Belmonte	edf39aa225	spelling fix: adjacent (#1115)	2021-03-09 09:19:16 +02:00
Aliaksandr Valialkin	502fab797a	lib/promscrape: add scrape_offset option to scrape_config ... This option can be used for specifying the particular offset per each scrape interval for target scraping	2021-03-08 11:59:32 +02:00
Aliaksandr Valialkin	175466bb41	lib/decimal: prevent exponent overflow when processing values close to zero ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1114	2021-03-05 18:53:41 +02:00
Aliaksandr Valialkin	26cb6f8861	app/vmauth: allow using regexps in url_map paths ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1112	2021-03-05 18:53:40 +02:00
Aliaksandr Valialkin	5807ff57f3	lib/promscrape/discovery/kubernetes: reduce memory usage when Kubernetes service discovery is configured on a big number of scrape jobs ... Previously vmagent was creating a separate Kubernetes object cache per each scrape job. This could result in increased memory usage when monitoring a Kubernetes cluster with big number of objects (pods / nodes / services, etc.) as seen at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1113 Now it uses a shared map of scrape objects across multiple scrape jobs.	2021-03-05 17:32:33 +02:00
Aliaksandr Valialkin	dfac6b53f5	docs/Articles.md: add https://dalefro.medium.com/prometheus-victoria-metrics-on-aws-ecs-62448e266090	2021-03-05 09:07:22 +02:00
Aliaksandr Valialkin	5277507932	app/vmselect/promql: add histogram_avg(), histogram_stddev() and histogram_stdvar() functions to MetricsQL	2021-03-04 14:12:52 +02:00
Aliaksandr Valialkin	133fb9fc00	lib/promscrape: add -promscrape.cluster.replicationFactor command-line flag for replicating scrape targets among vmagent instances in the cluster	2021-03-04 10:21:27 +02:00
Aliaksandr Valialkin	0ce89b85d4	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics needs free resources for handling workload spikes	2021-03-04 10:21:26 +02:00
Aliaksandr Valialkin	d109e17f46	all: bump minimum supported Go version from 1.13 to 1.14	2021-03-03 15:58:17 +02:00
Aliaksandr Valialkin	3c11ce9356	docs/vmagent.md: remove outdated suggestion for determining labels that lead to duplicate targets ... The original labels for duplicate targets is already printed in the error message starting from 71ea4935de	2021-03-03 12:28:50 +02:00
Aliaksandr Valialkin	0b8d9350d4	docs/CHANGELOG.md: cut v1.55.1 release	2021-03-03 11:49:26 +02:00
Aliaksandr Valialkin	b178f96ac2	docs/vmagent.md: make docs-sync after the commit 621bf03745	2021-03-03 10:53:43 +02:00
Aliaksandr Valialkin	3a79fa147b	docs/CHANGELOG.md: mention recent bugfixes from commits 7906316741 and e154f4a644	2021-03-03 10:50:59 +02:00
Alexandros Orfanos	ff5b8346d4	vmalert: docs update - status endpoint needs group ID, not group name (#1106)	2021-03-03 10:42:54 +02:00
Aliaksandr Valialkin	3a1d884618	docs/CHANGELOG.md: cut v1.55.0	2021-03-02 21:39:53 +02:00
Aliaksandr Valialkin	f686174329	lib/promscrape/discovery/ec2: follow-up after f6114345de	2021-03-02 13:47:35 +02:00
Aliaksandr Valialkin	e45c399467	lib/protoparser/prometheus: properly unescape label values in Prometheus exposition format ... Unescape only `\n`, `\"` and `\\` sequences as Prometheus does. Other escape sequences shouldn't be unescaped.	2021-03-02 13:22:10 +02:00
Aliaksandr Valialkin	f4969a624d	lib/protoparser/graphite: fix parsing of a Graphite line with empty tags such as foo; 1 2 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1100	2021-03-01 17:17:01 +02:00
Aliaksandr Valialkin	d9e8af0e8f	docs: actualize -help output	2021-03-01 17:02:05 +02:00
Aliaksandr Valialkin	3a87d38912	docs/CHANGELOG.md: mention the out of range panic bugfix d6a41b6ea2	2021-03-01 16:54:18 +02:00
Aliaksandr Valialkin	57d2a27a64	docs/CHANGELOG.md: mention the issue related to using Kubernetes watch API for service discovery	2021-03-01 01:42:05 +02:00
Aliaksandr Valialkin	d0be1f6f49	app/vmagent: remove data race when applying rate limits to -remoteWrite.url with multiple queues	2021-03-01 00:28:20 +02:00
Aliaksandr Valialkin	17eb29206d	docs/vmbackup.md: clarify docs on vmagent clustering	2021-02-28 21:59:55 +02:00
Aliaksandr Valialkin	0165063362	docs/CHANGELOG.md: mention about https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1074	2021-02-28 19:32:21 +02:00
Aliaksandr Valialkin	9e644ef111	lib/httpserver: make sure the gzipResponseWriter.Write() is called on Flush() and Close() calls ... This should fix the `http: superfluous response.WriteHeader call` issue See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1078	2021-02-28 19:23:26 +02:00
Aliaksandr Valialkin	9a2bf65134	lib/promscrape: add ability to spread scrape targets among multiple vmagent instances ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1084	2021-02-28 18:40:42 +02:00
Aliaksandr Valialkin	64b57c3ed3	docs/CHANGELOG.md: mention 317b0cbed2	2021-02-28 14:03:00 +02:00
Aliaksandr Valialkin	7f1302688f	lib/fs: follow-up after f3a03c4164	2021-02-27 01:09:37 +02:00
Aliaksandr Valialkin	095e61a37f	docs/CHANGELOG.md: mentioned a bugfix with extra_label handling during caching query results ... Related to 186c078fac	2021-02-27 00:23:39 +02:00
Aliaksandr Valialkin	c1b8729bd8	lib/fs: properly handle stale NFS file handle error during file deletion ... This error can appear when -storageDataPath points to NFS volume and the given file has been already removed.	2021-02-26 23:24:46 +02:00
Aliaksandr Valialkin	e38ca28d99	app/vmselect/promql: increase accuracy for buckets_limit() function for small limits by skipping the first and the last buckets during merge ... The first and the last buckets are usually `[0 ... leMin]` and `(leMax ... +Inf)`. If they are merged with adjancent buckets, then the resulting accuracy can suffer.	2021-02-26 22:56:04 +02:00
Aliaksandr Valialkin	dc8c045378	lib/promscrape: cleanup after 9b2246c29b ... Main points: * Revert changes outside lib/promscrape/discovery/kuberntes . These changes can be applied later in a separate commit * Minimize changes in lib/promscrape/discovery/kubernetes compared to a93e644001 * Corner case fixes.	2021-02-26 19:09:12 +02:00
dereksfoster99	5b5254793d	Alphabetized names and added "native speaker" spin. (#1093) ... Do we have the dates that each of these were written so that can be added next to each brand?	2021-02-26 16:41:26 +02:00
dereksfoster99	1f088eb571	Native speaker edits. (#1088) ... I made an effort to not change anything substantive.	2021-02-26 16:41:24 +02:00
Aliaksandr Valialkin	0144b164c7	app/vmselect: add sign(q) and clamp(q, min, max) functions, which will be added in the upcoming Prometheus release ... See https://twitter.com/roidelapluie/status/1363428376162295811 The `last_over_time(m[d])` function already exists in MetricsQL.	2021-02-24 17:26:27 +02:00
Aliaksandr Valialkin	0c76828ba6	docs/CHANGELOG.md: mention about a bugfix from 4805b80977	2021-02-24 11:48:54 +02:00
Aliaksandr Valialkin	d16effc29e	app/vmselect/promql: properly calculate histogram_quantile() over zero buckets and only a single non-zero le="+Inf"` bucket like Prometheus does	2021-02-24 00:41:30 +02:00
Aliaksandr Valialkin	5dbe88a1c6	app/vmselect/promql: add increase_pure() function to MetricsQL ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/962	2021-02-22 19:15:31 +02:00
Aliaksandr Valialkin	07effa77d9	app/vmselect/graphite: support Storage-Step header value and storage_step query arg at /render API	2021-02-22 18:33:51 +02:00
Aliaksandr Valialkin	63c16c3fdf	lib/promrelabel: optimize relabeling performance for common cases	2021-02-22 00:51:07 +02:00
Aliaksandr Valialkin	8b87398333	lib/promscrape: export vm_promscrape_target_relabel_duration_seconds metric	2021-02-21 23:21:35 +02:00
Aliaksandr Valialkin	1adbbe7617	vendor: update github.com/VictoriaMetrics/metrics from v1.14.0 to v1.15.0 ... The v1.15.0 exports the following additional metrics: process_io_read_bytes_total - the number of bytes read via io syscalls such as read and pread process_io_written_bytes_total - the number of bytes written via io syscalls such as write and pwrite process_io_read_syscalls_total - the number of read syscalls such as read and pread process_io_write_syscalls_total - the number of write syscalls such as write and pwrite process_io_storage_read_bytes_total - the number of bytes read from storage layer process_io_storage_written_bytes_total - the number of bytes written to storage layer These metrics can be used for monitoring process io	2021-02-21 22:53:54 +02:00
Aliaksandr Valialkin	72eef964d9	app/vmagent: properly perform graceful shutdown, which was broken in the commit 1d1ba889fe ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1065	2021-02-19 00:34:17 +02:00
Aliaksandr Valialkin	41d3ff4f2b	app/vmagent: fix scrape config example for scrape_align_interval option	2021-02-18 23:57:45 +02:00
Aliaksandr Valialkin	502d0e2524	lib/promscrape: add scrape_align_interval config option into scrape config ... This option allows aligning scrapes to a particular intervals.	2021-02-18 23:53:04 +02:00
Aliaksandr Valialkin	bd1d906eee	app/vmselect/promql: reduce the probability of duplicate time series errors when querying Kubernetes metrics	2021-02-18 22:08:13 +02:00
Aliaksandr Valialkin	3a8b2eed58	docs/CHANGELOG.md: cut v1.54.1	2021-02-18 19:10:57 +02:00
Aliaksandr Valialkin	418de71509	lib/storage: properly handle queries containing a filter on metric name plus any number of negative filters and zero non-negative filters ... Example: `node_cpu_seconds_total{mode!="idle"}`	2021-02-18 18:33:05 +02:00
Aliaksandr Valialkin	0af9fbe326	docs/Articles.md: add a link to https://www.percona.com/blog/2021/02/12/tame-kubernetes-costs-with-percona-monitoring-and-management-and-prometheus-operator/	2021-02-18 16:37:22 +02:00
Aliaksandr Valialkin	be93e02085	docs/CHANGELOG.md: cut v1.54.0	2021-02-18 14:52:52 +02:00
Aliaksandr Valialkin	a5bfd831fb	docs/Articles.md: add a link to https://medium.com/alteos-tech-blog/observability-availability-and-doras-research-program-85deb6680e78	2021-02-18 01:25:54 +02:00
Aliaksandr Valialkin	9c81429299	app/vmagent/remotewrite: cleanup after 1d1ba889fe ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1065	2021-02-17 21:43:48 +02:00
Aliaksandr Valialkin	57d192a2c2	docs/CHANGELOG.md: mention that prod binaries are built now with Go1.16 ... This is a follow-up for 4edfe76bef	2021-02-17 21:07:48 +02:00
Aliaksandr Valialkin	80699405aa	docs/CaseStudies.md: actualize Wix numbers	2021-02-17 21:03:42 +02:00
Aliaksandr Valialkin	31e04e0d45	docs/CHANGELOG.md: document new per-tenant metrics	2021-02-16 23:33:59 +02:00
Aliaksandr Valialkin	667a7594b7	docs: rename vmbackuper to vmbackupmanager	2021-02-16 22:01:21 +02:00
Aliaksandr Valialkin	93ff866e91	lib/storage: reduce the minimum supported retention for inverted index from one month to one day	2021-02-15 15:11:15 +02:00
Aliaksandr Valialkin	fccb481de2	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_endpoints_label_* and __meta_kuberntes_endpoints_annotation_* labels to role: endpoints ... This syncs kubernetes SD with Prometheus 2.25 See 617c56f55a	2021-02-15 02:51:36 +02:00
Aliaksandr Valialkin	cb6eba2ce0	docs/Cluster-VictoriaMetrics.md: clarify replication docs	2021-02-15 01:44:22 +02:00
Aliaksandr Valialkin	9e3993c585	lib/storage: properly hanle regexp tag filters with dots, which can be converted to full string match filters. ... For example `{label=~"foo\.bar"}` should be converted to `{label="foo.bar"}`. Previously it has was mistakenly conveted to `{label="foo\.bar"}` . This could result in missing time series for such tag filters.	2021-02-14 23:39:19 +02:00
Aliaksandr Valialkin	f85c2f052f	docs/CHANGELOG.md: mention about fixed multiarch build for Docker images ... Related commit: f9902b3372	2021-02-12 15:24:16 +02:00
Aliaksandr Valialkin	a463cda759	docs/Cluster-VictoriaMetrics.md: mention that /api/v1/import/prometheus supports OpenMetrics data	2021-02-12 00:59:27 +02:00
Aliaksandr Valialkin	670cc20b71	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics support data ingestion in OpenMetrics format	2021-02-12 00:57:33 +02:00
Aliaksandr Valialkin	9e88ff3075	app/vmauth: add ability to route requests from a single users to multiple targets depending on the requested path ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1064	2021-02-11 12:41:38 +02:00
Aliaksandr Valialkin	985c3e301d	app/vmselect: parallelize q1 <binary_op> q2 queries by running q1 and q2 in parallel ... This should reduce query execution times.	2021-02-10 23:00:56 +02:00
Aliaksandr Valialkin	148422bcba	lib/storage: disable composite index usage when querying old data	2021-02-10 14:57:58 +02:00
Aliaksandr Valialkin	fa0ef143b1	lib/storage: optimize search by label filters matching big number of time series	2021-02-10 00:46:17 +02:00
Aliaksandr Valialkin	7b7963a77f	lib/mergeset: unconditionally cache indexdb blocks ... Production workloads show that indexdb blocks must be cached unconditionally for reducing CPU usage. This shouldn't increase memory usage too much, since unused blocks are removed from the cache every two minutes.	2021-02-09 00:49:59 +02:00
Aliaksandr Valialkin	62574c478a	docs/CHANGELOG.md: mention about a bugfix for timezone data from df0cda3ab9	2021-02-08 16:01:26 +02:00
Aliaksandr Valialkin	2b36eb3d82	lib/cgroup: follow-up after b9bf3cbe3e	2021-02-08 16:01:26 +02:00
Aliaksandr Valialkin	35eb04b7dd	docs/vmctl.md: fix title, so it is properly displayed in the header of https://victoriametrics.github.io/	2021-02-04 20:20:38 +02:00
Aliaksandr Valialkin	191bc0bcf3	docs: sync with master branch	2021-02-04 20:02:24 +02:00
Aliaksandr Valialkin	8e5dad8483	docs/CHANGELOG.md: mention recently added changes	2021-02-04 16:42:33 +02:00
Aliaksandr Valialkin	b5eba70595	lib/httpserver: expose process_open_fds and process_max_fds metrics ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/402 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1037	2021-02-04 16:42:32 +02:00
Roman Khavronenko	2aa37b0450	vmalert: mention -datasource.appendTypePrefix in README (#1052)	2021-02-03 23:48:45 +02:00
Aliaksandr Valialkin	e802daa9ee	docs/CHANGELOG.md: cut v1.53.1	2021-02-03 22:51:06 +02:00
Aliaksandr Valialkin	88ee836d0c	docs/vmalert.md: mention that type option can be set at group level additionally to rule level	2021-02-03 21:12:39 +02:00
Aliaksandr Valialkin	a3aa9bdc9f	app/vmagent: add Advanced usage section with the description for all the command-line flags	2021-02-03 21:03:52 +02:00
Aliaksandr Valialkin	e6bcef6514	docs/CHANGELOG.md: mention that {__graphite__="foo.*.bar"} syntax deprecates -search.treatDotsAsIsInRegexps command-line flag	2021-02-03 20:42:18 +02:00
Aliaksandr Valialkin	e4a013d5d7	docs/Single-server-VictoriaMetrics.md: remove misleading section about native format in How to export data in JSON line format chapter	2021-02-03 20:42:17 +02:00
Aliaksandr Valialkin	8de3a329ff	app/vmselect: deprecate -search.treatDotsAsIsInRegexps in favor to {__graphite__="foo.*.bar"} syntax	2021-02-03 20:36:42 +02:00
Aliaksandr Valialkin	2976ec89b8	lib/storage: fix a bug, which breaks searching by Graphite wildcard filters	2021-02-03 20:15:50 +02:00
Aliaksandr Valialkin	785b770af3	docs/CHANGELOG.md: fix a link to Graphite Render API usage docs	2021-02-03 12:30:09 +02:00
Aliaksandr Valialkin	844f9991be	docs: mention about Graphite render API implementation	2021-02-03 12:13:08 +02:00
Aliaksandr Valialkin	b0acea9d4f	docs/Cluster-VictoriaMetrics.md: document Graphite Render API endpoint	2021-02-03 12:03:40 +02:00
Aliaksandr Valialkin	c69b52cf31	docs/CHANGELOG.md: cut v1.53.0	2021-02-03 03:43:14 +02:00
Aliaksandr Valialkin	52b218c07e	docs/Single-server-VictoriaMetrics.md: sync with master branch	2021-02-03 01:37:55 +02:00
Aliaksandr Valialkin	4b930b9ffe	app/vmselect: add ability to set Graphite-compatible filter via {__graphite__="foo.*.bar"} syntax	2021-02-03 01:17:19 +02:00
Aliaksandr Valialkin	755b0998ce	lib/promscrape: add vm_promscrape_service_discovery_duration_seconds metric	2021-02-02 16:16:51 +02:00
Aliaksandr Valialkin	4c59dbc127	lib/promscrape: add vm_promscrape_scrape_retries_total, vm_promscrape_discovery_retries_total and vm_promscrape_discovery_requests_total metrics	2021-02-01 20:06:16 +02:00
Aliaksandr Valialkin	03da0b728c	docs: increase heading sizes in vmagent, vmauth, vmbackup and vmrestore docs, so they match the heading sizes in VictoriaMetrics docs	2021-02-01 19:44:58 +02:00
Aliaksandr Valialkin	f4a4665857	docs/vmctl.md: update build instructions after the migration from github.com/VictoriaMetrics/vmctl to github.com/VictoriaMetrics/VictoriaMetrics/app/vmctl	2021-02-01 19:44:57 +02:00
Aliaksandr Valialkin	286625e4b3	docs: sync with master branch	2021-02-01 18:05:58 +02:00
Aliaksandr Valialkin	6811445b64	docs: document ability to query Graphite datasource from vmalert	2021-02-01 15:28:31 +02:00
Aliaksandr Valialkin	fdf9de98f8	app/vmagent: add -remoteWrite.roundDigits command-line option for limiting the number of digits after the point for stored values ... This commit also adds --vm-round-digits command-line option to vmctl tool.	2021-02-01 14:42:15 +02:00
Aliaksandr Valialkin	7f4fb34182	app/vmctl: move vmctl code from github.com/VictoriaMetrics/vmctl ... It is better developing vmctl tool in VictoriaMetrics repository, so it could be released together with the rest of vmutils tools such as vmalert, vmagent, vmbackup, vmrestore and vmauth.	2021-02-01 01:18:39 +02:00
Aliaksandr Valialkin	ff526492eb	docs/Cluster-VictoriaMetrics.md: mention about -search.denyPartialResponse command-line flag and deny_partial_response query arg	2021-01-27 14:06:14 +02:00
Aliaksandr Valialkin	db5b78f65c	docs/CHANGELOG.md: typo fixes	2021-01-27 01:20:31 +02:00
Aliaksandr Valialkin	ffec5131ae	lib/promscrape: export vm_promscrape_scrapes_failed_per_url_total and vm_promscrape_scrapes_skipped_by_sample_limit_per_url_total metrics ... These metrics could be useful for determining imporperly working scrape targets. Note that these metrics are exported only for failing scrape targets. They aren't exposed for normally working targets.	2021-01-27 00:40:39 +02:00
Aliaksandr Valialkin	29bf531f7d	app/vmagent: add -remoteWrite.rateLimit command-line flag for limiting data rate to remote storage ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1035	2021-01-27 00:40:39 +02:00
Aliaksandr Valialkin	68a66be811	lib/logger: add -loggerTimezone command-line flag for adjusting timezone for timestamps in log messages	2021-01-26 22:53:25 +02:00
Aliaksandr Valialkin	9e175683b1	docs/CHANGELOG.md: mention about https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1027	2021-01-26 16:38:22 +02:00
Aliaksandr Valialkin	fdced59278	lib/promscrape: retry scrape and service discovery requests when the remote server closes http keep-alive connection	2021-01-22 13:22:59 +02:00
Aliaksandr Valialkin	7308691865	docs/CHANGELOG.md: mention about the fix with too big HTTP reconnection rate to targets ... This has been fixed in 0a45220b0a	2021-01-22 12:10:01 +02:00
Aliaksandr Valialkin	e55205220b	app/vmselect: add -search.maxStepForPointsAdjustment command-line flag, which can be used for disabling adjustment for points returned from /api/v1/query_range handler if they have timestamps closer than -search.latencyOffset to the current time	2021-01-19 22:57:50 +02:00
Aliaksandr Valialkin	5640e6cbca	docs/vmagent.md: follow-up for 184a659c5f	2021-01-13 13:54:28 +02:00
mancubus77	6f3560d256	Doco vmagent fix (#1014) ... * Update section with remote_write.url for clustered version * fix typo Co-authored-by: mancubus <dont@write.me>	2021-01-13 13:54:27 +02:00
Aliaksandr Valialkin	d23d6d4bfa	docs/CHANGELOG.md: cut v1.52.0	2021-01-13 12:59:08 +02:00
Aliaksandr Valialkin	c5bdab5a4c	app/vmselect/promql: add ability to pass multiple labels to sort_by_label and sort_by_label_desc functions ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/992	2021-01-13 12:43:47 +02:00
Aliaksandr Valialkin	81789da731	lib/backup: increase backup chunk size from 128MB to 1GB ... This should reduce costs for object storage API calls by 8x. See https://cloud.google.com/storage/pricing#operations-pricing	2021-01-13 12:16:39 +02:00
Aliaksandr Valialkin	8cae98aa78	app/vmselect/promql: properly parse escaped multibyte utf8 code sequences in metric names and labels names ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/990	2021-01-13 10:59:32 +02:00
Aliaksandr Valialkin	2d4006cb4a	docs/CHANGELOG.md: document updated extra_label query arg behavior ... Follow-up for dc9d7aedd5	2021-01-13 01:07:25 +02:00
Nikolay	821492bc0b	adds extra_label to all import apis (#1007) ... * adds extra_label to all import apis, changes priority for extra_label - now it has priority over original labels * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * adds extra labels to vmagent import api changes order for adding labels, now its added after user values * adds tests for extra_label * import fix Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2021-01-13 01:07:24 +02:00
Aliaksandr Valialkin	bc8b38daca	docs/CHANGELOG.md: mention that the minimum supported TLS version now is v1.2 ... Follow-up for 7bf5d48315	2021-01-13 00:45:08 +02:00
Aliaksandr Valialkin	b71748f1d9	docs/Single-server-VictoriaMetrics.md: typo fix	2021-01-12 22:03:46 +02:00
Aliaksandr Valialkin	8711860327	deployment/docker: upgrade base image for Docker packages from Alpine 3.13.1 to Alpine 3.12.3 in order to fix potential security issues ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1010	2021-01-12 21:57:07 +02:00
Aliaksandr Valialkin	df6e399f73	app/vmselect/promql: add tfirst_over_time(m[d]) and tlast_over_time(m[d]) MetricsQL functions for returning timestamps for the first and the last samples in m over d	2021-01-12 16:12:47 +02:00
Aliaksandr Valialkin	de04dd81cf	docs/Articles.md: add https://cer6erus.medium.com/cloud-native-model-driven-telemetry-stack-on-openshift-80712621f5bc	2021-01-12 15:36:50 +02:00
Aliaksandr Valialkin	1dee98a331	docs/CHANGELOG.md: document big fixes from the commit 7976c22797	2021-01-12 13:44:10 +02:00
Aliaksandr Valialkin	c97681b45c	lib/promscrape: properly show scrape duration on /targets page ... Previously it has been shown as 0.000s for any scrape duration.	2021-01-11 21:15:50 +02:00
Aliaksandr Valialkin	bdf67a13cc	docs/Single-server-VictoriaMetrics.md: mention about https://github.com/aorfanos/vmalert-cli in Integrations section	2021-01-11 18:52:56 +02:00
Aliaksandr Valialkin	4731780a38	docs/CHANGELOG.md: mention about a bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/989	2021-01-11 13:11:53 +02:00
Aliaksandr Valialkin	4ee53c3961	all: use net.Dial instead of fasthttp.Dial, because fasthttp.Dial limits the number of concurrent dials to 1000	2021-01-11 12:52:51 +02:00
Aliaksandr Valialkin	d5a2b120e9	app/vmstorage: disable final merge by default, since it may result in high disk IO and CPU usage without measurable benefits such as increased query performance and reduced disk space usage	2021-01-08 00:12:12 +02:00
Aliaksandr Valialkin	fa176dacf1	docs/Single-server-VictoriaMetrics.md: sync with upstream	2021-01-07 23:39:21 +02:00
Aliaksandr Valialkin	5fb8cf00c3	docs/Cluster-VictoriaMetrics.md: typo fix	2021-01-07 23:39:12 +02:00
Nikolay	137efe6c71	Snap docs change (#986) ... * adds snap docs, adds release information for snap package, adds docs notes about configuration management with snap package. * adds release page mention * version fix for snap, its awful * revert version * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-12-29 11:44:50 +02:00
Aliaksandr Valialkin	e2d8b9e091	README.md: mention about -search.queryStats.lastQueriesCount and -search.queryStats.minQueryDuration command-line flags in docs about query stats	2020-12-29 11:39:45 +02:00
Aliaksandr Valialkin	66a19e0079	docs/CHANGELOG.md: cut v1.51.0	2020-12-27 14:21:41 +02:00
Aliaksandr Valialkin	47872ada7e	app/vmselect/promql: do not ajdust offset value provided in the query ... Previously it could be modified in order to improve response cache hit ratio. This is unneeded, since cache hit ratio should remain good because the query time range should be already aligned to multiple of `step` values. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/976	2020-12-27 14:10:15 +02:00
Aliaksandr Valialkin	5c8e4cf03e	docs/Articles.md: add a link to https://www.percona.com/blog/2020/12/23/observations-on-better-resource-usage-with-percona-monitoring-and-management-v2-12-0/	2020-12-27 13:02:08 +02:00
Aliaksandr Valialkin	5bbf200de2	app/vmselect: add per-tenant /api/v1/status/top_queries handler	2020-12-27 12:53:50 +02:00
Aliaksandr Valialkin	e6deb39064	app/vmselect: refactor /api/v1/stats/top_queries ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/907	2020-12-25 17:24:25 +02:00
Aliaksandr Valialkin	991262d53e	docs/CHANGELOG.md: mention that vmalert now properly escapes multi-line queries when passing to Grafana ... A follow-up for 1de15ad490 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890	2020-12-25 11:12:57 +02:00
Nikolay	14915071d6	adds escape for CRLF (#984) ... at external.alert.source - \n and \r symbols was url encoded, instead of direct usage. replace it from "\n" to `\n` allows to skip url encoding. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890	2020-12-25 11:06:47 +02:00
Aliaksandr Valialkin	b480585905	app/vmalert: typo fix in descriptions for notifier.basicAuth.username and notifier.basicAuth.password command-line flags	2020-12-24 12:49:40 +02:00
Aliaksandr Valialkin	2a8bd2b5cc	docs/CHANGELOG.md: mention about adding missing __meta_kubernetes_service_* labels for endpoints and endpointslices roles in kubernetes_sd_config ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/982	2020-12-24 11:34:01 +02:00
Aliaksandr Valialkin	367fc17933	lib/promscrape: code prettifying for 8dd03ecf19	2020-12-24 10:57:20 +02:00
Aliaksandr Valialkin	d8511b6651	docs: mention that it is possible to set multiple -notifier.tlsInsecureSkipVerify command-line flags for vmalert ... See c3a92968343c2b3619f1ab935702d0e9b3a46733	2020-12-22 22:32:56 +02:00
Aliaksandr Valialkin	fa3bcf220f	lib/storage: remove stale parts as soon as they go outside the configured retention ... Previously such parts could remain undeleted for long durations until they are merged with other parts. This should help for `-retentionPeriod` values smaller than one month.	2020-12-22 19:55:07 +02:00
Artem Navoiev	f6b76b5c01	add linkedin to release announcement	2020-12-21 08:57:23 +02:00
Artem Navoiev	618ecd4708	Announcement guide	2020-12-20 00:45:02 +02:00
Aliaksandr Valialkin	787cbd2f7e	docs/CHANGELOG.md: cut v1.50.2	2020-12-19 15:32:45 +02:00
Aliaksandr Valialkin	a5b17946fe	docs/CHANGELOG.md: mention about bugfix for populating template variables in vmalert ... See 404cbd1522 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/974	2020-12-19 14:21:28 +02:00
Aliaksandr Valialkin	262cf81757	app/vmselect: properly parse negative combined offsets such as -1h2m3s ... Previously such offsets were parsed as `-1h + 2m + 3s`. Now they are parsed as `-(1h + 2m + 3s)`.	2020-12-19 01:25:03 +02:00
Aliaksandr Valialkin	5aa2b0de55	docs/CHANGELOG.md: there is no visible difference for CPU usage and disk IO usage on production workloads	2020-12-19 00:51:32 +02:00
Aliaksandr Valialkin	edbe35509e	lib/{storage,mergeset}: tune background merge process in order to reduce CPU usage and disk IO usage	2020-12-18 20:01:20 +02:00
Aliaksandr Valialkin	c5b47df8a4	docs/CHANGELOG.md: mention that Docker images for vmagent, vmalert, vmauth, vmbackup and vmrestore with tags containing -cluster suffix are no longer published ... See 441822c4cc for details	2020-12-18 20:01:18 +02:00
Aliaksandr Valialkin	39f7fa4743	docs: alphabetically sort links to case studies	2020-12-18 12:31:03 +02:00
Aliaksandr Valialkin	5b2fd08b27	docs/Articles.md: classify articles by themes	2020-12-18 12:05:39 +02:00
Aliaksandr Valialkin	6edd3330b4	add a link to https://www.percona.com/blog/2020/12/16/percona-monitoring-and-management-migration-from-prometheus-to-victoriametrics-faq/	2020-12-18 11:44:31 +02:00
Aliaksandr Valialkin	4fd2973e7c	lib/protoparser/prometheus: follow-up commit after 7d38627b9f6f212ae602aea6a72f469fe3c70ba2 ... Document the bugfix in docs/CHANGELOG.md and add a test for the bugfix.	2020-12-16 23:42:17 +02:00
Aliaksandr Valialkin	49b6c6f6ab	docs/FAQ.md: add a link to https://valyala.medium.com/promscale-vs-victoriametrics-resource-usage-on-production-workload-91c8e3786c03 in the question about benchmarks	2020-12-16 23:15:49 +02:00
Aliaksandr Valialkin	2b5700b1c4	docs/Articles.md: add a link to https://valyala.medium.com/promscale-vs-victoriametrics-resource-usage-on-production-workload-91c8e3786c03	2020-12-16 14:27:01 +02:00
Aliaksandr Valialkin	f6b51889ce	docs/Cluster-VictoriaMetrics.md: fix incorrect commands for profile collecting	2020-12-16 01:06:49 +02:00
Aliaksandr Valialkin	69b3ca37d0	docs/Cluster-VictoriaMetrics.md: add Profiling section	2020-12-16 00:59:53 +02:00
Aliaksandr Valialkin	34622f7f9b	docs/CHANGELOG.md: cut v1.50.1 release	2020-12-15 21:11:53 +02:00
Aliaksandr Valialkin	1022505131	docs/Release-Guide.md: actualize release docs	2020-12-15 21:11:02 +02:00
Aliaksandr Valialkin	f89c3e505a	docs/CHANGELOG.md: mention about bugfix, which properly removes unregistered targets from /targets page ... See bugfix at a4c7fcb5e1	2020-12-15 21:07:28 +02:00
Aliaksandr Valialkin	49e800ba55	app/vmagent: add vmagent_remotewrite_blocks_sent_total and vmagent_remotewrite_bytes_sent_total metrics per each -remoteWrite.url	2020-12-15 20:41:08 +02:00
Aliaksandr Valialkin	9ab7ca1133	docs/vmagent.md: typo fix: pearsed->parsed	2020-12-15 19:03:35 +02:00
Aliaksandr Valialkin	11674a9b76	docs/vmagent.md: mention that sample_limit option has no sense when stream parsing is enabled	2020-12-15 18:44:19 +02:00
Aliaksandr Valialkin	dd47c8f084	docs/CHANGELOG.md: cut v1.50.0 release	2020-12-15 14:45:00 +02:00
Aliaksandr Valialkin	eddc2bd017	lib/promscrape: properly handle scrape errors when stream parsing is enabled ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/967	2020-12-15 14:10:52 +02:00
Aliaksandr Valialkin	aca669c89c	docs/CHANGELOG.md: mention that vmagent now accepts multiple -remoteWrite.sendTimeout and -remoteWrite.tlsInsecureSkipVerify command-line flags	2020-12-15 12:59:34 +02:00
Aliaksandr Valialkin	e85159813f	docs/CHANGELOG.md: mention about adding query, first and value functions to alert templates ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/539	2020-12-14 20:17:46 +02:00
Aliaksandr Valialkin	09a03b862d	docs/CHANGELOG.md: mention bugfix for proper recovering from incorrectly stored persistent queue ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/964	2020-12-14 19:29:23 +02:00
Aliaksandr Valialkin	a2eb451de4	app/{vmagent,vminsert}: follow-up for ce8c2dd1f1: return /targets page in HTML when requested via web browser	2020-12-14 14:13:01 +02:00
Aliaksandr Valialkin	756fc6fc6c	app/victoria-metrics: automatically reset response cache when samples with too timestamps older than now - search.cacheTimestampOffset are ingested	2020-12-14 13:10:16 +02:00
Aliaksandr Valialkin	c0db28cd9a	docs/MetricsQL.md: clarify that limitk(k, q) returns an arbitrary set of k time series with each call ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/951	2020-12-12 14:18:02 +02:00
Aliaksandr Valialkin	eed84ac2b5	docs/FAQ.md: use less confusing links in the chapter explaining why VictoriaMetrics doesnt support Prometheus remote_read API	2020-12-11 21:23:55 +02:00
Aliaksandr Valialkin	fc82c22e50	docs: consistently use links to https://victoriametrics.github.io for documentation references	2020-12-11 21:09:17 +02:00
Aliaksandr Valialkin	f1b303e70d	docs/Single-server-VictoriaMetrics.md: clarify docs in Relabeling section	2020-12-11 18:24:31 +02:00
Aliaksandr Valialkin	3ec5387a36	docs/CHANGELOG.md: mention https://github.com/VictoriaMetrics/VictoriaMetrics/issues/955	2020-12-11 17:49:04 +02:00
Aliaksandr Valialkin	d6f9bf2d19	app/vmselect/graphite: properly handle wildcards and charsets inside curly braces ... For example, `foo{bar*,[a-f]a*b}` should match `foobar`, `foobar123`, `foofab`, etc. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/952	2020-12-11 17:26:32 +02:00
Aliaksandr Valialkin	82d26d9dfe	docs/Single-server-VictoriaMetrics.md: sync with upstream README.md via make docs-sync	2020-12-11 12:09:17 +02:00
faceair	054ad542b0	docs/CaseStudies.md: add case study for zhihu (#956)	2020-12-11 12:09:16 +02:00
Aliaksandr Valialkin	4804e004f3	docs/Single-server-VictoriaMetrics.md: clarify that the recommended value for -dedup.minScrapeInterval is scrape_interval from Prometheus configs	2020-12-09 12:16:25 +02:00
Aliaksandr Valialkin	a52924c7a3	docs/CHANGELOG.md: mention about memory leak fix in vmagent when big number of targets is discovered via service discovery	2020-12-09 10:36:05 +02:00
Aliaksandr Valialkin	5b1c4f702e	docs/Single-server-VictoriaMetrics.md: sync with upstream README.md via make docs-sync	2020-12-09 10:28:24 +02:00
Aliaksandr Valialkin	a84467958a	lib/promscrape/discovery/consul: properly pass Datacenter filter to Consul API server ... Previously it has been passed as `sdc` query arg, while it should be passed as `dc` query arg. See https://www.consul.io/api-docs/health#list-nodes-for-service for details. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/574#issuecomment-740454170	2020-12-08 21:53:23 +02:00
Aliaksandr Valialkin	1a237c6903	all: properly handle CPU limits set on the host system/container ... This can reduce memory usage on systems with enabled CPU limits. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/946	2020-12-08 21:07:03 +02:00
Aliaksandr Valialkin	06091cfdf8	lib/promscrape: export vm_promscrape_scrapers_{started|stopped}_total metrics for monitoring target churn rate	2020-12-08 11:58:44 +02:00
Aliaksandr Valialkin	56a0b058c1	lib/promscrape: export vm_promscrape_active_scrapers{type="<sd_type>"} metric for tracking the number of active scrapers per each service discovery type	2020-12-08 01:54:44 +02:00
Aliaksandr Valialkin	b5b32c65b0	lib/promscrape: do not enable strict config parsing when -promscrape.config.dryRun command-line flag is passed ... Strict parsing for -promscrape.config can be enabled by passing `-promscrape.config.strictParse` command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/944	2020-12-07 13:18:16 +02:00
Aliaksandr Valialkin	9660774fd1	app/vmselect/graphite: remove duplicate name tag from /tags/autoComplete/tags handler ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/942	2020-12-07 01:10:02 +02:00
Aliaksandr Valialkin	3d00613076	lib/protoparser/influx: allow multiple whitespace chars between measurement, fields and timestamp in Influx line protocol	2020-12-06 12:00:28 +02:00
Aliaksandr Valialkin	80084d1827	docs/CHANGELOG.md: cut v1.49.0	2020-12-05 13:49:17 +02:00
Aliaksandr Valialkin	f4f530d686	deployment/docker: update Go builder from v1.15.5 to v1.15.6 ... This fixes issues found in Go since v1.15.5 - see https://github.com/golang/go/issues?q=milestone%3AGo1.15.6+label%3ACherryPickApproved	2020-12-05 12:38:14 +02:00
Aliaksandr Valialkin	d242c2f2bd	app/vmselect/promql: add count_eq_over_time(m[d], N) and count_ne_over_time(m[d], N) for calculating the number of samples in m over d that are equal / not equal to N	2020-12-05 12:31:01 +02:00
Aliaksandr Valialkin	bdac2171f1	all: do not print usage info for all the flags when incorrect command-line flag is passed ... This should improve usability for VictoriaMetrics apps that have big number of command-line flags, i.e. all the apps.	2020-12-03 21:46:19 +02:00
Aliaksandr Valialkin	8cf76d8747	app/vmselect/promql: add label_uppercase(q, label1, ... labelN) and label_lowercase(q, label1, ... labelN) functions ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/936	2020-12-03 21:46:18 +02:00
Aliaksandr Valialkin	7a889f6850	lib/promscrape: code cleanup after c6dee6c52d ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/574	2020-12-03 19:52:09 +02:00
Aliaksandr Valialkin	fca915dcf3	docs/Single-server-VictoriaMetrics.md: update features chapter according to the latest developments	2020-12-03 13:01:46 +02:00
Aliaksandr Valialkin	45c402ad8a	docs/Single-server-VictoriaMetrics.md: remove duplicate provide word	2020-12-03 09:48:54 +02:00
Aliaksandr Valialkin	dd96714a2c	docs/FAQ.md: add a link to https://valyala.medium.com/prometheus-vs-victoriametrics-benchmark-on-node-exporter-metrics-4ca29c75590f in performance comparisons section	2020-12-02 21:25:15 +02:00
Aliaksandr Valialkin	9e98a8f3d3	app/vmselect/promql: return nan from minute(m) when m equals to nan ... This aligns VictoriaMetrics behaviour with Prometheus behaviour. The issue has been spotted in https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 20:16:40 +02:00
Aliaksandr Valialkin	490c70a958	app/vmselect: return metric values from time() cmp_op metric query when cmp_op comparison is true ... This aligns MetricsQL behavior to Prometheus' one. The issue has been identified at https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 12:09:40 +02:00
Aliaksandr Valialkin	a8c5e2f0c5	vendor: upgrade github.com/VictoriaMetrics/metricsql from v0.7.2 to v0.7.3 ... This fixes parsing of hex numbers in MetricsQL such as 0x3b The bug has been detected at https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 08:11:42 +02:00
Aliaksandr Valialkin	e6bc08436c	docs/Articles.md: add a link to https://victoriametrics.medium.com/how-to-monitor-go-applications-with-victoriametrics-c04703110870	2020-12-02 07:21:10 +02:00
Aliaksandr Valialkin	a34910e12c	docs/Articles.md: add a link to an article on how Percona PMM has been migrated from Prometheus to VictoriaMetrics	2020-12-02 07:21:08 +02:00
Aliaksandr Valialkin	4ef7158e89	app/vmselect/promql: return nan from a >bool b if a is nan in the same way as Prometheus does	2020-12-02 00:28:56 +02:00
Aliaksandr Valialkin	2ed721e457	lib/protoparser/prometheus: properly parse OpenMetrics timestamps ... OpenMetrics timestamps are floating-point numbers, that represent Unix timestamp in seconds. This differs from Prometheus exposition format, where timestamps are integer numbers representing Unix timestamp in milliseconds.	2020-11-27 14:54:36 +02:00
Aliaksandr Valialkin	2c0b1d5454	sync with README.md from single-node version	2020-11-27 13:23:16 +02:00
Aliaksandr Valialkin	6bd9fe4e77	docs/Articles.md: add https://valyala.medium.com/prometheus-vs-victoriametrics-benchmark-on-node-exporter-metrics-4ca29c75590f	2020-11-27 10:25:00 +02:00
Aliaksandr Valialkin	af667c59c1	all: typo fix: thouthand->thousand	2020-11-26 13:34:05 +02:00
Aliaksandr Valialkin	81fadba0b2	docs/CHANGELOG.md: cut v1.48.0 release	2020-11-26 02:06:11 +02:00
Aliaksandr Valialkin	b542df9ab5	docs/CHANGELOG.md: add a link to Netflix Eureka - https://github.com/Netflix/eureka	2020-11-26 01:36:30 +02:00
Aliaksandr Valialkin	3f52e59efe	app/{vmagent,victoria-metrics}: add -dryRun option and make more clear handling for -promscrape.config.dryRun	2020-11-25 23:01:39 +02:00
Aliaksandr Valialkin	03002f1fe1	lib/storage: log metric name plus all its labels when the metric timestamp is outside the configured retention ... This should simplify debugging when the source of the metric with unexpected timestamp must be found.	2020-11-25 14:44:29 +02:00
Aliaksandr Valialkin	26e699c440	lib/protoparser/prometheus: properly parse "infinity" values in OpenMetrics format ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/924	2020-11-24 19:02:50 +02:00
Aliaksandr Valialkin	284d805895	docs/CHANGELOG.md: mention that /tags/delSeries handler is supported after f0c207fae2	2020-11-24 12:30:36 +02:00
Aliaksandr Valialkin	dad8b76a0e	lib/protoparser/prometheus: properly parse metrics with exemplars ... Examplars have been introduced in OpenMetrics - see https://github.com/OpenObservability/OpenMetrics/blob/master/OpenMetrics.md#exemplars-1 Previously VictoriaMetrics couldn't parse the following metric foo{bar="baz"} 123 # exemplar here This commit fixes this. Note that VictoriaMetrics ignores the exemplar as for now.	2020-11-24 12:30:34 +02:00
Aliaksandr Valialkin	768fd8c3d9	docs/Articles.md: add recent articles about VictoriaMetrics	2020-11-24 12:30:30 +02:00
Aliaksandr Valialkin	8b82f9d8b8	lib/promscrape: expose __meta_ec2_ipv6_addresses label for ec2_sd_config like Prometheus will do in the next release	2020-11-23 16:57:03 +02:00
Aliaksandr Valialkin	c2186279b7	lib/promscrape: add filters option to dockerswarm_sd_config like Prometheus did in v2.23.0	2020-11-23 16:27:33 +02:00
Aliaksandr Valialkin	e1297c0b78	app/vmselect: add /tags/delSeries handler from Graphite Tags API ... See https://graphite.readthedocs.io/en/stable/tags.html#removing-series-from-the-tagdb	2020-11-23 15:32:14 +02:00
Aliaksandr Valialkin	433ae806ac	app/vmselect: implement /tags/tagSeries and /tags/tagMultiSeries` in order to be consistent with single-node VictoriaMetrics	2020-11-23 14:57:08 +02:00
Aliaksandr Valialkin	85eecf5801	app/vmselect/netstorage: add -replicationFactor command-line flag for reducing query duration when a part of vmstorage nodes are temporarily slow and/or temporarily unavailable ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2020-11-23 00:39:53 +02:00
Nikolay	bb2bcb9725	Adds eureka service discovery (#913) ... * Adds eureka service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/851 Netflix service discovery for AWS * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-20 14:02:13 +02:00
John Belmonte	7ac49ac176	MetricsQL docs: parameter consistency (#915) ... * MetricsQL docs: parameter consistency if I understand correctly: * `fun(q)` - fun takes instant vector * `fun(m[d])` - fun takes range vector * Update docs/MetricsQL.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-20 11:43:07 +02:00
Aliaksandr Valialkin	5e39bedf40	docs/CHANGELOG.md: mention that slow query log now contains remote client address	2020-11-19 12:41:26 +02:00
Aliaksandr Valialkin	8e1f657ef9	lib/logger: follow-up for 09105ff49c	2020-11-19 12:37:05 +02:00
Aliaksandr Valialkin	2af08d6e97	docs/CHANGELOG.md: mention about snap install victoriametrics	2020-11-18 19:50:38 +02:00
Aliaksandr Valialkin	5331349efb	docs: make snap install victoriametrics more prominent in docs	2020-11-18 19:45:10 +02:00
Aliaksandr Valialkin	f372148203	docs/Single-server-VictoriaMetrics.md: an attempt to fix markdown formatting in Graphite Tags API section	2020-11-18 14:41:48 +02:00
Aliaksandr Valialkin	e7976363f9	docs: lowercase adidas trademark according to their request	2020-11-18 13:47:56 +02:00
Aliaksandr Valialkin	a5413aa438	docs/Cluster-VictoriaMetrics.md: adjust RAM sizing recommendations for vmstorage nodes ... It is recommended to have at least of 50% of free RAM on vmstorage nodes in order handle possible RAM usage spikes during rolling upgrade for vmstorage nodes when time series are re-routed from temporarily unavailable node to the remaining active nodes.	2020-11-18 13:02:38 +02:00
Aliaksandr Valialkin	a0a34e2a26	docs/Single-server-VictoriaMetrics.md: make consistent section title sizes	2020-11-18 12:36:22 +02:00
Aliaksandr Valialkin	bf9b6b77c8	docs/Single-server-VictoriaMetrics.md: mention that /internal/force_flush endpoint is mostly needed for testing and debugging	2020-11-18 01:37:39 +02:00
Aliaksandr Valialkin	c6adcafedb	app/vminsert: export vm_rpc_vmstorage_is_reachable metric, which can be used for monitoring reachability of vmstorage nodes from vminsert nodes	2020-11-17 22:13:26 +02:00
Aliaksandr Valialkin	a00df790b1	docs/CHANGELOG.md: cut v1.47.0 release	2020-11-16 21:00:21 +02:00
Aliaksandr Valialkin	5454137504	docs/Cluster-VictoriaMetrics.md: make docs-sync after 57dc152e9d	2020-11-16 20:20:19 +02:00
Aliaksandr Valialkin	6bcbdb18fb	docs/CHANGELOG.md: mention about Graphite Tags API implementation	2020-11-16 15:34:56 +02:00
Aliaksandr Valialkin	eb763bcb9d	app/vmselect/graphite: add /tags/autoComplete/values handler from Graphite Tags API	2020-11-16 15:29:29 +02:00
Aliaksandr Valialkin	f2f16d8e79	app/vmselect/graphite: add /tags/autoComplete/tags handler from Graphite Tags API ... See https://graphite.readthedocs.io/en/stable/tags.html#auto-complete-support	2020-11-16 14:58:10 +02:00
Aliaksandr Valialkin	852aed62f7	app/vmselect/prometheus: improve performance for /api/v1/labels and /api/v1/label/<labelName>/values on time ranges exceeding one day when match[] query arg is set	2020-11-16 13:46:51 +02:00
Aliaksandr Valialkin	467ed68a37	docs/CHANGELOG.md: mention about improved performance for /api/v1/series on a time range exceeding one day	2020-11-16 12:52:33 +02:00
Aliaksandr Valialkin	eea1be0d5c	app/vmselect/graphite: add /tags/findSeries handler from Graphite Tags API ... See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags	2020-11-16 12:52:23 +02:00
Aliaksandr Valialkin	5889273920	app/vmselect/graphite: add /tags/<tag_name> handler for Graphite Tags API	2020-11-16 03:41:41 +02:00
Aliaksandr Valialkin	99cb1a70cf	app/vmselect/graphite: add /tags handler from Graphite Tags API ... See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags	2020-11-16 02:57:20 +02:00
Aliaksandr Valialkin	4be5b5733a	app/vminsert: add /tags/tagSeries and /tags/tagMultiSeries handlers from Graphite Tags API ... See https://graphite.readthedocs.io/en/stable/tags.html#adding-series-to-the-tagdb	2020-11-16 02:40:04 +02:00
Aliaksandr Valialkin	2ac5f00d98	app/vmselect: propagate errors from vmstorage to response to the client if -search.denyPartialResponse command-line flag is set ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/891 This commit also adds `"isPartial":{true|false}` field to `/api/v1/*` responses. `"isPartial":true` is set when the response is based on a partial data because some of vmstorage nodes weren't available during query processing.	2020-11-14 13:20:10 +02:00
Aliaksandr Valialkin	c329aacedf	docs/Single-server-VictoriaMetrics.md: document /internal/force_flush endpoint	2020-11-13 18:43:40 +02:00
Aliaksandr Valialkin	f19547039a	docs/Single-server-VictoriaMetrics.md: explain why recently inserted data may be unavailable for querying for a few seconds	2020-11-13 18:34:31 +02:00
Aliaksandr Valialkin	1364dfdd8c	docs/CHANGELOG.md: mentioned that Go builder has been updated from v1.15.4 to v1.15.5 ... See 3fa9ab4a49 for details.	2020-11-13 16:22:18 +02:00
Aliaksandr Valialkin	cc4da051f3	docs/Single-server-VictoriaMetrics.md: sync with single-node README.md	2020-11-13 16:03:50 +02:00
Aliaksandr Valialkin	da6d82a8dd	app/vmselect/promql: assume that time series value doesnt change during gaps when calculating increase() and delta() ... This should remove unexpected spikes at the end of gaps. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/894	2020-11-13 14:59:32 +02:00
Aliaksandr Valialkin	739b88c1e4	lib/protoparser/promremotewrite: forward errors, which can occur during data ingestion, to the caller of ParseStream, so it could properly return HTTP 503 status code on non-nil error ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/896	2020-11-13 11:00:41 +02:00
Aliaksandr Valialkin	7ceaf4ba8f	all: consistently return text-based HTTP responses with charset=utf-8 ... This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/897	2020-11-13 10:30:21 +02:00
Aliaksandr Valialkin	f7a6ae3d11	docs/vmagent.md: added a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2 into Relabeling section	2020-11-12 12:27:13 +02:00
Aliaksandr Valialkin	069979c367	docs/vmagent.md: typo fix	2020-11-11 16:05:04 +02:00
Aliaksandr Valialkin	7a0094adae	docs/vmagent.md: add Configuration update section	2020-11-11 16:01:21 +02:00
Aliaksandr Valialkin	94842ed942	docs/Single-server-VictoriaMetrics.md: document -search.treatDotsAsIsInRegexps command-line option	2020-11-11 14:59:38 +02:00
Aliaksandr Valialkin	6b979ea5a7	docs/Single-server-VictoriaMetrics.md: small clarifications in VictoriaMetrics features	2020-11-11 13:48:16 +02:00
Aliaksandr Valialkin	20d0ead2f2	docs/Single-server-VictoriaMetrics.md: update the link to enterprise features	2020-11-11 13:42:42 +02:00
Aliaksandr Valialkin	779f591bcc	docs/Single-server-VictoriaMetrics.md: mention that /api/v1/status/tsdb handler accepts topN and date query args	2020-11-11 13:38:26 +02:00
Aliaksandr Valialkin	8033e4885b	docs/Cluster-VictoriaMetrics.md: mention about optional topN and date query args for /api/v1/status/tsdb handler	2020-11-11 13:35:13 +02:00
Aliaksandr Valialkin	4f2c5877db	app/vmselect: add -search.treatDotsAsIsInRegexps command-line flag for automatic escaping of dots in regexp label filters	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	0769f86a7e	docs/Single-server-VictoriaMetrics.md: clarify which directories can be removed when recovering from data corruption	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	346181fd48	docs/Single-server-VictoriaMetrics.md: add a hint that case studies can be read by clicking on the corresponding link	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	697fd44158	lib/promscrape: make a copy of ScrapeWork from discovered []ScrapeWork slice instead of referring to an item in this slice ... This should prevent from holding previously discovered []ScrapeWork slices when a part of discovered targets changes over time. This should reduce memory usage for the case when big number of discovered scrape targets changes over time. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825	2020-11-10 16:13:31 +02:00
Aliaksandr Valialkin	8f3339fa81	app/vmselect/promql: do not return data points in the end of the selected time range for time series ending in the middle of the selected time range ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/887 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/845	2020-11-10 14:51:55 +02:00
Aliaksandr Valialkin	6ae9d79f6b	docs/CHANGELOG.md: mention abot explicit setting of extra labels in alert entities (see 3adf8c5a6f) ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/870	2020-11-10 00:41:31 +02:00
Aliaksandr Valialkin	ad82b6ead8	Move CHANGELOG.md to docs/CHANGELOG.md	2020-11-10 00:37:15 +02:00
Aliaksandr Valialkin	a8562d643b	lib/promscrape: add -promscrape.dropOriginalLabels command-line flag for reducing memory usage when discovering big number of scrape targets ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825	2020-11-10 00:20:49 +02:00
Aliaksandr Valialkin	96e9deecbc	docs/Single-server-VictoriaMetrics.md: typo fix	2020-11-08 13:40:52 +02:00
Aliaksandr Valialkin	a8ad3091e3	CHANGELOG.md: cut v1.46.0	2020-11-07 17:54:10 +02:00
Aliaksandr Valialkin	d2296b7e09	docs/CHANGELOG.md: make docs-sync	2020-11-07 16:30:41 +02:00
Aliaksandr Valialkin	6ca5a94359	docs/CHANGELOG.md: add CHANGELOG header	2020-11-07 01:14:49 +02:00
Aliaksandr Valialkin	efebc3b6fb	app/vmselect/promql: code cleanup after 43823addea	2020-11-06 01:31:33 +02:00
Aliaksandr Valialkin	8accbc14d8	docs/Articles.md: add a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2	2020-11-05 19:18:13 +02:00
Aliaksandr Valialkin	6ce80425a6	docs/MetricsQL.md: fix a link to with templates page	2020-11-05 16:12:59 +02:00
Aliaksandr Valialkin	60747c5f14	docs/Articles.md: move third-party articles to the top	2020-11-05 15:03:50 +02:00
Aliaksandr Valialkin	bf28bc3792	docs: add CHANGELOG.md	2020-11-05 14:59:17 +02:00
Aliaksandr Valialkin	1336e47c86	docs/vmagent.md: update after 4c808d58bf	2020-11-04 20:33:49 +02:00
Nikolay	5b235b902b	Adds ready probe (#874) ... * adds leading forward slash check for scrapeURL path https://github.com/VictoriaMetrics/VictoriaMetrics/issues/835 * adds ready probe for scrape config initialization, it should prevent metrics loss during vmagent rolling update, /ready api will return 425 http code, if some scrape config still waits for initialization. * updates docs * Update app/vmagent/README.md * renames var * Update app/vmagent/README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-04 20:33:48 +02:00
Aliaksandr Valialkin	d8a7186019	docs/CaseStudies.md: add case study for Idealo.de	2020-11-04 20:19:26 +02:00