github-mirrors/VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-12-11 14:53:49 +00:00

Author	SHA1	Message	Date
Aliaksandr Valialkin	ea2aa617e5	docs/CHANGELOG.md: update after `e40d015e9a`	2022-06-24 18:03:56 +03:00
Aliaksandr Valialkin	94b81165d0	all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes), then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length of all cached regexps. So huge regexps won't result in high memory usage for the cache.	2022-06-24 17:58:47 +03:00
hagen1778	e40d015e9a	vmselect: make `vm_partial_results_total` consistent Metrics `vm_partial_results_total` and `vm_requests_total` serving the similar purpose, but contain inconsistent set of labels. This change updates `vm_partial_results_total` labels to be consistent with `vm_requests_total`. The change breaks backward compatibility with assumption that `vm_partial_results_total` wasn't widely used, since it is not documented and absent in the alerts and dashboards. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-24 13:50:26 +02:00
Dmytro Kozlov	f28cbcc7b5	vmui: added query tracing (#2748 ) * vmui: added query tracing * vmui: updated ui * vmui: update tracing logic, fix bugs, disable tracing by default * vmui: use empty message as props * vmui: fixed ui, added delete for each tacing data, show query in header * vmui: added timelines * vmui: speedup render * vmui: use memo for sorting * vmui: use Trace model, remove unused functions, simplify part of code * vmui: update recursive logic * vmui: fix set query to header * vmui: code cleanup, remove unused code * vmui: remove unused type, rename component * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 23:00:45 +03:00
Nikolay	ee5c502446	app/vmselect: fixes partial response with replicationFactor (#2777 ) * app/vmselect: fixes partial response with replicationFactor Allow partial response if it meets replicationFactor configured at vmselect https://t.me/VictoriaMetrics_ru1/38490 * docs/CHANGELOG.md: document this change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-23 20:17:24 +03:00
Yurii Kravets	f0c1edb175	docs: Update CHANGELOG Update notes (#2776 ) * docs: Update CHANGELOG Update notes Specified the reason why `vmselect` and `vmstorage` nodes may log communication errors.	2022-06-23 19:40:20 +03:00
Aliaksandr Valialkin	71b0dfdefa	lib/promscrape: always send stale markers with the real scrape timestamp This guarantees that query won't return data just after the series is disappeared.	2022-06-23 11:49:13 +03:00
Denys Holius	d7c4b01472	Adds a list of supported architectures (#2769 ) * add list of supported architectures * Update docs/BestPractices.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-06-22 22:01:29 +03:00
Aliaksandr Valialkin	3ae6300497	lib/promauth: add ability to send additional http headers in requests to scrape targets This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:40:50 +03:00
Aliaksandr Valialkin	7429dfbe9e	app/vmselect: add `-search.setLookbackToStep` command-line flag for making the gap filling algorithm similar to InfluxDB data model This option should override `-search.maxStalenessInterval` for most cases when users migrate from InfluxDB to VictoriaMetrics	2022-06-22 14:20:02 +03:00
Aliaksandr Valialkin	3e0f364489	docs/Cluster-VictoriaMetrics.md: small fixes	2022-06-22 13:42:07 +03:00
Roman Khavronenko	54f0f2d384	docs: follow-up for `197d3cdd74` (#2766 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-22 13:18:03 +03:00
云原生驿站	67e5833ced	docs: supplement vmalert downsampling docs (#2765 ) Co-authored-by: 吴典秋 <muti_kube@163.com>	2022-06-22 13:18:03 +03:00
Denys Holius	432b261c13	url-examples: added curl output after deleting metrics (#2764 ) docs: add more details to url-examples for series deleting	2022-06-21 17:56:00 +03:00
Aliaksandr Valialkin	9362da2e7f	docs: update `-help` output for vmbackup, vmbackupmanager, vmgateway and vmrestore components	2022-06-21 15:49:26 +03:00
Aliaksandr Valialkin	597bce4f55	docs: update docs after `e4d6b750f6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:25 +03:00
Aliaksandr Valialkin	24097f2417	docs/CHANGELOG.md: cut v1.78.0	2022-06-20 18:11:04 +03:00
Aliaksandr Valialkin	a1629bd3be	lib/netutil.ConnPool: skip dialing remote address if the previous dial attempt was unsuccessful If the previous dial attempt was unsuccessful, then all the new dial attempts are skipped until the background goroutine determines that the given address can be successfully dialed. This reduces query latency when some of vmstorage nodes are unavailable and dialing them is slow. This should help with https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711 This commit is based on ideas from the https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2756 The main differences are: - The check for healthy/unhealthy storage nodes is moved one level lower from app/vmselect/netstorage to lib/netutil.ConnPool. This makes possible re-using this feature everywhere lib/netutil.ConnPool is used. - The check doesn't take into account handshake errors for already established connections. Handshake errors usually mean improperly configured VictoriaMetrics cluster, so they shouldn't be ignored.	2022-06-20 17:33:54 +03:00
Aliaksandr Valialkin	45e9732764	docs: follow-up after `e4d6b750f6`	2022-06-20 17:15:52 +03:00
Nikolay	15662c0f29	lib/httpserver: adds flagsAuthKey command-line flag (#2758 ) * lib/httpserver: adds flagsAuthKey command-line flag It protects /flags endpoint with authKey. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753O * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-20 17:15:51 +03:00
Aliaksandr Valialkin	0abf46d66a	docs/Articles.md: add a link to https://www.sobyte.net/post/2022-05/victoriametrics-bloomfilter/	2022-06-20 14:44:11 +03:00
Roman Khavronenko	3ada676879	docs: reference links from key concepts (#2745 ) Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-19 23:14:30 +03:00
Artem Navoiev	42c69ae74e	docs: replace bash code block type with console (#2746 )	2022-06-19 23:02:00 +03:00
Aliaksandr Valialkin	4ae1c5655f	docs/CHANGELOG.md: document `ef7f52e0e6`	2022-06-19 22:49:11 +03:00
Aliaksandr Valialkin	88e1221b35	lib/storage: do not register new series if `-storage.maxHourlySeries` or `-storage.maxDailySeries` limits are exceeded Previously samples for new series weren't added as expected when series limits were reached, but new series were still registered in indexdb.	2022-06-19 22:03:02 +03:00
Aliaksandr Valialkin	c5ac176153	lib/storage: reset metric id caches for the previous and the current hour Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2698	2022-06-19 22:02:51 +03:00
Aliaksandr Valialkin	149c5c9381	docs: update docs on how to add tags to metrics collected by DataDog agent Follow-up for `f16072c3c1`	2022-06-17 13:12:21 +03:00
Dmytro Kozlov	5bc13e2fe8	vmui: added focusLabel, enable cardinality app configuratior (#2736 ) * vmui: added focusLabel, enable app configuratior * vmui: set focusLabel if {labelName!=""} * wip * docs/CHANGELOG.md: mention about focusLabel feature in cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2730 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-17 13:04:09 +03:00
Dmytro Kozlov	82440e76c5	doc: added workaround for datadog agent (#2712 ) * Added workaround for datadog agent * docs: update datadog workaround * doc: update doc description * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 22:24:17 +03:00
Roman Khavronenko	287bb96758	docs: mention sandbox update in release procedure (#2724 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:51:41 +03:00
Roman Khavronenko	cbe39bbb8d	vmselect: limit `end` param max value by 2d in future (#2729 ) * vmselect: limit `end` param max value by 2d in future The change is applied only to service handlers like `/labels` or `/series` and limits the `end` param by max value <= now() + 2 days. The same limit is applied for the ingested data, so no reason to allow to request data in future far than that. The change is also needed for corner cases like https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2669 where too high `end` value triggers inefficient global index search. Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	cda3ce09e5	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:51:40 +03:00
Aliaksandr Valialkin	450aa0ae5a	lib/promrelabel: support `action: graphite` relabeling Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:25:49 +03:00
Roman Khavronenko	ba7ece02c4	docs: add multiple-remote-writes topology to vmalert (#2738 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-16 20:21:12 +03:00
Aliaksandr Valialkin	b4e75a0b89	docs/CHANGELOG.md: document dd327bfa9e2c69fe21ab1d92c14636733d7c5620	2022-06-15 18:41:26 +03:00
Aliaksandr Valialkin	14ce7b0e25	docs/CHANGELOG.md: document 00719e5779a3e4eeedb74cb3d25a9ecfe0e16063	2022-06-15 18:09:23 +03:00
Aliaksandr Valialkin	45fa9d798d	app/vmselect: accept `focusLabel` query arg at /api/v1/status/tsdb	2022-06-14 18:39:00 +03:00
Aliaksandr Valialkin	fb77843639	lib/storage: show top labels with the highest number of series in cardinality explorer	2022-06-14 16:34:13 +03:00
Aliaksandr Valialkin	ce953d5e95	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:23 +03:00
Roman Khavronenko	0065b13243	docs: reduce free disk recommendation from 30% to 20% (#2728 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:55:41 +03:00
Aliaksandr Valialkin	12618925fc	docs/guides/migrate-from-influx.md: suggest more real-world value for `-search.maxStalenessInterval` Suggest `-search.maxStalenessInterval=10s` instead of `-search.maxStalenessInterval=1ms`, since `1ms` would result in empty graphs in most cases, since the interval between data points on the graph is usually much higher than 1ms. For example, if the graph shows time range of one hour and it contains 1000 points, then the interval between points on the graph would equal to 3600s/1000=3.6 seconds.	2022-06-14 12:51:35 +03:00
Roman Khavronenko	9873001539	docs: migrating from influx (#2720 ) Mention `-search.maxStalenessInterval` flag and its effect on query engine. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-14 12:51:33 +03:00
Aliaksandr Valialkin	b48ca34e05	docs/Single-server-VictoriaMetrics.md: recommend running all the VictoriaMetrics components behind auth proxy in Security chapter	2022-06-13 10:30:52 +03:00
Aliaksandr Valialkin	c846d0db01	docs/CHANGELOG.md: document `99dbe7f9d4`	2022-06-13 10:07:19 +03:00
Roman Khavronenko	81b6efea9e	Readme cleanup (#2715 ) * docs: minor styling and wording changes Changes made after reading https://developers.google.com/tech-writing Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: set proper types for code blocks Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: add `copy` wrapper for some commands Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: sync Signed-off-by: hagen1778 <roman@victoriametrics.com> * docs: resolve conflicts Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-13 09:49:59 +03:00
Yury Molodov	65107a4585	vmui: enhancements (#2638 ) (#2717 ) * feat: make datepicker to be set to last 30 min by default * fix: correct spinner while loading data * feat: change legend style * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:49:58 +03:00
Aliaksandr Valialkin	9d8c37d280	docs/CHANGELOG.md: refer to the issue, which should be solved after the optimization to /api/v1/labels and /api/v1/label/.../values is added The optimization has been added in `374beb350e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1533	2022-06-12 14:32:57 +03:00
Aliaksandr Valialkin	61e03f172b	app/vmselect: optimize `/api/v1/labels` and `/api/v1/label/.../values` handlers when `match[]` query arg is passed to them	2022-06-12 14:06:24 +03:00
Aliaksandr Valialkin	4a94cd81ce	app/vmselect: add optional `limit` query arg to `/api/v1/labels` and `/api/v1/label_values` endpoints This arg allows limiting the number of sample values returned from these APIs	2022-06-10 10:24:07 +03:00
Roman Khavronenko	3c09d25039	vmalert: followup for `76f05f8670` (#2706 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-06-09 13:15:35 +03:00
Howie	4afd7aa695	feat: rule limit (#2676 ) vmalert: support `limit` param in groups definition `limit` param limits number of time series samples produced by a single rule during execution. On reaching the limit rule will return an err. Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-06-09 13:15:33 +03:00
Aliaksandr Valialkin	a9ea3fee38	lib/querytracer: make it easier to use by passing trace context message to New and NewChild The context message can be extended by calling Donef. If there is no need to extend the message, then just call Done.	2022-06-08 21:16:12 +03:00
Aliaksandr Valialkin	5524d13a03	docs/Single-server-VictoriaMetrics.md: explain why free disk space shortage may negatively impact VictoriaMetrics performance	2022-06-08 20:04:30 +03:00
Aliaksandr Valialkin	2520b8efb8	docs: add a link to cardinality explorer playground	2022-06-08 19:40:12 +03:00
Aliaksandr Valialkin	8d98b8ae10	docs: refer to cardinality explorer Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233	2022-06-08 19:18:31 +03:00
Dmytro Kozlov	f2754c3e90	Cardinality explorer (#2625 ) * Cardinality explorer * vmui, vmselect: updated field name, added description to spinner * make vmui-update * updated const name, make vmui-update * lib/storage: changes calculation for totalSeries values * added static files * wip * wip * wip * wip * docs/CHANGELOG.md: document cardinality explorer feature See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2233 Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-08 18:54:27 +03:00
Aliaksandr Valialkin	ba406ff28c	docs/CHANGELOG.md: document `63b538ecd1`	2022-06-07 15:53:08 +03:00
Aliaksandr Valialkin	c07f99cd4f	docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2685	2022-06-07 15:39:53 +03:00
Aliaksandr Valialkin	c7ff4505d2	docs/CHANGELOG.md: document backwards-incompatible changes in communication protocol between vmselect and vmstorage The changes are related to the added query tracing in `afced37c0b` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-07 15:25:58 +03:00
Aliaksandr Valialkin	2b72d21840	docs/CHANGELOG.md: document `e755d0ec3f`	2022-06-07 15:21:10 +03:00
Aliaksandr Valialkin	0b4f767c53	docs/CHANGELOG.md: document `1ee1e986da`	2022-06-07 15:02:57 +03:00
Aliaksandr Valialkin	33afaa49d9	docs: run `make docs-sync` after `fda8da297e`	2022-06-07 14:51:32 +03:00
Dmytro Kozlov	50393d0024	docs: fixed typos (#2680 ) * docs: fixed typos * Update README.md * Update docs/README.md * Update docs/Single-server-VictoriaMetrics.md * docs: added examples with start and end params in request * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-07 14:51:31 +03:00
Aliaksandr Valialkin	933f4ae148	docs/Cluster-VictoriaMetrics.md: run `make docs-sync` after `1c96dce367`	2022-06-07 14:30:09 +03:00
Aliaksandr Valialkin	b4909351c5	docs: run `make docs-sync` after `a439e887a3`	2022-06-07 14:27:37 +03:00
Aliaksandr Valialkin	68b6ddfb14	all: follow-up after `8edb390e21` - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 01:05:53 +03:00
Aliaksandr Valialkin	3dbb19d624	lib/promscrape/discovery/kubernetes: follow-up after `006b8c7534` - make more clear error logs - simplify testing for newKubeConfig by passing only the path to kube_config file instead of SDConfig struct	2022-06-06 14:41:28 +03:00
Aliaksandr Valialkin	6d2832f413	docs/Articles.md: add a link to https://percona.community/blog/2022/06/02/long-time-keeping-metrics-victoriametrics/	2022-06-06 13:15:42 +03:00
Aliaksandr Valialkin	6c2fb9d8c4	lib/promscrape: add `-promscrape.cluster.name` command-line flag This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 01:11:23 +03:00
Dmytro Kozlov	ce8aade80e	lib/promscrape: adds service discovery visualization for /targets page(#2675 ) * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-04 01:11:23 +03:00
Nikolay	72e43ef2fe	lib/promscrape/discovery/kubernetes: follow-up after `0b5c874911` (#2672 )	2022-06-04 01:11:23 +03:00
Aliaksandr Valialkin	70bb84739d	docs/Single-server-VictoriaMetrics.md: small clarification about custom cache size tuning	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	cc226e6ebe	docs/CHANGELOG.md: follow-up after `2177089f94`	2022-06-01 14:57:39 +03:00
Roman Khavronenko	e9ee043879	lib/storage: make `indexdb/tagFilters` cache size configurable (#2667 ) The default size of `indexdb/tagFilters` now can be overridden via `storage.cacheSizeIndexDBTagFilters` flag. Please, be careful with changing default size since it may lead to inefficient work of the vmstorage or OOM exceptions. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2663 Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Roman Khavronenko	bca90d7148	promrelabel: add support of `lowercase` and `uppercase` relabeling actions (#2665 ) * promrelabel: add support of `lowercase` and `uppercase` relabeling actions https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2664 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/storage: make golangci-lint happy Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: Nikolay <nik@victoriametrics.com>	2022-06-01 14:57:39 +03:00
Aliaksandr Valialkin	fedfc9e686	lib/storage: stop background merge when storage enters read-only mode This should prevent from `no space left on device` errors when VictoriaMetrics under-estimates the additional disk space needed for background merge. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2603	2022-06-01 14:22:12 +03:00
Aliaksandr Valialkin	afced37c0b	all: add initial support for query tracing See https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#query-tracing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1403	2022-06-01 02:31:44 +03:00
Aliaksandr Valialkin	e83b96366f	docs/CHANGELOG.md: follow-up after `11f91532c5` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Dmytro Kozlov	cd1fa2e4cd	issue-2594: use embedded for static files (#2650 ) embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:42:48 +03:00
Howie	9c5f998438	fix: docs (#2658 ) Signed-off-by: lihaowei <haoweili35@gmail.com>	2022-05-30 12:27:19 +03:00
Roman Khavronenko	4f84afb032	docs: add more details to the key concepts (#2648 ) - data modification - more applications for gauges - recommendations for instrumenting app with metrics Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-30 12:26:37 +03:00
Dima Lazerka	3299865620	Change img urls to the same domain (#2649 )	2022-05-27 20:13:49 +02:00
Aliaksandr Valialkin	f149d56ac2	lib/promscrape: add -promscrape.suppressScrapeErrorsDelay command-line flag This flag can be used for reducing the amounts of logs when scraping unreliable scrape targets. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2575 The patch is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2576 . Thanks to @jelmd .	2022-05-25 23:00:30 +03:00
Roman Khavronenko	d367a65707	docs: update single version docs by adding extra links and formatting (#2643 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 23:00:28 +03:00
Aliaksandr Valialkin	38beb9fe04	lib/storage: add ability to change the indexdb rotation time offset with -retentionTimezoneOffset command-line flag This is a follow-up for `0fbf59199a` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2574	2022-05-25 16:07:14 +03:00
Aliaksandr Valialkin	05e47482a5	docs/CHANGELOG.md: document `9e343faa41`	2022-05-25 15:05:42 +03:00
Roman Khavronenko	cd8e58d0ae	docs: mention guide for migrating from inlfux in vmctl readme (#2640 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-25 15:05:12 +03:00
Aliaksandr Valialkin	df9ffa6854	app: expose `/api/v1/status/config` endpoint in the same way as Prometheus does This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 10:00:00 +03:00
Aliaksandr Valialkin	090c331c12	docs/Single-server-VictoriaMetrics.md: mention `Cardinality limiter` docs at `Resource usage limits` section	2022-05-23 10:55:42 +03:00
Nikolay	754d3b1f93	Updates operator docs (#2622 ) * docs/operator: adds information about VMAgent statefulMode * docs/operator: adds description for alertmanager configuration * docs/operator: adds description for configuration syncronization https://github.com/VictoriaMetrics/operator/issues/124 Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-23 10:55:42 +03:00
Roman Khavronenko	d597cdd06f	vmalert: mention how to build a custom image (#2626 ) Thanks to @f41gh7 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-23 10:55:42 +03:00
Aliaksandr Valialkin	513f9537a9	docs/CHANGELOG.md: cut v1.77.2	2022-05-21 02:26:29 +03:00
Aliaksandr Valialkin	cdbee6f470	docs/CHANGELOG.md: group vmalert features together	2022-05-21 01:52:13 +03:00
Aliaksandr Valialkin	35ed63f32e	docs/CHANGELOG.md: document `2cf586da78`	2022-05-21 01:17:49 +03:00
Roman Khavronenko	7406665fc3	lib/promscrape/discovery/kubernetes: fixes kubernetes service discovery (#2615 ) * lib/promscrape/discovery/kubernetes: properly updates discovered scrape works previously, added or updated scrapeworks may override previuosly discovered. it happens because swosByKey may contain small subset of kubernetes objects with it's labels. It happens for objectsUpdated and objectsAdded maps, which include only changed elements * Properly calculate vm_promscrape_discovery_kubernetes_scrape_works Co-authored-by: f41gh7 <nik@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-21 01:17:21 +03:00
Yurii Kravets	a723de6ae1	Update README.md (#2624 )	2022-05-21 01:07:04 +03:00
Aliaksandr Valialkin	aba00b8cb2	docs: update the description for command-line flags according to recent changes	2022-05-20 15:11:37 +03:00
Aliaksandr Valialkin	4ca5d97459	docs/CHANGELOG.md: document `3df8caca15`	2022-05-20 14:24:36 +03:00
Roman Khavronenko	e9165b041e	docs: add migration guide for influxdb (#2619 ) docs: add migration guide for influxdb Co-authored by @denisgolius Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:24:35 +03:00
Aliaksandr Valialkin	386ef69124	docs/CHANGELOG.md: formatting fixes	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	98123e95dd	docs/CHANGELOG.md: formatting fix for the issue url https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607	2022-05-20 14:22:02 +03:00
Aliaksandr Valialkin	c5765dd6ad	docs/CHANGELOG.md: link to the feature request about reusable templates in vmalert Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2510	2022-05-20 14:21:35 +03:00
Roman Khavronenko	f71d15c79e	docs: follow-up after `4b3eb40658` (#2602 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:21:09 +03:00
Roman Khavronenko	dcd8387601	docs: fix a typo of mentioning scrape support for vmselect (#2617 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:20:37 +03:00
Roman Khavronenko	2aeb00f98f	vmalert: support `scalar` type in response (#2610 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2607 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:08:19 +03:00
Roman Khavronenko	a07ddf9b65	vmalert: support strings in `humanize.*` templates (#2606 ) See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2569 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 14:05:53 +03:00
Yurii Kravets	40c614dc4e	Update vmalert.md (#2580 ) docs: update vmalert/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-20 14:02:34 +03:00
Roman Khavronenko	a616e0b997	docs: quickstart update (#2572 ) docs: update docs for beginners QuickStart page was updated with more relevant information. Key Concepts was added to cover basics for the VictoriaMetrics.	2022-05-20 14:00:43 +03:00
Roman Khavronenko	87e4e76537	vmalert: support `/rules` path for Grafana's ngalert requests (#2593 ) Unexpectedly, Grafana makes an extra request to `/rules` handler in addition to `/api/v1/rules` calls in alerts UI. This happens only for Grafana versions older than 8.5.*. Apparently, this is related to support of other monitoring systems. Prometheus responds with `text/html` content for UI page `/rules` to such requests. Actually, returning just a blank page with SC=200 works as well. Returning actual response of `/api/v1/rules` results in error in Grafana since it expects a `yaml` (?) in response. So we add a placeholder to `vmalert`. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2583 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:53:55 +03:00
Roman Khavronenko	ee1f8bae2e	docs: fix liquid syntax errors (#2592 ) For liquid text processor double braces `{{` `}}` are special chars for templating. Since we use them in some of our docs with different purpose, we must escape them to avoid syntax errors from liquid. For escaping curly braces we use bult-in plugin which helps to enclose sections of text via `{% raw %}` and `{% endraw %}`. This approach prevents liquid syntax errors and makes render correct. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:42:47 +03:00
Roman Khavronenko	6e5ba1921d	vmalert: fix readme formatting (#2587 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 13:40:41 +03:00
Roman Khavronenko	0790ba5e26	vmalert: follow-up after `0ac1cdfff5` (#2586 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-20 12:25:13 +03:00
Andrii Chubatiuk	7789c47e41	added reusable templates support (#2532 ) Signed-off-by: Andrii Chubatiuk <andrew.chubatiuk@gmail.com>	2022-05-20 12:25:11 +03:00
Aliaksandr Valialkin	83ff4c411d	app/vmalert: apply `-remoteRead.disablePathAppend` to `-datasource.url` in the same way as for the `-remoteRead.url` This is a follow-up for `0e2486df56` The related pull requests: - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1536 - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1712	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	c1dd458f56	docs/CHANGELOG.md: document `3f0ecee128` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2577	2022-05-13 16:59:16 +03:00
Yurii Kravets	d55791f59f	Update docs (#2566 ) * deployment/docker: pass `-buildvs=false` to `go build` for production builds This should resolve the `error obtaining VCS status: exit status 128` error when the environment contains incorrect version of git or has incorrect access rights to the directory with VictoriaMetrics source code. See the following links for additional info: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508#issuecomment-1117126702 , - https://github.com/google/ko/issues/672 - https://github.com/golang/go/issues/49004 * lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552 * docs/CHANGELOG.md: document `c8af625bcc` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146 * docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by` * docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits * docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect * Update root Readme and root vmagent readme Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-13 16:59:16 +03:00
Aliaksandr Valialkin	116c0b8f2e	docs/vmagent.md: typo fix in the description for `-promscrape.cluster.replicationFactor` command-line flag	2022-05-12 18:51:20 +03:00
Aliaksandr Valialkin	a47717f2ab	docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect	2022-05-11 20:00:36 +03:00
Aliaksandr Valialkin	7830448a36	docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits	2022-05-11 19:53:19 +03:00
Aliaksandr Valialkin	6048e2e82c	docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by`	2022-05-11 18:05:05 +03:00
Aliaksandr Valialkin	e35e488220	docs/CHANGELOG.md: document `c8af625bcc` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146	2022-05-11 14:33:06 +03:00
Denys Holius	f3ac421413	docs: fixed typos in CHANGELOG.md (#2565 )	2022-05-11 14:30:45 +03:00
Aliaksandr Valialkin	d8a276fbe4	lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552	2022-05-11 14:11:06 +03:00
Aliaksandr Valialkin	68bfa05437	app/vmselect/promql: do not return values from `label_value()` if the original time series has no values at the selected timestamps	2022-05-09 17:58:39 +03:00
Aliaksandr Valialkin	d5efd3949b	docs/CHANGELOG.md: document `8f4f5f1d68`	2022-05-09 17:33:04 +03:00
Aliaksandr Valialkin	86d344f6c0	docs/Release-Guide.md: typo fix: signle->single	2022-05-09 15:27:57 +03:00
Manuel Polo	2cc5486248	docs: fix typo in quickstart	2022-05-09 15:27:55 +03:00
Artem Navoiev	7197de0c8c	docs: add flags list to vmbackupmanager (#2554 ) docs: add flags list to vmbackupmanager docs Signed-off-by: hagen1778 <roman@victoriametrics.com> Co-authored-by: tenmozes <artem@victoriametrics.com>	2022-05-09 15:26:24 +03:00
Aliaksandr Valialkin	e3819d3e8d	docs/CHANGELOG.md: cut v1.77.1	2022-05-07 01:49:21 +03:00
Aliaksandr Valialkin	e613ca9ba8	app/vminsert/netstorage: re-route samples from readonly vmstorage nodes to healthy nodes if `-dropSamplesOnOverload` command-line flag is set	2022-05-07 01:40:02 +03:00
Aliaksandr Valialkin	e961aec551	app/vmstorage: do not allow to set -retentionPeriod smaller than one day VictoriaMetrics doesn't support retention periods smaller than one day, so do not allow to set it to small values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2496	2022-05-07 00:54:42 +03:00
Aliaksandr Valialkin	810dd74fb9	lib/promscrape: properly implement ScrapeConfig.clone() Previously ScrapeConfig.clone() was improperly copying promauth.Secret fields - their contents was replaced with `<secret>` value. This led to inability to use passwords and secrets in `-promscrape.config` file. The bug has been introduced in v1.77.0 in the commit `67b10896d2` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2551	2022-05-07 00:06:19 +03:00
Aliaksandr Valialkin	994c06cb84	docs/CHANGELOG.md: document `e726340914`	2022-05-06 18:11:16 +03:00
Dmytro Kozlov	8b5a819266	vmbackup: Prevent save backups to the same folder where TSDB data is (#2547 ) * {vmbackup, vmbackup/snapshot}: validate snapshot name * vmbackup/snapshot: added another checks * backup/actions: added check that we ignore backup_complete.ignore file * vmbackup: moved snapshot to lib directory * lib/snapshot: added functions description * lib/snapshot: fixed typo * vmbackup: code cleanup * wip * vmbackup: Prevent save backups to the same folder where TSDB data is * Apply suggestions from code review * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-06 18:04:58 +03:00
Aliaksandr Valialkin	7cd416f5e6	docs/Cluster-VictoriaMetrics.md: typo fix: bandidth -> bandwidth	2022-05-06 16:34:44 +03:00
Roman Khavronenko	fe697a9253	vmctl: add tip about safety flags during for native data export (#2540 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-05-06 16:28:24 +03:00
Aliaksandr Valialkin	925fa9a7de	docs/Cluster-VictoriaMetrics.md: make the description for `-rpc.disableCompression` command-line flag more clear	2022-05-06 16:24:56 +03:00
Aliaksandr Valialkin	983b465757	app/vmagent: add missing `_total` suffix to `vmagent_remotewrite_global_rows_pushed_before_relabel_total` counter This is a follow up for `c536139d0b`	2022-05-06 15:51:34 +03:00
Aliaksandr Valialkin	af0da45d3e	lib/promscrape: rename `promscrape_stale_samples_created_total` metric to `vm_promscrape_stale_samples_created_total`, so its name is consistent with the rest of `vm_promscrape_` metrics	2022-05-06 15:33:43 +03:00
Aliaksandr Valialkin	2baa9e8f48	app/vmagent: expose `vmagent_remotewrite_global_rows_pushed_before_relabel` and `vmagent_remotewrite_rows_pushed_after_relabel_total` metrics	2022-05-06 15:30:10 +03:00
Aliaksandr Valialkin	9c89ea1c90	app/vmagent: rename `vmagent_remote_write_rate_limit_reached_total` to `vmagent_remotewrite_rate_limit_reached_total` for the sake of consistency with other `vmagent_remotewrite_` metrics	2022-05-06 15:02:18 +03:00
Aliaksandr Valialkin	9d40bb7137	lib/promscrape/discovery/ec2: add ability to filter Availability Zones in `ec2_sd_config` via `az_filters` section	2022-05-06 12:44:01 +03:00
Aliaksandr Valialkin	8babb4aebc	app/vmselect/vmui: `make vmui-update` after `450d879eaa`	2022-05-05 22:11:41 +03:00
Denis Fondras	53b68eb254	Fix typo (#2538 )	2022-05-05 21:16:39 +03:00
Aliaksandr Valialkin	c5e47929c3	docs/Cluster-VictoriaMetrics.md: update cluster scalability tips	2022-05-05 21:09:17 +03:00
Aliaksandr Valialkin	0634a894a9	docs/CHANGELOG.md: document `bf5e3774cc`	2022-05-05 13:38:44 +03:00
Aliaksandr Valialkin	0ad5b64930	docs/CHANGELOG.md: cut v1.77.0	2022-05-05 00:16:31 +03:00
Aliaksandr Valialkin	2213eef6b7	docs/vmbackup.md: added missing -storageDataPath argument in the command for creating daily backups	2022-05-04 22:50:18 +03:00
Aliaksandr Valialkin	4ae1a8514a	docs/vmbackup.md: acutalize docs Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2503	2022-05-04 22:44:40 +03:00
Aliaksandr Valialkin	9fea63d1c8	app/vmagent: rename -remoteWrite.useSigv4 command-line flag to -remoteWrite.aws.useSigv4, so its name is consistent with the other -remoteWrite.aws.* command-line flags	2022-05-04 20:41:45 +03:00
Aliaksandr Valialkin	358fa99af2	app/vmalert: run `make quicktemplate-gen` from the root directory after the commit `f6dcfbcdd6`	2022-05-04 20:28:37 +03:00
Nikolay	7e58cba6cf	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458 ) * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:28:37 +03:00
Dmytro Kozlov	0aeefeb5f1	vmalert/tpl: fixed truncating alerts expression in table (#2494 ) vmalert: improve `/groups` UI visual The change also fixes truncated rules expressions in UI https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2484	2022-05-04 20:28:37 +03:00
Aliaksandr Valialkin	a297315ff1	docs/guides/multi-regional-setup-dedicated-regions.md: clarify wording on vmagent configuration	2022-05-04 18:50:37 +03:00
Aliaksandr Valialkin	4dfd84c505	docs/Cluster-VictoriaMetrics.md: move `environment variables` entry closer to `cluster setup` section	2022-05-04 18:41:44 +03:00
Aliaksandr Valialkin	9dc9e03a14	docs/CHANGELOG.md: yet another typo fix: present -> pressed	2022-05-04 18:20:58 +03:00
Aliaksandr Valialkin	c2610e4186	docs/CHANGELOG.md: typo fixes	2022-05-04 18:19:05 +03:00
Aliaksandr Valialkin	47010a9875	docs/CHANGELOG.md: document `8639e79d38`	2022-05-04 10:46:32 +03:00
Aliaksandr Valialkin	4fa3cd701c	docs/Cluster-VictoriaMetrics.md: typo fix: serparated -> separated	2022-05-03 15:20:11 +03:00
Aliaksandr Valialkin	25266d2194	docs/CHANGELOG.md: document `3575aabeaf`	2022-05-03 14:01:58 +03:00
Aliaksandr Valialkin	ec3a37896f	all: add -cluster.tlsInsecureSkipVerify command-line option to vminsert, vmselect and vmstorage components in order to be able to disable TLS certificate verification in mTLS mode See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2490	2022-05-03 13:13:43 +03:00
Aliaksandr Valialkin	7291c81f0d	docs/Cluster-VictoriaMetrics.md: refer to the doc on how to set up mTLS	2022-05-03 11:54:05 +03:00
Aliaksandr Valialkin	ccf44e810c	docs/CHANGELOG.md: document `488c34f5e1`	2022-05-03 11:01:27 +03:00
Aliaksandr Valialkin	d384997657	docs/CHANGELOG.md: document `d0706c8c95`	2022-05-02 22:25:47 +03:00
Aliaksandr Valialkin	361b08c30e	lib/storage: leave the last sample per each discrete interval during the deduplicaton This aligns better with staleness logic in Prometheus - https://prometheus.io/docs/prometheus/latest/querying/basics/#staleness	2022-05-02 21:59:31 +03:00
Aliaksandr Valialkin	7ca32c21c8	app/vmui: execute query by pressing `enter` in the same way as Prometheus does Multi-line query can be entered via `shift-enter` in the query input field	2022-05-02 20:24:43 +03:00
Aliaksandr Valialkin	58e4e16588	docs/Cluster-VictoriaMetrics.md: move here the `deduplication` docs related to cluster version	2022-05-02 15:54:48 +03:00
Max Golionko	be81a0a327	added details about deduplication (#2527 ) * added details about deduplication * Update docs/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Apply suggestions from code review * Update docs/README.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-05-02 15:54:46 +03:00
Aliaksandr Valialkin	a70ac35ac7	docs/CHANGELOG.md: document `3616337812` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2514	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	75f4adab40	docs/CHANGELOG.md: document `32a6b67e6c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1761	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	693e1838b3	docs/CHANGELOG.md: document `b2294d1cf1`	2022-05-02 15:37:54 +03:00
Aliaksandr Valialkin	190c8b463c	lib/netutil: close connections in ConnPool if they are idle for more than 30 seconds Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508	2022-05-02 15:01:52 +03:00
Artem Navoiev	11db05a4ff	lib/{storage,flagutil} - Add option for snapshot autoremoval (#2487 ) * lib/{storage,flagutil} - Add option for snapshot autoremoval - add prometheus-like duration as command flag - add option to delete stale snapshots - update duration.go flag to re-use own code * wip * lib/flagutil: re-use Duration.Set() call in NewDuration * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-02 11:24:12 +03:00
Peter Dupej	9e193fb764	Update MetricsQL.md (#2519 ) remove typo from label_replace doc.	2022-05-02 09:43:57 +03:00
Aliaksandr Valialkin	eaae544238	docs/CHANGELOG.md: document `c7aad8d441`	2022-04-29 13:02:43 +03:00
Dima Lazerka	e6ee235707	Export "null" in jsonl instead of NaN (#2518 ) * Export "null" in jsonl instead of NaN The NaN appeared because of staleness markers that were added for compatibility. I think it's better to use json `null`, implemented here. Also maybe it also makes sense to add a flag like `?skip-staleness-markers=true` to `/export`, to skip nulls at all? * Update app/vmselect/prometheus/export.qtpl * app/vmselect/prometheus/export.qtpl.go: `make quicktemplate-gen` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-29 12:51:03 +03:00
Aliaksandr Valialkin	83db416567	docs/MetricsQL.md: clarify keep_metric_names docs	2022-04-27 11:25:02 +03:00
Aliaksandr Valialkin	6eb1580158	app/vmselect/promql: add `tlast_change_over_time(m[d])` function, which returns the timestamp for the last change of `m` on the given lookbehind window `d`	2022-04-27 10:58:40 +03:00
Aliaksandr Valialkin	917bb702ef	app/vmagent: substitute hard-to-read 500000000 with 500MB in `-remoteWrite.maxDiskUsagePerURL` description	2022-04-26 15:48:44 +03:00
Yury Molodov	eae6f68be2	vmui: add support relative time (#2504 ) * feat: add support relative time * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-26 15:46:47 +03:00
Aliaksandr Valialkin	7d9d790bfb	docs/Cluster-VictoriaMetrics.md: remove incorrect and misleading instructions for passing `-replicationFactor` flag to vmselect nodes in multi-level setup. The `-replicationFactor` passed to top-level `vmselect` nodes mustn't exceed the `-replicationFactor` passed to top-level `vminsert` nodes	2022-04-26 15:13:08 +03:00
Aliaksandr Valialkin	cd4d1599cb	docs/CHANGELOG.md: document `4c1fbcd6b0` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2368	2022-04-26 15:09:57 +03:00
Aliaksandr Valialkin	374212333f	docs/CHANGELOG.md: typo fix: `may result` -> `could result`	2022-04-23 00:31:47 +03:00
Aliaksandr Valialkin	4c3cd96db5	lib/promauth: add support for `min_version` option at `tls_config` section in the same way as Prometheus does	2022-04-23 00:24:11 +03:00
Aliaksandr Valialkin	808a2f3b61	lib/promauth: add support for `proxy_url` option at `oauth2` section in the same way as Prometheus does	2022-04-23 00:01:53 +03:00
Aliaksandr Valialkin	4ade8511e2	lib/promauth: add support for `tls_config` section at `oauth2` config in the same way as Prometheus does	2022-04-23 00:01:52 +03:00
Aliaksandr Valialkin	a89e31b304	lib/promscrape/discovery/kubernetes: allow attaching node-level labels and annotations to discovered pod targets in the same way as Prometheus 2.35 does See https://github.com/prometheus/prometheus/issues/9510 and https://github.com/prometheus/prometheus/pull/10080	2022-04-22 20:15:34 +03:00
Aliaksandr Valialkin	a69dabf709	docs/Cluster-VictoriaMetrics.md: mention that enterprise binaries are available for evaluation	2022-04-21 15:57:13 +03:00
Aliaksandr Valialkin	c341a46745	docs/Single-server-VictoriaMetrics.md: refer to the docs on how to set up multiple vmagent instances for scraping the same set of targets	2022-04-21 15:52:22 +03:00
Aliaksandr Valialkin	dac24aa342	app/vmselect/promql: properly handle `scalar default vector`, `scalar if vector` and `scalar ifnot vector` queries Previously `vector` time series could be unexpectedly returned from such queries	2022-04-21 15:34:14 +03:00
Aliaksandr Valialkin	a5cfe5d13e	app/vmselect/promql: add `drop_common_labels()` function	2022-04-21 14:20:36 +03:00
Aliaksandr Valialkin	ed1b394a1a	app/vmstorage: expose `vm_indexdb_items_added_total` and `vm_indexdb_items_added_size_bytes_total` counters at `/metrics` page These counters can be used for monitoring the rate of addition of new entries in indexdb (aka inverted index). See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2471	2022-04-21 13:19:42 +03:00
Aliaksandr Valialkin	25b841c6ed	app/vmselect/promql: fix `duplicate time series` error on joins against time series filtered by values This should prevent from `duplicate time series` errors when executing the following query: kube_pod_container_resource_requests{resource="cpu"} * on (namespace,pod) group_left() (kube_pod_status_phase{phase=~"Pending\|Running"}==1) where `kube_pod_status_phase{phase=~"Pending\|Running"}==1` filters out diplicate time series	2022-04-20 22:21:20 +03:00
Aliaksandr Valialkin	90db923662	docs/CHANGELOG.md: document that the service discovery speed now scales with the number of CPU cores	2022-04-20 16:22:50 +03:00
Aliaksandr Valialkin	45385a5dc6	lib/promscrape: optimize getScrapeWork() function Reduce the number of memory allocations in this function. This improves its performance by up to 50%. This should improve service discovery speed when big number of potential targets with big number of meta-labels are generated by service discovery. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2270	2022-04-20 15:34:18 +03:00
Aliaksandr Valialkin	d0bac8e224	all: typo fix: Kuberntes -> Kubernetes	2022-04-20 10:51:41 +03:00
Dmytro Kozlov	17552dba8b	lib/promscrape: Enable filters for endpoint and labels (#2466 ) * lib/promscrape: Enable filters for endpoint and labels * lib/promscrape: cleanup * lib/promscrape: update template * lib/promscrape: move logic filter logic to backend * lib/promscrape: updated placeholder * lib/promscrape: updated placeholder * lib/promscrape: use two different fields for filters, updated form, added error on parsing queries * lib/promscrape: rename functions * lib/promscrape: removed unused values * wip * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-19 18:27:44 +03:00
Nikolay	628905f080	lib/promscrape: adds job restart method (#2455 ) * lib/promscrape: adds job restart method it must restart only ScrapeConfig with changed content this change greatly reduce time, that needed for job restart and it should decrease possible data loss when config frequently changed at kubernetes based deployments Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 20:29:33 +03:00
Yury Molodov	60c4e0022a	fix: prevent graph hiding without data (#2456 ) * fix: prevent graph hiding without data * fix: add yaxis labels default * app/vmselect: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-16 17:16:17 +03:00
Aliaksandr Valialkin	944070eafa	docs/Cluster-VictoriaMetrics.md: sync docs	2022-04-16 16:59:42 +03:00
Aliaksandr Valialkin	7debf57ca6	lib/httpserver: clarify that `-tls` flag enables TLS for http requests to `-httpListenAddr`	2022-04-16 16:59:41 +03:00
Aliaksandr Valialkin	a7689e1b0c	app/vmstorage: add support for mTLS cipher suites via `-cluster.tlsCipherSuites` command-line flag Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2404	2022-04-16 16:36:38 +03:00
Aliaksandr Valialkin	0156a8b1e1	docs/Cluster-VictoriaMetrics.md: update docs after `26ae50ec26`	2022-04-16 16:04:32 +03:00
Aliaksandr Valialkin	6bd032a6d3	docs: sync docs with the latest changes	2022-04-16 16:00:27 +03:00
Aliaksandr Valialkin	27e74f25d6	lib/httpserver: follow up after `def0032c7d`	2022-04-16 15:52:44 +03:00
Aliaksandr Valialkin	c50e48a74c	lib/promscrape: follow-up after `baa1c24b36`	2022-04-16 14:26:38 +03:00
Aliaksandr Valialkin	f6fed6637d	docs/Cluster-VictoriaMetrics.md: clarify the issue with multi-level cluster, which may result in data gaps at some AZs	2022-04-16 13:03:39 +03:00
Aliaksandr Valialkin	ef86cbabcc	docs/Cluster-VictoriaMetrics.md: improve docs on cluster setup, resizing and scalability	2022-04-15 15:04:10 +03:00
Aliaksandr Valialkin	437a12cb64	docs/Cluster-VictoriaMetrics.md: mention about possible issues with multi-level cluster setup	2022-04-15 14:26:01 +03:00
Aliaksandr Valialkin	564996da14	docs/CHANGELOG.md: document `45fcaa33e8`	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	951b2a0067	docs/CHANGELOG.md: document `f7e4c5a628`	2022-04-13 14:14:25 +03:00
Roman Khavronenko	56cd2b918a	vmalert: add DNS service discovery (#2465 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2460 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-13 14:14:25 +03:00
Anton Bystrov	af96e6594c	Update CHANGELOG.md (#2463 ) May be mispint here?	2022-04-13 14:14:25 +03:00
Aliaksandr Valialkin	4a6b56e5be	docs/CHANGELOG.md: cut v1.76.1	2022-04-12 16:21:06 +03:00
Aliaksandr Valialkin	3e2a4c07cd	app/vmui: further improvements for number display on graphs This is a follow-up for `c4d2cd8336` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2409	2022-04-12 16:02:37 +03:00
Aliaksandr Valialkin	50a6354a03	docs/CHANGELOG.md: link to the bug related to improper handling of maxSeries limit passed from vmselect to vmstorage	2022-04-12 16:02:37 +03:00
Yurii Kravets	488d300d8b	Update Quick-Start (#2422 ) * Update Quick-Start * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update docs/Quick-Start.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * update Quick-Start.md added "Starting VM-Cluster via Docker" + Anchor fixes * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-04-12 14:27:36 +03:00
Roman Khavronenko	e48a59eaa6	docs: add managed vm documentation section (#2437 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-12 13:04:11 +03:00
Aliaksandr Valialkin	70ad171070	lib/promscrape: follow-up after `7e79adfb55`	2022-04-12 12:37:03 +03:00
Yurii Kravets	e5b8a5210e	url-examples.md (#2435 ) * url-examples.md added 1 more example * Update url-examples.md	2022-04-12 11:30:53 +03:00
Aliaksandr Valialkin	81b7a31cb1	app/vmstorage: properly handle `maxSeries` limit passed from vmselect to vmstorage	2022-04-12 11:19:07 +03:00
Aliaksandr Valialkin	e3bf464f11	lib/protoparser/native: follow-up after `fe01f4803d`	2022-04-11 19:27:53 +03:00
Aliaksandr Valialkin	b3a3e9990f	vendor: update github.com/VictoriaMetrics/metricsql from v0.40.0 to v0.41.0 This allows using built-in function names as with template names	2022-04-11 18:32:18 +03:00
Aliaksandr Valialkin	5b265b3031	docs/Single-server-VictoriaMetrics.md: clarify that `ingestion protocol` means `data ingestion protocol`	2022-04-11 12:57:55 +03:00
Aliaksandr Valialkin	3c27bde77e	docs/CHANGELOG.md: document `ed364a42e3`	2022-04-11 12:12:07 +03:00
Aliaksandr Valialkin	e1b274d26c	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics supports data ingestion in Graphite protocol at `Graphite API usage` chapter	2022-04-10 16:21:19 +03:00
Aliaksandr Valialkin	cf9d261038	docs/Cluster-VictoriaMetrics.md: update docs after `b843f0e229`	2022-04-10 16:17:57 +03:00
Yurii Kravets	ace7dfe5d1	Update url-examples (#2410 )	2022-04-08 13:07:06 +03:00
Aliaksandr Valialkin	4f5622b6fa	docs/Cluster-VictoriaMetrics.md: clarify high availability docs	2022-04-08 12:51:49 +03:00
Aliaksandr Valialkin	ce02d086d0	docs/CHANGELOG.md: document backwards-incompatible changes in cluster version of v1.76.0	2022-04-08 12:06:49 +03:00
Dmytro Kozlov	2aeb221691	docs/guides: Multi-regional setup with VictoriaMetrics (#2416 ) * docs/guides: Multi-regional setup with VictoriaMetrics * docs/guides: cleanup	2022-04-08 11:49:04 +03:00
Aliaksandr Valialkin	d7557b12ab	docs/CHANGELOG.md: document the bugfix in hitCount function	2022-04-08 11:48:36 +03:00
Aliaksandr Valialkin	949bf25a87	docs/CHANGELOG.md: typo fix	2022-04-07 17:20:20 +03:00
Aliaksandr Valialkin	e59019d088	docs/CHANGELOG.md: cut v1.76.0	2022-04-07 15:34:12 +03:00
Aliaksandr Valialkin	f082e64e0c	app/vmagent: reduce the probability of TLS handshake timeout when dialing the remote storage The following actions are taken: - Increase the TLS hashdshake timeout from 5 seconds to 10 seconds - Increase dial timeout from 5 seconds to 30 seconds - Specify DialContext instead of Dial in http.Transport. This allows properly handling the Context arg during dialing the remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1699	2022-04-06 12:35:14 +03:00
Aliaksandr Valialkin	087609a12b	docs/Release-Guide.md: add missing steps	2022-04-06 11:41:42 +03:00
Aliaksandr Valialkin	c24c5b8926	docs/CHANGELOG.md: document `0c0efc7781`	2022-04-05 19:22:08 +03:00
Nikolay	7eb49d204f	vmctl verify-blocks command (#2390 ) * lib/protoparser: changes ParseStream for native format uses reader instead of http.Request updates app/vmagent and app/vmagent method usage * app/vmctl: add verify-block subcommand it allows to check exported from VictoriaMetrics data block in native format https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2362 Update app/vmctl/README.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-04-05 17:46:36 +03:00
Aliaksandr Valialkin	8752cce157	app/vminsert: reduce the max packet size, which vminsert can send to vmstorage This reduces the max memory usage for vminsert and vmstorage under heavy ingestion rate by up to 50% on production workload	2022-04-05 15:39:58 +03:00
Roman Khavronenko	ce1629b70a	vmalert: add flag for disabling long-lived connections (keepalive) (#2395 ) The new flag `datasource.disableKeepAlive` allows disabling keepalive connections. This may be useful if there are multiple datasource replicas (e.g. vmselects) behind the HTTP balancer to avoid uneven load spread because of long-lived connections. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-04 13:08:06 +03:00
Aliaksandr Valialkin	816085a652	docs/CHANGELOG.md: document `70bb0d2708`	2022-04-04 13:02:41 +03:00
Aliaksandr Valialkin	676c1f4fd7	docs/CHANGELOG.md: document 173073364e1bb1e0259ddc873dbd96ce62b07543	2022-04-04 12:56:11 +03:00
Artem Navoiev	23614d752a	Update release process. Actualize helm-charts release process. Add re… (#2397 ) * Update release process. Actualize helm-charts release process. Add release guide for ansible playbooks * add step to Ansible steps	2022-04-04 12:56:11 +03:00
Ross Dougherty	4df09074d3	fix object selectors link (#2391 ) * fix object selectors link * update kustomize url	2022-04-01 12:41:28 +03:00
Dima Lazerka	e756eae06d	Fix typo "vmanomapy"	2022-04-01 12:26:53 +03:00
Aliaksandr Valialkin	157555b022	docs/CHANGELOG.md: document a57e3807537914396ee3eb378648a464fa9e1b97	2022-04-01 12:25:54 +03:00
Aliaksandr Valialkin	151a00189e	docs/CHANGELOG.md: document `0989649ad0`	2022-04-01 12:03:41 +03:00
Yurii Kravets	bd0068254d	url-examples (#2389 )	2022-04-01 12:03:41 +03:00
Roman Khavronenko	d907e0d9f0	docs: fix typo in vmalert's API (#2380 ) The API handler was changed in 1.75 but docs still contain the old address. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2366 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-04-01 12:03:41 +03:00
Roman Khavronenko	5b367ad594	docs: update `increase_prometheus` desc (#2381 ) Remove note that this func is supported by PromQL.	2022-03-28 12:29:41 +03:00
Roman Khavronenko	44fa461e77	docs: escape chars for /label/values endpoint (#2379 ) Without escaping the part wrapped with `<` `>` chars won't be rendered properly.	2022-03-28 12:29:41 +03:00
Aliaksandr Valialkin	7c81ce296d	docs/CHANGELOG.md: cut v1.75.1	2022-03-28 12:28:27 +03:00
Yury Molodov	7cbf19812d	vmui: predefined panels (#2243 ) * feat: add basic components for predefined dashboards * fix: change display alert * feat: add autosize and unit for axes * feat: add component for CircularProgress * feat: change layout for predefined dashboards * feat: add override step for predefined panels * feat: add override step for predefined panels * feat: change yaxis limits for predefined panels * fix: rename flag for hide legend * feat: add formatted panel description * feat: add README.md for dashboard setup * feat: validate dashboard settings * feat: add unit for y-ticks * fix: correct display error for dashboards * fix: disable auto refresh after route change * update package-lock.json * fix: add basename for BrowserRouter * fix: add dynamic basename for routing * update packages * feat: add a pre-defined dashboard "per-job resource usage" * feat: display unit in the hover-tooltip * fix: change routing and home layout * fix: change axis width calc * updated packages * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-26 13:05:21 +02:00
Aliaksandr Valialkin	b843f0e229	app/vmselect: add fine-grained limits for the number of returned/scanned time series for various APIs	2022-03-26 11:28:14 +02:00
Dima Lazerka	6e8e385375	VMAnomaly docs fixes (#2361 ) * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Squeeze vmanomaly after vmbackupmanager before Case Studies Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-25 12:09:05 +02:00
Aliaksandr Valialkin	b7b06fb50e	Revert "docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0" This reverts commit `1e18c1c1ae`. The bugfix has been alread mentioned in the commit `9290605891`	2022-03-24 19:21:15 +02:00
Aliaksandr Valialkin	1e18c1c1ae	docs/CHANGELOG.md: mention a bugfix in Graphite render API in v1.75.0	2022-03-24 19:20:42 +02:00
Dima Lazerka	50bc179dce	Add vmanomaly docs section (#2356 ) * Added docs for vmanomaly * Add example images * Stylistic fixes * Move images to root * Update docs/vmanomaly.md * Update docs/vmanomaly.md Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2022-03-24 11:57:07 +02:00
Yurii Kravets	b8d9c071e9	Update url-examples (#2358 ) * Update url-examples Add federate example * Update docs/url-examples.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-24 11:57:06 +02:00
Aliaksandr Valialkin	c3d7522c19	docs: a follow-up after `76a477c609`	2022-03-23 19:39:58 +02:00
Yurii Kravets	5f41e22cb1	Update Single-server-VictoriaMetrics.md (#2357 ) * Update Single-server-VictoriaMetrics.md Adding /federate link * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-23 19:39:57 +02:00
Yurii Kravets	a8b55103aa	Update url-examples.md (#2297 ) * Update url-examples.md +additional examples * Update * Update url-examples Some changes requested by Roman. * Update url-examples.md * Update url-example * Update url-examples Additional info and marking for /labels part * Update url-example Added example with complex query which needs encoding: How to execute the query similar to - sum(increase(foo{status="bar"}[5m])) by (status) * Update url-samples Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-03-22 15:12:36 +02:00
Aliaksandr Valialkin	8f678411cc	docs/Cluster-VictoriaMetrics.md: clarify mTLS protection docs	2022-03-22 14:01:06 +02:00
Arash Hatami	2e01691d5d	A good change for MD files (#2353 ) * Lint YAML * Remove extra comment * Fix command problem * Format MD files * Format & fix problem of MD files for docs * Another fix for MD files	2022-03-22 14:01:04 +02:00
Roman Khavronenko	bb594b34b8	docs: update release notes (#2349 ) Warn about memory issue introduced in releases 1.73 - 1.74	2022-03-21 15:41:25 +02:00
Aliaksandr Valialkin	84b3234f3d	docs/CHANGELOG.md: document `a1e17e91f8`	2022-03-21 15:37:03 +02:00
hagen1778	7c7436b584	docs: add update note to v1.75.0 release note Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-21 15:37:01 +02:00
Aliaksandr Valialkin	7e67d61fdf	docs/CHANGELOG.md: cut v1.75.0	2022-03-18 19:54:13 +02:00
Aliaksandr Valialkin	85695faa94	app/vmselect/bufferedwriter: suppress trivial network errors, which can be generated by remote side These errors include `broken pipe` and `reset by peer`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2334	2022-03-18 19:27:33 +02:00
Aliaksandr Valialkin	9d91ad7124	app/vmagent/remotewrite: prevent from infinite recursion panic when pushing a time series with big number of samples to remote storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2335	2022-03-18 19:07:27 +02:00
Aliaksandr Valialkin	ab966f8a7a	docs: document `20bb5e703c`	2022-03-18 18:42:09 +02:00
Aliaksandr Valialkin	e35c9124b7	lib/storage: reduce the interval for checking for free disk space from 30 seconds to 1 second This should reduce the probability of out of disk space panics when -storage.minFreeDiskSpaceBytes is set to low values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2305	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	7c92aaeaa4	lib/blockcache: properly release memory occupied by deleted entries Proviously the deleted entries could remain referenced via lastAccessHeap for long time. This could lead to increased memory usage for the following caches starting from v1.73.0: * indexdb/indexBlocks * indexdb/dataBlocks * storage/indexBlocks Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2242 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-03-18 16:53:19 +02:00
Aliaksandr Valialkin	85a4b805e1	docs/CHANGELOG.md: document `e5868b9c29` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/546 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2255	2022-03-18 13:08:56 +02:00
Aliaksandr Valialkin	3b7aefade2	docs/vmalert.md: sync after `11ae1ae924`	2022-03-17 20:18:07 +02:00
Aliaksandr Valialkin	e1f70af14e	docs/CHANGELOG.md: document `11ae1ae924`	2022-03-17 20:09:18 +02:00
Aliaksandr Valialkin	f0e96a84db	docs: document the addition of mTLS communication between cluster components	2022-03-17 20:00:14 +02:00
Aliaksandr Valialkin	9290605891	docs/CHANGELOG.md: document c1d07e7c52f0a2ab892921b0639cd42677aa33a8	2022-03-16 14:25:38 +02:00
Aliaksandr Valialkin	c175afbe02	docs/CHANGELOG.md: document changes from `fb6eab03a2`	2022-03-16 13:28:29 +02:00
Aliaksandr Valialkin	5b53373154	docs/CHANGELOG.md: document `565bd08c43` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1824	2022-03-16 13:28:29 +02:00
Aliaksandr Valialkin	bf131a4990	docs: `make docs-sync`	2022-03-16 13:28:29 +02:00
hagen1778	fd0f521bb9	docs: add update details for some releases Some of the releases could negatively affect performance for a limited period of time due to some changes in core. Update details are meant to warn users about expected changes in peformance after the update. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 13:03:36 +02:00
Roman Khavronenko	ec48d022df	docs: fix broken links (#2303 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 13:01:46 +02:00
Dmytro Kozlov	7f0212f964	Issue-1824: added flags and different auth types support (#2287 ) * vmalert/notifier: added flags and different auth types support Co-authored-by: hagen1778 <roman@victoriametrics.com>	2022-03-16 12:52:01 +02:00
Ted Robertson	d4f2dd2a71	Clarify lack of support for InfluxQL (#2273 )	2022-03-16 12:25:09 +02:00
Bastien Dronneau	da722e462e	docs(vmalert): typo in path (#2278 )	2022-03-16 12:24:12 +02:00
Aliaksandr Valialkin	e7a0b4e095	docs/CHANGELOG.md: cut v1.74.0	2022-03-03 19:30:53 +02:00
Aliaksandr Valialkin	419f109f88	docs: `make docs-sync` after `702aa4948b`	2022-03-03 18:37:07 +02:00
Dan Dascalescu	e15b27b792	docs: clarify Retention, improve English (#2266 )	2022-03-03 18:37:07 +02:00
nemobis	cd522dee14	Fix typo, sentence flow in operator description (#2251 )	2022-03-03 18:37:07 +02:00
Aliaksandr Valialkin	0b5ec1780d	docs/CHANGELOG.md: document performance improvements when registering new time series	2022-03-03 17:12:25 +02:00
Nikolay	d5ba1249f8	fixes incorrect step for calculation for MovingWindow functions (#283 ) * fixes incorrect step for calculation for MovingWindow functions https://victoriametrics.zendesk.com/agent/tickets/99 * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-25 13:53:48 +02:00
Aliaksandr Valialkin	1bde8b4e22	docs/CHANGELOG.md: document cfc6c14dc48ae9dd35e65f1a6e5c7af8ccb9f029	2022-02-25 13:53:09 +02:00
Aliaksandr Valialkin	02a922b53f	lib/storage: properly handle series selector matching multiple metric names plus a negative filter Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2238 This is a follow-up for `00cbb099b6`	2022-02-24 12:11:53 +02:00
Aliaksandr Valialkin	2431c9cf81	lib/promrelabel: add support for conditional relabeling via `if` filter Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1998	2022-02-24 02:35:13 +02:00
Nikolay	54221297d1	fixes jwt token parse with correct base64Url decoding (#281 ) * fixes jwt token parse with correct base64Url decoding it must be applied according to jwt RFC that requires token to be URL safe added slow path for decoding tokens with std base64 decoding adds error logging for vmgateway * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-23 13:57:54 +02:00
Aliaksandr Valialkin	244c23ea2c	lib/workingsetcache: reduce the default cache rotation period from hour to 20 minutes This should reduce memory usage under high time series churn rate	2022-02-23 13:42:27 +02:00
Aliaksandr Valialkin	cb100ce2af	docs/CHANGELOG.md: cut v1.73.1	2022-02-22 21:11:55 +02:00
Aliaksandr Valialkin	1ff42a0080	docs/CHANGELOG.md: link to the feature request for X-Influxdb-Version response header Follow-up for `71ef3155c8` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2209	2022-02-22 20:34:03 +02:00
Yurii Kravets	538114cd7c	Update URL examples (#2207 ) added div with copy function	2022-02-22 20:09:27 +02:00
Denys Holius	fc6f71fba8	Added minimal supported version of AlertManager (#2237 ) * added minimal supported version of supported AlertManager * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-22 20:09:26 +02:00
Aliaksandr Valialkin	89ead3daca	app/vmselect/netstorage: report vmstorage errors to vmselect clients even if partial responses are allowed If a vmstorage is reachable and returns an application-level error to vmselect, then such error must be returned to the caller even if partial responses are allowed, since it usually means cluster mis-configuration. Partial responses may be returned only if some vmstorage nodes are temporarily unavailable. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1941 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/678	2022-02-21 21:17:05 +02:00
Roman Khavronenko	5a4b16794d	Consul SD - update services on the watcher's start (#2202 ) * lib/discovery/consul: update services on the watcher's start Previously, watcher's start was only initing goroutines for discovery but not waiting for the first iteration to end. It means first Consul discovery wasn't returning discovered targets until the next iteration. The change makes the watcher's start blocking until we get first discovery iteration done and all registries updated. Signed-off-by: hagen1778 <roman@victoriametrics.com> * vmalert: remove workarounds for consul SD Now when consul SD lib properly updates services on the first start, we don't need workarounds in vmalert. Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/discovery/consul: update after review Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 15:33:33 +02:00
Aliaksandr Valialkin	4a658cf955	app/vmagent: add `-influxDBLabel` in the same way as for app/vminsert This is a follow-up for `3d19fa6932`	2022-02-21 14:09:40 +02:00
Roman Khavronenko	bd7837d524	lib: allow to configure cache size by type (#2206 ) * lib: allow to configure cache size by type https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1940 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-21 13:55:51 +02:00
Pablo Ley	4606d00d7d	Added missing inlineScrapeConfig field to the VMAgentSpec docs	2022-02-21 13:55:50 +02:00
Aliaksandr Valialkin	47b93a1337	docs: `make docs-sync`	2022-02-18 12:26:35 +02:00
Roman Khavronenko	f59685e5ff	docs: make profiling commands more copy-friendly (#2213 ) * docs: make profiling commands more copy-friendly The change adds `copy text` snippet to code examples and replaces hostname placeholders with `0.0.0.0`. Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * Apply suggestions from code review * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-18 12:26:35 +02:00
Aliaksandr Valialkin	ce91456982	app/vminsert: add `X-Influxdb-Version` response header for InfluxDB API requests This is needed for some clients, which expect this header. See https://github.com/ntop/ntopng/issues/5449#issuecomment-1005347597	2022-02-17 12:49:24 +02:00
Aliaksandr Valialkin	8aaeffa7b4	docs: document `3d19fa6932`	2022-02-16 23:30:52 +02:00
Aliaksandr Valialkin	ee066aa0d5	lib/storage: use binary search instead of full scan for skipping artificial tags when searching for tag names or tag values This should improve performance for /api/v1/labels and /api/v1/label/<label_name>/values See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2200	2022-02-16 18:17:27 +02:00
Aliaksandr Valialkin	f227712d7d	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics doesnt check DD_API_KEY when accepting data via DataDog protocol	2022-02-16 14:40:01 +02:00
匠心零度	cbba78e091	Correct URL:How to delete time series (#2201 ) Co-authored-by: lirenzuo <lirenzuo@shein.com>	2022-02-16 14:39:59 +02:00
Aliaksandr Valialkin	eaf29a5e8e	docs/url-examples.md: formatting fixes	2022-02-15 21:25:09 +02:00
Aliaksandr Valialkin	bb113efeb4	docs/CHANGELOG.md: document `2efa46a11c`	2022-02-15 21:13:32 +02:00
Denys Holius	7e73fafc6f	Update revisions of dashboards (#2199 ) * update revision of vmcluster for operator guide * update revision of vmcluster for vmcluster guide	2022-02-15 21:13:32 +02:00
Yurii Kravets	759ea64b85	Create url-examples.md	2022-02-15 21:13:32 +02:00
Aliaksandr Valialkin	5aa3c896a8	docs/Single-server-VictoriaMetrics.md: clarify that the data is imported into VictoriaMetrics at `how to import data` section	2022-02-15 21:07:04 +02:00
Aliaksandr Valialkin	7e8596edb8	docs: update `-help` output for VictoriaMetrics components	2022-02-15 21:02:36 +02:00
Oct	c7c45bf842	docs: correct address in the docs (#2189 ) * docs/FAQ.md:fix 404 url * app/vmui/packages/vmui/README.md:rm 404 url	2022-02-15 12:59:50 +02:00
Aliaksandr Valialkin	e2be41f4dd	docs/CHANGELOG.md: document `ad6bdd78d0`	2022-02-15 12:48:23 +02:00
Aliaksandr Valialkin	38c73a00db	docs/CHANGELOG.md: cut v1.73.0	2022-02-14 17:54:53 +02:00
Aliaksandr Valialkin	5d8ea8c918	docs/CHANGELOG.md: document `3d890e89f1`	2022-02-14 17:42:33 +02:00
Nikolay	48a9e068be	adds release build for macos darwin amd64 and arm64 (#2185 ) * adds release build for macos darwin amd64 and arm64 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1896 https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1851 * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-14 17:42:33 +02:00
Aliaksandr Valialkin	fc0771a888	docs/CHANGELOG.md: document `c90c1c4d54`	2022-02-14 13:13:03 +02:00
Aliaksandr Valialkin	31b42e9c57	lib/promscrape: add `expand all` and `collapse all` buttons to `/targets` page See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2021	2022-02-12 18:42:01 +02:00
Aliaksandr Valialkin	989668beba	app/vmselect/promql: return at most one time series from `absent_over_time()` in the same way as Prometheus does See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2130	2022-02-12 15:46:43 +02:00
Aliaksandr Valialkin	216b13186d	docs/vmagent.md: add `unsupported Prometheus config sections` chapter	2022-02-12 01:08:34 +02:00
Aliaksandr Valialkin	3ab4aef140	docs/CHANGELOG.md: document `ea153e5f90`	2022-02-12 00:48:40 +02:00
Roman Khavronenko	d107f86fbc	lib/index: reduce read/write load after indexDB rotation (#2177 ) * lib/index: reduce read/write load after indexDB rotation IndexDB in VM is responsible for storing TSID - ID's used for identifying time series. The index is stored on disk and used by both ingestion and read path. IndexDB is stored separately to data parts and is global for all stored data. It can't be deleted partially as VM deletes data parts. Instead, indexDB is rotated once in `retention` interval. The rotation procedure means that `current` indexDB becomes `previous`, and new freshly created indexDB struct becomes `current`. So in any time, VM holds indexDB for current and previous retention periods. When time series is ingested or queried, VM checks if its TSID is present in `current` indexDB. If it is missing, it checks the `previous` indexDB. If TSID was found, it gets copied to the `current` indexDB. In this way `current` indexDB stores only series which were active during the retention period. To improve indexDB lookups, VM uses a cache layer called `tsidCache`. Both write and read path consult `tsidCache` and on miss the relad lookup happens. When rotation happens, VM resets the `tsidCache`. This is needed for ingestion path to trigger `current` indexDB re-population. Since index re-population requires additional resources, every index rotation event may cause some extra load on CPU and disk. While it may be unnoticeable for most of the cases, for systems with very high number of unique series each rotation may lead to performance degradation for some period of time. This PR makes an attempt to smooth out resource usage after the rotation. The changes are following: 1. `tsidCache` is no longer reset after the rotation; 2. Instead, each entry in `tsidCache` gains a notion of indexDB to which they belong; 3. On ingestion path after the rotation we check if requested TSID was found in `tsidCache`. Then we have 3 branches: 3.1 Fast path. It was found, and belongs to the `current` indexDB. Return TSID. 3.2 Slow path. It wasn't found, so we generate it from scratch, add to `current` indexDB, add it to `tsidCache`. 3.3 Smooth path. It was found but does not belong to the `current` indexDB. In this case, we add it to the `current` indexDB with some probability. The probability is based on time passed since the last rotation with some threshold. The more time has passed since rotation the higher is chance to re-populate `current` indexDB. The default re-population interval in this PR is set to `1h`, during which entries from `previous` index supposed to slowly re-populate `current` index. The new metric `vm_timeseries_repopulated_total` was added to identify how many TSIDs were moved from `previous` indexDB to the `current` indexDB. This metric supposed to grow only during the first `1h` after the last rotation. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401 Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-12 00:34:44 +02:00
Roman Khavronenko	791cad8c2e	lib/promscrape: support prometheus-like duration in scrape configs (#2169 ) * lib/promscrape: support prometheus-like duration in scrape configs The change allows to specify duration values like `1d`, `1w` for fields `scrape_interval`, `scrape_timeout`, etc. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/817#issuecomment-1033384766 Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/blockcache: make linter happy Signed-off-by: hagen1778 <roman@victoriametrics.com> * lib/promscrape: support prometheus-like duration in scrape configs * add support for extra fields `scrape_align_interval` and `scrape_offset`; * support Prometheus duration parsing for `__scrape_interval__` and `__scrape_duration__` labels; Signed-off-by: hagen1778 <roman@victoriametrics.com> * wip * wip * docs/CHANGELOG.md: document the feature Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 16:17:51 +02:00
Aliaksandr Valialkin	727b29d4a3	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_endpointslice_{label,annotation}*` labels to be consistent with other `role` values for Kubernetes service discovery	2022-02-11 14:56:10 +02:00
Nikolay	265938a385	fixes service discovery for kubernetes (#2173 ) * fixes service discovery for kubernetes now it must take in account all pods that belong to the discovered endpoint and endpointslice adds simple test for endpoints https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2134 * wip * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-11 13:35:34 +02:00
Aliaksandr Valialkin	6cb2954612	docs/CHANGELOG.md: document `4e722c459b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2167	2022-02-10 12:21:05 +02:00
Aliaksandr Valialkin	718342a806	docs/Articles.md: add an article from Asserts.io, which mentions VictoriaMetrics components	2022-02-10 12:21:05 +02:00
Aliaksandr Valialkin	b81e6ba403	docs/CHANGELOG.md: add instructions on how to build VictoriaMetrics components from source code in order to test tip changes	2022-02-08 16:44:20 +02:00
Nikolay	feefbbab48	adds CGO build for arm64 (#2102 ) * adds CGO build for arm64 it must improve performance for arm64 based deployments of vmstorage and vmsingle for 15-20% it depends on gozstd package update for correct musl gozstd vendoring * typo fixes * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 16:26:55 +02:00
Roman Khavronenko	763cb68a67	docs: add Storage section to docs (#2155 ) * docs: add Storage section to docs https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2151 Signed-off-by: hagen1778 <roman@victoriametrics.com> * Apply suggestions from code review * docs: `make docs-sync` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-02-08 16:00:18 +02:00
Aliaksandr Valialkin	eed66b6640	lib/promscrape: set `-promscrape.config.strictParse` to true by default This allows detecting long-living silent errors in -promscrape.config	2022-02-08 15:42:33 +02:00
Aliaksandr Valialkin	6e05e3308e	docs/Single-server-VictoriaMetrics.md: add a link to exlanation on how downsampling works	2022-02-08 15:11:27 +02:00
Aliaksandr Valialkin	2149805886	docs/CHANGELOG.md: add links to issues, which could benefit from improved re-routing algorithm	2022-02-07 16:54:27 +02:00
Aliaksandr Valialkin	eb466e0c4e	docs: fix links to FAQ.md entries after they have been changed in `ccf04239e6`	2022-02-07 16:01:34 +02:00
Aliaksandr Valialkin	5da7f08be6	docs: cross-link downsampling docs from deduplication and vmalert docs	2022-02-07 14:53:50 +02:00
Aliaksandr Valialkin	c738739494	app/vminsert: add `-dropSamplesOnOverload` command-line flag Drop incoming samples if the destination vmstorage node is unavailable and/or accepts data at slower rate than other vmstorage nodes	2022-02-07 12:32:18 +02:00
Aliaksandr Valialkin	021ee53ba8	app/vminsert: improve re-routing logic in order to spread rows more evenly among the available storage nodes	2022-02-06 20:20:02 +02:00
Aliaksandr Valialkin	d24e5d9efd	lib/promscrape: show the total number of scrapes and the total number of scrape errors per target at /targets page This information may be useful when debugging unreliable scrape targets	2022-02-03 20:23:27 +02:00
Aliaksandr Valialkin	678b3e71db	lib/promscrape: provide the ability to fetch target responses on behalf of vmagent or single-node VictoriaMetrics This feature may be useful when debugging metrics for the given target located in isolated environment	2022-02-03 19:02:12 +02:00
Aliaksandr Valialkin	10367d7e4c	app/vmselect/promql: do not push down filters, which enumerate more than 10k unique values Such filters may slow down time series search, so just skip them. This is a follow-up for `e7f1ceeb84` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1827	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	97b7b94f91	docs/CHANGELOG.md: document `55e3bbd4cc` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1567	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	dbead4813e	docs: updates after `5da71eb685` * Mention about the ability to configure vmalert notifiers via files in docs/CHANGELOG.md * Mention about the ability to use Consul service discovery for vmalert notifiers in docs/CHANGELOG.md * Run `make docs-sync` in order to sync app/vmalert/README.md to docs/vmalert.md	2022-02-02 23:42:25 +02:00
Pablo Ley	66271bfeee	Added missing links in EmbeddedHPA API docs	2022-02-02 23:42:25 +02:00
Aliaksandr Valialkin	566e12874d	lib/cgroup: expose `process_cpu_cores_available` metric This metric shows the number of CPU cores available to the process. This allows creating alerting rules on CPU saturation with the following query: rate(process_cpu_seconds_total[5m]) / process_cpu_cores_available > 0.9 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2107	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	04d6596298	app/vmselect/promql: optimize queries, which join on `_info` metrics. Automatically add common filters from one side of binary operation to the other side before sending the query to storage subsystem. See https://grafana.com/blog/2021/08/04/how-to-use-promql-joins-for-more-effective-queries-of-prometheus-metrics-at-scale/ and https://www.robustperception.io/exposing-the-software-version-to-prometheus	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	ad5d646e4e	docs/Release-Guide.md: add instructions on how to create signed release tags	2022-01-31 20:25:15 +02:00
Aliaksandr Valialkin	35164d4dcf	docs/CHANGELOG.md: document `6a519896db`	2022-01-31 12:42:27 +02:00
Aliaksandr Valialkin	069880fd3c	docs/vmauth.md: mention that backend services must be accessible only via vmauth	2022-01-28 12:07:12 +02:00
Denys Holius	9e7d6a585b	FAQ update (#2111 ) * FAQ update: how downsampling and deduplication will work at the same time * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2022-01-27 20:36:15 +02:00
jaysony	3e22537248	correct VMAgentStatus description (#2109 ) correct VMAgentStatus description from VMAlert to VMAgent.	2022-01-27 20:18:37 +02:00
Aliaksandr Valialkin	0ac2a51682	vendor: update github.com/VictoriaMetrics/metricsql from v0.37.0 to v0.38.0 This adds more optimization cases for https://utcc.utoronto.ca/~cks/space/blog/sysadmin/PrometheusLabelNonOptimization For example: * Multi-level transform functions. For example, abs(round(foo{a="b"})) + bar{x="y"} is now optimized to abs(round(foo{a="b",x="y"})) + bar{a="b",x="y"} * Binary operations with `on()`, `without()`, `group_left()` and `group_right()` modifiers. For example, foo{a="b"} on (a) + bar is now optimized to foo{a="b"} on (a) + bar{a="b"} * Multi-level binary operations. For example, foo{a="b"} + bar{x="y"} + baz{z="q"} is now optimized to foo{a="b",x="y",z="q"} + bar{a="b",x="y",z="q"} + baz{a="b",x="y",z="q"} * Aggregate functions. For example, sum(foo{a="b"}) by (c) + bar{c="d"} is now optimized to sum(foo{a="b",c="d"}) by (c) + bar{c="d"}	2022-01-27 19:04:45 +02:00
Aliaksandr Valialkin	4911c0c045	docs/operator: fix links to Operator API docs	2022-01-25 17:38:41 +02:00
Aliaksandr Valialkin	49650fe6aa	lib/logger/throttler.go: show the original location of the error and warning message Previously the location inside LogThrottler implementation was shown. This could complicate debugging.	2022-01-23 13:55:48 +02:00
f41gh7	2f56f484af	updates operator docs	2022-01-23 13:15:37 +02:00
Yury Molodov	196bef8348	vmui: fixed display type switching (#2088 ) * fix: correct switch display type * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 16:57:14 +02:00
Yurii Kravets	4b7650832e	Created Operator folder in docs (#2034 ) * Created Operator folder in docs Transferred Operator documentation * Removed Contributing and Release * Changed sort numbering * Renamed folder Operator -> operator * 1 1 * Name change Operator -> operator * Removed colon symbol * Useful links transformed to links style * "updated at..." is no longer a header * delete manager patch.yaml * delete kustomization.yaml * removed part with links * community and contributions part removed * Delete readme * Docs navigation removed	2022-01-21 12:06:41 +02:00
Yury Molodov	034012c80f	vmui: fix time range selector (#2085 ) * fix: add date validate for time range * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-21 12:03:41 +02:00
Aliaksandr Valialkin	93cadb4a16	all: update link to EULA from https://victoriametrics.com/assets/VM_EULA.pdf to https://victoriametrics.com/legal/eula/	2022-01-20 22:22:44 +02:00
Aliaksandr Valialkin	6ae584b9b3	lib/{mergeset,storage}: properly limit cache sizes for indexdb Previously these caches could exceed limits set via `-memory.allowedPercent` and/or `-memory.allowedBytes`, since limits were set independently per each data part. If the number of data parts was big, then limits could be exceeded, which could result to out of memory errors. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2007	2022-01-20 18:45:03 +02:00
Aliaksandr Valialkin	c2abd6a702	docs/CHANGELOG.md: document the bugfix for highestMax() function is Graphite render API	2022-01-20 12:16:12 +02:00
Aliaksandr Valialkin	d9ab623c5b	docs/Release-Guide.md: update instructions for exporting snapcraft login to ~/.snap/login.json	2022-01-19 15:21:49 +02:00
Aliaksandr Valialkin	6233e7c40c	docs/CHANGELOG.md: add missing parens in example for `@` modifier	2022-01-19 13:05:29 +02:00
Oct	9cd8aa8444	docs: Correct some urls in the docs (#2081 ) * docs:update Swift S3 api url * docs/vmbackup.md: update Swift S3 api url * docs: update KairosDB docs url * docs: update thanos docs url	2022-01-19 11:57:02 +02:00
Aliaksandr Valialkin	2eaf7a7c46	docs/CHANGELOG.md: fix incorrect link to the issue Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2022-01-19 00:08:31 +02:00
Aliaksandr Valialkin	f3196e48e1	docs/CHANGELOG.md: cut v1.72.0	2022-01-18 22:43:34 +02:00
Aliaksandr Valialkin	0c9cf79e51	docs/vmbackup.md: `make docs-sync` after `ca11def2a5`	2022-01-18 22:30:23 +02:00
Roman Khavronenko	c71a05a528	docs: update retention docs with additional details (#2060 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-01-18 22:30:23 +02:00
Yury Molodov	1d19303f35	fix: remove buffer period (#2078 ) * fix: remove buffer period * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the implemented feature Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2064 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 22:23:40 +02:00
Yury Molodov	5b286a4728	vmui: correct url encoding (#2067 ) * fix: correct encode multi-line queries * fix: change autocomplete for correct arrows work * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2039 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-01-18 21:32:30 +02:00
Oct	cb5d8a8633	docs: Correct config URL (#2077 ) docs: update incorrect links	2022-01-18 21:27:26 +02:00
Aliaksandr Valialkin	ce55b31d2e	docs/CHANGELOG.md: document `8e3f9c1fbb`	2022-01-18 21:27:26 +02:00
Aliaksandr Valialkin	7dabfbee45	docs/CHANGELOG.md: document `fcd33fc409`	2022-01-18 12:47:02 +02:00
Aziz Köksal	f3f764fe8b	docs: proofread FAQ.md (#2062 ) * Added missing articles. * Changed minus characters to long dashes. * Rephrased some words. * Corrected grammar mistakes. * Set correct possessive apostrophes. * "setup" -> "set up" * "no need in" -> "no need for" * "comparing" -> "compared" * "less" -> "fewer" * "additionally" -> "in addition to"	2022-01-18 12:40:43 +02:00
Aliaksandr Valialkin	b020bf4e3f	docs/CHANGELOG.md: document that vmgateway now supports extra_filters option Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:38:24 +02:00
Aliaksandr Valialkin	4f3ed98ea4	docs/vmgateway.md: update docs, since vmgateway now supports extra_filters See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2022-01-18 12:38:23 +02:00
Aliaksandr Valialkin	5a1e4a140f	app/vmselect/promql: implement `keep_metric_names` modifier for transform and rollup functions Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949	2022-01-14 04:15:35 +02:00
Aliaksandr Valialkin	53c9a81f2b	app/vmselect/promql: add `stale_samples_over_time()` function	2022-01-14 01:49:24 +02:00
Aliaksandr Valialkin	410905e2ed	docs/CHANGELOG.md: yet another attempt to fix formatting for yaml snippet	2022-01-14 01:15:15 +02:00
Aliaksandr Valialkin	2eb9ec4476	docs/CHANGELOG.md: fix formatting for `scrape_configs` example	2022-01-14 01:03:02 +02:00
Aliaksandr Valialkin	da95516a1f	lib/promscrape: expose promscrape_stale_samples_created_total metric for monitoring the number of created stale samples	2022-01-14 01:00:40 +02:00
Aliaksandr Valialkin	755779adb7	app/vmalert: add `parseDuration` function in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/8817	2022-01-13 23:30:56 +02:00
Aliaksandr Valialkin	dd91759f1f	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_node_provider_id` label for discovered Kubernetes nodes in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/9603	2022-01-13 23:17:24 +02:00
Aliaksandr Valialkin	0f81ecd7df	app/vmalert: add `stripPort` template function in the same way as Prometheus does See https://github.com/prometheus/prometheus/pull/10002	2022-01-13 22:54:46 +02:00
Aliaksandr Valialkin	bc18368c15	lib/promscrape/discovery/kubernetes: add the ability to limit service discovery to the current namespace See https://github.com/prometheus/prometheus/issues/9782 and https://github.com/prometheus/prometheus/pull/9881	2022-01-13 22:44:59 +02:00
Aliaksandr Valialkin	0580a58feb	app/vmselect/promql: add support for `@` modifier Add support for `@` modifier in MetricsQL according to https://prometheus.io/docs/prometheus/latest/querying/basics/#modifier Extend the support with the following features: * Allow using `@` modifier everywhere in the query. For example, `sum(foo) @ end()` * Allow using arbitrary expression as `@` modifier. For example, `foo @ (end() - 1h)` returns `foo` value at `end - 1 hour` timestamp on the selected time range `[start ... end]` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1348	2022-01-13 22:15:19 +02:00
Aliaksandr Valialkin	de8299f465	lib/promscrape/discovery/dockerswarm: follow up after `68a117a25a` - Document the bugfix at docs/CHANGELOG.md - Set __address__ field after copying commonLabels to the resulting map of discovered labels. This makes sure that the correct __address__ label is used.	2022-01-11 09:22:03 +02:00
Aliaksandr Valialkin	21e5e90d75	docs/CHANGELOG.md: document `77bfa8181d`	2022-01-11 08:56:02 +02:00
Dmitry Tolstoy	56fa9ede65	docs: Correct config URL (#2051 ) Missed /guides folder	2022-01-11 08:55:57 +02:00
Aliaksandr Valialkin	7509780cc0	docs/CHANGELOG.md: add release dates for every release	2022-01-07 12:28:01 +02:00
Aliaksandr Valialkin	fa89f3e5a5	lib/promscrape: do not send staleness markers on graceful shutdown This follows Prometheus behavior. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2013#issuecomment-1006994079	2022-01-07 01:19:06 +02:00
Aliaksandr Valialkin	32ef62b18f	docs/vmctl.md: `make docs-sync`	2022-01-07 01:19:04 +02:00
Aliaksandr Valialkin	c6abaa824d	docs/FAQ.md: add `what is the difference between vmagent and Prometheus agent` chapter	2022-01-06 23:14:22 +02:00
Aliaksandr Valialkin	13c36e5e54	docs: follow-up after `ae89b4e818`	2022-01-05 16:32:56 +02:00
Denys Holius	3a522c591a	Old links replaced for newest (#2033 ) * replaced old links to the website * fixed deletion main README.md file * fix: added docs files after docs-sync	2022-01-05 16:32:54 +02:00
Aliaksandr Valialkin	c91df022cc	docs/CHANGELOG.md: clarify the issue description, which is fixed by `38bf5fc136`	2022-01-05 16:19:32 +02:00
Aliaksandr Valialkin	80fc3fda07	lib/storage: follow-up for `38bf5fc136`	2022-01-05 16:02:17 +02:00
Aliaksandr Valialkin	c29ce8acef	docs/CHANGELOG.md: document `60266078ca`	2022-01-04 11:48:23 +02:00
Aliaksandr Valialkin	276cccb888	docs/CHANGELOG.md: document `ac47733044`	2022-01-03 21:16:19 +02:00
Aliaksandr Valialkin	22c78de2f2	docs/Quick-Start.md: simplify quick start guide	2022-01-03 17:29:10 +02:00
Yurii Kravets	f6e2e0dbd1	Update README.md (#1996 ) * Update README.md go 1.16 -> 1.17 * Update README.md * Update README.md * Update Cluster-VictoriaMetrics.md * Update Single-server-VictoriaMetrics.md * Update vmauth.md * Update vmbackup.md * Update vmrestore.md * Update vmagent.md * Update vmctl.md * Update README.md * Update README.md * Update README.md * Update README.md * Update README.md	2021-12-23 12:11:30 +02:00
Aliaksandr Valialkin	b18d80c247	docs/CHANGELOG.md: document `543bd0ea0c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1999	2021-12-23 12:08:41 +02:00
Aliaksandr Valialkin	c1722003a2	lib/promscrape: scrape replicated targets at different offsets in vmagent replicated clustering mode This guarantees that the deduplication consistently leaves samples from the same vmagent replica. See https://docs.victoriametrics.com/vmagent.html#scraping-big-number-of-targets	2021-12-23 00:21:41 +02:00
Aliaksandr Valialkin	419ea376a6	docs/FAQ.md: link to managed VictoriaMetrics at AWS See https://docs.victoriametrics.com/FAQ.html#what-is-the-pricing-for-victoriametrics	2021-12-22 23:17:00 +02:00
Nikolay	6cdc934c3d	adds restore.lock (#1988 ) * adds restore.lock it must prevent from running storage after incomplete restore process https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 * return back flock file deletion * Apply suggestions from code review * wip * docs/CHANGELOG.md: document https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1958 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-22 13:10:56 +02:00
Aliaksandr Valialkin	c61aa01c71	docs/CHANGELOG.md: document `34fdc8881b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1911	2021-12-21 16:42:38 +02:00
Denys Holius	e24f7884e2	bump revision of dashboards to latest (#1986 )	2021-12-21 12:11:52 +02:00
Aliaksandr Valialkin	41c2657f23	docs/Single-server-VictoriaMetrics.md: mention that recording rules in vmalert can be used for reducing the number of time series	2021-12-20 20:04:21 +02:00
Aliaksandr Valialkin	28a0d3faaa	docs/CHANGELOG.md: cut v1.71.0	2021-12-20 19:10:38 +02:00
Aliaksandr Valialkin	996c3b0957	docs: mention that downsampling can be evaluated for free by running enterprise binaries	2021-12-20 15:57:52 +02:00
Yurii Kravets	3638e096f3	Update FAQ.md (#1765 ) * Update FAQ.md Adding explanation "Why do same metrics have differences in VictoriaMetrics and Prometheus dashboards?" * Update FAQ * Update FAQ.md * Apply suggestions from code review Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-12-20 13:43:40 +02:00
Aliaksandr Valialkin	3396f08874	app/vmselect/promql: follow-up after `177e345d8a` * Document changes_prometheus(), increase_prometheus() and delta_prometheus() functions. * Simplify their implementation * Mention these functions in docs/CHANGELOG.md	2021-12-20 13:15:06 +02:00
Aliaksandr Valialkin	b1196e594b	docs/FAQ.md: describe main reasons for high churn rate	2021-12-20 12:30:42 +02:00
Aliaksandr Valialkin	c446858d08	docs/CHANGELOG.md: document `6814cc6809` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1943	2021-12-17 20:17:09 +02:00
Aliaksandr Valialkin	d9f075622b	app/vmselect: de-duplicate data exported via `/api/v1/export/csv` by default Previously the exported data wasn't de-duplicated. Now it is possible to export the raw data without deduplication by passing reduce_mem_usage=1 query arg to /api/v1/export/csv See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-12-17 11:52:42 +02:00
Roman Khavronenko	e7cca46479	docs: add Benchmarks section (#1950 ) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-17 11:52:42 +02:00
Roman Khavronenko	a92f53486a	docs: update `MetricsQL`.`Subquery` section description (#1951 ) * simplify sentences; * fix typo. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-17 11:52:42 +02:00
Aliaksandr Valialkin	5bd4e47a9e	lib/promscrape: allow up to 5 redirects when scraping a target by default See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1945	2021-12-16 00:14:45 +02:00
Aliaksandr Valialkin	c170841951	app/vmselect/promql: add `timestamp_with_name(m[d])` function This function works the same as `timestamp()`, but doesn't remove source time series names. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/949#issuecomment-995222388	2021-12-15 23:38:09 +02:00
Aliaksandr Valialkin	5b4cb65138	docs: mention `-storage.minFreeDiskSpaceBytes` command-line flag at `capacity planning` section See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1727 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-12-15 21:43:21 +02:00
Aliaksandr Valialkin	946769a828	docs/Cluster-VictoriaMetrics.md: mention about the added downsampling support	2021-12-15 16:39:35 +02:00
Aliaksandr Valialkin	3b8a300588	docs: document the added dowsnampling support in VictoriaMetrics enterprise	2021-12-15 16:25:32 +02:00
Aliaksandr Valialkin	d36fdbe537	lib/storage: deduplicate samples more thoroughly Previously some duplicate samples may be left on disk for time series with high churn rate. This may result in higher disk space usage.	2021-12-15 16:00:30 +02:00
Aliaksandr Valialkin	68cafdcf0b	app/victoria-metrics: mention https://docs.victoriametrics.com/#downsampling in the description for -dedup.minScrapeInterval command-line flag	2021-12-15 13:18:45 +02:00
Aliaksandr Valialkin	c922c7af9a	lib/storage: convert alternate regexps into Graphite wildcards inside `__graphite__` pseudo-label For example, `{__graphite__=~"foo.(bar\|baz)"}` is automatically converted to `{__graphite__=~"foo.{bar,baz}"}` before execution. This allows using multi-value Grafana template variables such as `{__graphite__=~"foo.($app)"}`.	2021-12-14 19:55:59 +02:00
Aliaksandr Valialkin	eedc2aac08	docs/CHANGELOG.md: link to the issue about `unaligned 64-bit atomic opertion` panic on 32-bit architectures	2021-12-14 15:00:46 +02:00
Aliaksandr Valialkin	d02553831d	docs/CHANGELOG.md: an attempt to properly show $labels.alertname at https://docs.victoriametrics.com/CHANGELOG.html	2021-12-14 14:57:03 +02:00
Yury Molodov	b3389ce26b	vmui: custom step (#1942 ) * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * feat: add custom step * update package-lock.json * docs: document that VMUI now supports overriding of `step` query arg, which is passed to `/api/v1/query_range` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-14 14:52:44 +02:00
Yury Molodov	28655e8eb8	vmui: minor fixes (#1936 ) * feat: add a label for the Query field * fix: change zoom position * fix: add description and error code to alerts * fix: correct logic query history * fix: correct update query history * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document bugfixes Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-13 13:44:32 +02:00
Aliaksandr Valialkin	24d0bb7c2a	docs/Single-server-VictoriaMetrics.md: added a link to Graphite paths and wildcards - https://graphite.readthedocs.io/en/latest/render_api.html#paths-and-wildcards	2021-12-13 13:30:02 +02:00
Aliaksandr Valialkin	7b38507fc1	docs/CHANGELOG.md: document `7c3b6365f0`	2021-12-12 19:10:58 +02:00
Aliaksandr Valialkin	addae7fc6a	app/vmselect/promql: preserve the order of time series passed to `limit_offset()` function Previously time series passed to `limit_offset()` were shuffled according to hash for their labels. This was unexpected behaviour for most users. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1920 and https://github.com/VictoriaMetrics/VictoriaMetrics/issues/951	2021-12-12 18:07:15 +02:00
Aliaksandr Valialkin	988003536d	docs/CHANGELOG.md: document `2851709745` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1921	2021-12-10 12:14:18 +02:00
Aliaksandr Valialkin	e267355706	docs/Single-server-VictoriaMetrics.md: add a link to https://github.com/denisgolius/victoriametrics-ru-links	2021-12-09 19:43:28 +02:00
Aliaksandr Valialkin	d91adcba3c	docs: document the ability to investigate correlation between two queries at /vmui This is a follow-up for `c1fd93e8a0`	2021-12-08 17:24:55 +02:00
Aliaksandr Valialkin	38f5bc7451	lib/httpserver: add missing 127.0.0.1 hostname to the logged address for http and pprof server if the address starts with ':' This allows copy-pasting the url to http server from logs.	2021-12-08 16:15:12 +02:00
Aliaksandr Valialkin	ddd2f531bc	docs/Single-server-VictoriaMetrics.md: add LinkedIn public channel	2021-12-08 13:16:10 +02:00
Aliaksandr Valialkin	e21d1353f4	docs/Release-Guide.md: refresh the list of channels for publishing release notes	2021-12-08 13:16:09 +02:00
Aliaksandr Valialkin	1c09881cf7	docs/Single-server-VictoriaMetrics.md: move features chapter above the `case studies` chapter	2021-12-08 12:49:50 +02:00
Aliaksandr Valialkin	54d4a1c959	app/vmselect: accept optional `extra_filters[]` query args for all the supported Prometheus querying APIs See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1863	2021-12-06 17:33:49 +02:00
Aliaksandr Valialkin	9aa9b081a4	app/vminsert: add `-maxLabelValueLen` command-line flag See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1908	2021-12-06 11:42:24 +02:00
Aliaksandr Valialkin	51f2eb3c46	lib/workingsetcache: fix `unaligned 64-bit atomic operation` panic on 32-bit architectures The panic has been introduced in `7275ebf91a`	2021-12-03 01:22:30 +02:00
Aliaksandr Valialkin	d40441947a	app: allow specifying http and https urls in the following command-line flags * -promscrape.config * -relabelConfig * -remoteWrite.relabelConfig * -remoteWrite.urlRelabelConfig	2021-12-03 00:11:47 +02:00
Aliaksandr Valialkin	daaea1eb2c	app/vmauth: follow-up for `13368bed18` * Document the ability to specify http or https urls in `-auth.config` at docs/CHANGELOG.md * Move the ReadFileOrHTTP to lib/fs, so it can be re-used in other places where a file should be read from the given path. For example, in `-promscrape.config` at `vmagent`.	2021-12-02 23:34:15 +02:00
Aliaksandr Valialkin	0f9aaf9cec	docs/CHANGELOG.md: cut v1.70.0	2021-12-02 15:01:39 +02:00
Aliaksandr Valialkin	8abf415225	docs/CHANGELOG.md: document `0afd14a14a`	2021-12-02 14:51:57 +02:00
Aliaksandr Valialkin	b885a3b6e9	lib/httpserver: expose `/-/healthy` and `/-/ready` endpoints as Prometheus does This improves integration with third-party solutions, which rely on these endpoints. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1833	2021-12-02 14:37:50 +02:00
Aliaksandr Valialkin	d1289383eb	lib/protoparser/graphite: allow multiple separators between metric name, value and timestamp	2021-12-02 13:44:01 +02:00
Aliaksandr Valialkin	37a2bea072	lib/protoparser/graphite: properly parse Graphite line with whitespace after the timestamp See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1865	2021-12-02 13:33:50 +02:00
Aliaksandr Valialkin	ca9827fecc	docs/FAQ.md: mention that VictoriaMetrics can be queried via vmui	2021-12-02 13:16:34 +02:00
Aliaksandr Valialkin	2b7dee15dd	app/{vmbackup,vmrestore}: export internal metrics at `/metrics` http handler	2021-12-02 11:56:34 +02:00
Roman Khavronenko	fc4e59ec1d	vmalert: adjust topologies docs in README (#1893 ) Commit changes images width and order in topologies section for better readability. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-12-02 10:33:47 +02:00
Denys Holius	60a83fefbc	added guide-vmcluster-multiple-retention-setup to guides list (#1891 )	2021-12-02 10:33:47 +02:00
Roman Khavronenko	6823818843	Vmalert docs upd (#1890 ) * vmalert: add topology examples in docs * vmalert: docs typo fix	2021-12-02 10:33:47 +02:00
Aliaksandr Valialkin	ab4be24397	app/vmstorage: export vm_cache_size_max_bytes metrics for determining capacity of various caches The vm_cache_size_max_bytes metric can be used for determining caches which reach their capacity via the following query: vm_cache_size_bytes / vm_cache_size_max_bytes > 0.9	2021-12-02 10:30:01 +02:00
Aliaksandr Valialkin	d4655beae8	lib/fs: add `vm_filestream_read_duration_seconds_total` and `vm_filestream_write_duration_seconds_total` metrics These metrics help determining persistent disk saturation with `rate(vm_filestream_read_duration_seconds_total) > 0.9`	2021-12-02 09:13:20 +02:00
Aliaksandr Valialkin	22e7b3c95a	README.md: add a link to https://docs.victoriametrics.com/guides/guide-vmcluster-multiple-retention-setup.html for multi-retention setups	2021-12-01 12:49:05 +02:00
Yurii Kravets	8e4aa91475	Create guide-vmcluster-multiple-retention-setup.md (#1888 ) * Create guide-vmcluster-multiple-retention-setup.md * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-12-01 12:42:56 +02:00
Yurii Kravets	38c9981a98	Add retention-scheme.png	2021-12-01 12:30:06 +02:00
Aliaksandr Valialkin	d0c0c599a5	docs/CHANGELOG.md: document `06eff5a72c` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/487	2021-12-01 12:30:03 +02:00
Aliaksandr Valialkin	bf6eb624f0	docs/Articles.md: added a link to https://mist.io/blog/2021-11-26-kubernetes-and-victoriametrics-in-Mist-v4-6	2021-11-30 15:00:05 +02:00
Aliaksandr Valialkin	5af9480e8e	docs/Single-server-VictoriaMetrics.md: document that the deduplication is applied only when exporting data in JSON line format The exported data isn't de-duplicated by default due to performance reasons. It is expected that the de-duplication is applied during importing the exported data. The deduplication is applied only when exporting data via /api/v1/export if `reduce_mem_usage=1` query arg isn't passed to the request. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1837	2021-11-30 13:06:50 +02:00
Aliaksandr Valialkin	7b88daf2ec	docs/CHANGELOG.md: document `852a895b70`	2021-11-30 01:22:59 +02:00
Aliaksandr Valialkin	fdca152322	docs/CHANGELOG.md: document `f05cddd2fc` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1830	2021-11-30 01:16:16 +02:00
Aliaksandr Valialkin	cc773ac199	docs/CHANGELOG.md: document `9dd650f67f`	2021-11-30 01:09:30 +02:00
Aliaksandr Valialkin	b7eb4bb6cb	docs/CHANGELOG.md: document `624ad73705`	2021-11-30 01:05:29 +02:00
Aliaksandr Valialkin	e4c329f5a8	docs/CHANGELOG.md: document `c6d5927281`	2021-11-30 01:00:56 +02:00
Aliaksandr Valialkin	4ad397188e	lib/protoparser: do not log `connection reset by peer` error when reading the data via InfluxDB, Graphite and OpenTSDB protocols over plain TCP connections This error is expected, so there is no need in spamming the log with this error.	2021-11-29 21:58:11 +02:00
Aliaksandr Valialkin	4c466b27f1	docs/CHANGELOG.md: document `695cb617b2`	2021-11-29 12:13:39 +02:00
Aliaksandr Valialkin	84decc4254	app/vmselect/promql: consistently return zero from `deriv(const)`	2021-11-17 18:01:58 +02:00
Aliaksandr Valialkin	e93f46187d	lib/persistentqueue: add vm_persistentqueue_read_duration_seconds_total and vm_persistentqueue_write_duration_seconds_total metrics for determining disk usage saturation at vmagent	2021-11-17 16:42:12 +02:00
Aliaksandr Valialkin	aa6d11a33f	app/vmselect/promql: add `now()` function, which returns the current timestamp as a floating-point value in seconds	2021-11-17 16:42:11 +02:00
Aliaksandr Valialkin	5610207549	docs: document -s3ForcePathStyle command-line option This is a follow-up for `b72eed1f5e`	2021-11-17 01:10:24 +02:00
vic	273fbc2e8a	Update Cluster-VictoriaMetrics.md (#1806 ) replicationFactor flag should be passed to vmselect instead of vminsert for improving query speed:)	2021-11-17 01:01:08 +02:00
Florian Klink	89650de497	docs/vmalert.md: document vmalert url flags a bit more cleanly (#1823 ) Describe remoteWrite.url is used to persist rules and alerts state info, and add an additional paragraph explaining the separation between -remoteRead.url and -datasource.url. Fixes #1810.	2021-11-17 00:56:52 +02:00
Aliaksandr Valialkin	71082c7df8	app/vmauth: add ability to override the `username` label value for `vmauth_user_requests_total` metric by specifying `name` option in `-auth.config` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1805	2021-11-17 00:48:14 +02:00
Aliaksandr Valialkin	8fabca9f5d	docs/Single-server-VictoriaMetrics.md: add a link to vmalert rules backfilling at `Backfilling` chapter	2021-11-17 00:24:05 +02:00
Aliaksandr Valialkin	f1c0e9db25	docs/CHANGELOG.md: document the addition of `vm_tenant_used_tenant_bytes` metric, which shows the per-tenant disk usage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1605	2021-11-16 23:35:48 +02:00
Aliaksandr Valialkin	471c0ddd88	docs/Articles.md: add a linkt to OSA Con talk about `how clickhouse inspired us to build victoriametrics`	2021-11-12 14:21:42 +02:00
Aliaksandr Valialkin	82917398b9	docs/CHANGELOG.md: document bugfixes in enteprise versions of vmagent and vmalert	2021-11-12 13:24:37 +02:00
Aliaksandr Valialkin	fd4d665079	docs/Single-server-VictoriaMetrics.md: mention that it is possible to send gzipped data to /api/v1/import/prometheus	2021-11-09 20:45:54 +02:00
Aliaksandr Valialkin	305507930c	app/vmauth: initialize reverse proxy only after flag.Parse() is called This should properly take into accoun the `-maxIdleConnsPerBackend` command-line flag value. Previously it was hardcoded to 100. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1300	2021-11-09 19:23:44 +02:00
Aliaksandr Valialkin	bc357d7132	docs/vmalert.md: improve wording in `Multitenancy` chapter	2021-11-09 14:20:30 +02:00
Aliaksandr Valialkin	57aaf914ac	docs: mention that graphs on the official dashboards contain useful hints	2021-11-08 19:54:25 +02:00
Aliaksandr Valialkin	a352b59b7e	docs/MetricsQL.md: mention than tlast_over_time() is an alias for timestamp()	2021-11-08 18:29:59 +02:00
Aliaksandr Valialkin	b1de180886	docs/CHANGELOG.md: cut v1.69.0	2021-11-08 15:47:48 +02:00
Aliaksandr Valialkin	3a1ac218ba	app/vmselect/promql: add `duration_over_time(m[d], max_interval)` function This function calculates the actual lifetime of the time series on the given lookbehdind window `d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 13:14:57 +02:00
Aliaksandr Valialkin	62edbcdb23	docs/MetricsQL.md: clarify documentation for `lifetime` function Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1780	2021-11-08 12:35:45 +02:00
Aliaksandr Valialkin	7cbb81c2a6	Makefile: add `TAG=v... make publish-release` rule for building and publishing a release for the given TAG	2021-11-08 12:29:24 +02:00
Aliaksandr Valialkin	2e237a6e8c	docs/CHANGELOG.md: document b9cdbcb5046315db96e1e7ca9923d09d0f30dc25	2021-11-08 12:13:32 +02:00
João Paulo	5bd3518e4d	docs: fix multiple typos (#1787 ) Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-11-05 20:46:06 +02:00
Aliaksandr Valialkin	9aa40fc0c3	docs/vmalert.md: document the addition of -defaultTenant.prometheus and -defaultTenant.graphite command-line options to enterprise version of vmalert	2021-11-05 20:04:53 +02:00
Aliaksandr Valialkin	31ac507bee	app/vmalert: remove `rule.type` config, since it doesnt play well with the upcoming default tenants for -clusterMode It is better from the consistency point of view to set up rule types at group level where tenant config is set up.	2021-11-05 19:52:41 +02:00
Aliaksandr Valialkin	847004fa77	app/{vminsert,vmagent}: hide passwords and auth tokens by default at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-05 14:42:13 +02:00
Denys Holius	a3182bc541	bumped grafana dashboards revisions for guides (#1784 )	2021-11-05 11:50:41 +02:00
Aliaksandr Valialkin	c8b9d9e96e	docs/FAQ.md: mention that VictoriaMetrics can be queried via Graphite API	2021-11-04 22:38:33 +02:00
Aliaksandr Valialkin	63c29099ba	app/vmagent: add `-remoteWrite.maxRowsPerBlock` command-line option, which may be used for improving data ingestion performance under high load	2021-11-04 15:39:55 +02:00
Aliaksandr Valialkin	5f13ba8631	app/vmagent/remotewrite: send data to remote storage systems in parallel This should improve data ingestion speed many `-remoteWrite.url` options are configured	2021-11-04 15:04:02 +02:00
Roman Khavronenko	c78496d536	docs: make link to logos zip absolute (#1782 ) The relative link won't work for github-docs website, so we're changing it to absolute link. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2021-11-04 12:16:55 +02:00
Aliaksandr Valialkin	d445d22c0c	lib/promscrape: add `-promscrape.maxResponseHeadersSize` command-line flag for tuning the maximum http response headers size from Prometheus scrape targets	2021-11-03 22:27:55 +02:00
Aliaksandr Valialkin	a102fca4ac	app/vmselect/promql: add `limit_offset(limit, offset, q)` function, which can be used for paging over big number of time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1778	2021-11-03 16:03:10 +02:00
Aliaksandr Valialkin	43bf0333eb	app/vmselect/promql: add `label_graphite_group()` function for extracting groups from Graphite metric names	2021-11-03 13:20:34 +02:00
Aliaksandr Valialkin	8a490bf375	docs/CHANGELOG.md: document `e3a91b186a`	2021-11-02 18:39:52 +02:00
Aliaksandr Valialkin	551a94ba7f	app/{vmagent,vminsert}: add ability to restrict access to /config page with authKey query arg The authKey can be configured via `-configAuthKey` command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1764	2021-11-01 16:47:30 +02:00
Aliaksandr Valialkin	7cf069ddfd	docs/Articles.md: add a link to https://valyala.medium.com/how-to-optimize-promql-and-metricsql-queries-85a1b75bf986	2021-10-29 14:03:27 +03:00
Aliaksandr Valialkin	94d9c06fc1	docs/vmauth.md: typo fix	2021-10-28 14:06:28 +03:00
Aliaksandr Valialkin	6873d6d893	lib/protoparser/influx: automatically detect timestamp precision depending on the number of decimal digits in the timestamp	2021-10-28 12:48:34 +03:00
Aliaksandr Valialkin	38cbae006a	app/vmbackupmanager: fix links to images This is a follow-up after `bd6b8f7e31`	2021-10-27 21:36:25 +03:00
Aliaksandr Valialkin	b626d6d606	lib/promscrape: add `collapse` and `expand` buttons per each group of targets from the same scrape job	2021-10-27 20:04:03 +03:00
Aliaksandr Valialkin	99784b21c1	all: fix build issues and tests for Apple M1 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1653	2021-10-27 15:07:19 +03:00
Aliaksandr Valialkin	f86dba1f5c	docs/CHANGELOG.md: mention the issue about missing `proxy_url` config option at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 22:07:07 +03:00
Aliaksandr Valialkin	ad445a06cd	lib/promscrape: properly show `proxy_url` option value at `/config` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1755	2021-10-26 21:24:22 +03:00
Dima Lazerka	464f5d0910	Fix doc: vmbackup splits by 1 GiB not 100 MB (#1756 ) This is a follow-up for `bdd0a1cdb2`	2021-10-26 19:21:25 +03:00
Aliaksandr Valialkin	9e8697c6c3	docs/CHANGELOG.md: document `3dbdf1632e`	2021-10-25 14:46:52 +03:00
Aliaksandr Valialkin	2d7d67372f	docs/Cluster-VictoriaMetrics.md: add links with the explanation of active time series and series churn rate	2021-10-24 18:39:16 +03:00
Aliaksandr Valialkin	30ade321a6	docs/CaseStudies.md: fix a link to AbisoGaming case study	2021-10-24 18:37:19 +03:00
Aliaksandr Valialkin	7ec253a3da	docs/CHANGELOG.md: typo fix	2021-10-22 21:13:03 +03:00
Aliaksandr Valialkin	1bdfa475f3	docs/CHANGELOG.md: cut v1.68.0	2021-10-22 19:38:01 +03:00
Aliaksandr Valialkin	1780c25e05	docs/vmauth.md: `make docs-sync`	2021-10-22 19:28:27 +03:00
Aliaksandr Valialkin	559dd996c4	app/vmauth: add ability to specify http headers to send in requests to backends See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1736	2021-10-22 19:11:35 +03:00
Aliaksandr Valialkin	fcdb0c415e	docs/CHANGELOG.md: document `43a7984cd8`	2021-10-22 14:00:50 +03:00
Aliaksandr Valialkin	a8bcc3c276	lib/promscrape: reduce memory usage if `-promscrape.noStaleMarkers` command-line flag is passed Do not store in memory the response from the last scrape per each target if -promscrape.noStaleMarkers option is enabled. This should reduce memory usage when the scraped targets return large responses.	2021-10-22 13:22:08 +03:00
Aliaksandr Valialkin	ad40e70d39	docs/CHANGELOG.md: document `a3684fe3de`	2021-10-22 12:29:27 +03:00
Yury Molodov	3ccc37a98b	vmui: query history (#1732 ) * feat: add query history * fix: change detect keyUp for nav query history * feat: set default query history * app/vmselect/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-22 12:29:27 +03:00
Aliaksandr Valialkin	5705f4b6d1	lib/httpserver: expose command-line flags at `/flags` page This should simplify debugging. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-20 00:46:54 +03:00
Aliaksandr Valialkin	5df7ef323f	docs/Single-server-VictoriaMetrics.md: add a link to VMUI at VictoriaMetrics playground	2021-10-19 14:42:35 +03:00
Aliaksandr Valialkin	948e9b8f50	docs/CHANGELOG.md: document `146a5b504c`	2021-10-19 11:24:44 +03:00
Aliaksandr Valialkin	a7de3712e6	docs/CHANGELOG.md: document `cbcc622786`	2021-10-19 09:00:05 +03:00
Yury Molodov	744f6a98eb	vmui: features (#1711 ) * feat: initial uPlot graph * feat: add zoom/pan for graph * fix: add zoom by ctrl/mac * fix: remove unused code * feat: add toggle cache for fetch * feat: add fix y-axis limits * fix: stop point events while panning * fix: change getting cursor position when scaling * feat: add cursor tooltip to graph * fix: uninstall chart.js * fix: change link for create an issue * fix: set default cache value to true * app/vmalert: follow-up after `0e2486df56` * docs/CHANGELOG.md: document `5416e18007` * app/vmui: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-18 15:19:01 +03:00
Aliaksandr Valialkin	f87d43a5e4	docs/CHANGELOG.md: document `5416e18007`	2021-10-18 15:08:44 +03:00
Aliaksandr Valialkin	9273b83cd0	app/vmalert: follow-up after `0e2486df56`	2021-10-18 15:08:42 +03:00
Alexander Rickardsson	0e1dbcd039	vmalert: add disablePathAppend to remote read (#1712 ) * vmalert: add disablePathAppend to remoteRead * docs: add docs for remoteRead.disablePathAppend	2021-10-18 14:59:17 +03:00
Aliaksandr Valialkin	fbcc8b5c7d	lib/promscrape: set `honor_timestamps: true` by default if this option isnt set explicitly in scrape configs This aligns the behavior to Prometheus - see https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config	2021-10-16 20:48:53 +03:00
Aliaksandr Valialkin	102dd91ddd	docs/CaseStudies.md: add Smarkets case study	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	6e1d7d3c9c	docs/CaseStudies.md: add Fly.io case study	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	043c7119c8	docs/CaseStudies.md: add a case study for Razorpay	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	3e12eeaa3b	docs/CaseStudies.md: add AbiosGaming	2021-10-16 20:00:32 +03:00
Aliaksandr Valialkin	24ffb606be	docs/CaseStudies.md: add Percona case study	2021-10-16 19:14:15 +03:00
Aliaksandr Valialkin	0a9be5ef9d	lib/promscrape: expose `promscrape_series_limit_max_series` and `promscrape_series_limit_current_series` metrics per each scrape target with the enabled unique series limiter	2021-10-16 19:14:13 +03:00
Aliaksandr Valialkin	0452a8d4e8	lib/promscrape: store the full response in stream parsing mode in scrapeWork.lastScrape byte slice This allows sending staleness marks and properly calculate scrape_series_added metric in stream parsing mode at the cost of the increased memory usage, since now the potentially big response is kept in the lastScrape byte slice per each scrapeWork. In practice the memory usage increase shouldn't be big, since the response size is usually much smaller than the parsed metrics from this response after the relabeling, which usually adds a big pile of target-specific labels per each metric.	2021-10-15 15:26:24 +03:00
Aliaksandr Valialkin	72c79d7689	docs/FAQ.md: improve wording on why MetricsQL isnt 100% compatible with PromQL	2021-10-14 16:23:17 +03:00
Aliaksandr Valialkin	ae1ee5ba4a	docs/CHANGELOG.md: document the change at `7fcbd3fa4b`	2021-10-14 14:38:14 +03:00
Aliaksandr Valialkin	1beb38d476	docs/FAQ.md: add an entry explaining why MetricsQL isn't 100% compatible with PromQL	2021-10-14 12:50:24 +03:00
Aliaksandr Valialkin	25421fa2ae	lib/promscrape: add `-promscrape.minResponseSizeForStreamParse` command-line option for automatic switching to stream parsing mode when scraping targets with big responses This should reduce memory usage when vmagent scrapes targets with non-uniform response sizes. This is common case in Kubernetes monitoring.	2021-10-14 12:30:55 +03:00
Aliaksandr Valialkin	bee130cc78	lib/promscrape: return error if `sample_limit` or `series_limit` options are set when stream parsing mode is enabled	2021-10-14 12:30:54 +03:00
Aliaksandr Valialkin	73dbad3c2a	docs/CHANGELOG.md: document `e3c8304deb`	2021-10-13 16:44:34 +03:00
Aliaksandr Valialkin	5b7d90d178	lib/promscrape: add ability to show the original labels for discovered targets at /targets page See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1698	2021-10-13 16:44:34 +03:00
Aliaksandr Valialkin	9568961054	docs/MetricsQL.md: add missing blank line before the link to github.com/VictoriaMetrics/metricsql package	2021-10-13 15:11:46 +03:00
Aliaksandr Valialkin	c3a729d458	lib/promscrape: shard targets among cluster nodes after relabeling is applied This guarantees that targets with the same set of labels go to the same vmagent node. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1687#issuecomment-940629495	2021-10-12 17:06:37 +03:00
Aliaksandr Valialkin	aeedfe2fe2	app/vmagent: expose -promscrape.config contents at /config page as Prometheus does See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1695	2021-10-12 16:27:37 +03:00
Aliaksandr Valialkin	1e56d19c09	docs/FAQ.md: add a solution against high churn rate	2021-10-12 10:33:08 +03:00
Roman Khavronenko	49a7ff62df	docs: mention "PromQL compliance" in MetricsQL docs (#1691 )	2021-10-11 21:52:28 +03:00
Aliaksandr Valialkin	48c3668b3d	app/vmselect/promql: add `atan2` binary operator, which is going to be added in Prometheus 2.31 See https://github.com/prometheus/prometheus/pull/9248	2021-10-11 21:17:23 +03:00
Aliaksandr Valialkin	b3d28f3872	app/vmselect/promql: add missing trigonometric functions, which are going to be added in Prometheus 2.31 See https://github.com/prometheus/prometheus/issues/9233	2021-10-11 21:17:21 +03:00
Aliaksandr Valialkin	d00f8b8800	docs/MetricsQL.md: clarify docs for union() function	2021-10-11 17:41:10 +03:00
Denys Holius	6199bd28a2	Added some fixes (#1690 ) * removed not needed description * added some fixes and fixed typos	2021-10-11 12:42:18 +03:00
Aliaksandr Valialkin	f17c4b74c5	docs/MetricsQL.md: add a link to https://medium.com/@romanhavronenko/victoriametrics-promql-compliance-d4318203f51e	2021-10-11 11:02:03 +03:00
Roman Khavronenko	de4fbe9402	docs: add "PromQL compliance" article (#1689 ) * docs: add "PromQL compliance" article * Update docs/Articles.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-10-11 11:01:59 +03:00
Aliaksandr Valialkin	f1e1d20ac4	app/vmselect/promql: consistently return the same set of time series from `limitk()` function This is the expected behaviour by most users.	2021-10-08 19:55:29 +03:00
Aliaksandr Valialkin	a7a1305395	lib/storage: fix unaligned access on 32-bit architectures. The bug has been introduced at `a171916ef5`	2021-10-08 19:38:20 +03:00
Denys Holius	d1ecffb0f6	Added fixes and improvements (#1677 ) * added guide for VM operator * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/getting-started-with-vm-operator.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Fixed different typos and added improvements from proposals * move remoteWrite.url to other place * fixed typo * rephrased vminsert explanation * remove not needed parameters for default setup Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-10-08 18:58:42 +03:00
Aliaksandr Valialkin	aae6f7dfd0	docs/CHANGELOG.md: cut v1.67.0	2021-10-08 16:00:43 +03:00
Aliaksandr Valialkin	cf87050d83	app/vmui: follow-up after `7bfb44113e` * Run `vmui-update` * Document the changes in README.md and CHANGELOG.md	2021-10-08 15:11:09 +03:00
Aliaksandr Valialkin	4fddcf4c83	app/{vminsert,vmstorage}: follow-up after `a171916ef5` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/269	2021-10-08 14:09:51 +03:00
Aliaksandr Valialkin	64b6f3f1c8	app/vminsert: fix uneven distribution of time series among storage nodes Use distinct seed for distribution hash calculations on the second level of vminsert nodes. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1672	2021-10-07 12:22:39 +03:00
Aliaksandr Valialkin	cea79d2013	docs/guides: follow-up after `05a1396247`	2021-10-06 14:47:28 +03:00
Thomas Danielsson	8d26b0f3f5	fix: typo metric_relabel_configs (#1674 ) metric_ralabel_configs -> metric_relabel_configs	2021-10-06 14:47:26 +03:00
Ziqi Zhao	1db3aeab36	fix some typos (#1678 ) Co-authored-by: 柘远 <zzq237937@alibaba-inc.com>	2021-10-06 14:43:56 +03:00
Aliaksandr Valialkin	89700433cc	docs/vmagent.md: update docs after 3e9a939a990c8b608414388c96f68eb062364ae7	2021-10-05 10:23:37 +03:00
Aliaksandr Valialkin	a9420317d9	docs/vmagent.md: document how to write data to Kafka	2021-09-30 17:46:23 +03:00
Aliaksandr Valialkin	ec6eb03d65	app/vmselect/promql: add `topk_last` and `bottomk_last` functions	2021-09-30 13:23:27 +03:00
Aliaksandr Valialkin	d51118e226	app/vminsert: document that -relabelConfig is reloaded on SIGHUP signal	2021-09-29 21:17:25 +03:00
Aliaksandr Valialkin	ae76ceb5f1	docs/CHANGELOG.md: link to Kafka integration docs	2021-09-29 12:31:59 +03:00
Aliaksandr Valialkin	8dcf814c48	app/{vmbackup,vmrestore}: switch from `gcs://...` to `gs://...` urls for backups to GCS The `gs://` urls are commonly used, so prefer them instead of `gcs://` urls, while leaving support for `gcs://` urls for backwards compatibility.	2021-09-29 12:12:37 +03:00
Aliaksandr Valialkin	f35f9188bc	docs/vmagent.md: update Telegraf config in the section about Kafka	2021-09-29 12:01:46 +03:00
Aliaksandr Valialkin	16d7ee7b44	docs/vmagent.md: add docs about reading metrics from Kafka	2021-09-29 01:46:40 +03:00
Aliaksandr Valialkin	428c03c3b8	docs/CHANGELOG.md: document the bugfix from `de810031bf`	2021-09-29 00:42:21 +03:00
Aliaksandr Valialkin	2577e7c306	docs/CHANGELOG.md: document `3d17112a7e`	2021-09-29 00:33:41 +03:00
Aliaksandr Valialkin	4e65bfcc00	app/{vminsert,vmagent}: add ability to ingest data via DataDog "submit metrics" API See https://docs.datadoghq.com/api/latest/metrics/#submit-metrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/206	2021-09-29 00:12:26 +03:00
Yury Molodov	80df31b2ee	vmui: use Chart.js as default engine for graph (#1634 ) * feat: add Plotly as default engine for graph * fix: remove unused components * feat: use Chart.js as default engine graph * fix: correct styles for loader * feat: add zoom/pan for chart * feat: add height for chart * fix: remove unused code * fix: remove empty units from duration * fix: change debounce for pan to 500ms * fix: add utility for plugins register globally * fix: optimize render graph * feat: add buffer data for zoom * fix: add limits for zoom in/out * fix: change update data while zooming * app/vmselect: `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2021-09-27 22:27:49 +03:00
Aliaksandr Valialkin	4b3951fd86	app/vmselect/promql: add `rollup_scrape_interval(m[d])` function It calculates the min, max and avg scrape intervals for m over the given lookbehind window d	2021-09-27 19:21:55 +03:00
Aliaksandr Valialkin	eff31c10ec	app/vmselect/promql: follow-up after `526dd93b32` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1625 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-27 18:57:03 +03:00
Aliaksandr Valialkin	a957d420f4	docs/BestPractices.md docs/BestPractices.md: update the doc	2021-09-27 17:51:57 +03:00
Aliaksandr Valialkin	1115c2f235	app/vmselect/promql: align the behavior of `or`, `and` and `unless` operators with `on (labels)` modifier to Prometheus Previously VictoriaMetrics could return unexpected result of the right-hand side operand had multiple time series with the given set of labels mentioned in `on(labels)`. See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1643	2021-09-24 00:56:35 +03:00
Aliaksandr Valialkin	6fbfa026ca	docs/CHANGELOG.md: cut v1.66.2	2021-09-23 22:53:27 +03:00
Aliaksandr Valialkin	d15d036a5a	lib/storage: properly handle `{__name__=~"prefix(suffix1\|suffix2)",other_label="..."}` queries They were broken in the commit `00cbb099b6` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1644	2021-09-23 21:52:31 +03:00
Aliaksandr Valialkin	f93146c81e	docs: `make docs-sync`	2021-09-23 20:55:29 +03:00
Aliaksandr Valialkin	7edb65a9a3	docs/CHANGELOG.md: document `0e35fc9538` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1641	2021-09-23 20:47:56 +03:00
Aaron France	e398d83829	fix: typo in vmagent.md (#1642 )	2021-09-23 20:47:56 +03:00
Aliaksandr Valialkin	d8de26bbfd	lib/promscrape: add `vm_promscrape_max_scrape_size_exceeded_errors_total` metric for counting of the failed scrapes due to the exceeded response size Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1639	2021-09-23 14:48:16 +03:00
Aliaksandr Valialkin	9b76515216	docs/CaseStudies.md: add a case study for Grammarly	2021-09-23 13:12:20 +03:00
Aliaksandr Valialkin	e128915c6e	docs/Articles.md: add https://cer6erus.medium.com/superset-bi-with-victoria-metrics-a109d3e91bc6	2021-09-23 10:44:14 +03:00
Aliaksandr Valialkin	5e5d5fa8fb	docs/CaseStudies.md: fix a link to third-party articles	2021-09-22 03:53:08 +03:00
Aliaksandr Valialkin	47422e9918	docs/CHANGELOG.md: cut v1.66.1	2021-09-22 01:47:26 +03:00
Aliaksandr Valialkin	25361d176d	docs/CHANGELOG.md: document `9ca1cbced1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1635	2021-09-21 23:17:26 +03:00
Aliaksandr Valialkin	c3e1f87048	lib/promrelabel: fix parsing `regex: true` in relabeling rules	2021-09-21 23:01:40 +03:00
Aliaksandr Valialkin	3f1104ea74	app/vmselect: fix accessing `/graphite/*` endpoints	2021-09-21 14:06:18 +03:00
Aliaksandr Valialkin	e8700b57b9	docs/vmagent.md: typo fix	2021-09-20 16:49:32 +03:00
Aliaksandr Valialkin	233c6a8a82	docs/vmagent.md: typo fixes in `Prometheus staleness markers` docs	2021-09-20 16:44:42 +03:00
Aliaksandr Valialkin	d43ebb8314	docs/CHANGELOG.md: cut v1.66.0	2021-09-20 15:20:36 +03:00
n4mine	a5fcc9e356	fix: typo, dddresses -> addresses (#1630 )	2021-09-20 14:27:34 +03:00
Aliaksandr Valialkin	4150772ef8	docs/Articles.md: add a link to `Open-source strategy at VictoriaMetrics`	2021-09-20 11:46:38 +03:00
Aliaksandr Valialkin	76c650bbda	app/vmselect/promql: add `quantiles_over_time("phiLabel", phi1, ..., phiN, m[d])` function for calculating multiple quantiles at once	2021-09-17 23:35:04 +03:00
Aliaksandr Valialkin	727521d20a	docs/CHANGELOG.md: document `0e09fdb8b0`	2021-09-17 18:47:39 +03:00
Aliaksandr Valialkin	81d24045c2	app/vmselect/promql: add histogram_quantiles("phiLabel", phi1, ..., phiN, buckets) function This function calculates multiple quantiles over the given buckets at once Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1573	2021-09-17 13:39:06 +03:00
Aliaksandr Valialkin	9333c4111e	docs/CHANGELOG.md: document the change in enterprise apps, which allows passing `-version` without `-eula` flag See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1621	2021-09-17 12:38:22 +03:00
Aliaksandr Valialkin	f9910113b5	docs/FAQ.md: extend `VictoriaMetrics vs TimescaleDB` section with real user experience See also https://github.com/timescale/promscale/issues/427 , which is mentioned in the https://abiosgaming.com/press/high-cardinality-aggregations/	2021-09-16 20:47:15 +03:00
Roman Khavronenko	cec67a3129	docs: fix indentation for FAQ document (#1620 )	2021-09-16 14:01:22 +03:00
Aliaksandr Valialkin	3f8de4f82f	app/vmselect/promql: add `mad(q)` and `outliers_mad(tolerance, q)` functions to MetricsQL	2021-09-16 13:35:38 +03:00
Aliaksandr Valialkin	7ad54041fe	app/{vminsert,vmselect}: automatically add missing port in `-storageNode` lists passed to `vminsert` and `vmselect` This should simplify manual setup of the cluster according to https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#cluster-setup	2021-09-15 18:04:30 +03:00
Aliaksandr Valialkin	9ebccddfc2	docs/CHANGELOG.md: document `777ff75874`	2021-09-15 17:45:18 +03:00
Aliaksandr Valialkin	e67b4fca11	vendor: update github.com/valyala/histogram from v1.1.2 to v1.2.0 This fixes the non-repeatable quantile_over_time() results when the number of input samples exceeds 1000. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1612	2021-09-15 09:35:40 +03:00
Roman Khavronenko	45cce85bf4	docs: add "Choosing a Time Series Database for High Cardinality Aggregations" article (#1617 )	2021-09-15 09:35:38 +03:00
Aliaksandr Valialkin	63fb5a5ca5	docs/vmalert.md: follow-up after `68721f6e7d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1608	2021-09-14 14:48:45 +03:00
Dima Lazerka	5a256970d6	Remove port 3000 and add https to play-grafana link (#1616 ) * Remove port 3000 and add https to play-grafana link * Fix typo Co-authored-by: Dzmitry Lazerka <dlazerka@gmail.com>	2021-09-14 14:27:16 +03:00
Aliaksandr Valialkin	1493461244	lib/storage: follow up after `00cbb099b6`	2021-09-14 14:23:02 +03:00
Aliaksandr Valialkin	5e5ce27df7	app/vmauth: do not log invalid auth tokens by default for security reasons The logging can be enabled by passing `-logInvalidAuthTokens` command-line flag to vmauth	2021-09-14 12:20:17 +03:00
Aliaksandr Valialkin	d3289bf276	docs/Single-server-VictoriaMetrics.md: link to cardinality limiter docs in vmagent	2021-09-13 21:27:25 +03:00
Aliaksandr Valialkin	a8f1b614e5	docs/vmagent.md: mention `out of order sample` errors, which are typically emitted by Thanos, Cortex or Prometheus	2021-09-13 19:36:09 +03:00
Aliaksandr Valialkin	a1b298a842	app/vminsert/netstorage: disable rerouting by default Production clusters work more stable with the disabled rerouting during rolling restarts and/or during spikes in time series churn rate. So it would be better disabling the rerouting by default. The re-routing can be enabled by passing `-disableRerouting=false` command-line flag to `vminsert` nodes. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/791 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1054 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1165	2021-09-13 18:50:47 +03:00
Aliaksandr Valialkin	2932f495f3	docs/CHANGELOG.md: document `5494bc02a6`	2021-09-13 17:14:45 +03:00
Aliaksandr Valialkin	184e145570	docs: consistency renaming: Influx -> InfluxDB	2021-09-13 17:14:45 +03:00
Aliaksandr Valialkin	b721110902	docs/vmbackup.md: update the outdated link to vmbackupmanager	2021-09-13 14:17:53 +03:00
Aliaksandr Valialkin	19516aedb5	app/vmselect/promql: use Prometheus-compatible label value formatting for `count_values` function	2021-09-13 13:48:18 +03:00
Aliaksandr Valialkin	b684624f67	lib/promscrape/discovery/docker: support host networking mode See https://github.com/prometheus/prometheus/issues/9116	2021-09-13 13:30:55 +03:00
Aliaksandr Valialkin	6ed9f10da5	lib/promscrape/discovery/kubernetes: properly use https scheme for wildcard TLS certificates in ingress target discovery See https://github.com/prometheus/prometheus/issues/8902	2021-09-13 13:04:43 +03:00
Aliaksandr Valialkin	d90834da70	lib/promscrape: generate `scrape_timeout_seconds` metric per each scrape target in the same way as Prometheus 2.30 does See https://github.com/prometheus/prometheus/pull/9247	2021-09-12 15:21:26 +03:00
Aliaksandr Valialkin	6c97388dde	lib/promscrape: add ability to configure scrape_timeout and scrape_interval via relabeling See https://github.com/prometheus/prometheus/pull/8911	2021-09-12 13:35:20 +03:00
Aliaksandr Valialkin	09670479cd	lib/promscrape: reduce CPU usage for common case when calculating `scrape_series_added` metric Also reduce CPU usage when applying `series_limit` to scrape targets with constant set of metrics. The main idea is to perform the calculations on scrape_series_added and series_limit only if the set of metrics exposed by the target has been changed. Scrape targets rarely change the set of exposed metrics, so this optimization should reduce CPU usage in general case.	2021-09-12 12:53:45 +03:00
Aliaksandr Valialkin	2b64c1c95e	docs/Single-server-VictoriaMetrics.md: refer to relabeling section for vmagent This removes duplicate docs about additional relabeling actions supported by VictoriaMetrics components	2021-09-12 11:40:23 +03:00
Aliaksandr Valialkin	def0430318	docs/vmagent.md: sync with app/vmagent/README.md by running `make docs-sync`	2021-09-11 11:05:12 +03:00
Aliaksandr Valialkin	5aaaa686a4	lib/promscrape: send stale markers for disappeared metrics like Prometheus does	2021-09-11 11:02:56 +03:00
Aliaksandr Valialkin	e1632dc0df	docs/vmalert.md: typo fix in `Multitenancy` chapter	2021-09-10 17:57:43 +03:00
Aliaksandr Valialkin	c2f37f049b	lib/storage: properly search series by multiple tag filters matching empty labels such as foo{bar=~"baz\|",x=~"y\|"} Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1601 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/395	2021-09-09 21:12:53 +03:00
Aliaksandr Valialkin	9b07cb2988	app/vmselect/promql: keep metric name in `rollup_candlestick` results, since they don't change the original series meaning Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1600	2021-09-09 19:24:10 +03:00
Aliaksandr Valialkin	09edcfd21c	docs/CHANGELOG.md: typo fix	2021-09-09 18:58:03 +03:00
Aliaksandr Valialkin	d613a018c8	lib/promscrape: add ability to set `series_limit` and `stream_parse` options via relabeling This allows managing these options on a per-target basis. Typical use case: to manage these options for pods via Kubernetes annotations.	2021-09-09 18:51:23 +03:00
Aliaksandr Valialkin	986807ebd9	docs/vmagent.md: typo fix in `Relabeling` chapter	2021-09-09 16:39:34 +03:00
Aliaksandr Valialkin	75c3514c5c	lib/promrelabel: add `keep_metrics` and `drop_metrics` actions to relabeling rules These actions simlify metrics filtering. For example, - action: keep_metrics regex: 'foo\|bar\|baz' would leave only metrics with `foo`, `bar` and `baz` names, while the rest of metrics will be deleted. The commit also makes possible to split long regexps into multiple lines. For example, the following config is equivalent to the config above: - action: keep_metrics regex: - foo - bar - baz	2021-09-09 16:25:09 +03:00
Aliaksandr Valialkin	708ebd59ad	docs/vmalert.md: `make docs-sync` after `21f022e5f0`	2021-09-09 16:25:08 +03:00
Aliaksandr Valialkin	2b19dd8601	docs/MetricsQL.md: add a link to VictoriaMetrics github	2021-09-08 00:15:34 +03:00
Aliaksandr Valialkin	608ed19655	app/vmalert: follow-up after `21f022e5f0`	2021-09-07 22:45:47 +03:00
Aliaksandr Valialkin	9be7294331	docs/CHANGELOG.md: document `42e07cfaea`	2021-09-07 22:32:01 +03:00
Aliaksandr Valialkin	304661c547	docs/vmagent.md: add API path for Prometheus text exposition format	2021-09-07 16:15:28 +03:00
Aliaksandr Valialkin	c5e030dfc4	docs/Articles.md: add a link to case studies	2021-09-06 10:58:48 +03:00
Aliaksandr Valialkin	52b44945a0	docs/Articles.md: add an url to https://www.vultr.com/docs/install-and-configure-victoriametrics-on-debian	2021-09-03 11:50:23 +03:00
Aliaksandr Valialkin	9f816dfee8	docs/Single-server-VictoriaMetrics.md: fix a link multitenancy docs for cluster version in VictoriaMetrics	2021-09-02 17:44:22 +03:00
Aliaksandr Valialkin	a88b02287d	docs/CHANGELOG.md: cut v1.65.0	2021-09-01 17:12:44 +03:00
Aliaksandr Valialkin	41af6a73fe	docs/FAQ.md: add questions on how to migrate data from various systems (Prometheus, InfluxDB, OpenTSDB, Graphite) to VictoriaMetrics	2021-09-01 16:48:05 +03:00
Aliaksandr Valialkin	5c58c8d55e	docs: update `-help` output for victoria-metrics and vmagent after `f77dde837a`	2021-09-01 16:35:18 +03:00
Aliaksandr Valialkin	c4df601f43	lib/promscrape: add the ability to limit the number of unique series per each scrape target The number of series per target can be limited with the following options: * Global limit with `-promscrape.maxSeriesPerTarget` command-line option. * Per-target limit with `max_series: N` option in `scrape_config` section. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1561	2021-09-01 16:08:12 +03:00
Aliaksandr Valialkin	835efb111e	docs: `make docs-sync`	2021-09-01 12:25:17 +03:00
Aliaksandr Valialkin	816d4b6095	docs/CHANGELOG.md: document `eff940aa76`	2021-09-01 12:25:11 +03:00
Aliaksandr Valialkin	22bb18a449	docs/CHANGELOG.md: document `7c70dcbe3b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1471	2021-09-01 12:25:04 +03:00
Nikolay	210c76b51e	adds external_labels per group for vmalert (#1485 ) * adds external_label per group for vmalert https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1471	2021-09-01 12:19:49 +03:00
Aliaksandr Valialkin	9723ac30dd	docs/Single-server-VictoriaMetrics.md: remove outdated link to VictoriaMetrics wiki VictoriaMetrics wiki became outdated after publishing all the docs at https://docs.victoriametrics.com	2021-08-31 11:53:38 +03:00
Aliaksandr Valialkin	b3d240f7b4	docs/CHANGELOG.md: add a link to Prometheus staleness tracking	2021-08-31 11:53:38 +03:00
Aliaksandr Valialkin	146c14d879	lib/promscrape/discovery/kubernetes: return back support `role: endpointslices`, since it is used by VictoriaMetrics operator This is a follow up commit after `31b42b30b6`	2021-08-29 12:37:36 +03:00
Aliaksandr Valialkin	18d7adf731	lib/protoparser/opentsdb: follow-up after `8ee75ca45a`	2021-08-29 11:50:01 +03:00
Aliaksandr Valialkin	ca61d7c82b	lib/promscrape/discovery/kubernetes: rename `role: endpointslices` to `role: endpointslice` to be consistent with Prometheus See `2ec6c7dbb8/discovery/kubernetes/kubernetes.go (L99)`	2021-08-29 11:23:59 +03:00
Aliaksandr Valialkin	327034b54f	lib/promscrape/discovery/kubernetes: use v1 API instead of v1beta1 API for `role: ingress` and `role: endpointslices` This should fix service discovery for these roles in Kubernetes v1.22 and newer versions. See https://kubernetes.io/docs/reference/using-api/deprecation-guide/#ingress-v122 The corresponding change in Prometheus - https://github.com/prometheus/prometheus/pull/9205	2021-08-29 11:23:58 +03:00
Aliaksandr Valialkin	0e809bd4b6	docs/Single-server-VictoriaMetrics.md: mention that downsampling doesnt improve query performance on high churn rate	2021-08-27 18:51:28 +03:00
Aliaksandr Valialkin	39bb6bdd79	app/vmselect/promql: add `quantile("phiLabel", phi1, ..., phiN, q)` aggregate function to MetricsQL See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1573	2021-08-27 18:40:25 +03:00
Aliaksandr Valialkin	14d4b5aa83	app/vmselect: add `-search.disableAutoCacheReset` command-line option for disabling automatic cache reset when a sample with old timestamp outside -search.cacheTimestampOffset is inserted See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1570	2021-08-27 17:17:43 +03:00
Aliaksandr Valialkin	6e5864b014	docs/{vmgateway,vmbackupmanager}: mention that enterprise binaries are free for download and evaluation	2021-08-27 14:53:48 +03:00
Aliaksandr Valialkin	adf71a415e	docs: link to `active time series`, `churn rate` and `high cardinality` questions	2021-08-27 14:45:36 +03:00
Aliaksandr Valialkin	1a7646c142	docs/CHANGELOG.md: document the bugfix for possible timeout error in vmbackupmanager when making snapshots See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1571	2021-08-27 13:04:33 +03:00
Aliaksandr Valialkin	125a94e6ca	docs: mention that enterprise binaries can be downloaded and evaluated for free	2021-08-27 12:48:51 +03:00
Aliaksandr Valialkin	102ab795f8	docs/vmagent.md: document the ability to load scrape configs from multiple files See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1559	2021-08-26 09:13:54 +03:00
Aliaksandr Valialkin	7fdb4db73d	lib/promscrape: add ability to load scrape configs from multiple files See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1559	2021-08-26 08:51:53 +03:00
Aliaksandr Valialkin	8d843d0754	docs/CHANGELOG.md: document `48f33d098b`	2021-08-25 13:32:05 +03:00
Aliaksandr Valialkin	874660a4ae	docs/Cluster-VictoriaMetrics.md: mention that the `-replicationFactor` at `vmselect` is an optional parameter	2021-08-25 13:10:31 +03:00
Aliaksandr Valialkin	4a2d7aec7f	lib/promscrape: expose promscrape_discovery_http_errors_total metric for tracking errors per each http_sd config	2021-08-25 13:05:29 +03:00
Aliaksandr Valialkin	b885bd9b7d	lib/{mergeset,storage}: improve the detection of the needed free space for background merge This should prevent from possible out of disk space crashes during big merges. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1560	2021-08-25 10:01:09 +03:00
Aliaksandr Valialkin	ae8ec78c63	docs/FAQ.md: add more entries for frequently asked questions The following topics are covered: * Active time series * High cardinality * High churn rate * Slow inserts	2021-08-24 11:34:31 +03:00
Aliaksandr Valialkin	9b39e078c0	docs/MetricsQL.md: typo fix: histogram_qunatile -> histogram_quantile	2021-08-23 23:08:28 +03:00
Aliaksandr Valialkin	3eca49c4a6	docs/MetricsQL.md: fix the indentation for `median` function	2021-08-23 12:04:43 +03:00
Aliaksandr Valialkin	a4948d92b5	docs/MetricsQL.md: typo fix: convesions->conversions	2021-08-23 12:01:34 +03:00
Aliaksandr Valialkin	8b9dc45c3c	docs/MetricsQL.md: typo fixes	2021-08-23 12:00:17 +03:00
Aliaksandr Valialkin	5917c72ddd	docs/MetricsQL.md: rehaul the documentation on MetricsQL * Document all the functions supported by MetricsQL, including PromQL functions * Group functions by their type: rollup functions, transform functions, label manipulation functions and aggregate functions. * Document implicit query transformations.	2021-08-23 11:46:30 +03:00
Aliaksandr Valialkin	40b06e84f8	app/vmselect/promql: rename `sign()` function to `sgn()` in order to be consistent with Prometheus See https://github.com/prometheus/prometheus/pull/8457 for details.	2021-08-23 11:46:29 +03:00
Aliaksandr Valialkin	8493159eed	deployment/docker: update Go builder from Go1.16.7 to Go1.17.0 This improves data ingestion and query performance by up to 5% according to benchmarks. See https://go.dev/blog/go1.17	2021-08-21 22:22:31 +03:00
Aliaksandr Valialkin	67bc407747	lib/promscrape: reduce memory and CPU usage when Prometheus staleness tracking is enabled for metrics from deleted / disappeared scrape targets Store the scraped response body instead of storing the parsed and relabeld metrics. This should reduce memory usage, since the response body takes less memory than the parsed and relabeled metrics. This is especially true for Kubernetes service discovery, which adds many long labels for all the scraped metrics. This should also reduce CPU usage, since the marshaling of the parsed and relabeld metrics has been substituted by response body copying. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526	2021-08-21 21:24:07 +03:00
Aliaksandr Valialkin	ff4c7c1a3d	docs/vmalert.md: run `make docs-sync` after `9ee3d0378f`	2021-08-21 20:25:26 +03:00
Aliaksandr Valialkin	388e07b37f	docs/CHANGELOG.md: document `9ee3d0378f`	2021-08-21 20:23:22 +03:00
Aliaksandr Valialkin	3454f25e0f	docs/CHANGELOG.md: document `b5d6a0e499`	2021-08-19 14:07:00 +03:00
Aliaksandr Valialkin	2e1eb33bfd	docs/CHANGELOG.md: clarify the change, which adds `-search.noStaleMarkers` command-line flag	2021-08-19 13:55:43 +03:00
Aliaksandr Valialkin	ee1f3414d1	app/vmselect/promql: do not override `[d]` at `last_over_time(m[d])` if `[d]` is smaller than `scrape_interval` Since most users do not expect the overriding of explicitly set `[d]`.	2021-08-19 10:33:10 +03:00
Aliaksandr Valialkin	47a37b8cfc	docs/CHANGELOG.md: cut v1.64.1 This is mostly bugfix release, which includes fixes for staleness handling and a security update for Alpine base image	2021-08-18 22:07:05 +03:00
Aliaksandr Valialkin	8ee575dee9	lib/promscrape: send stale markers for the previously scraped metrics on failed scrapes like Prometheus does	2021-08-18 22:00:46 +03:00
Aliaksandr Valialkin	355690a719	docs/CHANGELOG.md: document `06bf21c21b`	2021-08-18 14:01:42 +03:00
Aliaksandr Valialkin	5d92fafc40	app/vmselect: add `-search.noStaleMarkers` command-line flag for disabling stale markers handling in queries This option allows reducing CPU usage a bit when VictoriaMetrics is used for collecting and processing non-Prometheus data. For example, InfluxDB line protocol, Graphite, OpenTSDB, CSV, etc.	2021-08-18 13:58:06 +03:00
Aliaksandr Valialkin	f21fad53b4	lib/promscrape: add ability to disable sending Prometheus staleness markers with -promscrape.disableStaleMarkers command-line flag This option can be useful when vmagent consumes too much additional memory for staleness markers functionality and when staleness markers aren't needed.	2021-08-18 13:58:05 +03:00
Aliaksandr Valialkin	49886ecbc8	app/vmselect/promql: add bitmap_and(), bitmap_or() and bitmap_xor() functions to MetricsQL Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1541	2021-08-17 13:22:15 +03:00
Aliaksandr Valialkin	130a5cab7e	docs/Single-server-VictoriaMetrics.md: mention that vmctl can migrate data from OpenTSDB to VictoriaMetrics	2021-08-17 11:17:38 +03:00
Aliaksandr Valialkin	db34c40aec	lib/promscrape: stop scrapers for the removed targets before starting scrapers for the added targets This should prevent from possible time series overlap when old target is substituted by new target (for example, during Kubernetes deployments). Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1530 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/748 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1509	2021-08-17 01:00:40 +03:00
Aliaksandr Valialkin	fe8c462044	app/vmalert: mention -remoteWrite.disablePathAppend in the description for -remoteWrite.url	2021-08-16 15:23:39 +03:00
Aliaksandr Valialkin	21974cb571	app/vmalert: follow-up for `2400f85761`	2021-08-16 15:20:35 +03:00
Aliaksandr Valialkin	a47c1a734a	docs/CHANGELOG.md: update urls to Prometheus 2.29 release Previously these urls were pointing to rc0 release	2021-08-16 14:58:05 +03:00
Aliaksandr Valialkin	f05e827757	docs/CHANGELOG.md: typo fix: satureated -> saturated	2021-08-16 14:58:05 +03:00
Alexander Rickardsson	d27dc3721b	vmalert: enable configuring explicit path (#1536 ) * vmalert: allow to disable automatically added path to remote write address via disablePathAppend flag * docs: update docs to include remoteWrite.disablePathAppend	2021-08-16 14:58:05 +03:00
Aliaksandr Valialkin	75a0345215	docs/CHANGELOG.md: cut v1.64.0	2021-08-15 23:52:24 +03:00
Aliaksandr Valialkin	5f13c519ee	lib/promscrape: restore red highlighting for DOWN targets at /targets page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1461	2021-08-15 16:04:33 +03:00
Aliaksandr Valialkin	175727dace	docs/CHANGELOG.md: mention the bugfix when more than 27 time series are selected at /vmui	2021-08-15 15:11:13 +03:00
Aliaksandr Valialkin	b09b035d3e	docs/CHANGELOG.md: mention that VMUI automatically fills Server URL field Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1506	2021-08-15 14:45:59 +03:00
Aliaksandr Valialkin	48920bdef8	app/vmagent/remotewrite: expose vmagent_remotewrite_send_duration_seconds_total metric This metric can be used for determining high saturation of every connection to remote storage with an alerting query `rate(vmagent_remotewrite_send_duration_seconds_total) > 0.9s`. This query triggers when a connection is satureated by more than 90%	2021-08-15 13:34:07 +03:00
Aliaksandr Valialkin	c1f81f08d4	all: add support for Prometheus staleness markers Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1526 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/748 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1509 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1530 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/845	2021-08-13 12:13:15 +03:00
Aliaksandr Valialkin	7feb62eea9	docs/Cluster-VictoriaMetrics.md: meniton that vmagent can be used for replicating the data among multiple clusters Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1491	2021-08-12 12:47:08 +03:00
Denys Holius	1491767a9e	added guide for HA monitoring setup in K8s via VM Cluster (#1523 ) * added guide for HA monitoring setup in K8s via VM Cluster * fixed missed divs * fixed different typos * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> * Update docs/guides/k8s-ha-monitoring-via-vm-cluster.md Co-authored-by: Roman Khavronenko <hagen1778@gmail.com> Co-authored-by: Roman Khavronenko <hagen1778@gmail.com>	2021-08-11 13:42:53 +03:00
Aliaksandr Valialkin	9eb828b2c2	app/vminsert: add vm_rpc_send_duration_seconds_total metric per each `vminsert->vmstorage` link This metric is useful for determining high link saturation with the following alerting rule: rate(vm_rpc_send_duration_seconds_total) > 0.9s	2021-08-11 11:42:33 +03:00
Aliaksandr Valialkin	3df6550153	docs/Cluster-VictoriaMetrics.md: update `-help` output for cluster components after the `d375d9b878`	2021-08-11 11:39:09 +03:00
Aliaksandr Valialkin	518d0aba18	docs: `make docs-sync` after `e0ee69797d`	2021-08-11 10:54:28 +03:00
Aliaksandr Valialkin	90efb5831b	lib/envflag: add a link to docs for -envflag.enable	2021-08-11 10:32:40 +03:00
Aliaksandr Valialkin	d5ca07bd71	docs/CHANGELOG.md: document new metrics added to vmalert at `7416fdaa8b`	2021-08-05 10:12:53 +03:00
Aliaksandr Valialkin	13d438d808	app/vmagent: typo fix in the description for `-remoteWrite.queues`	2021-08-05 10:00:58 +03:00
Aliaksandr Valialkin	b877538622	app/vmagent: follow-up after `fe445f753b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1491	2021-08-05 09:51:00 +03:00
Aliaksandr Valialkin	44bf4cabea	docs/Articles.md: actualize links and re-order some links	2021-08-03 16:11:30 +03:00
Aliaksandr Valialkin	77bb9e1656	lib/promscrape/discovery/gce: add __meta_gce_interface_ipv4_<name> labels as in Prometheus 2.29 See https://github.com/prometheus/prometheus/pull/8978	2021-08-03 15:51:45 +03:00
Aliaksandr Valialkin	336a2aa2e0	lib/promscrape/discovery/ec2: add `__meta_ec2_availability_zone_id` label as Prometheus 2.29 does	2021-08-03 13:28:13 +03:00
Aliaksandr Valialkin	60cfa5f100	app/vmselect/promql: add `present_over_time(m[d])` function, which will be available starting from Prometheus 2.29.0 See https://github.com/prometheus/prometheus/releases/tag/v2.29.0-rc.0 and https://github.com/prometheus/prometheus/pull/9097	2021-08-03 12:21:53 +03:00
Roman Khavronenko	51329d9e1e	docs: add "Scaling to trillions of metric data points" to articles (#1517 )	2021-08-03 11:14:57 +03:00
Roman Khavronenko	e127dcf013	docs: mention "Push Prometheus metrics to VictoriaMetrics or other exporters" article (#1511 )	2021-08-02 17:23:45 +03:00
Roman Khavronenko	8e15c96004	docs: fix indentation for guide articles (#1512 )	2021-08-02 17:17:24 +03:00
Aliaksandr Valialkin	d9810a7403	docs/CaseStudies.md: typo fix: hed->had	2021-07-30 18:49:17 +03:00
Aliaksandr Valialkin	c2df339eb2	docs/CHANGELOG.md: typo fix	2021-07-30 12:35:28 +03:00
Aliaksandr Valialkin	3389f1e474	docs/CHANGELOG.md: document `d05cac6c98` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1486	2021-07-30 12:26:34 +03:00
Aliaksandr Valialkin	99004a6a40	app/vmselect/netstorage: unpack time series data in mostly local big chunks This should improve performance on multi-CPU systems for queries selecting time series with big number of raw samples	2021-07-30 12:26:33 +03:00
Aliaksandr Valialkin	b709fa387a	app/vmselect: follow-up for `ed95bc9531` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1493	2021-07-29 09:48:47 +03:00
Aliaksandr Valialkin	c582d95cf0	docs: remove SampleSizeCalculations.md, since it is outdated and no longer used There was a reference to this doc from the old victoriametrics.com site	2021-07-28 19:25:45 +03:00
Denys Holius	113df2f3b7	Added new guide for monitoring k8s via VictoriaMetrics cluster (#1476 ) * renamed and moved screenshots * fixed cluster guide, updated helm chart versions, added values.yaml for vm single * renamed guide files * fixed typo * add some fixes * fixed typos,added guide k8s-monitoring-via-vm-cluster * added fixes for yamls	2021-07-28 18:06:50 +03:00
Aliaksandr Valialkin	49bf3abf67	app/vmselect: follow-up for `626073bca8` * Rename -search.maxMetricsPointSearch to -search.maxSamplesPerQuery, so it is more consistent with the existing -search.maxSamplesPerSeries * Move the -search.maxSamplesPerQuery from vmstorage to vmselect, so it could effectively limit the number of raw samples obtained from all the vmstorage nodes * Document the -search.maxSamplesPerQuery in docs/CHANGELOG.md	2021-07-28 18:00:04 +03:00
Aliaksandr Valialkin	857fa4e28a	docs/CHANGELOG.md: document `9d45b46f4c`	2021-07-27 12:39:10 +03:00
Aaron France	3c22b5c41e	fix: typo in metrics.md docs	2021-07-27 10:53:02 +03:00
Aliaksandr Valialkin	3921d8afae	app/vmselect: prevent from possible deadlock when f callback blocks inside RunParallel	2021-07-26 15:50:45 +03:00
Aliaksandr Valialkin	349d45bbbe	docs/Articles.md: add links to new articles	2021-07-23 21:09:00 +03:00
Aliaksandr Valialkin	b047feeb8b	app/vmselect/promql: properly handle `(a op b) default N` if `(a op b)` returns NaN series The result should be a series with `N` values and `a op b` labels. Previously such series has been removed from the result.	2021-07-16 01:44:24 +03:00
Aliaksandr Valialkin	df117f85bd	app/vmselect: do not track queries with less than 1ms execution time at /api/v1/status/top_queries This should improve the readability and usefullness of the /api/v1/status/top_queries when debugging slow queries or queries that take too much cpu time.	2021-07-15 16:53:35 +03:00
Aliaksandr Valialkin	5830ce2706	app/vmselect/netstorage: add `-search.maxSamplesPerSeries` command-line option for limiting the number of samples a query can process per each series This should prevent from out of memory crashes like in https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1067	2021-07-15 16:53:35 +03:00
Aliaksandr Valialkin	f847677513	docs/CHANGELOG.md: typo fix: suffxies->suffixes	2021-07-15 15:02:55 +03:00
Aliaksandr Valialkin	4ec57102e6	docs/CHANGELOG.md: cut v1.63.0	2021-07-15 14:02:45 +03:00
Aliaksandr Valialkin	e992754e79	lib/storage: remove cache directory if it contains reset_cache_on_startup file See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1447	2021-07-13 17:59:51 +03:00
Aliaksandr Valialkin	ee7e9795ec	docs: clarify why spare CPU and RAM resources are needed in `capacity planning`	2021-07-13 15:49:38 +03:00
Aliaksandr Valialkin	03f1c0b58a	docs/Cluster-VictoriaMetrics.md: clarify the docs about the needed values for `-dedup.minScrapeInterval` at `vmselect` during replication when the data is pushed from HA pair	2021-07-13 15:29:43 +03:00
Aliaksandr Valialkin	e6edb85fa2	lib/httpserver: add `is_set` label to `flag` metrics This label allows determining the set flags with the query `flag{is_set="true"}`	2021-07-13 15:10:18 +03:00
Aliaksandr Valialkin	9add9d86a6	app/vmselect/promql: duration handling improvements in MetricsQL queries - Support durations anywhere in MetricsQL queries. E.g. sum_over_time(m[1h])/1h is equivalent to sum_over_time(m[1h])/3600 - Support durations without suffix. E.g. rate(m[300]) is equivalent to rate(m[5m])	2021-07-12 17:19:32 +03:00
Aliaksandr Valialkin	390a31ccfa	docs/CHANGELOG.md: document the change from `bfba4c28a4`	2021-07-12 12:42:42 +03:00
Aliaksandr Valialkin	253fe7699c	docs: update http://slack.victoriametrics.com to https://slack.victoriametrics.com	2021-07-12 10:58:19 +03:00
Aliaksandr Valialkin	0b98f6c7ff	app/vmselect: expose vmui at `/vmselect/<accountID>/vmui/` instead of `/vmselect/<accountID>/prometheus/vmui/` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-10 12:32:21 +03:00
Aliaksandr Valialkin	98e049ba6d	app/vmui: move source code from https://github.com/VictoriaMetrics/vmui to app/vmui Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-09 17:13:51 +03:00
Aliaksandr Valialkin	9900a1f563	docs: clarify what does "workload" mean in capacity planning docs	2021-07-09 12:50:51 +03:00
Aliaksandr Valialkin	2c5e1cd893	app/vmselect: move web ui from /ui to /select/<accountID>/prometheus/ui This way the UI is available for every tenant (aka accountID) and the UI can automatically determine the needed per-tenant datasource path from page referer. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413	2021-07-08 13:14:50 +03:00
Aliaksandr Valialkin	acb7a95c64	app/vmselect: follow-up after `aa11ef6d3b` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4	2021-07-07 17:45:09 +03:00
Aliaksandr Valialkin	6f8dd85deb	docs/Cluster-VictoriaMetrics.md: improve capacity planning recommendations	2021-07-07 16:21:59 +03:00
Aliaksandr Valialkin	41754e12f8	lib/mergeset: cache indexBlock items only on the second request This should reduce the indexdb/indexBlocks cache size, since it won't contain one-time-wonders items.	2021-07-07 15:24:37 +03:00
Aliaksandr Valialkin	9c19719ad6	app/{vminsert,vmselect}: export vminsert_request_duration_seconds and vmselect_request_duration_seconds histograms	2021-07-07 13:27:23 +03:00
Aliaksandr Valialkin	ceda2b1df4	lib/httpserver: print full requestURI in httpserver.Errorf This should simplify debugging.	2021-07-07 13:11:29 +03:00
Aliaksandr Valialkin	4e87638877	docs: clarify `capacity planning` docs	2021-07-07 12:48:07 +03:00
Roman Khavronenko	0541e3108a	add option to add Copy button for code snippets (#1433 ) To add a Copy button wrap code snippet with the following element: ``` <div class="with-copy" markdown="1"> <your-code-snippet> </div> ``` See the changes to `Kubernetes monitoring with VictoriaMetrics Single` for details.	2021-07-06 10:54:37 +03:00
Roman Khavronenko	e2b5f93170	move github-pages docs to the main repo (#1432 ) * move github-pages docs to the main repo * rm github actions for copying docs to VictoriaMetrics/VictoriaMetrics.github.io	2021-07-05 15:20:29 +03:00
Aliaksandr Valialkin	4b25e627f8	lib/workingsetcache: properly switch to `whole` mode Previously the switch from `split` to `whole` mode had been performed too early, e.g. when the current cache size became bigger than 1/4 of the allowed cache size. Now it is performed when the current cache size becomes bigger than 1/2 of the allowed cache size. This change can reduce memory usage for data ingestion path when big number of active time series are ingested.	2021-07-05 15:15:39 +03:00
Aliaksandr Valialkin	28a778dc9f	docs/CHANGELOG.md: document the bugfix for `vm_merge_need_free_disk_space` metric at `9a83e9018d`	2021-07-05 12:01:24 +03:00
Aliaksandr Valialkin	2386829ad6	docs/Articles.md: add an url to https://medium.com/ibm-garage/monitoring-of-multiple-openshift-clusters-with-victoriametrics-d4f0979e2544	2021-07-05 11:52:18 +03:00
Aliaksandr Valialkin	44855f0c9b	app/{vmselect,vmstorage}: clarify the description for `-dedup.minScrapeInterval` command-line flag Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1426	2021-07-02 15:06:41 +03:00
Aliaksandr Valialkin	4b4e69791f	docs/Cluster-VictoriaMetrics.md: typo fix: siplify -> simplify	2021-07-02 10:50:26 +03:00
Aliaksandr Valialkin	9ec08213be	docs/Cluster-VictoriaMetrics.md: add a chapter describing a toy cluster setup on a single host While at it, refer to available tools, which can simplify cluster setup	2021-07-02 10:48:13 +03:00
Aliaksandr Valialkin	1c12c0f79c	lib/promauth: reload TLS certificates from disk on every mTLS connection as Prometheus does This allows updating client certificates without the need to restart vmagent and/or single-node VictoriaMetrics. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1420 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/470	2021-07-01 15:43:43 +03:00
Aliaksandr Valialkin	c1b15c7764	docs/CHANGELOG.md: document `ae485c2bfd`	2021-07-01 11:52:47 +03:00
Aliaksandr Valialkin	71c856beb8	lib/workingsetcache: reset the cache mode when the cache is reset This should reduce memory usage if the working set is reduced after the cache reset.	2021-07-01 11:52:47 +03:00
Aliaksandr Valialkin	0c4c630839	lib/promscrape: typo fix in `/targets` output The typo has been introduced in `fb72a2133f` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1408	2021-06-28 21:27:22 +03:00
Aliaksandr Valialkin	4d8ab5d9fa	docs/vmagent.md: mention about docker_sd_config support	2021-06-25 20:53:09 +03:00
Aliaksandr Valialkin	db66ea9a5f	docs/CHANGELOG.md: cut v1.62.0	2021-06-25 13:29:48 +03:00
Aliaksandr Valialkin	97d1ccfc8e	lib/promscrape: split docker and dockerswarm service discovery code bases, since they have very little in common This is a follow up after `c85a5b7fcb`	2021-06-25 13:22:16 +03:00
Aliaksandr Valialkin	01af676436	docs: consistently put the link to articles and slides about VictoriaMetrics after the links to case studies	2021-06-24 15:38:49 +03:00
Aliaksandr Valialkin	634f2128d8	docs/CaseStudies.md: add a case study for DFKI	2021-06-24 15:25:19 +03:00
Aliaksandr Valialkin	b054563703	Add case study for Groove X	2021-06-24 15:06:19 +03:00
Aliaksandr Valialkin	65576ebb5b	docs/CaseStudies.md: add Sensedia case study	2021-06-24 14:35:47 +03:00
Aliaksandr Valialkin	1b6850bab3	docs/CHANGELOG.md: document the bugfix in increase_pure() function from the commit `fb4f758715`	2021-06-24 12:06:15 +03:00
Aliaksandr Valialkin	b84aea1e6e	lib/protoparser/clusternative: do not pool unmarshalWork structs, since they can occupy big amounts of memory (more than 100MB per each struct) This should reduce memory usage for vmstorage under high ingestion rate when the vmstorage runs on a system with big number of CPU cores	2021-06-23 15:45:08 +03:00
Aliaksandr Valialkin	856aecae05	app/vmselect/promql: return the last timestamp for the max / min value from `tmax_over_time()` and `tmin_over_time()` function as most users expect	2021-06-23 14:18:37 +03:00
Aliaksandr Valialkin	dffa2afefe	docs/CHANGELOG.md: document the bugfix for incorrect stats collection for concurrently executed tag filter Follow up for `c22114c6f0`	2021-06-23 14:06:33 +03:00
Aliaksandr Valialkin	c18017a9c3	app/vminsert/netstorage: sort the `-storageNode` list passed to `vminsert` nodes This should reduce resource usage (CPU, RAM, disk IO) at vmstorage nodes if the addresses of vmstorage nodes are passed in random order to vminsert nodes.	2021-06-23 14:00:08 +03:00
Aliaksandr Valialkin	4adf6c9766	lib/promscrape/discovery/http: follow up after `e307bbb29a`	2021-06-22 13:42:10 +03:00
Nikolay	e03a3d3a36	adds http_sd (#1399 ) * adds http_sd * adds X-Prometheus-Refresh-Interval-Seconds header * Update lib/promscrape/discovery/http/api.go Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2021-06-22 13:42:09 +03:00
Aliaksandr Valialkin	3ab3902f17	lib/promscrape/discovery: support generic auth configs in Consul service discovery in the same way as Prometheus 2.28 does	2021-06-22 13:18:51 +03:00
Aliaksandr Valialkin	61fc9b98e5	docs/CHANGELOG.md: document the support for Consul namepsace See `58a2989fe7`	2021-06-22 12:56:12 +03:00
Aliaksandr Valialkin	a575882ca2	docs/PerTenantStatistic.md: document that the per-tenant statistic is a part of cluster version of VictoriaMetrics	2021-06-22 12:43:30 +03:00
Aliaksandr Valialkin	23fcafd437	docs/CHANGELOG.md: typo fixes	2021-06-18 19:15:29 +03:00
Aliaksandr Valialkin	b92d110cad	app/vmselect: log slow requests to all the `/api/v1/*` handlers if their execution time exceeds `-search.logSlowQueryDuration`	2021-06-18 19:07:03 +03:00
Aliaksandr Valialkin	d29e130181	docs/Single-server-VictoriaMetrics.md: mention that it is recommended to use a single scrape_interval across all the scrape targets	2021-06-18 15:41:35 +03:00
Aliaksandr Valialkin	4acc4602b3	app/vmctl: limit JSON line size by 10K samples (#1394 ) This should reduce the maximum memory usage at VictoriaMetrics when importing time series with big number of samples.	2021-06-18 15:41:34 +03:00
Aliaksandr Valialkin	3ec3705943	docs/Cluster-VictoriaMetrics.md: clarify docs about VictoriaMetrics cluster architecture	2021-06-18 14:35:55 +03:00
Aliaksandr Valialkin	cd697b88c5	docs/CHANGELOG.md: document the reduced disk write IO usage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1338	2021-06-18 14:03:42 +03:00
Aliaksandr Valialkin	f9069ba32a	lib/promscrape: show jobs with empty scrape targets on /targets page	2021-06-18 10:54:12 +03:00
Aliaksandr Valialkin	60bc35f550	docs/{vmgateway,vmbackupmanager}: explicitly mention that these components are a part of an enterprise package	2021-06-17 17:19:13 +03:00
Aliaksandr Valialkin	90c3606269	docs/vmagent.md: sync with app/vmagent/README.md via `make docs-sync`	2021-06-16 12:37:55 +03:00
Aliaksandr Valialkin	644102b03b	docs/CHANGELOG.md: document the changed `-remoteWrite.queues` value This is a follow-up for `0a796f7c3a` See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1385	2021-06-16 12:37:55 +03:00
Aliaksandr Valialkin	234152d66e	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics works great with APM workloads (aka Application Performance Monitoring)	2021-06-15 17:33:41 +03:00
Aliaksandr Valialkin	b133de1e37	lib/storage: move deletedMetricIDs set from indexDB to Storage This makes consitent the list of deleted metricIDs when it is used from both the current indexDB and the previous indexDB (aka extDB). This should fix the issue, which could lead to storing new samples under deleted metricIDs after indexDB rotation. See more details at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1347#issuecomment-861232136 . Thanks to @tangqipengleoo for the initial analysis and the pull request - https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1383 . This commit resolves the issue in more generic way compared to https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1383 . The downside of the commit is the deletedMetricIDs set isn't cleaned from the metricIDs outside the retention. It needs app restart. This should be OK in most cases.	2021-06-15 15:07:54 +03:00
Aliaksandr Valialkin	5f91a701fa	lib/promscrape: show the number of samples collected during the last scrape at /targets and /api/v1/targets pages Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1377	2021-06-14 14:04:35 +03:00
Aliaksandr Valialkin	5cd50d840f	docs/CHANGELOG.md: document the addition of DigitalOcean service discovery Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1367	2021-06-14 13:19:31 +03:00
Nikolay	e42da47608	adds digital ocean sd (#1376 ) * adds digital ocean sd config * adds digital ocean sd https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1367 * typo fix	2021-06-14 13:19:29 +03:00
Aliaksandr Valialkin	357dbe092c	docs/Cluster-VictoriaMetrics.md: add lists for command-line flags for cluster components	2021-06-14 12:21:22 +03:00
Aliaksandr Valialkin	52efd5a05c	docs/vmalert.md: follow-up after `6d5a8c28cd`	2021-06-14 11:43:02 +03:00
Aliaksandr Valialkin	541429a9af	docs/CHANGELOG.md: cut v1.61.1	2021-06-11 13:02:04 +03:00
Aliaksandr Valialkin	ce10bdc82a	lib/storage: reset cache on disk during series deletion and during indexdb rotation This should prevent from inconsistent behavior (aka partially missing data for some time series) after unclean shutdown. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1347	2021-06-11 12:54:36 +03:00
Aliaksandr Valialkin	d5973d3180	docs/CHANGELOG.md: document the bugfix from `7adfe878e1`	2021-06-11 11:30:07 +03:00
John Belmonte	3e79f3994e	spelling fix: synonym (#1363 )	2021-06-11 10:58:48 +03:00
Aliaksandr Valialkin	83adc2f3ac	docs/CHANGELOG.md: cut v1.61.0	2021-06-09 19:04:59 +03:00
Aliaksandr Valialkin	c7efd5b43f	docs/FAQ.md: add a chapter comparing VictoriaMetrics to QuestDB	2021-06-09 19:03:47 +03:00
Aliaksandr Valialkin	203d883b2b	docs/Articles.md: update the broken link to https://nordicapis.com/api-monitoring-with-prometheus-grafana-alertmanager-and-victoriametrics/	2021-06-09 16:40:39 +03:00
Aliaksandr Valialkin	247b2a5a08	app/vmauth: improve readability for a config with multiple `src_paths`	2021-06-09 15:38:09 +03:00
Aliaksandr Valialkin	1e13deaa2c	docs/CHANGELOG.md: document the enterprise bugfix for the `target` property in Graphite Render API	2021-06-09 13:51:32 +03:00
Aliaksandr Valialkin	490783696a	docs/CHANGELOG.md: document improvements in re-routing handling in vminsert See the following commits: * `1c09e71f5b` * `0d067eb112` * `2c6b917749`	2021-06-09 13:42:12 +03:00
Aliaksandr Valialkin	520d62ade2	docs/vmagent.md: mention that vmagent supports scrape targets sharding	2021-06-09 12:30:54 +03:00
Aliaksandr Valialkin	f3749dedba	docs: document rules replay feature for vmalert Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/836 This is a follow-up for `2a259ef5e7`	2021-06-09 12:30:54 +03:00
Aliaksandr Valialkin	8ad445474a	docs/CHANGELOG.md: document the bugfix, which prevents panics for aborted http requests in vmauth See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1353 This is a follow-up for `6b29b955c0`	2021-06-09 12:12:47 +03:00
Aliaksandr Valialkin	269e35d676	app/{vmagent,vminsert}: follow-up after `2fe045e2a4` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1343	2021-06-04 20:33:22 +03:00
jelmd	d8b46908db	new feature: debug relabeling (#1344 ) * new feature: relabel logging Use scrape_configs[x].relabel_debug = true to log metric names inkl. labels before and after relabeling. After relabeling related metrics get dropped, i.e. not submitted to servers. * vminsert wants relabel logging, too.	2021-06-04 20:33:21 +03:00
Aliaksandr Valialkin	67cfc07004	docs/CHANGELOG.md: document the bugfix from `6f19bb23a1`	2021-06-04 11:56:06 +03:00
Aliaksandr Valialkin	c53a90e5fc	docs/CHANGELOG.md: document that it is possible to build VictoriaMetrics components for Solaris Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322 This is a follow-up for `ddc8022702`	2021-06-04 04:41:12 +03:00
Aliaksandr Valialkin	1c09e71f5b	app/vminsert: add `-disableRerouting` command-line flag for disabling re-routing if some vmstorage nodes have lower performance than the others Refactor the rerouting mechanism and make it more resilient to cases when some of vmstorage nodes are temporarily unavailable. Reduce the probability of rerouting storm. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/791 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1054 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1165	2021-06-04 04:33:52 +03:00
Aliaksandr Valialkin	8cdecfc52c	app/vmauth: allow balancing the load among multiple backend nodes by specifying multiple urls in `url_prefix` config	2021-05-29 01:04:22 +03:00
Aliaksandr Valialkin	bf9f77d74d	docs/Articles.md: add a link to https://www.percona.com/blog/2021/05/26/compiling-a-percona-monitoring-and-management-v2-client-in-arm-raspberry-pi-3/	2021-05-28 14:34:06 +03:00
Aliaksandr Valialkin	c97212ea63	docs/MetricsQL.md: add a link to technical details about `rate()` and `increase()` calculations in Prometheus and VictoriaMetrics	2021-05-28 13:14:23 +03:00
Aliaksandr Valialkin	734074e8a6	docs/Single-server-VictoriaMetrics.md: remove misleading wording about querying Graphite metrics with MetricsQL	2021-05-28 02:40:02 +03:00
Aliaksandr Valialkin	97de72054e	docs: document `f0c21b6300`	2021-05-27 15:04:13 +03:00
Aliaksandr Valialkin	6c4921b3bd	docs: `make docs-sync` after `2bbb1cc7c1`	2021-05-26 12:33:01 +03:00
Roman Khavronenko	b42f7fc185	Docs review (#1330 ) * re-order components by prioritizing Cluster-VictoriaMetrics.md * drop Home.md since it just duplicates other links	2021-05-26 12:32:59 +03:00
Aliaksandr Valialkin	820ac6cd0c	docs/CHANGELOG.md: document changes from `2233d6ed8a` and `d210958fd0`	2021-05-26 12:24:28 +03:00
Dan Fredell	e05c03cf00	Fix quote difference on label_move example (#1321 ) Fix quote difference on label_move example	2021-05-25 12:13:39 +03:00
Aliaksandr Valialkin	25ed1f0c4f	docs/CHANGELOG.md: cut v1.60.0	2021-05-24 15:55:31 +03:00
Aliaksandr Valialkin	65b4ae95e3	docs/Single-server-VictoriaMetrics.md: clarify that the storage size depends on the number of samples per series	2021-05-24 15:48:45 +03:00
Aliaksandr Valialkin	c9229e3c0b	docs/vmalert.md: sync with app/vmalert/README.md via `make docs-sync`	2021-05-24 15:48:44 +03:00
Aliaksandr Valialkin	402a8ca710	lib/storage: do not populate MetricID->MetricName cache during data ingestion This cache isn't needed during data ingestion, so there is no need in spending RAM on it. This reduces RAM usage on data ingestion path by 30%	2021-05-24 03:06:40 +03:00
Aliaksandr Valialkin	68c3901ebd	docs/CHANGELOG.md: small typo fix	2021-05-23 14:15:49 +03:00
Aliaksandr Valialkin	8ec3e876be	docs/CHANGELOG.md: document the addition of `extra_filter_labels` at `84cc0513e1`	2021-05-23 14:15:49 +03:00
Aliaksandr Valialkin	71ff7ee18d	lib/promauth: follow-up after `5b8176c68e`	2021-05-22 18:02:03 +03:00
Aliaksandr Valialkin	23355ca34c	lib/fs: wait for a while before giving up on NFS file removal if the removal queue is full This should reduce the probability of the panic on a highly loaded VictoriaMetrics accepting millions of samples per second. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1313	2021-05-21 17:21:35 +03:00
Aliaksandr Valialkin	e9a63a5942	docs/MetricsQL.md: add a link to a list of supported timezones that can be passed to timezone_offset() function Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1306	2021-05-21 16:56:07 +03:00
Aliaksandr Valialkin	f664f7fb1d	docs/CHANGELOG.md: mention the bugfix from `d626c5c2a9` Updates https://github.com/VictoriaMetrics/operator/issues/243	2021-05-21 16:38:20 +03:00
Aliaksandr Valialkin	d77db9d813	all: do not skip SIGHUP signal during service initialization This can lead to stale or incomplete configs like in the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-05-21 16:38:20 +03:00
Aliaksandr Valialkin	45849886a3	docs/FAQ.md: re-order questions to be more attractive to visitors	2021-05-20 19:50:57 +03:00
Aliaksandr Valialkin	6139f6ed6d	app/vmauth: add ability to protect `/-/reload` endpoint with authKey	2021-05-20 18:48:34 +03:00
Aliaksandr Valialkin	9aa22cccf0	docs/CHANGELOG.md: move tip to proper place	2021-05-20 17:58:24 +03:00
Aliaksandr Valialkin	4a7aef4707	docs/FAQ.md: add a question on how to run VictoriaMetrics on FreeBSD The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	429ae37863	docs/FAQ.md: add `can I use VictoriaMetrics instead of Prometheus?` The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	6d987971e3	docs/FAQ.md: add a question about memory limits for VictoriaMetrics components The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 16:18:36 +03:00
Aliaksandr Valialkin	26dc52cbde	docs/FAQ.md: add a question about multi-tenancy The question has been extracted from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1284	2021-05-20 15:52:17 +03:00
Aliaksandr Valialkin	165a9f9200	app/vmstorage: add ability to limit series cardinality via `-storage.maxHourlySeries` and `-storage.maxDailySeries` command-line flags	2021-05-20 15:31:57 +03:00
Aliaksandr Valialkin	7aad5c3f76	app/vmagent: add ability to limit series cardinality on a per-hour and per-day basis	2021-05-20 15:31:57 +03:00
Aliaksandr Valialkin	a613be1518	docs/CHANGELOG.md: document the bugfix in vmctl import for InfluxDB lines with identical names for field and tag See `dcf8803bbd` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1299	2021-05-20 12:07:15 +03:00
Aliaksandr Valialkin	2cc5567ab8	docs/CHANGELOG.md: refer to the issue related to timezone_offset() function	2021-05-20 12:02:32 +03:00
Aliaksandr Valialkin	180829b8c2	app/vmselect/promql: add `timezone_offset(tz)` function Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1306	2021-05-20 11:54:06 +03:00
Neo He	c5ab00ebee	app/{vmbackup,vmrestore},docs/vmrestore.md: typo fix: vbackup -> vmbackup (#1305 )	2021-05-18 16:38:15 +03:00
Aliaksandr Valialkin	74ef40034c	lib/httpserver: typo fix in `-http.shutdownDelay` command-line flag description: servier -> server	2021-05-18 16:25:27 +03:00
Aliaksandr Valialkin	1668280e67	docs/vmalert.md: document multitenant support https://github.com/VictoriaMetrics/VictoriaMetrics/issues/740	2021-05-18 16:25:21 +03:00
Aliaksandr Valialkin	7fe362deb1	app/vmauth: reload `-auth.config` on the request to `/-/reload` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1194	2021-05-18 02:24:37 +03:00
Aliaksandr Valialkin	25ca108642	docs/vmbackup.md: typo fix: snaphosts -> snapshots Thanks to @jelmd - see `1ab27582a3 (r50884395)`	2021-05-18 01:14:01 +03:00
Aliaksandr Valialkin	6ea191d196	docs: dealay -> delay	2021-05-18 01:07:32 +03:00
Aliaksandr Valialkin	bae4d61ef2	docs/CHANGELOG.md: document `b38edec7ee` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1293	2021-05-17 01:58:18 +03:00
Roman Khavronenko	c47825c255	Docs update from victoriaMetrics.github.io (#1302 ) * port change from `11ca65677b` * port change from `afb41dfa43` * port change from `f82e3733c9` * port change from `d499ab0502`	2021-05-17 01:51:54 +03:00
Aliaksandr Valialkin	e08287f017	lib/promscrape: reload auth tokens from files every second Previously auth tokens were loaded at startup and couldn't be updated without vmagent restart. Now there is no need in vmagent restart. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1297	2021-05-14 20:03:35 +03:00
Aliaksandr Valialkin	f13fb6e867	docs/Articles.md: add a link to https://fly.io/blog/measuring-fly/	2021-05-14 20:03:34 +03:00
Aliaksandr Valialkin	30e8ba63f1	docs/vmauth.md: sync with app/vmauth/README.md after `10a47af631`	2021-05-14 18:13:35 +03:00
Aliaksandr Valialkin	a6cb4f10a7	app/{vmalert,vmauth}: explicitly set MaxIdleConnsPerHost in net/http.Client.Transport By default MaxIdleConnsPerHost is set to 2. This limits the possibility to re-use http keep-alive connections. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1300	2021-05-14 18:13:34 +03:00
Aliaksandr Valialkin	d274dae73f	docs/Single-server-VictoriaMetrics.md: document how to reduce memory usage when importing too long JSON lines into VictoriaMetrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1295	2021-05-14 17:22:51 +03:00
Denys Holius	ac5a28db9a	Fix Cortex typo	2021-05-13 17:40:19 +03:00
Aliaksandr Valialkin	e3f61d540b	lib/promscrape: limit `scrape_timeout` by `scrape_interval` like Prometheus does Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1281	2021-05-13 16:10:42 +03:00
Aliaksandr Valialkin	76e03b46df	docs/CHANGELOG.md: document the bugfix from `b4f5be8bd8`	2021-05-13 11:19:31 +03:00
Aliaksandr Valialkin	f13585dc5d	vendor: update github.com/VictoriaMetrics/fasthttp from v1.0.14 to v1.0.15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1289	2021-05-13 10:47:09 +03:00
Aliaksandr Valialkin	66c6976723	lib/cgroup: document the ability to detect cgroup v2 memory and cpu limits. This is follow-up for `b50024812e`	2021-05-13 09:27:35 +03:00
Aliaksandr Valialkin	ad04c29a35	docs/Single-server-VictoriaMetrics.md: typo fix: retuns->returns	2021-05-12 17:23:27 +03:00
Nikolay	be87be34a4	Adds tsdb match filters (#1282 ) * init work on filters * init propose for status filters * fixes tsdb status adds test * fix bug * removes checks from test	2021-05-12 17:16:58 +03:00
Aliaksandr Valialkin	56b08390f6	app/vmselect/promql: allow to use 2x more memory for query processing in cluster mode compared to single-node mode `vmselect` has no `vmstorage`-related caches. So it can use more memory for query processing compared to single-node VictoriaMetrics.	2021-05-12 14:43:49 +03:00
Aliaksandr Valialkin	f1317f7c6c	lib/httpserver: return X-Server-Hostname http header in all the responses for better debuggability	2021-05-11 22:04:41 +03:00
Aliaksandr Valialkin	cca9670573	docs/CHANGELOG.md: document `-datasource.roundDigits` added at `5c448126dc`	2021-05-10 11:18:58 +03:00
Aliaksandr Valialkin	f551b99082	docs/CHANGELOG.md: document vmalert fix for state restoration on startup	2021-05-10 11:10:34 +03:00
Aliaksandr Valialkin	2dddd68feb	docs/vmagent.md: add `stream parsing mode` chapter	2021-05-08 23:14:47 +03:00
Aliaksandr Valialkin	4128c4db16	docs/CHANGELOG.md: mention the comment, which gives an example of multi-level vminsert setup	2021-05-08 22:50:40 +03:00
Aliaksandr Valialkin	9c505d27dd	lib/ingestserver: properly close incoming connections during graceful shutdown	2021-05-08 19:53:45 +03:00
Aliaksandr Valialkin	4a5f45c77e	app/vminsert: add support for data ingestion via other vminsert nodes	2021-05-08 19:53:45 +03:00
Aliaksandr Valialkin	c656b589a1	docs/Single-server-VictoriaMetrics.md: add links to vmauth and vmgateway as auth proxy examples	2021-05-07 10:46:47 +03:00
Aliaksandr Valialkin	e8478e1e97	app/vmbackup: make sure that `-snapshotName` isnt set if `-snapshot.createURL` is set	2021-05-07 08:44:44 +03:00
Aliaksandr Valialkin	3108cdb930	docs/CHANGELOG.md: document `904bbffc7f` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-05-05 20:34:00 +03:00
Aliaksandr Valialkin	326c7995c1	docs/CHANGELOG.md: document `9cdd4696fe` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1252	2021-05-05 20:33:59 +03:00
Aliaksandr Valialkin	ec6becd3f5	lib/httpserver: stop the process on panics in request handlers Panics may leave the process in inconsistent state. That's why it is better to stop the process after the panic instead of recovering from the panic. Unfortunately, the standard net/http.Server recovers panics in request handlers. See https://github.com/golang/go/issues/16542 . That's lib/httpserver must stop the process on itself after the panic.	2021-05-03 12:00:44 +03:00
Aliaksandr Valialkin	a302f79e5e	docs/CHANGELOG.md: document the bugfix for proper removal of stale parts (`477369b62f`)	2021-05-03 11:38:38 +03:00
Aliaksandr Valialkin	9aa44a2760	docs/CHANGELOG.md: cut v1.59.0	2021-05-01 09:43:35 +03:00
Aliaksandr Valialkin	b43ba6d85f	lib/storage: log dropped labels if the number of labels in a metric exceeds `-maxLabelsPerTimeseries` command-line flag value This should improve debuggability for this case.	2021-05-01 09:29:56 +03:00
Aliaksandr Valialkin	0a2e746175	docs/vmalert.md: update docs after `afca7b430c`	2021-04-30 11:49:40 +03:00
Aliaksandr Valialkin	131e9912eb	docs/Cluster-VictoriaMetrics.md: document `api/v1/series/count` endpoint	2021-04-30 11:41:45 +03:00
Aliaksandr Valialkin	daf2778025	docs/CHANGELOG.md: document the change from `f3a048288e` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1232	2021-04-30 09:56:47 +03:00
Aliaksandr Valialkin	8be1cb297b	app/vmagent: list user-visible endpoints at `http://vmagent:8429/` While at it, use common WriteAPIHelp function for the listing in vmagent, vmalert and victoria-metrics	2021-04-30 09:38:23 +03:00
Aliaksandr Valialkin	2d1d60118d	lib/mergeset: split rows ingestion among multiple shards This improves rows ingestion on systems with many CPU cores by reducing lock contention. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1244 Thanks to @waldoweng for the original idea and draft implementation at https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1243	2021-04-27 15:45:11 +03:00
Aliaksandr Valialkin	f14412321b	lib/persistentqueue: eliminate possible data race when obtaining vm_persistentqueue_bytes_pending metric value	2021-04-27 00:26:32 +03:00
Roman Khavronenko	2357e21024	docs: update per tenant stats page (#1246 )	2021-04-27 00:16:44 +03:00
Aliaksandr Valialkin	97424c05c0	docs: ordering fix	2021-04-24 02:29:30 +03:00
Aliaksandr Valialkin	2bd99046a1	docs: update docs order	2021-04-24 01:28:13 +03:00
Aliaksandr Valialkin	fecc300e3c	docs/Single-server-VictoriaMetrics.md: mention that the native export format can change between releases Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1203	2021-04-24 01:28:12 +03:00
Aliaksandr Valialkin	cbf545f3af	docs: sync with master branch	2021-04-23 22:05:36 +03:00
Aliaksandr Valialkin	320983f650	lib/promscrape: apply `scrape_timeout` on receiving the first response byte for `stream_parse: true` scrape targets Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1017#issuecomment-767235047	2021-04-23 22:05:00 +03:00
Aliaksandr Valialkin	db27dbab5e	lib/promscrape/discovery/kubernetes: refresh endpoints and endpointslices targets on service object update like Prometheus does Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1240	2021-04-23 20:12:22 +03:00
Aliaksandr Valialkin	8a6bf55a9b	docs: add missing images for vmbackupmanager.md	2021-04-22 14:46:40 +03:00
Aliaksandr Valialkin	7f573a9564	docs/vmbackupmanager.md: sync with app/vmbackupmanager/README.md	2021-04-22 14:45:31 +03:00
Aliaksandr Valialkin	ab8008d6d7	lib/{storage,mergeset}: remove empty directories on startup. Such directories can be left after unclean shutdown on NFS storage Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1142	2021-04-22 13:03:29 +03:00
Denys Holius	c1fa465fe0	fixed typo; added example of usage vmbackup in docker-compose (#1237 )	2021-04-22 11:18:12 +03:00
Aliaksandr Valialkin	6dc5d3b357	all: rename https://victoriametrics.github.io to https://docs.victoriametrics.com	2021-04-20 20:20:01 +03:00
Aliaksandr Valialkin	64f1ddefe5	all: consistency renaming `Victoria Metrics` -> `VictoriaMetrics` VMInsert -> vminsert VMSelect -> vmselect VMStorage -> vmstorage	2021-04-20 11:45:02 +03:00
Aliaksandr Valialkin	8d869d112b	app/vmauth: follow-up for `6a81a89b3d`	2021-04-20 10:59:22 +03:00
Aliaksandr Valialkin	b0bd2c0d61	docs/Cluster-VictoriaMetrics.md: sync with cluster README.md	2021-04-19 13:31:23 +03:00
Denys Holius	9896b51ee5	Added some explanation to vmctl docs (#1217 ) Added explanation that vmctl do not make snapshot from Prometheus when run migration data	2021-04-16 10:58:51 +03:00
dereksfoster99	1b6d2467ff	Update PerTenantStatistic.md	2021-04-16 10:58:51 +03:00
Aliaksandr Valialkin	6ea174e78a	docs/Cluster-VictoriaMetrics.md: mention that sometimes `-replicationFactor` shouldnt be set at `vmselect` nodes Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1207	2021-04-14 13:06:49 +03:00
f41gh7	b493937815	updates per-tenant stats docs changes docs order changes per-tenant-stats pic	2021-04-14 12:31:51 +03:00
Artem Navoiev	39b5de9f24	[draft] per tenant statistic (#121 ) * [draft] per tenant statistic * updates metric name update graph adds link and example config * quick fix * adds grafana dashboard adds example alert Co-authored-by: f41gh7 <nik@victoriametrics.com>	2021-04-14 11:23:41 +03:00
Aliaksandr Valialkin	c872ba45b9	docs: update `-help` output after the commit `77be3e3a82`	2021-04-12 12:35:39 +03:00
Aliaksandr Valialkin	2190fd2148	docs: `make docs-sync`	2021-04-10 19:55:05 +03:00
Artem Navoiev	ddf3f17887	update vmgateway.md (#1201 )	2021-04-10 19:55:04 +03:00
Roman Khavronenko	46e6fdb131	Docs update (#1199 ) * docs: drop table of contents for `vmctl` We already have it autogenerated on .github.io, so no need to keep it. * docs: mention OpenTSDB migration feature for vmctl * docs: sync docs for `vmalert`	2021-04-10 15:47:52 +03:00
Aliaksandr Valialkin	c3893805f2	docs/Single-server-VictoriaMetrics.md: recommend using the official alerts for VictoriaMetrics in `Monitoring` section	2021-04-08 12:14:28 +03:00
Aliaksandr Valialkin	3e4f063afc	docs/CHANGELOG.md: cut v1.58.0	2021-04-08 00:48:46 +03:00
Aliaksandr Valialkin	3d5f1f779f	app/vmselect: do not sort series returned from `topk` and `bottomk` functions, since these series are already sorted in user-expected order Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1189	2021-04-07 14:16:02 +03:00
Aliaksandr Valialkin	18cad589d7	docs/Cluster-VictoriaMetrics.md: follow-up after `c6a8ebb11f`	2021-04-07 13:46:56 +03:00
Roman Khavronenko	ff3711eea2	docs: update docs ordering and formatting (#1192 ) The major change is adding `sort` directive to docs. For those docs which are copied from internal packages `sort` is added via makefile command. For the rest it is added manually since they're updated manually as well. The rest of changes is connected with markdown formatting. For example, changing headers in some files (`##` => `#`) makes navigation on .github.io to look better. This especially useful for `changelog` docs. Table of contents for `vmctl` is dropped, since we already have it autogenerated on .github.io. No link changes expected. The corresponding PR to `cluster` branch will be made in follow-up PR.	2021-04-07 13:43:01 +03:00
Aliaksandr Valialkin	59ccc43e3a	lib/storage: properly handle big time ranges passed to `/api/v1/labels` and `/api/v1/label/<labelName>/values` It should be faster querying all the labels and/or all the values instead of querying per-day labels/values on time ranges exceeding maxDaysForPerDaySearch	2021-04-07 13:33:10 +03:00
Aliaksandr Valialkin	2585058a5f	Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command	2021-04-05 23:01:45 +03:00
Aliaksandr Valialkin	4d6a3aba4d	lib/persistentqueue: delete corrupted persistent queue instead of throwing a fatal error Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1030	2021-04-05 19:26:51 +03:00
Aliaksandr Valialkin	fe084fdd33	lib/promscrape/discovery/kubernetes: synchronously load Kubernetes objects on first access Remove async registration of apiWatchers, since it breaks discovering `role: endpoints` and `role: endpointslices` targets, which depend on pod and service objects. There is no need in reloading `endpoints` and `endpointslices` targets if the referenced `pod` or `service` objects change, since in this case the corresponding `endpoints` and `endpointslices` objects should also change because they contain ResourceVersion of the referenced `pod` or `service` objects, which is modified on object update. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1182	2021-04-05 14:37:07 +03:00
Aliaksandr Valialkin	e0b687171b	lib/proxy: add support for `socks5 over tls` proxy	2021-04-05 13:00:42 +03:00
Aliaksandr Valialkin	90da332ea0	lib/promscrape: pass `X-Prometheus-Scrape-Timeout-Seconds` header to scrape targets as Prometheus does	2021-04-05 12:15:14 +03:00
Aliaksandr Valialkin	c229e10619	docs/CHANGELOG.md: explain why `-sortLabels` is set to false by default	2021-04-04 01:59:19 +03:00
Aliaksandr Valialkin	92d4c80639	docs/vmagent.md: mention that vmagent supports scraping via socks5 proxy	2021-04-04 01:45:46 +03:00
Aliaksandr Valialkin	afb139c244	docs/CHANGELOG.md: document the ability to use socks5 proxy Follow-up for `a4c6a3b3e1` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1177	2021-04-04 01:44:01 +03:00
Aliaksandr Valialkin	ab9e1eb41f	lib/promscrape: support for simple HTTP proxies without `CONNECT` method support such as https://github.com/prometheus-community/PushProx See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1179	2021-04-04 00:40:58 +03:00
Aliaksandr Valialkin	4aa59cae7c	app/vmselect/promql: do not delete `dst_label` if `src_label` is empty in `label_copy(q, src_label, dst_label)` and `label_move(q, src_label, dst_label)`	2021-04-03 22:06:50 +03:00
Aliaksandr Valialkin	8b2c4fe0ff	docs/CHANGELOG.md: document the change from `3055ab0115` (add ability to pass "label=value" to the third argument to `topk_` and `bottomk_` functions	2021-04-03 21:42:23 +03:00
Aliaksandr Valialkin	1d88c8523d	docs/Single-server-VictoriaMetrics.md: add missing link in heading to `Graphite Render API usage` chapter	2021-04-03 21:34:57 +03:00
Aliaksandr Valialkin	dfec690548	docs/vmgateway.md: update docs	2021-04-03 00:29:57 +03:00
Aliaksandr Valialkin	e1347a91b0	docs/CHANGELOG.md: yet another typo fix	2021-04-03 00:26:02 +03:00
Aliaksandr Valialkin	6b2e496baf	docs/CHANGELOG.md: typo fix	2021-04-03 00:24:05 +03:00
Aliaksandr Valialkin	b9469de410	app/vmselect/promql: add ability to set label value additionally to label name for the remaining sum of time series returned from `topk_` and `bottomk_` functions in the form: `topk_min(N, m, "label=value")`	2021-04-02 23:56:30 +03:00
Aliaksandr Valialkin	262da1c2e5	docs/{vmauth,vmgateway}.md: small fixes	2021-04-02 23:15:40 +03:00
Aliaksandr Valialkin	5edec0e57e	app/vmgateway: publish docs	2021-04-02 23:10:10 +03:00
Aliaksandr Valialkin	89771d082d	app/vmauth: add support for authorization via `Authorization: Bearer <token>`	2021-04-02 22:15:07 +03:00
Aliaksandr Valialkin	6c6174271a	docs/vmagent.md: mention about proxy_authorization section	2021-04-02 21:24:52 +03:00
Aliaksandr Valialkin	87700f1259	lib/promscrape: add support for `authorization` config in `-promscrape.config` as Prometheus 2.26 does See https://github.com/prometheus/prometheus/pull/8512	2021-04-02 21:20:37 +03:00
Aliaksandr Valialkin	2825a1e86d	lib/promscrape: add `follow_redirect` option to `scrape_configs` section like Prometheus does See https://github.com/prometheus/prometheus/pull/8546	2021-04-02 21:20:37 +03:00
Aliaksandr Valialkin	eee860f83d	lib/promscrape/discovery/kubernetes: properly discover targets in multiple namespaces Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1170	2021-04-02 14:29:24 +03:00
Aliaksandr Valialkin	4e685fb0df	docs/CHANGELOG.md: mention about AWS IAM roles for tasks support for EC2 service discovery Follow-up for `fdb8995642`	2021-04-02 13:11:05 +03:00
Aliaksandr Valialkin	512addc608	app/{vminsert,vmagent}: add `-sortLabels` command-line option for sorting time series labels before ingesting them in the storage This option can be useful when samples for the same time series are ingested with distinct order of labels. For example, metric{k1="v1",k2="v2"} and metric{k2="v2",k1="v1"}.	2021-03-31 23:27:21 +03:00
Aliaksandr Valialkin	ae1c653d55	lib/storage: reduce memory usage when ingesting samples for the same time series with distinct order of labels	2021-03-31 21:22:40 +03:00
Aliaksandr Valialkin	392ba94d1d	app/vmagent/remotewrite: reduce memory usage when `-remoteWrite.queues` is set to a big value See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1167	2021-03-31 16:17:23 +03:00
Aliaksandr Valialkin	6712173ce3	docs/Articles.md: add a link to https://blog.kintone.io/entry/2021/03/31/175256	2021-03-31 15:34:57 +03:00
Aliaksandr Valialkin	108bf68a91	docs/Single-server-VictoriaMetrics.md: update `victoria-metrics -help` output after `e7fdea5953`	2021-03-30 21:47:12 +03:00
Aliaksandr Valialkin	c237a5f0d1	docs/CHANGELOG.md: cut v1.57.1	2021-03-30 15:40:23 +03:00
Aliaksandr Valialkin	4fa8ae1621	docs/CHANGELOG.md: mention about returned back `type` label for `vm_tenant_inserted_rows_total` metric See `9b4e608199`	2021-03-30 15:16:33 +03:00
Aliaksandr Valialkin	ecfd6fe78d	app/vmselect: remove `-search.storageTimeout` command-line flag, since it has the same meaning as `-search.maxQueryDuration` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2021-03-30 14:54:36 +03:00
Aliaksandr Valialkin	7bafaad46d	app/vmselect: prevent from possible incomplete query results after timed out query Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2021-03-30 13:34:57 +03:00
Aliaksandr Valialkin	a9e0c09be0	Makefile: build vmutils for arm on `make release-vmutils` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1147	2021-03-29 23:16:30 +03:00
Aliaksandr Valialkin	0a8f0a4e2f	all: increase minimum supported Go version for building VictoriaMetrics components from v1.14 to v1.15 This is needed after the commit `c0ac740f93`, which uses URL.Redacted() method, which has been added in v1.15. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1147	2021-03-29 23:06:36 +03:00
Aliaksandr Valialkin	6bfac94995	docs/CHANGELOG.md: cut v1.57.0	2021-03-29 19:15:01 +03:00
Aliaksandr Valialkin	8c957f0483	docs/CHANGELOG.md: typo fixes	2021-03-29 15:47:03 +03:00
Aliaksandr Valialkin	842c5a6202	docs/CHANGELOG.md: mention about logging of metrics with too old timestamps in a single-node VictoriaMetrics This is a follow up for `aa81039b42`	2021-03-29 15:43:27 +03:00
Aliaksandr Valialkin	3b8894e51e	docs/CHANGELOG.md: mention Graphite Render API fixes	2021-03-29 14:28:25 +03:00
Aliaksandr Valialkin	3fdc43a1c9	docs/CHANGELOG.md: mention optimized query performance on systems with many CPU cores	2021-03-29 13:55:46 +03:00
Aliaksandr Valialkin	8a3939e93e	docs: document that vmagent drops data blocks when remote storage replies with 400 and 409 http status codes This is a follow up for `1b7dc1e5a5`. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1149	2021-03-26 14:43:41 +02:00
Aliaksandr Valialkin	a920e71809	lib/promscrape/discovery/kubernetes: properly handle `too old resource version` error message from Kubernetes watch API	2021-03-26 12:28:35 +02:00
Aliaksandr Valialkin	c5618949a0	docs/Cluster-VictoriaMetrics.md: mention that vmselect doesnt serve partial responses from export API Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1148	2021-03-25 21:03:32 +02:00
Aliaksandr Valialkin	b91e18af0e	docs/vmagent.md: add an example for `-remoteWrite.label`	2021-03-25 17:59:30 +02:00
Aliaksandr Valialkin	82047be90b	docs: add a link to the repository from build instruction for all the VictoriaMetrics components	2021-03-25 17:16:55 +02:00
Aliaksandr Valialkin	6de36b4e21	docs/vmagent.md: cosmetic fixes	2021-03-25 17:11:10 +02:00
Aliaksandr Valialkin	1b13d02728	docs/vmagent.md: cosmetic fixes	2021-03-25 16:54:37 +02:00
Aliaksandr Valialkin	155cd90fc8	docs/vmagent.md: typo fix: tupically -> typically	2021-03-25 16:48:27 +02:00
Aliaksandr Valialkin	450e23533d	docs/vmalert.md: remove misleading `-evaluationInterval=3s` from example config args 3s evaluation interval is too small for practical setups. It can result in increased load on datasource. So it is better to remove it from example config args, which are usually copy-pasted by novice users.	2021-03-25 15:31:10 +02:00
Aliaksandr Valialkin	b473c21915	app/vmselect/promql: do not merge time series during requests to `/api/v1/query` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1141	2021-03-25 13:56:23 +02:00
Aliaksandr Valialkin	6b1f807418	app/vmagent: add `-promscrape.consul.waitTime` command-line flag for configuring Consul service discovery wait time See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1144	2021-03-23 19:34:12 +02:00
Aliaksandr Valialkin	3bcad1c513	docs/CHANGELOG.md: mention the feature from `44a6cc5eca`	2021-03-23 19:00:51 +02:00
Aliaksandr Valialkin	d1e773266f	app/vmselect/graphite: accept and enforce `extra_label` in all the Graphite APIs	2021-03-23 15:30:15 +02:00
Aliaksandr Valialkin	e01bf33485	docs/Single-server-VictoriaMetrics.md: sync with README.md	2021-03-22 17:52:14 +02:00
Aliaksandr Valialkin	020b031bc3	docs/Articles.md: add https://blog.cybozu.io/entry/2021/03/18/115743	2021-03-22 17:52:13 +02:00
Aliaksandr Valialkin	799461d8bf	app/vmselect/graphite: follow-up after `529d7be26b`	2021-03-18 16:33:00 +02:00
Aliaksandr Valialkin	ff6fe0698b	docs/Single-server-VictoriaMetrics.md: remove outdated message about experimental mode for `-pure` builds	2021-03-18 16:16:33 +02:00
Aliaksandr Valialkin	4443254fb9	lib/storage: prevent from infinite loop if `{__graphite__="..."}` filter matches a metric name with `*`, `[` or `{` chars The idea has been borrowed from https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1137	2021-03-18 14:57:39 +02:00
Aliaksandr Valialkin	156b4c2490	vendor: update github.com/VictoriaMetrics/metrics from v1.16.0 to v1.17.0	2021-03-17 23:22:40 +02:00
Aliaksandr Valialkin	93a318d1bf	vendor: update github.com/VictoriaMetrics/metrics from v1.15.3 to v1.16.0 This adds the following new metrics for each VictoriaMetrics app: * process_resident_memory_anonymous_bytes - the RSS share for memory allocated by the process itself. This share cannot be freed by the OS, so it must be taken into account by OOM killer. * process_resident_memory_pagecache_bytes - the RSS share for page cache memory (aka memory-mapped files). This share can be freed by the OS at any time, so it must be ignored by OOM killer.	2021-03-17 17:59:31 +02:00
Aliaksandr Valialkin	a3b3d434a3	docs/CHANGELOG.md: cut v1.56.0	2021-03-17 02:05:10 +02:00
Aliaksandr Valialkin	265ac5f695	docs/CHANGELOG.md: do not mention reduction in query duration There was a signficant refactoring in the code responsible for time series search, so it can result in both speed ups and slow downs depending on used queries.	2021-03-17 01:58:34 +02:00
Aliaksandr Valialkin	8ef1184adf	app/vmstorage: add `vm_index_search_duration_seconds` histogram for monitoring the performance of index search	2021-03-17 01:13:15 +02:00
Aliaksandr Valialkin	8005ba26b9	lib/netutil: enable IPv6 UDP listening if `-enableTCP6` command-line flag is passed to VictoriaMetrics This is a follow-up for `18cfc4be7b` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1131	2021-03-17 00:19:30 +02:00
Aliaksandr Valialkin	3caac5edd4	Makefile: prepare vmutils-windows-.zip archive on `make release-vmutils` command The archive contains the following executables for Windows: vmagent * vmalert * vmauth * vmctl Other components - vmbackup, vmrestore, victoria-metrics - aren't supported for Windows yet	2021-03-16 20:54:10 +02:00
Aliaksandr Valialkin	f54ece438d	app/vmselect/promql: do not crash if `histogram_over_time()` function name contains uppercase letters such as `Histogram_over_time()`	2021-03-16 12:23:55 +02:00
Aliaksandr Valialkin	5c28e76ef8	docs/Articles.md: added a link to https://www.youtube.com/watch?v=QgLMztnj7-8	2021-03-15 23:02:35 +02:00
Aliaksandr Valialkin	d074326970	app/vmstorage: add `-logNewSeries` command-line flag for determining the source of series churn rate	2021-03-15 22:40:28 +02:00
Aliaksandr Valialkin	e2717d84c0	all: various fixes in command-line flag descriptions	2021-03-15 22:03:49 +02:00
Aliaksandr Valialkin	776b8b32ca	app/{vminsert,vmagent}: a follow-up for `b1aa8c3d8f` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1124	2021-03-15 22:03:49 +02:00
Nikolay	a843dc0219	adds fake response for telegraph queries (#1130 ) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1124	2021-03-15 22:03:49 +02:00
Aliaksandr Valialkin	b7ce96548c	docs/CHANGELOG.md: typo fix: FATURE -> FEATURE	2021-03-15 14:59:40 +02:00
Aliaksandr Valialkin	6b9bba7448	app/vmselect: add `round_digits` query arg to `/api/v1/query` and `/api/v1/query_range` handlers for limiting the number of decimal digits after the point	2021-03-15 12:38:59 +02:00
Aliaksandr Valialkin	1f2a7c3863	docs/Cluster-VictoriaMetrics.md: sync with cluster README.md	2021-03-15 11:51:03 +02:00
Aliaksandr Valialkin	b6dcb37fca	app/vmselect/prometheus: do not include datapoints with timestamps matching `t-d` when returning results from `/api/v1/query?query=m[d]&time=t` as Prometheus does	2021-03-12 12:18:37 +02:00
Aliaksandr Valialkin	a12d2013d5	docs/CaseStudies.md: fix incorrect number of active time series for Zhihu	2021-03-12 11:45:52 +02:00
Aliaksandr Valialkin	60e0280a94	lib/promscrape: add ability to configure proxy options via `proxy_tls_config`, `proxy_basic_auth`, `proxy_bearer_token` and `proxy_bearer_token_file` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1116	2021-03-12 03:36:11 +02:00
Aliaksandr Valialkin	b240d41ede	docs/Articles.md: add https://www.sensedia.com/post/monitoring-with-prometheus-alertmanager	2021-03-12 01:23:22 +02:00
Aliaksandr Valialkin	ccfe944ce7	docs/ExttendedPromQL.md: remove outdated doc	2021-03-11 12:42:57 +02:00
Brensted	03c8438099	Update BestPractices.md (#1123 ) update lists, hyperlinks fixed.	2021-03-11 12:42:56 +02:00
Aliaksandr Valialkin	bd8b7a88a7	lib/httpserver: export `vm_available_memory_bytes` and `vm_available_cpu_cores` metrics These metrics are useful for tracking the available memory and CPU cores for VictoriaMetrics apps.	2021-03-10 12:08:26 +02:00
Ihor Borodin	933de6b9b1	Fixing examples of external.alert.source in documentation (#1120 ) * Fixing examples of external.alert.source in documentation	2021-03-10 12:08:22 +02:00
Aliaksandr Valialkin	f05f7831b8	docs/BestPractices.md: initial add	2021-03-10 12:08:17 +02:00
Aliaksandr Valialkin	9dfa71ad15	docs/CHANGELOG.md: mention about the bugfix from `787242d7b0`	2021-03-09 20:56:48 +02:00
Aliaksandr Valialkin	9d8223eafb	lib/proxy: set missing ServerName in TLS config for `proxy_url`. While at it, allow setting Proxy-Authorization for `proxy_url` via `basic_auth` and `bearer_token` configs.	2021-03-09 19:01:14 +02:00
Aliaksandr Valialkin	0554430d7e	lib/promscrape: apply `sample_limit` after metric relabeling is applied as Prometheus does See the description for `sample_limit` option from Prometheus docs: Per-scrape limit on number of scraped samples that will be accepted. If more than this number of samples are present after metric relabeling the entire scrape will be treated as failed. 0 means no limit. https://prometheus.io/docs/prometheus/latest/configuration/configuration/#scrape_config	2021-03-09 15:52:41 +02:00
Aliaksandr Valialkin	058aa0de75	docs/CHANGELOG.md: mention about improved query performance at `18fe0ff14b`	2021-03-09 13:12:18 +02:00
Aliaksandr Valialkin	942890b1bb	app/vmselect/promql: follow up for `433fff0006`	2021-03-09 12:54:23 +02:00
Aliaksandr Valialkin	2c5ac00231	vendor: update github.com/VictoriaMetrics/fasthttp from 1.0.12 to 1.0.13 This should fix a bug in vmagent with high CPU usage during failed scrapes with small `scrape_timeout`.	2021-03-09 11:44:44 +02:00
John Belmonte	edf39aa225	spelling fix: adjacent (#1115 )	2021-03-09 09:19:16 +02:00
Aliaksandr Valialkin	502fab797a	lib/promscrape: add `scrape_offset` option to `scrape_config` This option can be used for specifying the particular offset per each scrape interval for target scraping	2021-03-08 11:59:32 +02:00
Aliaksandr Valialkin	175466bb41	lib/decimal: prevent exponent overflow when processing values close to zero See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1114	2021-03-05 18:53:41 +02:00
Aliaksandr Valialkin	26cb6f8861	app/vmauth: allow using regexps in `url_map` paths See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1112	2021-03-05 18:53:40 +02:00
Aliaksandr Valialkin	5807ff57f3	lib/promscrape/discovery/kubernetes: reduce memory usage when Kubernetes service discovery is configured on a big number of scrape jobs Previously vmagent was creating a separate Kubernetes object cache per each scrape job. This could result in increased memory usage when monitoring a Kubernetes cluster with big number of objects (pods / nodes / services, etc.) as seen at https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1113 Now it uses a shared map of scrape objects across multiple scrape jobs.	2021-03-05 17:32:33 +02:00
Aliaksandr Valialkin	dfac6b53f5	docs/Articles.md: add https://dalefro.medium.com/prometheus-victoria-metrics-on-aws-ecs-62448e266090	2021-03-05 09:07:22 +02:00
Aliaksandr Valialkin	5277507932	app/vmselect/promql: add `histogram_avg()`, `histogram_stddev()` and `histogram_stdvar()` functions to MetricsQL	2021-03-04 14:12:52 +02:00
Aliaksandr Valialkin	133fb9fc00	lib/promscrape: add `-promscrape.cluster.replicationFactor` command-line flag for replicating scrape targets among `vmagent` instances in the cluster	2021-03-04 10:21:27 +02:00
Aliaksandr Valialkin	0ce89b85d4	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics needs free resources for handling workload spikes	2021-03-04 10:21:26 +02:00
Aliaksandr Valialkin	d109e17f46	all: bump minimum supported Go version from 1.13 to 1.14	2021-03-03 15:58:17 +02:00
Aliaksandr Valialkin	3c11ce9356	docs/vmagent.md: remove outdated suggestion for determining labels that lead to duplicate targets The original labels for duplicate targets is already printed in the error message starting from `71ea4935de`	2021-03-03 12:28:50 +02:00
Aliaksandr Valialkin	0b8d9350d4	docs/CHANGELOG.md: cut v1.55.1 release	2021-03-03 11:49:26 +02:00
Aliaksandr Valialkin	b178f96ac2	docs/vmagent.md: `make docs-sync` after the commit `621bf03745`	2021-03-03 10:53:43 +02:00
Aliaksandr Valialkin	3a79fa147b	docs/CHANGELOG.md: mention recent bugfixes from commits `7906316741` and `e154f4a644`	2021-03-03 10:50:59 +02:00
Alexandros Orfanos	ff5b8346d4	vmalert: docs update - status endpoint needs group ID, not group name (#1106 )	2021-03-03 10:42:54 +02:00
Aliaksandr Valialkin	3a1d884618	docs/CHANGELOG.md: cut v1.55.0	2021-03-02 21:39:53 +02:00
Aliaksandr Valialkin	f686174329	lib/promscrape/discovery/ec2: follow-up after `f6114345de`	2021-03-02 13:47:35 +02:00
Aliaksandr Valialkin	e45c399467	lib/protoparser/prometheus: properly unescape label values in Prometheus exposition format Unescape only `\n`, `\"` and `\\` sequences as Prometheus does. Other escape sequences shouldn't be unescaped.	2021-03-02 13:22:10 +02:00
Aliaksandr Valialkin	f4969a624d	lib/protoparser/graphite: fix parsing of a Graphite line with empty tags such as `foo; 1 2` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1100	2021-03-01 17:17:01 +02:00
Aliaksandr Valialkin	d9e8af0e8f	docs: actualize `-help` output	2021-03-01 17:02:05 +02:00
Aliaksandr Valialkin	3a87d38912	docs/CHANGELOG.md: mention the out of range panic bugfix `d6a41b6ea2`	2021-03-01 16:54:18 +02:00
Aliaksandr Valialkin	57d2a27a64	docs/CHANGELOG.md: mention the issue related to using Kubernetes watch API for service discovery	2021-03-01 01:42:05 +02:00
Aliaksandr Valialkin	d0be1f6f49	app/vmagent: remove data race when applying rate limits to `-remoteWrite.url` with multiple queues	2021-03-01 00:28:20 +02:00
Aliaksandr Valialkin	17eb29206d	docs/vmbackup.md: clarify docs on `vmagent` clustering	2021-02-28 21:59:55 +02:00
Aliaksandr Valialkin	0165063362	docs/CHANGELOG.md: mention about https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1074	2021-02-28 19:32:21 +02:00
Aliaksandr Valialkin	9e644ef111	lib/httpserver: make sure the gzipResponseWriter.Write() is called on Flush() and Close() calls This should fix the `http: superfluous response.WriteHeader call` issue See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1078	2021-02-28 19:23:26 +02:00
Aliaksandr Valialkin	9a2bf65134	lib/promscrape: add ability to spread scrape targets among multiple vmagent instances Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1084	2021-02-28 18:40:42 +02:00
Aliaksandr Valialkin	64b57c3ed3	docs/CHANGELOG.md: mention `317b0cbed2`	2021-02-28 14:03:00 +02:00
Aliaksandr Valialkin	7f1302688f	lib/fs: follow-up after `f3a03c4164`	2021-02-27 01:09:37 +02:00
Aliaksandr Valialkin	095e61a37f	docs/CHANGELOG.md: mentioned a bugfix with `extra_label` handling during caching query results Related to `186c078fac`	2021-02-27 00:23:39 +02:00
Aliaksandr Valialkin	c1b8729bd8	lib/fs: properly handle `stale NFS file handle` error during file deletion This error can appear when -storageDataPath points to NFS volume and the given file has been already removed.	2021-02-26 23:24:46 +02:00
Aliaksandr Valialkin	e38ca28d99	app/vmselect/promql: increase accuracy for `buckets_limit()` function for small limits by skipping the first and the last buckets during merge The first and the last buckets are usually `[0 ... leMin]` and `(leMax ... +Inf)`. If they are merged with adjancent buckets, then the resulting accuracy can suffer.	2021-02-26 22:56:04 +02:00
Aliaksandr Valialkin	dc8c045378	lib/promscrape: cleanup after `9b2246c29b` Main points: * Revert changes outside lib/promscrape/discovery/kuberntes . These changes can be applied later in a separate commit * Minimize changes in lib/promscrape/discovery/kubernetes compared to `a93e644001` * Corner case fixes.	2021-02-26 19:09:12 +02:00
dereksfoster99	5b5254793d	Alphabetized names and added "native speaker" spin. (#1093 ) Do we have the dates that each of these were written so that can be added next to each brand?	2021-02-26 16:41:26 +02:00
dereksfoster99	1f088eb571	Native speaker edits. (#1088 ) I made an effort to not change anything substantive.	2021-02-26 16:41:24 +02:00
Aliaksandr Valialkin	0144b164c7	app/vmselect: add `sign(q)` and `clamp(q, min, max)` functions, which will be added in the upcoming Prometheus release See https://twitter.com/roidelapluie/status/1363428376162295811 The `last_over_time(m[d])` function already exists in MetricsQL.	2021-02-24 17:26:27 +02:00
Aliaksandr Valialkin	0c76828ba6	docs/CHANGELOG.md: mention about a bugfix from `4805b80977`	2021-02-24 11:48:54 +02:00
Aliaksandr Valialkin	d16effc29e	app/vmselect/promql: properly calculate `histogram_quantile() over zero buckets and only a single non-zero` le="+Inf"` bucket like Prometheus does	2021-02-24 00:41:30 +02:00
Aliaksandr Valialkin	5dbe88a1c6	app/vmselect/promql: add `increase_pure()` function to MetricsQL Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/962	2021-02-22 19:15:31 +02:00
Aliaksandr Valialkin	07effa77d9	app/vmselect/graphite: support `Storage-Step` header value and `storage_step` query arg at /render API	2021-02-22 18:33:51 +02:00
Aliaksandr Valialkin	63c16c3fdf	lib/promrelabel: optimize relabeling performance for common cases	2021-02-22 00:51:07 +02:00
Aliaksandr Valialkin	8b87398333	lib/promscrape: export vm_promscrape_target_relabel_duration_seconds metric	2021-02-21 23:21:35 +02:00
Aliaksandr Valialkin	1adbbe7617	vendor: update github.com/VictoriaMetrics/metrics from v1.14.0 to v1.15.0 The v1.15.0 exports the following additional metrics: process_io_read_bytes_total - the number of bytes read via io syscalls such as read and pread process_io_written_bytes_total - the number of bytes written via io syscalls such as write and pwrite process_io_read_syscalls_total - the number of read syscalls such as read and pread process_io_write_syscalls_total - the number of write syscalls such as write and pwrite process_io_storage_read_bytes_total - the number of bytes read from storage layer process_io_storage_written_bytes_total - the number of bytes written to storage layer These metrics can be used for monitoring process io	2021-02-21 22:53:54 +02:00
Aliaksandr Valialkin	72eef964d9	app/vmagent: properly perform graceful shutdown, which was broken in the commit `1d1ba889fe` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1065	2021-02-19 00:34:17 +02:00
Aliaksandr Valialkin	41d3ff4f2b	app/vmagent: fix scrape config example for scrape_align_interval option	2021-02-18 23:57:45 +02:00
Aliaksandr Valialkin	502d0e2524	lib/promscrape: add scrape_align_interval config option into scrape config This option allows aligning scrapes to a particular intervals.	2021-02-18 23:53:04 +02:00
Aliaksandr Valialkin	bd1d906eee	app/vmselect/promql: reduce the probability of `duplicate time series` errors when querying Kubernetes metrics	2021-02-18 22:08:13 +02:00
Aliaksandr Valialkin	3a8b2eed58	docs/CHANGELOG.md: cut v1.54.1	2021-02-18 19:10:57 +02:00
Aliaksandr Valialkin	418de71509	lib/storage: properly handle queries containing a filter on metric name plus any number of negative filters and zero non-negative filters Example: `node_cpu_seconds_total{mode!="idle"}`	2021-02-18 18:33:05 +02:00
Aliaksandr Valialkin	0af9fbe326	docs/Articles.md: add a link to https://www.percona.com/blog/2021/02/12/tame-kubernetes-costs-with-percona-monitoring-and-management-and-prometheus-operator/	2021-02-18 16:37:22 +02:00
Aliaksandr Valialkin	be93e02085	docs/CHANGELOG.md: cut v1.54.0	2021-02-18 14:52:52 +02:00
Aliaksandr Valialkin	a5bfd831fb	docs/Articles.md: add a link to https://medium.com/alteos-tech-blog/observability-availability-and-doras-research-program-85deb6680e78	2021-02-18 01:25:54 +02:00
Aliaksandr Valialkin	9c81429299	app/vmagent/remotewrite: cleanup after `1d1ba889fe` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1065	2021-02-17 21:43:48 +02:00
Aliaksandr Valialkin	57d192a2c2	docs/CHANGELOG.md: mention that prod binaries are built now with Go1.16 This is a follow-up for `4edfe76bef`	2021-02-17 21:07:48 +02:00
Aliaksandr Valialkin	80699405aa	docs/CaseStudies.md: actualize Wix numbers	2021-02-17 21:03:42 +02:00
Aliaksandr Valialkin	31e04e0d45	docs/CHANGELOG.md: document new per-tenant metrics	2021-02-16 23:33:59 +02:00
Aliaksandr Valialkin	667a7594b7	docs: rename vmbackuper to vmbackupmanager	2021-02-16 22:01:21 +02:00
Aliaksandr Valialkin	93ff866e91	lib/storage: reduce the minimum supported retention for inverted index from one month to one day	2021-02-15 15:11:15 +02:00
Aliaksandr Valialkin	fccb481de2	lib/promscrape/discovery/kubernetes: add `__meta_kubernetes_endpoints_label_` and `__meta_kuberntes_endpoints_annotation_` labels to `role: endpoints` This syncs kubernetes SD with Prometheus 2.25 See `617c56f55a`	2021-02-15 02:51:36 +02:00
Aliaksandr Valialkin	cb6eba2ce0	docs/Cluster-VictoriaMetrics.md: clarify replication docs	2021-02-15 01:44:22 +02:00
Aliaksandr Valialkin	9e3993c585	lib/storage: properly hanle regexp tag filters with dots, which can be converted to full string match filters. For example `{label=~"foo\.bar"}` should be converted to `{label="foo.bar"}`. Previously it has was mistakenly conveted to `{label="foo\.bar"}` . This could result in missing time series for such tag filters.	2021-02-14 23:39:19 +02:00
Aliaksandr Valialkin	f85c2f052f	docs/CHANGELOG.md: mention about fixed multiarch build for Docker images Related commit: `f9902b3372`	2021-02-12 15:24:16 +02:00
Aliaksandr Valialkin	a463cda759	docs/Cluster-VictoriaMetrics.md: mention that `/api/v1/import/prometheus` supports OpenMetrics data	2021-02-12 00:59:27 +02:00
Aliaksandr Valialkin	670cc20b71	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics support data ingestion in OpenMetrics format	2021-02-12 00:57:33 +02:00
Aliaksandr Valialkin	9e88ff3075	app/vmauth: add ability to route requests from a single users to multiple targets depending on the requested path Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1064	2021-02-11 12:41:38 +02:00
Aliaksandr Valialkin	985c3e301d	app/vmselect: parallelize `q1 <binary_op> q2` queries by running `q1` and `q2` in parallel This should reduce query execution times.	2021-02-10 23:00:56 +02:00
Aliaksandr Valialkin	148422bcba	lib/storage: disable composite index usage when querying old data	2021-02-10 14:57:58 +02:00
Aliaksandr Valialkin	fa0ef143b1	lib/storage: optimize search by label filters matching big number of time series	2021-02-10 00:46:17 +02:00
Aliaksandr Valialkin	7b7963a77f	lib/mergeset: unconditionally cache indexdb blocks Production workloads show that indexdb blocks must be cached unconditionally for reducing CPU usage. This shouldn't increase memory usage too much, since unused blocks are removed from the cache every two minutes.	2021-02-09 00:49:59 +02:00
Aliaksandr Valialkin	62574c478a	docs/CHANGELOG.md: mention about a bugfix for timezone data from `df0cda3ab9`	2021-02-08 16:01:26 +02:00
Aliaksandr Valialkin	2b36eb3d82	lib/cgroup: follow-up after `b9bf3cbe3e`	2021-02-08 16:01:26 +02:00
Aliaksandr Valialkin	35eb04b7dd	docs/vmctl.md: fix title, so it is properly displayed in the header of https://victoriametrics.github.io/	2021-02-04 20:20:38 +02:00
Aliaksandr Valialkin	191bc0bcf3	docs: sync with master branch	2021-02-04 20:02:24 +02:00
Aliaksandr Valialkin	8e5dad8483	docs/CHANGELOG.md: mention recently added changes	2021-02-04 16:42:33 +02:00
Aliaksandr Valialkin	b5eba70595	lib/httpserver: expose `process_open_fds` and `process_max_fds` metrics See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/402 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1037	2021-02-04 16:42:32 +02:00
Roman Khavronenko	2aa37b0450	vmalert: mention `-datasource.appendTypePrefix` in README (#1052 )	2021-02-03 23:48:45 +02:00
Aliaksandr Valialkin	e802daa9ee	docs/CHANGELOG.md: cut v1.53.1	2021-02-03 22:51:06 +02:00
Aliaksandr Valialkin	88ee836d0c	docs/vmalert.md: mention that `type` option can be set at group level additionally to rule level	2021-02-03 21:12:39 +02:00
Aliaksandr Valialkin	a3aa9bdc9f	app/vmagent: add `Advanced usage` section with the description for all the command-line flags	2021-02-03 21:03:52 +02:00
Aliaksandr Valialkin	e6bcef6514	docs/CHANGELOG.md: mention that `{__graphite__="foo.*.bar"}` syntax deprecates `-search.treatDotsAsIsInRegexps` command-line flag	2021-02-03 20:42:18 +02:00
Aliaksandr Valialkin	e4a013d5d7	docs/Single-server-VictoriaMetrics.md: remove misleading section about native format in `How to export data in JSON line format` chapter	2021-02-03 20:42:17 +02:00
Aliaksandr Valialkin	8de3a329ff	app/vmselect: deprecate `-search.treatDotsAsIsInRegexps` in favor to `{__graphite__="foo.*.bar"}` syntax	2021-02-03 20:36:42 +02:00
Aliaksandr Valialkin	2976ec89b8	lib/storage: fix a bug, which breaks searching by Graphite wildcard filters	2021-02-03 20:15:50 +02:00
Aliaksandr Valialkin	785b770af3	docs/CHANGELOG.md: fix a link to Graphite Render API usage docs	2021-02-03 12:30:09 +02:00
Aliaksandr Valialkin	844f9991be	docs: mention about Graphite render API implementation	2021-02-03 12:13:08 +02:00
Aliaksandr Valialkin	b0acea9d4f	docs/Cluster-VictoriaMetrics.md: document Graphite Render API endpoint	2021-02-03 12:03:40 +02:00
Aliaksandr Valialkin	c69b52cf31	docs/CHANGELOG.md: cut v1.53.0	2021-02-03 03:43:14 +02:00
Aliaksandr Valialkin	52b218c07e	docs/Single-server-VictoriaMetrics.md: sync with master branch	2021-02-03 01:37:55 +02:00
Aliaksandr Valialkin	4b930b9ffe	app/vmselect: add ability to set Graphite-compatible filter via `{__graphite__="foo.*.bar"}` syntax	2021-02-03 01:17:19 +02:00
Aliaksandr Valialkin	755b0998ce	lib/promscrape: add vm_promscrape_service_discovery_duration_seconds metric	2021-02-02 16:16:51 +02:00
Aliaksandr Valialkin	4c59dbc127	lib/promscrape: add `vm_promscrape_scrape_retries_total`, `vm_promscrape_discovery_retries_total` and `vm_promscrape_discovery_requests_total` metrics	2021-02-01 20:06:16 +02:00
Aliaksandr Valialkin	03da0b728c	docs: increase heading sizes in vmagent, vmauth, vmbackup and vmrestore docs, so they match the heading sizes in VictoriaMetrics docs	2021-02-01 19:44:58 +02:00
Aliaksandr Valialkin	f4a4665857	docs/vmctl.md: update build instructions after the migration from github.com/VictoriaMetrics/vmctl to github.com/VictoriaMetrics/VictoriaMetrics/app/vmctl	2021-02-01 19:44:57 +02:00
Aliaksandr Valialkin	286625e4b3	docs: sync with master branch	2021-02-01 18:05:58 +02:00
Aliaksandr Valialkin	6811445b64	docs: document ability to query Graphite datasource from vmalert	2021-02-01 15:28:31 +02:00
Aliaksandr Valialkin	fdf9de98f8	app/vmagent: add -remoteWrite.roundDigits command-line option for limiting the number of digits after the point for stored values This commit also adds --vm-round-digits command-line option to vmctl tool.	2021-02-01 14:42:15 +02:00
Aliaksandr Valialkin	7f4fb34182	app/vmctl: move vmctl code from github.com/VictoriaMetrics/vmctl It is better developing vmctl tool in VictoriaMetrics repository, so it could be released together with the rest of vmutils tools such as vmalert, vmagent, vmbackup, vmrestore and vmauth.	2021-02-01 01:18:39 +02:00
Aliaksandr Valialkin	ff526492eb	docs/Cluster-VictoriaMetrics.md: mention about `-search.denyPartialResponse` command-line flag and `deny_partial_response` query arg	2021-01-27 14:06:14 +02:00
Aliaksandr Valialkin	db5b78f65c	docs/CHANGELOG.md: typo fixes	2021-01-27 01:20:31 +02:00
Aliaksandr Valialkin	ffec5131ae	lib/promscrape: export `vm_promscrape_scrapes_failed_per_url_total` and `vm_promscrape_scrapes_skipped_by_sample_limit_per_url_total` metrics These metrics could be useful for determining imporperly working scrape targets. Note that these metrics are exported only for failing scrape targets. They aren't exposed for normally working targets.	2021-01-27 00:40:39 +02:00
Aliaksandr Valialkin	29bf531f7d	app/vmagent: add -remoteWrite.rateLimit command-line flag for limiting data rate to remote storage See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1035	2021-01-27 00:40:39 +02:00
Aliaksandr Valialkin	68a66be811	lib/logger: add `-loggerTimezone` command-line flag for adjusting timezone for timestamps in log messages	2021-01-26 22:53:25 +02:00
Aliaksandr Valialkin	9e175683b1	docs/CHANGELOG.md: mention about https://github.com/VictoriaMetrics/VictoriaMetrics/pull/1027	2021-01-26 16:38:22 +02:00
Aliaksandr Valialkin	fdced59278	lib/promscrape: retry scrape and service discovery requests when the remote server closes http keep-alive connection	2021-01-22 13:22:59 +02:00
Aliaksandr Valialkin	7308691865	docs/CHANGELOG.md: mention about the fix with too big HTTP reconnection rate to targets This has been fixed in `0a45220b0a`	2021-01-22 12:10:01 +02:00
Aliaksandr Valialkin	e55205220b	app/vmselect: add `-search.maxStepForPointsAdjustment` command-line flag, which can be used for disabling adjustment for points returned from `/api/v1/query_range` handler if they have timestamps closer than `-search.latencyOffset` to the current time	2021-01-19 22:57:50 +02:00
Aliaksandr Valialkin	5640e6cbca	docs/vmagent.md: follow-up for `184a659c5f`	2021-01-13 13:54:28 +02:00
mancubus77	6f3560d256	Doco vmagent fix (#1014 ) * Update section with remote_write.url for clustered version * fix typo Co-authored-by: mancubus <dont@write.me>	2021-01-13 13:54:27 +02:00
Aliaksandr Valialkin	d23d6d4bfa	docs/CHANGELOG.md: cut v1.52.0	2021-01-13 12:59:08 +02:00
Aliaksandr Valialkin	c5bdab5a4c	app/vmselect/promql: add ability to pass multiple labels to `sort_by_label` and `sort_by_label_desc` functions See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/992	2021-01-13 12:43:47 +02:00
Aliaksandr Valialkin	81789da731	lib/backup: increase backup chunk size from 128MB to 1GB This should reduce costs for object storage API calls by 8x. See https://cloud.google.com/storage/pricing#operations-pricing	2021-01-13 12:16:39 +02:00
Aliaksandr Valialkin	8cae98aa78	app/vmselect/promql: properly parse escaped multibyte utf8 code sequences in metric names and labels names See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/990	2021-01-13 10:59:32 +02:00
Aliaksandr Valialkin	2d4006cb4a	docs/CHANGELOG.md: document updated `extra_label` query arg behavior Follow-up for `dc9d7aedd5`	2021-01-13 01:07:25 +02:00
Nikolay	821492bc0b	adds extra_label to all import apis (#1007 ) * adds extra_label to all import apis, changes priority for extra_label - now it has priority over original labels * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * adds extra labels to vmagent import api changes order for adding labels, now its added after user values * adds tests for extra_label * import fix Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2021-01-13 01:07:24 +02:00
Aliaksandr Valialkin	bc8b38daca	docs/CHANGELOG.md: mention that the minimum supported TLS version now is v1.2 Follow-up for `7bf5d48315`	2021-01-13 00:45:08 +02:00
Aliaksandr Valialkin	b71748f1d9	docs/Single-server-VictoriaMetrics.md: typo fix	2021-01-12 22:03:46 +02:00
Aliaksandr Valialkin	8711860327	deployment/docker: upgrade base image for Docker packages from Alpine 3.13.1 to Alpine 3.12.3 in order to fix potential security issues See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1010	2021-01-12 21:57:07 +02:00
Aliaksandr Valialkin	df6e399f73	app/vmselect/promql: add `tfirst_over_time(m[d])` and `tlast_over_time(m[d])` MetricsQL functions for returning timestamps for the first and the last samples in `m` over `d`	2021-01-12 16:12:47 +02:00
Aliaksandr Valialkin	de04dd81cf	docs/Articles.md: add https://cer6erus.medium.com/cloud-native-model-driven-telemetry-stack-on-openshift-80712621f5bc	2021-01-12 15:36:50 +02:00
Aliaksandr Valialkin	1dee98a331	docs/CHANGELOG.md: document big fixes from the commit `7976c22797`	2021-01-12 13:44:10 +02:00
Aliaksandr Valialkin	c97681b45c	lib/promscrape: properly show scrape duration on `/targets` page Previously it has been shown as 0.000s for any scrape duration.	2021-01-11 21:15:50 +02:00
Aliaksandr Valialkin	bdf67a13cc	docs/Single-server-VictoriaMetrics.md: mention about https://github.com/aorfanos/vmalert-cli in `Integrations` section	2021-01-11 18:52:56 +02:00
Aliaksandr Valialkin	4731780a38	docs/CHANGELOG.md: mention about a bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/989	2021-01-11 13:11:53 +02:00
Aliaksandr Valialkin	4ee53c3961	all: use `net.Dial` instead of `fasthttp.Dial`, because `fasthttp.Dial` limits the number of concurrent dials to 1000	2021-01-11 12:52:51 +02:00
Aliaksandr Valialkin	d5a2b120e9	app/vmstorage: disable final merge by default, since it may result in high disk IO and CPU usage without measurable benefits such as increased query performance and reduced disk space usage	2021-01-08 00:12:12 +02:00
Aliaksandr Valialkin	fa176dacf1	docs/Single-server-VictoriaMetrics.md: sync with upstream	2021-01-07 23:39:21 +02:00
Aliaksandr Valialkin	5fb8cf00c3	docs/Cluster-VictoriaMetrics.md: typo fix	2021-01-07 23:39:12 +02:00
Nikolay	137efe6c71	Snap docs change (#986 ) * adds snap docs, adds release information for snap package, adds docs notes about configuration management with snap package. * adds release page mention * version fix for snap, its awful * revert version * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-12-29 11:44:50 +02:00
Aliaksandr Valialkin	e2d8b9e091	README.md: mention about `-search.queryStats.lastQueriesCount` and `-search.queryStats.minQueryDuration` command-line flags in docs about query stats	2020-12-29 11:39:45 +02:00
Aliaksandr Valialkin	66a19e0079	docs/CHANGELOG.md: cut v1.51.0	2020-12-27 14:21:41 +02:00
Aliaksandr Valialkin	47872ada7e	app/vmselect/promql: do not ajdust `offset` value provided in the query Previously it could be modified in order to improve response cache hit ratio. This is unneeded, since cache hit ratio should remain good because the query time range should be already aligned to multiple of `step` values. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/976	2020-12-27 14:10:15 +02:00
Aliaksandr Valialkin	5c8e4cf03e	docs/Articles.md: add a link to https://www.percona.com/blog/2020/12/23/observations-on-better-resource-usage-with-percona-monitoring-and-management-v2-12-0/	2020-12-27 13:02:08 +02:00
Aliaksandr Valialkin	5bbf200de2	app/vmselect: add per-tenant `/api/v1/status/top_queries` handler	2020-12-27 12:53:50 +02:00
Aliaksandr Valialkin	e6deb39064	app/vmselect: refactor `/api/v1/stats/top_queries` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/907	2020-12-25 17:24:25 +02:00
Aliaksandr Valialkin	991262d53e	docs/CHANGELOG.md: mention that vmalert now properly escapes multi-line queries when passing to Grafana A follow-up for `1de15ad490` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890	2020-12-25 11:12:57 +02:00
Nikolay	14915071d6	adds escape for CRLF (#984 ) at external.alert.source - \n and \r symbols was url encoded, instead of direct usage. replace it from "\n" to `\n` allows to skip url encoding. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890	2020-12-25 11:06:47 +02:00
Aliaksandr Valialkin	b480585905	app/vmalert: typo fix in descriptions for notifier.basicAuth.username and notifier.basicAuth.password command-line flags	2020-12-24 12:49:40 +02:00
Aliaksandr Valialkin	2a8bd2b5cc	docs/CHANGELOG.md: mention about adding missing __meta_kubernetes_service_* labels for `endpoints` and `endpointslices` roles in `kubernetes_sd_config` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/982	2020-12-24 11:34:01 +02:00
Aliaksandr Valialkin	367fc17933	lib/promscrape: code prettifying for `8dd03ecf19`	2020-12-24 10:57:20 +02:00
Aliaksandr Valialkin	d8511b6651	docs: mention that it is possible to set multiple `-notifier.tlsInsecureSkipVerify` command-line flags for vmalert See c3a92968343c2b3619f1ab935702d0e9b3a46733	2020-12-22 22:32:56 +02:00
Aliaksandr Valialkin	fa3bcf220f	lib/storage: remove stale parts as soon as they go outside the configured retention Previously such parts could remain undeleted for long durations until they are merged with other parts. This should help for `-retentionPeriod` values smaller than one month.	2020-12-22 19:55:07 +02:00
Artem Navoiev	f6b76b5c01	add linkedin to release announcement	2020-12-21 08:57:23 +02:00
Artem Navoiev	618ecd4708	Announcement guide	2020-12-20 00:45:02 +02:00
Aliaksandr Valialkin	787cbd2f7e	docs/CHANGELOG.md: cut v1.50.2	2020-12-19 15:32:45 +02:00
Aliaksandr Valialkin	a5b17946fe	docs/CHANGELOG.md: mention about bugfix for populating template variables in vmalert See `404cbd1522` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/974	2020-12-19 14:21:28 +02:00
Aliaksandr Valialkin	262cf81757	app/vmselect: properly parse negative combined offsets such as `-1h2m3s` Previously such offsets were parsed as `-1h + 2m + 3s`. Now they are parsed as `-(1h + 2m + 3s)`.	2020-12-19 01:25:03 +02:00
Aliaksandr Valialkin	5aa2b0de55	docs/CHANGELOG.md: there is no visible difference for CPU usage and disk IO usage on production workloads	2020-12-19 00:51:32 +02:00
Aliaksandr Valialkin	edbe35509e	lib/{storage,mergeset}: tune background merge process in order to reduce CPU usage and disk IO usage	2020-12-18 20:01:20 +02:00
Aliaksandr Valialkin	c5b47df8a4	docs/CHANGELOG.md: mention that Docker images for vmagent, vmalert, vmauth, vmbackup and vmrestore with tags containing `-cluster` suffix are no longer published See `441822c4cc` for details	2020-12-18 20:01:18 +02:00
Aliaksandr Valialkin	39f7fa4743	docs: alphabetically sort links to case studies	2020-12-18 12:31:03 +02:00
Aliaksandr Valialkin	5b2fd08b27	docs/Articles.md: classify articles by themes	2020-12-18 12:05:39 +02:00
Aliaksandr Valialkin	6edd3330b4	add a link to https://www.percona.com/blog/2020/12/16/percona-monitoring-and-management-migration-from-prometheus-to-victoriametrics-faq/	2020-12-18 11:44:31 +02:00
Aliaksandr Valialkin	4fd2973e7c	lib/protoparser/prometheus: follow-up commit after 7d38627b9f6f212ae602aea6a72f469fe3c70ba2 Document the bugfix in docs/CHANGELOG.md and add a test for the bugfix.	2020-12-16 23:42:17 +02:00
Aliaksandr Valialkin	49b6c6f6ab	docs/FAQ.md: add a link to https://valyala.medium.com/promscale-vs-victoriametrics-resource-usage-on-production-workload-91c8e3786c03 in the question about benchmarks	2020-12-16 23:15:49 +02:00
Aliaksandr Valialkin	2b5700b1c4	docs/Articles.md: add a link to https://valyala.medium.com/promscale-vs-victoriametrics-resource-usage-on-production-workload-91c8e3786c03	2020-12-16 14:27:01 +02:00
Aliaksandr Valialkin	f6b51889ce	docs/Cluster-VictoriaMetrics.md: fix incorrect commands for profile collecting	2020-12-16 01:06:49 +02:00
Aliaksandr Valialkin	69b3ca37d0	docs/Cluster-VictoriaMetrics.md: add `Profiling` section	2020-12-16 00:59:53 +02:00
Aliaksandr Valialkin	34622f7f9b	docs/CHANGELOG.md: cut v1.50.1 release	2020-12-15 21:11:53 +02:00
Aliaksandr Valialkin	1022505131	docs/Release-Guide.md: actualize release docs	2020-12-15 21:11:02 +02:00
Aliaksandr Valialkin	f89c3e505a	docs/CHANGELOG.md: mention about bugfix, which properly removes unregistered targets from `/targets` page See bugfix at `a4c7fcb5e1`	2020-12-15 21:07:28 +02:00
Aliaksandr Valialkin	49e800ba55	app/vmagent: add `vmagent_remotewrite_blocks_sent_total` and `vmagent_remotewrite_bytes_sent_total` metrics per each `-remoteWrite.url`	2020-12-15 20:41:08 +02:00
Aliaksandr Valialkin	9ab7ca1133	docs/vmagent.md: typo fix: pearsed->parsed	2020-12-15 19:03:35 +02:00
Aliaksandr Valialkin	11674a9b76	docs/vmagent.md: mention that `sample_limit` option has no sense when stream parsing is enabled	2020-12-15 18:44:19 +02:00
Aliaksandr Valialkin	dd47c8f084	docs/CHANGELOG.md: cut v1.50.0 release	2020-12-15 14:45:00 +02:00
Aliaksandr Valialkin	eddc2bd017	lib/promscrape: properly handle scrape errors when stream parsing is enabled See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/967	2020-12-15 14:10:52 +02:00
Aliaksandr Valialkin	aca669c89c	docs/CHANGELOG.md: mention that vmagent now accepts multiple `-remoteWrite.sendTimeout` and `-remoteWrite.tlsInsecureSkipVerify` command-line flags	2020-12-15 12:59:34 +02:00
Aliaksandr Valialkin	e85159813f	docs/CHANGELOG.md: mention about adding `query`, `first` and `value` functions to alert templates See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/539	2020-12-14 20:17:46 +02:00
Aliaksandr Valialkin	09a03b862d	docs/CHANGELOG.md: mention bugfix for proper recovering from incorrectly stored persistent queue See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/964	2020-12-14 19:29:23 +02:00
Aliaksandr Valialkin	a2eb451de4	app/{vmagent,vminsert}: follow-up for `ce8c2dd1f1`: return `/targets` page in HTML when requested via web browser	2020-12-14 14:13:01 +02:00
Aliaksandr Valialkin	756fc6fc6c	app/victoria-metrics: automatically reset response cache when samples with too timestamps older than `now - search.cacheTimestampOffset` are ingested	2020-12-14 13:10:16 +02:00
Aliaksandr Valialkin	c0db28cd9a	docs/MetricsQL.md: clarify that `limitk(k, q)` returns an arbitrary set of `k` time series with each call Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/951	2020-12-12 14:18:02 +02:00
Aliaksandr Valialkin	eed84ac2b5	docs/FAQ.md: use less confusing links in the chapter explaining why VictoriaMetrics doesnt support Prometheus remote_read API	2020-12-11 21:23:55 +02:00
Aliaksandr Valialkin	fc82c22e50	docs: consistently use links to https://victoriametrics.github.io for documentation references	2020-12-11 21:09:17 +02:00
Aliaksandr Valialkin	f1b303e70d	docs/Single-server-VictoriaMetrics.md: clarify docs in `Relabeling` section	2020-12-11 18:24:31 +02:00
Aliaksandr Valialkin	3ec5387a36	docs/CHANGELOG.md: mention https://github.com/VictoriaMetrics/VictoriaMetrics/issues/955	2020-12-11 17:49:04 +02:00
Aliaksandr Valialkin	d6f9bf2d19	app/vmselect/graphite: properly handle wildcards and charsets inside curly braces For example, `foo{bar,[a-f]ab}` should match `foobar`, `foobar123`, `foofab`, etc. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/952	2020-12-11 17:26:32 +02:00
Aliaksandr Valialkin	82d26d9dfe	docs/Single-server-VictoriaMetrics.md: sync with upstream README.md via `make docs-sync`	2020-12-11 12:09:17 +02:00
faceair	054ad542b0	docs/CaseStudies.md: add case study for zhihu (#956 )	2020-12-11 12:09:16 +02:00
Aliaksandr Valialkin	4804e004f3	docs/Single-server-VictoriaMetrics.md: clarify that the recommended value for `-dedup.minScrapeInterval` is `scrape_interval` from Prometheus configs	2020-12-09 12:16:25 +02:00
Aliaksandr Valialkin	a52924c7a3	docs/CHANGELOG.md: mention about memory leak fix in vmagent when big number of targets is discovered via service discovery	2020-12-09 10:36:05 +02:00
Aliaksandr Valialkin	5b1c4f702e	docs/Single-server-VictoriaMetrics.md: sync with upstream README.md via `make docs-sync`	2020-12-09 10:28:24 +02:00
Aliaksandr Valialkin	a84467958a	lib/promscrape/discovery/consul: properly pass Datacenter filter to Consul API server Previously it has been passed as `sdc` query arg, while it should be passed as `dc` query arg. See https://www.consul.io/api-docs/health#list-nodes-for-service for details. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/574#issuecomment-740454170	2020-12-08 21:53:23 +02:00
Aliaksandr Valialkin	1a237c6903	all: properly handle CPU limits set on the host system/container This can reduce memory usage on systems with enabled CPU limits. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/946	2020-12-08 21:07:03 +02:00
Aliaksandr Valialkin	06091cfdf8	lib/promscrape: export `vm_promscrape_scrapers_{started\|stopped}_total` metrics for monitoring target churn rate	2020-12-08 11:58:44 +02:00
Aliaksandr Valialkin	56a0b058c1	lib/promscrape: export `vm_promscrape_active_scrapers{type="<sd_type>"}` metric for tracking the number of active scrapers per each service discovery type	2020-12-08 01:54:44 +02:00
Aliaksandr Valialkin	b5b32c65b0	lib/promscrape: do not enable strict config parsing when `-promscrape.config.dryRun` command-line flag is passed Strict parsing for -promscrape.config can be enabled by passing `-promscrape.config.strictParse` command-line flag. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/944	2020-12-07 13:18:16 +02:00
Aliaksandr Valialkin	9660774fd1	app/vmselect/graphite: remove duplicate `name` tag from `/tags/autoComplete/tags` handler Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/942	2020-12-07 01:10:02 +02:00
Aliaksandr Valialkin	3d00613076	lib/protoparser/influx: allow multiple whitespace chars between measurement, fields and timestamp in Influx line protocol	2020-12-06 12:00:28 +02:00
Aliaksandr Valialkin	80084d1827	docs/CHANGELOG.md: cut v1.49.0	2020-12-05 13:49:17 +02:00
Aliaksandr Valialkin	f4f530d686	deployment/docker: update Go builder from v1.15.5 to v1.15.6 This fixes issues found in Go since v1.15.5 - see https://github.com/golang/go/issues?q=milestone%3AGo1.15.6+label%3ACherryPickApproved	2020-12-05 12:38:14 +02:00
Aliaksandr Valialkin	d242c2f2bd	app/vmselect/promql: add `count_eq_over_time(m[d], N)` and `count_ne_over_time(m[d], N)` for calculating the number of samples in `m` over `d` that are equal / not equal to `N`	2020-12-05 12:31:01 +02:00
Aliaksandr Valialkin	bdac2171f1	all: do not print usage info for all the flags when incorrect command-line flag is passed This should improve usability for VictoriaMetrics apps that have big number of command-line flags, i.e. all the apps.	2020-12-03 21:46:19 +02:00
Aliaksandr Valialkin	8cf76d8747	app/vmselect/promql: add `label_uppercase(q, label1, ... labelN)` and `label_lowercase(q, label1, ... labelN)` functions Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/936	2020-12-03 21:46:18 +02:00
Aliaksandr Valialkin	7a889f6850	lib/promscrape: code cleanup after `c6dee6c52d` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/574	2020-12-03 19:52:09 +02:00
Aliaksandr Valialkin	fca915dcf3	docs/Single-server-VictoriaMetrics.md: update `features` chapter according to the latest developments	2020-12-03 13:01:46 +02:00
Aliaksandr Valialkin	45c402ad8a	docs/Single-server-VictoriaMetrics.md: remove duplicate `provide` word	2020-12-03 09:48:54 +02:00
Aliaksandr Valialkin	dd96714a2c	docs/FAQ.md: add a link to https://valyala.medium.com/prometheus-vs-victoriametrics-benchmark-on-node-exporter-metrics-4ca29c75590f in `performance comparisons` section	2020-12-02 21:25:15 +02:00
Aliaksandr Valialkin	9e98a8f3d3	app/vmselect/promql: return `nan` from `minute(m)` when `m` equals to `nan` This aligns VictoriaMetrics behaviour with Prometheus behaviour. The issue has been spotted in https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 20:16:40 +02:00
Aliaksandr Valialkin	490c70a958	app/vmselect: return `metric` values from `time() cmp_op metric` query when `cmp_op` comparison is true This aligns MetricsQL behavior to Prometheus' one. The issue has been identified at https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 12:09:40 +02:00
Aliaksandr Valialkin	a8c5e2f0c5	vendor: upgrade github.com/VictoriaMetrics/metricsql from v0.7.2 to v0.7.3 This fixes parsing of hex numbers in MetricsQL such as 0x3b The bug has been detected at https://promlabs.com/promql-compliance-test-results/2020-12-01/victoriametrics/	2020-12-02 08:11:42 +02:00
Aliaksandr Valialkin	e6bc08436c	docs/Articles.md: add a link to https://victoriametrics.medium.com/how-to-monitor-go-applications-with-victoriametrics-c04703110870	2020-12-02 07:21:10 +02:00
Aliaksandr Valialkin	a34910e12c	docs/Articles.md: add a link to an article on how Percona PMM has been migrated from Prometheus to VictoriaMetrics	2020-12-02 07:21:08 +02:00
Aliaksandr Valialkin	4ef7158e89	app/vmselect/promql: return `nan` from `a >bool b` if `a` is `nan` in the same way as Prometheus does	2020-12-02 00:28:56 +02:00
Aliaksandr Valialkin	2ed721e457	lib/protoparser/prometheus: properly parse OpenMetrics timestamps OpenMetrics timestamps are floating-point numbers, that represent Unix timestamp in seconds. This differs from Prometheus exposition format, where timestamps are integer numbers representing Unix timestamp in milliseconds.	2020-11-27 14:54:36 +02:00
Aliaksandr Valialkin	2c0b1d5454	sync with README.md from single-node version	2020-11-27 13:23:16 +02:00
Aliaksandr Valialkin	6bd9fe4e77	docs/Articles.md: add https://valyala.medium.com/prometheus-vs-victoriametrics-benchmark-on-node-exporter-metrics-4ca29c75590f	2020-11-27 10:25:00 +02:00
Aliaksandr Valialkin	af667c59c1	all: typo fix: thouthand->thousand	2020-11-26 13:34:05 +02:00
Aliaksandr Valialkin	81fadba0b2	docs/CHANGELOG.md: cut v1.48.0 release	2020-11-26 02:06:11 +02:00
Aliaksandr Valialkin	b542df9ab5	docs/CHANGELOG.md: add a link to Netflix Eureka - https://github.com/Netflix/eureka	2020-11-26 01:36:30 +02:00
Aliaksandr Valialkin	3f52e59efe	app/{vmagent,victoria-metrics}: add `-dryRun` option and make more clear handling for `-promscrape.config.dryRun`	2020-11-25 23:01:39 +02:00
Aliaksandr Valialkin	03002f1fe1	lib/storage: log metric name plus all its labels when the metric timestamp is outside the configured retention This should simplify debugging when the source of the metric with unexpected timestamp must be found.	2020-11-25 14:44:29 +02:00
Aliaksandr Valialkin	26e699c440	lib/protoparser/prometheus: properly parse "infinity" values in OpenMetrics format Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/924	2020-11-24 19:02:50 +02:00
Aliaksandr Valialkin	284d805895	docs/CHANGELOG.md: mention that `/tags/delSeries` handler is supported after `f0c207fae2`	2020-11-24 12:30:36 +02:00
Aliaksandr Valialkin	dad8b76a0e	lib/protoparser/prometheus: properly parse metrics with exemplars Examplars have been introduced in OpenMetrics - see https://github.com/OpenObservability/OpenMetrics/blob/master/OpenMetrics.md#exemplars-1 Previously VictoriaMetrics couldn't parse the following metric foo{bar="baz"} 123 # exemplar here This commit fixes this. Note that VictoriaMetrics ignores the exemplar as for now.	2020-11-24 12:30:34 +02:00
Aliaksandr Valialkin	768fd8c3d9	docs/Articles.md: add recent articles about VictoriaMetrics	2020-11-24 12:30:30 +02:00
Aliaksandr Valialkin	8b82f9d8b8	lib/promscrape: expose `__meta_ec2_ipv6_addresses` label for `ec2_sd_config` like Prometheus will do in the next release	2020-11-23 16:57:03 +02:00
Aliaksandr Valialkin	c2186279b7	lib/promscrape: add `filters` option to `dockerswarm_sd_config` like Prometheus did in v2.23.0	2020-11-23 16:27:33 +02:00
Aliaksandr Valialkin	e1297c0b78	app/vmselect: add `/tags/delSeries` handler from Graphite Tags API See https://graphite.readthedocs.io/en/stable/tags.html#removing-series-from-the-tagdb	2020-11-23 15:32:14 +02:00
Aliaksandr Valialkin	433ae806ac	app/vmselect: implement `/tags/tagSeries` and /tags/tagMultiSeries` in order to be consistent with single-node VictoriaMetrics	2020-11-23 14:57:08 +02:00
Aliaksandr Valialkin	85eecf5801	app/vmselect/netstorage: add `-replicationFactor` command-line flag for reducing query duration when a part of vmstorage nodes are temporarily slow and/or temporarily unavailable Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/711	2020-11-23 00:39:53 +02:00
Nikolay	bb2bcb9725	Adds eureka service discovery (#913 ) * Adds eureka service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/851 Netflix service discovery for AWS * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-20 14:02:13 +02:00
John Belmonte	7ac49ac176	MetricsQL docs: parameter consistency (#915 ) * MetricsQL docs: parameter consistency if I understand correctly: * `fun(q)` - fun takes instant vector * `fun(m[d])` - fun takes range vector * Update docs/MetricsQL.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-20 11:43:07 +02:00
Aliaksandr Valialkin	5e39bedf40	docs/CHANGELOG.md: mention that slow query log now contains remote client address	2020-11-19 12:41:26 +02:00
Aliaksandr Valialkin	8e1f657ef9	lib/logger: follow-up for `09105ff49c`	2020-11-19 12:37:05 +02:00
Aliaksandr Valialkin	2af08d6e97	docs/CHANGELOG.md: mention about `snap install victoriametrics`	2020-11-18 19:50:38 +02:00
Aliaksandr Valialkin	5331349efb	docs: make `snap install victoriametrics` more prominent in docs	2020-11-18 19:45:10 +02:00
Aliaksandr Valialkin	f372148203	docs/Single-server-VictoriaMetrics.md: an attempt to fix markdown formatting in `Graphite Tags API` section	2020-11-18 14:41:48 +02:00
Aliaksandr Valialkin	e7976363f9	docs: lowercase `adidas` trademark according to their request	2020-11-18 13:47:56 +02:00
Aliaksandr Valialkin	a5413aa438	docs/Cluster-VictoriaMetrics.md: adjust RAM sizing recommendations for vmstorage nodes It is recommended to have at least of 50% of free RAM on vmstorage nodes in order handle possible RAM usage spikes during rolling upgrade for vmstorage nodes when time series are re-routed from temporarily unavailable node to the remaining active nodes.	2020-11-18 13:02:38 +02:00
Aliaksandr Valialkin	a0a34e2a26	docs/Single-server-VictoriaMetrics.md: make consistent section title sizes	2020-11-18 12:36:22 +02:00
Aliaksandr Valialkin	bf9b6b77c8	docs/Single-server-VictoriaMetrics.md: mention that `/internal/force_flush` endpoint is mostly needed for testing and debugging	2020-11-18 01:37:39 +02:00
Aliaksandr Valialkin	c6adcafedb	app/vminsert: export `vm_rpc_vmstorage_is_reachable` metric, which can be used for monitoring reachability of vmstorage nodes from vminsert nodes	2020-11-17 22:13:26 +02:00
Aliaksandr Valialkin	a00df790b1	docs/CHANGELOG.md: cut v1.47.0 release	2020-11-16 21:00:21 +02:00
Aliaksandr Valialkin	5454137504	docs/Cluster-VictoriaMetrics.md: `make docs-sync` after `57dc152e9d`	2020-11-16 20:20:19 +02:00
Aliaksandr Valialkin	6bcbdb18fb	docs/CHANGELOG.md: mention about Graphite Tags API implementation	2020-11-16 15:34:56 +02:00
Aliaksandr Valialkin	eb763bcb9d	app/vmselect/graphite: add `/tags/autoComplete/values` handler from Graphite Tags API	2020-11-16 15:29:29 +02:00
Aliaksandr Valialkin	f2f16d8e79	app/vmselect/graphite: add `/tags/autoComplete/tags` handler from Graphite Tags API See https://graphite.readthedocs.io/en/stable/tags.html#auto-complete-support	2020-11-16 14:58:10 +02:00
Aliaksandr Valialkin	852aed62f7	app/vmselect/prometheus: improve performance for `/api/v1/labels` and `/api/v1/label/<labelName>/values` on time ranges exceeding one day when `match[]` query arg is set	2020-11-16 13:46:51 +02:00
Aliaksandr Valialkin	467ed68a37	docs/CHANGELOG.md: mention about improved performance for `/api/v1/series` on a time range exceeding one day	2020-11-16 12:52:33 +02:00
Aliaksandr Valialkin	eea1be0d5c	app/vmselect/graphite: add /tags/findSeries handler from Graphite Tags API See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags	2020-11-16 12:52:23 +02:00
Aliaksandr Valialkin	5889273920	app/vmselect/graphite: add `/tags/<tag_name>` handler for Graphite Tags API	2020-11-16 03:41:41 +02:00
Aliaksandr Valialkin	99cb1a70cf	app/vmselect/graphite: add `/tags` handler from Graphite Tags API See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags	2020-11-16 02:57:20 +02:00
Aliaksandr Valialkin	4be5b5733a	app/vminsert: add `/tags/tagSeries` and `/tags/tagMultiSeries` handlers from Graphite Tags API See https://graphite.readthedocs.io/en/stable/tags.html#adding-series-to-the-tagdb	2020-11-16 02:40:04 +02:00
Aliaksandr Valialkin	2ac5f00d98	app/vmselect: propagate errors from `vmstorage` to response to the client if `-search.denyPartialResponse` command-line flag is set Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/891 This commit also adds `"isPartial":{true\|false}` field to `/api/v1/*` responses. `"isPartial":true` is set when the response is based on a partial data because some of vmstorage nodes weren't available during query processing.	2020-11-14 13:20:10 +02:00
Aliaksandr Valialkin	c329aacedf	docs/Single-server-VictoriaMetrics.md: document `/internal/force_flush` endpoint	2020-11-13 18:43:40 +02:00
Aliaksandr Valialkin	f19547039a	docs/Single-server-VictoriaMetrics.md: explain why recently inserted data may be unavailable for querying for a few seconds	2020-11-13 18:34:31 +02:00
Aliaksandr Valialkin	1364dfdd8c	docs/CHANGELOG.md: mentioned that Go builder has been updated from v1.15.4 to v1.15.5 See `3fa9ab4a49` for details.	2020-11-13 16:22:18 +02:00
Aliaksandr Valialkin	cc4da051f3	docs/Single-server-VictoriaMetrics.md: sync with single-node README.md	2020-11-13 16:03:50 +02:00
Aliaksandr Valialkin	da6d82a8dd	app/vmselect/promql: assume that time series value doesnt change during gaps when calculating increase() and delta() This should remove unexpected spikes at the end of gaps. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/894	2020-11-13 14:59:32 +02:00
Aliaksandr Valialkin	739b88c1e4	lib/protoparser/promremotewrite: forward errors, which can occur during data ingestion, to the caller of ParseStream, so it could properly return HTTP 503 status code on non-nil error Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/896	2020-11-13 11:00:41 +02:00
Aliaksandr Valialkin	7ceaf4ba8f	all: consistently return text-based HTTP responses with charset=utf-8 This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/897	2020-11-13 10:30:21 +02:00
Aliaksandr Valialkin	f7a6ae3d11	docs/vmagent.md: added a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2 into `Relabeling` section	2020-11-12 12:27:13 +02:00
Aliaksandr Valialkin	069979c367	docs/vmagent.md: typo fix	2020-11-11 16:05:04 +02:00
Aliaksandr Valialkin	7a0094adae	docs/vmagent.md: add `Configuration update` section	2020-11-11 16:01:21 +02:00
Aliaksandr Valialkin	94842ed942	docs/Single-server-VictoriaMetrics.md: document `-search.treatDotsAsIsInRegexps` command-line option	2020-11-11 14:59:38 +02:00
Aliaksandr Valialkin	6b979ea5a7	docs/Single-server-VictoriaMetrics.md: small clarifications in VictoriaMetrics features	2020-11-11 13:48:16 +02:00
Aliaksandr Valialkin	20d0ead2f2	docs/Single-server-VictoriaMetrics.md: update the link to enterprise features	2020-11-11 13:42:42 +02:00
Aliaksandr Valialkin	779f591bcc	docs/Single-server-VictoriaMetrics.md: mention that `/api/v1/status/tsdb` handler accepts `topN` and `date` query args	2020-11-11 13:38:26 +02:00
Aliaksandr Valialkin	8033e4885b	docs/Cluster-VictoriaMetrics.md: mention about optional topN and date query args for `/api/v1/status/tsdb` handler	2020-11-11 13:35:13 +02:00
Aliaksandr Valialkin	4f2c5877db	app/vmselect: add `-search.treatDotsAsIsInRegexps` command-line flag for automatic escaping of dots in regexp label filters	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	0769f86a7e	docs/Single-server-VictoriaMetrics.md: clarify which directories can be removed when recovering from data corruption	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	346181fd48	docs/Single-server-VictoriaMetrics.md: add a hint that case studies can be read by clicking on the corresponding link	2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin	697fd44158	lib/promscrape: make a copy of ScrapeWork from discovered []ScrapeWork slice instead of referring to an item in this slice This should prevent from holding previously discovered []ScrapeWork slices when a part of discovered targets changes over time. This should reduce memory usage for the case when big number of discovered scrape targets changes over time. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825	2020-11-10 16:13:31 +02:00
Aliaksandr Valialkin	8f3339fa81	app/vmselect/promql: do not return data points in the end of the selected time range for time series ending in the middle of the selected time range Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/887 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/845	2020-11-10 14:51:55 +02:00
Aliaksandr Valialkin	6ae9d79f6b	docs/CHANGELOG.md: mention abot explicit setting of extra labels in alert entities (see `3adf8c5a6f`) Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/870	2020-11-10 00:41:31 +02:00
Aliaksandr Valialkin	ad82b6ead8	Move CHANGELOG.md to docs/CHANGELOG.md	2020-11-10 00:37:15 +02:00
Aliaksandr Valialkin	a8562d643b	lib/promscrape: add `-promscrape.dropOriginalLabels` command-line flag for reducing memory usage when discovering big number of scrape targets Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825	2020-11-10 00:20:49 +02:00
Aliaksandr Valialkin	96e9deecbc	docs/Single-server-VictoriaMetrics.md: typo fix	2020-11-08 13:40:52 +02:00
Aliaksandr Valialkin	a8ad3091e3	CHANGELOG.md: cut v1.46.0	2020-11-07 17:54:10 +02:00
Aliaksandr Valialkin	d2296b7e09	docs/CHANGELOG.md: `make docs-sync`	2020-11-07 16:30:41 +02:00
Aliaksandr Valialkin	6ca5a94359	docs/CHANGELOG.md: add `CHANGELOG` header	2020-11-07 01:14:49 +02:00
Aliaksandr Valialkin	efebc3b6fb	app/vmselect/promql: code cleanup after `43823addea`	2020-11-06 01:31:33 +02:00
Aliaksandr Valialkin	8accbc14d8	docs/Articles.md: add a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2	2020-11-05 19:18:13 +02:00
Aliaksandr Valialkin	6ce80425a6	docs/MetricsQL.md: fix a link to `with templates` page	2020-11-05 16:12:59 +02:00
Aliaksandr Valialkin	60747c5f14	docs/Articles.md: move third-party articles to the top	2020-11-05 15:03:50 +02:00
Aliaksandr Valialkin	bf28bc3792	docs: add CHANGELOG.md	2020-11-05 14:59:17 +02:00
Aliaksandr Valialkin	1336e47c86	docs/vmagent.md: update after `4c808d58bf`	2020-11-04 20:33:49 +02:00
Nikolay	5b235b902b	Adds ready probe (#874 ) * adds leading forward slash check for scrapeURL path https://github.com/VictoriaMetrics/VictoriaMetrics/issues/835 * adds ready probe for scrape config initialization, it should prevent metrics loss during vmagent rolling update, /ready api will return 425 http code, if some scrape config still waits for initialization. * updates docs * Update app/vmagent/README.md * renames var * Update app/vmagent/README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-04 20:33:48 +02:00
Aliaksandr Valialkin	d8a7186019	docs/CaseStudies.md: add case study for Idealo.de	2020-11-04 20:19:26 +02:00
Aliaksandr Valialkin	2cd86d0220	lib/promscrape: docs update after `e4182dd896` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878	2020-11-04 17:13:34 +02:00
Nikolay	d0a9b24c5a	reduces memory usage for vmagent, (#880 ) * reduces memory usage for vmagent, limits count of droppedTarget, that can be stored for /api/v1/targets page up to 999 items, https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878 * Update app/vmagent/README.md * Update app/vmagent/README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-11-04 17:13:33 +02:00
Aliaksandr Valialkin	407a46c11e	Revert "docs/vmagent.md: mention about `-promscrape.dropOriginalLabels`" This reverts commit `1a80acc712`.	2020-11-04 11:45:35 +02:00
Aliaksandr Valialkin	1a80acc712	docs/vmagent.md: mention about `-promscrape.dropOriginalLabels`	2020-11-04 11:16:16 +02:00
Aliaksandr Valialkin	40a4f5ded4	docs/MetricsQL.md: add missing whitespace	2020-11-02 23:49:45 +02:00
Aliaksandr Valialkin	ed724d25ba	lib/promscrape: add `stream parse` mode for efficient scraping of targets that expose millions of metrics	2020-11-01 23:12:26 +02:00
Aliaksandr Valialkin	abdf22e0bb	app/vmagent: expose `/api/v1/targets` page according to https://prometheus.io/docs/prometheus/latest/querying/api/#targets This page is exposed by vmagent and by a single-node VictoriaMetrics Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/643	2020-10-20 21:55:14 +03:00
Aliaksandr Valialkin	c4464594b7	app/vmselect/promql: allow passing optional third argument to `topk_` and `bottomk_` functions in order to obtain sum of time series outside top/bottom K	2020-10-20 20:09:55 +03:00
Aliaksandr Valialkin	0db7c2b500	app/vmstorage: support for `-retentionPeriod` smaller than one month Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/173 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/17	2020-10-20 14:42:46 +03:00
Aliaksandr Valialkin	abdf020e22	docs/vmrestore.md: `make docs-sync`	2020-10-20 10:49:22 +03:00
Aliaksandr Valialkin	9b91305a31	docs/MetricsQL.md: small clarifications	2020-10-17 12:01:33 +03:00
Aliaksandr Valialkin	6227b71a67	docs: add a link to https://smarketshq.com/monitoring-kubernetes-clusters-41a4b24c19e3 article about VictoriaMetrics	2020-10-16 09:07:55 +03:00
Aliaksandr Valialkin	bc446ec62a	docs/Single-server-VictoriaMetrics.md: update docs	2020-10-14 13:27:01 +03:00
Aliaksandr Valialkin	1634415441	docs/CaseStudies.md: actualize numbers for Wix.com	2020-10-14 13:07:41 +03:00
Aliaksandr Valialkin	e9fec0e5b8	docs/vmalert.md: `make docs-sync`	2020-10-13 18:35:00 +03:00
Aliaksandr Valialkin	de9d3f1332	docs/Cluster-VictoriaMetrics.md: clarify RAM requirements for `vmstorage` nodes	2020-10-13 16:47:25 +03:00
Aliaksandr Valialkin	0867dea5fc	app/vmselect: add ability to export data in CSV format via `/api/v1/export/csv`	2020-10-12 20:08:08 +03:00
Aliaksandr Valialkin	938b3b7ed1	lib/promscrape: code prettifying after `9bd9f67718`	2020-10-12 16:13:59 +03:00
Aliaksandr Valialkin	ac525462ce	docs/MetricsQL.md: mention that VictoriaMetrics keeps metric names after applying functions which dont change time series meaning	2020-10-12 13:25:28 +03:00
Aliaksandr Valialkin	85d507f71d	docs/Single-server-VictoriaMetrics.md: add missing whitespace	2020-10-09 20:56:45 +03:00
Aliaksandr Valialkin	35b8ffaa17	docs/vmagent.md: clarify `-promscrape.suppressDuplicateScrapeTargetErrors` command-line flag usage	2020-10-08 19:24:05 +03:00
Aliaksandr Valialkin	0d44e371f3	lib/promscrape: add `-promscrape.suppressDuplicateScrapeTargetErrors` command-line flag in order to suppress `duplicate scrape target` errors Show also original labels for duplicate targets in error message in order to simplify debugging the issue. Now `/targets` endpoint accepts optional `show_original_labels=1` query arg, which shows original labels for each target. This may simplify debugging for target relabeling. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/651	2020-10-08 18:59:25 +03:00
Aliaksandr Valialkin	5d5076c4a2	docs/CaseStudies.md: actualize Wix numbers	2020-10-06 16:09:30 +03:00
Aliaksandr Valialkin	70bb5624ad	docs/Articles.md: add https://medium.com/@VictoriaMetrics/anomaly-detection-in-victoriametrics-9528538786a7	2020-10-06 15:30:07 +03:00
Aliaksandr Valialkin	5f15c52d21	docs: `make docs-sync` after `cbe3cf683b`	2020-10-05 16:48:25 +03:00
Aliaksandr Valialkin	40df42e1e5	docs: `make docs-sync`	2020-09-30 09:51:16 +03:00
Aliaksandr Valialkin	10b6982ef8	docs/Release-Guide.md: mention that CHANGELOG.md must be updated before release	2020-09-30 08:53:27 +03:00
Aliaksandr Valialkin	536aa8779a	app/vmstorage: rename `vm_{big\|small}_merge_need_free_disk_space` to `vm_merge_need_free_disk_space` This simplifies alerting.	2020-09-29 22:53:33 +03:00
Aliaksandr Valialkin	a4361a4c07	docs/Single-server-VictoriaMetrics.md: typo fix	2020-09-29 20:30:26 +03:00
Aliaksandr Valialkin	7ae0ab976a	docs/Single-server-VictoriaMetrics.md: typo fix: compations -> compactions	2020-09-29 20:27:37 +03:00
Aliaksandr Valialkin	f4d74ccfec	docs/{vmbackup,vmrestore}: formatting fixes	2020-09-29 13:19:13 +03:00
Aliaksandr Valialkin	5179df7082	docs/vmbackup.md: make docs about minio config more prominent	2020-09-29 13:16:34 +03:00
Aliaksandr Valialkin	79b00f7b6b	docs: improve readability a bit	2020-09-29 13:05:05 +03:00
Aliaksandr Valialkin	aadbd014ff	all: add native format for data export and import The data can be exported via [/api/v1/export/native](https://victoriametrics.github.io/#how-to-export-data-in-native-format) handler and imported via [/api/v1/import/native](https://victoriametrics.github.io/#how-to-import-data-in-native-format) handler.	2020-09-27 17:36:38 +03:00
Aliaksandr Valialkin	00ec2b7189	lib/protoparser: use all the available CPU cores for processing ingested data from a single /api/v1/import stream Previously a single data ingestion stream to /api/v1/import could load only a single CPU core.	2020-09-26 04:22:06 +03:00
Aliaksandr Valialkin	00ff01f766	docs/Single-server-VictoriaMetrics.md: VictoriaMetrics properly stores Inf values after `26115891db`	2020-09-22 17:03:16 +03:00
Aliaksandr Valialkin	ed473c94ff	docs/vmagent.md: typo fix	2020-09-21 21:49:08 +03:00
Aliaksandr Valialkin	bedc971398	docs: `make docs-sync`	2020-09-21 21:48:05 +03:00
Aliaksandr Valialkin	9b15b11f74	app/vmstorage: added `-forceMergeAuthKey` command-line flag for protecting `/internal/force_merge` endpoint	2020-09-17 14:24:20 +03:00
Aliaksandr Valialkin	d96858b921	lib/storage: add `/internal/force_merge` handler for running forced compactions on historical per-month partitions This may be useful for freeing up storage space after time series deletion. See https://victoriametrics.github.io/#force-merge for more details. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/686	2020-09-17 12:20:56 +03:00
Aliaksandr Valialkin	2084496462	docs/Single-server-VictoriaMetrics.md: document that /api/v1/series/count may count delete time series Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/770	2020-09-17 01:39:09 +03:00
Aliaksandr Valialkin	406f4fe445	app/vmagent: substitute `-remoteWrite.url` with `secret-url` value in logs, since it may contain sensitive info such as passwords or auth tokens Pass `-remoteWrite.showURL` command-line flag in order to see real `-remoteWrite.url` values in logs and at `/metrics` page. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/773	2020-09-16 22:36:18 +03:00
Aliaksandr Valialkin	d39a985d6b	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics ignores NaN and Inf values during data ingestion Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/752	2020-09-15 23:41:10 +03:00
Aliaksandr Valialkin	5f04b00b2d	docs/Articles.md: add a link to https://medium.com/miro-engineering/prometheus-high-availability-and-fault-tolerance-strategy-long-term-storage-with-victoriametrics-82f6f3f0409e	2020-09-15 12:29:44 +03:00
Aliaksandr Valialkin	8bd5aa3516	lib/protoparser: accept timestamp in milliseconds instead of seconds at /api/v1/import/prometheus This improves consistency with timestamps in Prometheus text exposition format	2020-09-11 14:05:24 +03:00
Aliaksandr Valialkin	58d3b82ae5	app/{vminsert,vmagent}: allow passing timestamp via `timestamp` query arg when ingesting data to `/api/v1/import/prometheus` See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/750	2020-09-11 13:28:31 +03:00
John Belmonte	a72a2566d7	fix typo on outliersk() doc (#758 )	2020-09-11 01:59:55 +03:00
Aliaksandr Valialkin	f307e6f432	app/vmselect: initial implementation of Graphite Metrics API See https://graphite-api.readthedocs.io/en/latest/api.html#the-metrics-api	2020-09-11 00:30:20 +03:00
Aliaksandr Valialkin	475698d2ad	docs: sync docs for vmalert, vmauth, vmbackup and vmrestore	2020-09-09 21:10:48 +03:00
Aliaksandr Valialkin	d72fd86488	docs/Articles.md: add links to recently published third-party articles and talks about VictoriaMetrics	2020-09-09 20:15:44 +03:00
Aliaksandr Valialkin	5a82f645e4	docs/Single-server-VictoriaMetrics.md: typo fix	2020-09-09 01:22:18 +03:00
Aliaksandr Valialkin	95ad657a1c	docs/Single-server-VictoriaMetrics.md: typo fix	2020-09-09 01:00:05 +03:00
Aliaksandr Valialkin	5ab57f916b	docs/vmagent.md: clarified the case when `-remoteWrite.queues` must be tuned Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/745	2020-09-08 20:15:49 +03:00
Aliaksandr Valialkin	13dd915302	docs/Single-server-VictoriaMetrics.md: `make docs-sync`	2020-09-07 21:58:48 +03:00
Aliaksandr Valialkin	5cb8c82fe5	docs/Single-server-VictoriaMetrics.md: sync with README.md	2020-09-04 03:30:43 +03:00
Aliaksandr Valialkin	38462bd95e	docs/Single-server-VictoriaMetrics.md: updates according to review comments at `fe98ba5a60`	2020-09-04 03:08:20 +03:00
Aliaksandr Valialkin	478d8f8393	app/vmselect/promql: add `count_le_over_time(m[d], le)` and `count_gt_over_time(m[d], gt)` functions These functions returns the number of raw samples that don't exceed `le` or are bigger than `gt`. These functions are complement to already existing `share_le_over_time(m[d], le)` and `share_gt_over_time(m[d], gt)`.	2020-09-03 15:28:58 +03:00
Aliaksandr Valialkin	7ab7ae79c7	docs/Single-server-VictoriaMetrics.md: mention that `/api/v1/series` returns series for the last 5 minutes if `start` query arg is missing Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/735	2020-09-03 12:39:31 +03:00
Aliaksandr Valialkin	4388c6cad1	docs/Single-server-VictoriaMetrics.md: add missing link to Prometheus text exposition format	2020-09-03 01:14:33 +03:00
Aliaksandr Valialkin	4fa97430d7	app/{vminsert,vmagent}: allow adding extra labels when importing data via Prometheus, CSV and JSON line formats Extra labels may be added to the imported data by passing `extra_label=name=value` query args. Multiple query args may be passed in order to add multiple extra labels. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/719	2020-09-02 19:47:02 +03:00
Aliaksandr Valialkin	49140edd41	docs/Single-server-VictoriaMetrics.md: mention that VictoriaMetrics accepts relative times at `time`, `start` and `end` query args	2020-08-28 10:14:33 +03:00
Aliaksandr Valialkin	7e74cf4d71	docs/vmalert.md: sync with app/vmalert/README.md via `make docs-update`	2020-08-28 09:52:10 +03:00
Aliaksandr Valialkin	815dffabed	docs/Articles.md: add a link to https://medium.com/@romanhavronenko/victoriametrics-how-to-migrate-data-from-prometheus-filtering-and-modifying-time-series-6d40cea4bf21	2020-08-28 09:52:09 +03:00
Aliaksandr Valialkin	285665e93b	app/vmselect/promql: allow passing multiple args to aggregate functions such as `avg(q1, q2, q3)`	2020-08-15 01:15:16 +03:00
Aliaksandr Valialkin	a2021d0dde	docs/vmagent.md: mention that gaps in remote storage may appear if vmagent cannot keep up with data ingestion	2020-08-14 20:48:17 +03:00
Aliaksandr Valialkin	e7c0b2ca56	docs: update docs	2020-08-14 19:14:46 +03:00
Aliaksandr Valialkin	60c7397be5	all: support `%{ENV_VAR}` placeholders in yaml configs in all the vm* components Such placeholders are substituted by the corresponding environment variable values. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/583	2020-08-13 17:17:06 +03:00
Aliaksandr Valialkin	c5d50a5940	docs/Cluster-VictoriaMetrics.md: mention about Kubernetes operator	2020-08-12 21:15:01 +03:00
Aliaksandr Valialkin	801a0241fc	docs/Single-server-VictoriaMetrics.md: mention helm charts, k8s operator and vmctl tool in `Integrations` chapter	2020-08-12 21:12:45 +03:00
Aliaksandr Valialkin	f20032dbb5	docs/Articles.md: added https://medium.com/@romanhavronenko/victoriametrics-how-to-migrate-data-from-prometheus-d44a6728f043	2020-08-12 21:03:25 +03:00
Aliaksandr Valialkin	315b752245	docs/Single-server-VictoriaMetrics.md: mention that it is safe to skip multiple versions during the upgrade	2020-08-11 14:22:24 +03:00
Aliaksandr Valialkin	87d7710c8e	docs/MetricsQL.md: mention that MetricsQL removes all the NaN values from results	2020-08-07 07:51:40 +03:00
Aliaksandr Valialkin	265206a6c3	docs/Single-server-VictoriaMetrics.md: add a chapter about data updates	2020-08-04 13:54:29 +03:00
Aliaksandr Valialkin	bdb881c43b	app/vmselect/promql: add zscore-related functions: `zscore_over_time(m[d])` and `zscore(q) by (...)`	2020-08-03 21:52:15 +03:00
Aliaksandr Valialkin	945645f38f	docs/{vmagent,vmalert}: add instruction on how to build for ARM	2020-07-31 09:25:41 +03:00
Aliaksandr Valialkin	a0eec52e6c	docs/Single-server-VictoriaMetrics.md: mention that downgrade is also safe to perform	2020-07-31 09:21:03 +03:00
Aliaksandr Valialkin	e9860b2fa3	docs/vmalert.md: sync with app/vmalert/README.md	2020-07-30 21:57:20 +03:00
Aliaksandr Valialkin	312acf7ce9	docs/MetricsQL.md: small fixes in the docs	2020-07-28 13:28:01 +03:00
Aliaksandr Valialkin	91d4673bd6	docs/Single-server-VictoriaMetrics.md: mention that OpenTSDB data ingestion protocol is used by KairosDB	2020-07-28 13:11:36 +03:00
Aliaksandr Valialkin	cf69b1ea6f	app/vmselect/promql: add `buckets_limit(k, buckets)` function, which limits the number of buckets per time series to `k` This function works with both Prometheus-style and VictoriaMetrics-style buckets. The function removes buckets with the lowest values in order to reserve the highest precision. The function is useful for building heatmaps in Grafana from too big number of buckets.	2020-07-24 16:14:12 +03:00
Aliaksandr Valialkin	8d1721d128	app/vmselect/promql: add `rate_over_sum(m[d])` function to MetricsQL, which returns rate over sum of `m` values over `d` duration Something like `sum_over_time(m[d]) / d`, but more accurate.	2020-07-24 01:17:15 +03:00
Aliaksandr Valialkin	b8303afcd8	lib/storage: improve prioritizing of data ingestion over querying Prioritize also small merges over big merges. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/291 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/648	2020-07-23 01:40:38 +03:00
Aliaksandr Valialkin	71c3266fca	docs/Single-server-VictoriaMetrics.md: mention that it is recommended inspecting logs during troubleshooting	2020-07-22 18:21:06 +03:00
Aliaksandr Valialkin	8bee3ef91b	docs/vmagent.md: sync with app/vmagent/README.md	2020-07-20 17:09:30 +03:00
Aliaksandr Valialkin	4d2011a87d	app/vmselect/promql: add `mode()` aggregate function	2020-07-20 15:30:11 +03:00
Aliaksandr Valialkin	427fa43ce2	app/vmselect/promql: add `mode_over_time(m[d])` function See https://en.wikipedia.org/wiki/Mode_(statistics) and https://stackoverflow.com/questions/61134078/promql-query-to-return-the-value-from-a-range-vector-which-occurs-maximum-no-of	2020-07-17 18:29:10 +03:00
Aliaksandr Valialkin	c64914a7e4	app/vmselect/promql: keep all labels for time series from `any()` call	2020-07-17 15:17:37 +03:00
Aliaksandr Valialkin	e6d96bb0bd	docs/vmagent.md: make filtering rules for init container pods less confusing	2020-07-14 20:33:19 +03:00
Aliaksandr Valialkin	8e7c7a6fbd	docs/Single-server-VictoriaMetrics.md: remove `Roadmap` chapter, since it became outdated	2020-07-14 19:07:06 +03:00
Aliaksandr Valialkin	3365f6867b	docs/Single-server-VictoriaMetrics.md: sync with README.md	2020-07-14 14:19:53 +03:00
Aliaksandr Valialkin	b6a5c29549	docs/vmagent.md: sync with app/vmagent/README.md	2020-07-13 21:26:00 +03:00
Aliaksandr Valialkin	5d21c79af9	docs/Single-server-VictoriaMetrics.md: sync with the original README.md	2020-07-10 12:16:16 +03:00
Aliaksandr Valialkin	6373d377ef	app/{vminsert,vmagent}: add ability to import data in Prometheus exposition format via `/api/v1/import/prometheus`	2020-07-10 12:13:28 +03:00
Aliaksandr Valialkin	418f0e46cb	docs: add a link to the `The CMS monitoring infrastructure and applications` publication from CERN	2020-07-08 20:16:31 +03:00
Aliaksandr Valialkin	cd58e4356d	docs/Cluster-VictoriaMetrics.md: mention about `api/v1/status/active_queries` page Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/528	2020-07-08 19:15:38 +03:00
Aliaksandr Valialkin	fb86071552	app/vmselect: add `/api/v1/status/active_queries` page with the list of currently running queries This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/575 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/528	2020-07-08 19:09:31 +03:00
Aliaksandr Valialkin	0bff96fe4b	lib/storage: prioritize data ingestion over heavy queries Heavy queries could result in the lack of CPU resources for processing the current data ingestion stream. Prevent this by delaying queries' execution until free resources are available for data ingestion. Expose `vm_search_delays_total` metric, which may be used in for alerting when there is no enough CPU resources for data ingestion and/or for executing heavy queries. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/291	2020-07-05 19:44:04 +03:00
Aliaksandr Valialkin	6ebac3ab63	app/vminsert: add ability to apply relabeling to all the incoming metrics if `-relabelConfig` command-line arg points to a file with a list of `relabel_config` entries See https://victoriametrics.github.io/#relabeling	2020-07-02 20:36:33 +03:00
Aliaksandr Valialkin	f10e8809c0	app/vmselect: add `interpolate` function for filling gaps with linearly interpolated values See https://stackoverflow.com/q/62565021/274937 for details	2020-07-02 14:54:46 +03:00
Aliaksandr Valialkin	2361ad8ab4	lib/promscrape: add ability to set `disable_compression` and `disable_keepalive` options in `scrape_config` section of the config passed to `-promscrape.config` Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/580	2020-07-02 14:19:34 +03:00

... 26 27 28 29 30 ...

2942 commits