859 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	4b930b9ffe	app/vmselect: add ability to set Graphite-compatible filter via {__graphite__="foo.*.bar"} syntax	2021-02-03 01:17:19 +02:00
Aliaksandr Valialkin	03da0b728c	docs: increase heading sizes in vmagent, vmauth, vmbackup and vmrestore docs, so they match the heading sizes in VictoriaMetrics docs	2021-02-01 19:44:58 +02:00
Aliaksandr Valialkin	f4a4665857	docs/vmctl.md: update build instructions after the migration from github.com/VictoriaMetrics/vmctl to github.com/VictoriaMetrics/VictoriaMetrics/app/vmctl	2021-02-01 19:44:57 +02:00
Aliaksandr Valialkin	7d23f3ff3a	app/vmselect: add ability to set an additional label filters via extra_label query arg	2021-02-01 17:42:35 +02:00
Aliaksandr Valialkin	6811445b64	docs: document ability to query Graphite datasource from vmalert	2021-02-01 15:28:31 +02:00
Nikolay	b8bc1c2e0f	Graphite vmalert wip (#112) ... * init implementation for graphite alerts * adds graphite support for vmalert * small fix * changes vmalert graphite api with type * updates tests * small fix * fixes graphite parse * Fixes graphite from time	2021-02-01 15:28:30 +02:00
Aliaksandr Valialkin	fdf9de98f8	app/vmagent: add -remoteWrite.roundDigits command-line option for limiting the number of digits after the point for stored values ... This commit also adds --vm-round-digits command-line option to vmctl tool.	2021-02-01 14:42:15 +02:00
Aliaksandr Valialkin	05474aaa29	app/vmctl: fix make check-all warnings	2021-02-01 01:31:45 +02:00
Aliaksandr Valialkin	7f4fb34182	app/vmctl: move vmctl code from github.com/VictoriaMetrics/vmctl ... It is better developing vmctl tool in VictoriaMetrics repository, so it could be released together with the rest of vmutils tools such as vmalert, vmagent, vmbackup, vmrestore and vmauth.	2021-02-01 01:18:39 +02:00
Aliaksandr Valialkin	5328a102e0	app/vmselect: unconditionally deny partial responses from /api/v1/export* ... It is expected that `/api/v1/export*` returns full data, so there is no sense in partial responses there.	2021-01-27 14:39:53 +02:00
Aliaksandr Valialkin	4b324da947	all: consistently use timers from timerpool	2021-01-27 00:40:39 +02:00
Aliaksandr Valialkin	29bf531f7d	app/vmagent: add -remoteWrite.rateLimit command-line flag for limiting data rate to remote storage ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1035	2021-01-27 00:40:39 +02:00
weng zhao	2a8a34ea05	vmalert: add option datasource.queryStep to allow user to address the inconsistency between grafana dashboards(query_range with step 15s usually) and ALERTS (#1027) ... Co-authored-by: zhao.weng <zhao.weng@shopee.com>	2021-01-26 16:38:20 +02:00
Aliaksandr Valialkin	44c74f1e79	app/vmselect/promql: improve documentation for -search.maxPointsPertimeseries command-line flag ... This should reduce incorrect usage and assumptions for this flag. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1020	2021-01-22 13:00:35 +02:00
Aliaksandr Valialkin	e55205220b	app/vmselect: add -search.maxStepForPointsAdjustment command-line flag, which can be used for disabling adjustment for points returned from /api/v1/query_range handler if they have timestamps closer than -search.latencyOffset to the current time	2021-01-19 22:57:50 +02:00
Aliaksandr Valialkin	5856611291	app/vmselect/graphite: extract getCanonicalPath() function from loop body inside getCanonicalPaths()	2021-01-18 17:31:27 +02:00
Aliaksandr Valialkin	5640e6cbca	docs/vmagent.md: follow-up for 184a659c5f	2021-01-13 13:54:28 +02:00
Aliaksandr Valialkin	c5bdab5a4c	app/vmselect/promql: add ability to pass multiple labels to sort_by_label and sort_by_label_desc functions ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/992	2021-01-13 12:43:47 +02:00
Aliaksandr Valialkin	8cae98aa78	app/vmselect/promql: properly parse escaped multibyte utf8 code sequences in metric names and labels names ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/990	2021-01-13 10:59:32 +02:00
Nikolay	821492bc0b	adds extra_label to all import apis (#1007) ... * adds extra_label to all import apis, changes priority for extra_label - now it has priority over original labels * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * Update README.md Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * adds extra labels to vmagent import api changes order for adding labels, now its added after user values * adds tests for extra_label * import fix Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2021-01-13 01:07:24 +02:00
Aliaksandr Valialkin	df6e399f73	app/vmselect/promql: add tfirst_over_time(m[d]) and tlast_over_time(m[d]) MetricsQL functions for returning timestamps for the first and the last samples in m over d	2021-01-12 16:12:47 +02:00
Nikolay	9f0a4fd00e	Fixes error handling for promscrape.streamParse (#1009) ... properly return error if client cannot read data, properly suppress scraper errors	2021-01-12 13:35:09 +02:00
Roman Khavronenko	304512b668	vmalert-989: return non-empty result in template func query stub to pass validation (#1002) ... On templates validation stage vmalert does not acutally send queries, so for complex chained expression validation may fail. To avoid this, we add a blank sample in response so validation can pass successfully. Later, during the rule execution, stub will be replaced with real `query` function. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/989	2021-01-11 12:59:33 +02:00
Aliaksandr Valialkin	4ee53c3961	all: use net.Dial instead of fasthttp.Dial, because fasthttp.Dial limits the number of concurrent dials to 1000	2021-01-11 12:52:51 +02:00
Aliaksandr Valialkin	d5a2b120e9	app/vmstorage: disable final merge by default, since it may result in high disk IO and CPU usage without measurable benefits such as increased query performance and reduced disk space usage	2021-01-08 00:12:12 +02:00
Aliaksandr Valialkin	47872ada7e	app/vmselect/promql: do not ajdust offset value provided in the query ... Previously it could be modified in order to improve response cache hit ratio. This is unneeded, since cache hit ratio should remain good because the query time range should be already aligned to multiple of `step` values. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/976	2020-12-27 14:10:15 +02:00
Aliaksandr Valialkin	5bbf200de2	app/vmselect: add per-tenant /api/v1/status/top_queries handler	2020-12-27 12:53:50 +02:00
Aliaksandr Valialkin	0e739efc88	app/vmselect/promql: simplify defer call for querystats.RegisterQuery	2020-12-27 12:07:56 +02:00
Aliaksandr Valialkin	44932098b5	app/vmselect/querystats: reduce the default number of last queries to track from 100K to 20K ... This should reduce memory usage in constrained environments	2020-12-25 17:40:32 +02:00
Aliaksandr Valialkin	e6deb39064	app/vmselect: refactor /api/v1/stats/top_queries ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/907	2020-12-25 17:24:25 +02:00
Nikolay	76d092c091	Adds query stats handler (#945) ... * Adds query stat handler, for query and query_range api, victoriametrics tracks query execution time, stats are expored at /api/v1/status/queries endpoint with topN param https://github.com/VictoriaMetrics/VictoriaMetrics/issues/907 * fixed query stats bugs * improves queryStats tracker * improves query stat * small fix * fix tests * added more tests * fixes 386 tests * naming fixes * adds drop for outdated records	2020-12-25 17:24:24 +02:00
Nikolay	14915071d6	adds escape for CRLF (#984) ... at external.alert.source - \n and \r symbols was url encoded, instead of direct usage. replace it from "\n" to `\n` allows to skip url encoding. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/890	2020-12-25 11:06:47 +02:00
Aliaksandr Valialkin	b480585905	app/vmalert: typo fix in descriptions for notifier.basicAuth.username and notifier.basicAuth.password command-line flags	2020-12-24 12:49:40 +02:00
Nikolay	0b87f02602	fixes panic (#979) ... * fixes panic https://github.com/VictoriaMetrics/helm-charts/issues/89 * add fast-path * Apply suggestions from code review Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-12-24 09:01:40 +02:00
Aliaksandr Valialkin	d8511b6651	docs: mention that it is possible to set multiple -notifier.tlsInsecureSkipVerify command-line flags for vmalert ... See c3a92968343c2b3619f1ab935702d0e9b3a46733	2020-12-22 22:32:56 +02:00
Nikolay	67e470e598	changes vmalert notifier flag, (#978) ... fixes issue with notifier insecure setting, now its possible to use multiple notifier.tlsInsecureSkipVerify multiple time.	2020-12-22 22:27:03 +02:00
Roman Khavronenko	9ce8b36d2a	vmalert-974: fix order for labels templating (#975) ... The change fixes bug caused by 3adf8c5a6f. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/974	2020-12-19 14:21:27 +02:00
Aliaksandr Valialkin	262cf81757	app/vmselect: properly parse negative combined offsets such as -1h2m3s ... Previously such offsets were parsed as `-1h + 2m + 3s`. Now they are parsed as `-(1h + 2m + 3s)`.	2020-12-19 01:25:03 +02:00
Aliaksandr Valialkin	49e800ba55	app/vmagent: add vmagent_remotewrite_blocks_sent_total and vmagent_remotewrite_bytes_sent_total metrics per each -remoteWrite.url	2020-12-15 20:41:08 +02:00
Aliaksandr Valialkin	9ab7ca1133	docs/vmagent.md: typo fix: pearsed->parsed	2020-12-15 19:03:35 +02:00
Aliaksandr Valialkin	11674a9b76	docs/vmagent.md: mention that sample_limit option has no sense when stream parsing is enabled	2020-12-15 18:44:19 +02:00
Aliaksandr Valialkin	8d1031c29a	app/vmselect/promql: return expected increase() result for the first point on the graph with value not exceeding 100	2020-12-15 14:10:50 +02:00
Nikolay	7064c4eb8e	adds new Array Flags (#965) ... * adds ArrayDuration and ArrayBool flags, makes sendTimeout and tlsInsecure configurable per remoteWrite url * added backward compatibility testcases for ArrayDuration and ArrayBool * fixes bool flag * fixes test cases	2020-12-15 12:59:33 +02:00
Roman Khavronenko	9f578e389c	vmalert: add function "query", "first" and "value" to alert templates functions (#960) ... The commit adds a support for template function `query`, `first` and `value`. The function `query` executes a MetricsQL query for active alerts. In vmalert we update templates on every evaluation for active alerts to keep them up to date. With `query` func it may become a perf issue since it will fire a query on every execution. We should keep it in mind for now. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/539	2020-12-14 20:12:16 +02:00
Aliaksandr Valialkin	a2eb451de4	app/{vmagent,vminsert}: follow-up for ce8c2dd1f1: return /targets page in HTML when requested via web browser	2020-12-14 14:13:01 +02:00
Nikolay	324e3aa1a5	Changes targets api (#961) ... * changes /targets api adds html response if requester accepts text/html, adds quick template for /targets api, fixes pathPrefix for / requests * changes namings * renamed targets file * Update app/victoria-metrics/main.go Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com> * adds trimspace to qtpl, moves content-type for targets response closer to writer * fixes bug with prefix Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>	2020-12-14 14:13:00 +02:00
Aliaksandr Valialkin	fc82c22e50	docs: consistently use links to https://victoriametrics.github.io for documentation references	2020-12-11 21:09:17 +02:00
Aliaksandr Valialkin	d6f9bf2d19	app/vmselect/graphite: properly handle wildcards and charsets inside curly braces ... For example, `foo{bar*,[a-f]a*b}` should match `foobar`, `foobar123`, `foofab`, etc. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/952	2020-12-11 17:26:32 +02:00
Aliaksandr Valialkin	9e79fc27c8	app/vminsert/netstorage: properly update vm_rpc_rerouted_rows_processed_total metric ... Previously this metric wasn't updated because of improper defer call. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/955 Thanks to @xemxx for spotting the bug.	2020-12-11 13:07:05 +02:00
Aliaksandr Valialkin	1a237c6903	all: properly handle CPU limits set on the host system/container ... This can reduce memory usage on systems with enabled CPU limits. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/946	2020-12-08 21:07:03 +02:00