Nikolay
bb2bcb9725
Adds eureka service discovery ( #913 )
...
* Adds eureka service discovery
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/851
Netflix service discovery for AWS
* Apply suggestions from code review
Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>
2020-11-20 14:02:13 +02:00
John Belmonte
7ac49ac176
MetricsQL docs: parameter consistency ( #915 )
...
* MetricsQL docs: parameter consistency
if I understand correctly:
* `fun(q)` - fun takes instant vector
* `fun(m[d])` - fun takes range vector
* Update docs/MetricsQL.md
Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>
2020-11-20 11:43:07 +02:00
Aliaksandr Valialkin
5e39bedf40
docs/CHANGELOG.md: mention that slow query log now contains remote client address
2020-11-19 12:41:26 +02:00
Aliaksandr Valialkin
8e1f657ef9
lib/logger: follow-up for 09105ff49c
2020-11-19 12:37:05 +02:00
Aliaksandr Valialkin
2af08d6e97
docs/CHANGELOG.md: mention about snap install victoriametrics
2020-11-18 19:50:38 +02:00
Aliaksandr Valialkin
5331349efb
docs: make snap install victoriametrics
more prominent in docs
2020-11-18 19:45:10 +02:00
Aliaksandr Valialkin
f372148203
docs/Single-server-VictoriaMetrics.md: an attempt to fix markdown formatting in Graphite Tags API
section
2020-11-18 14:41:48 +02:00
Aliaksandr Valialkin
e7976363f9
docs: lowercase adidas
trademark according to their request
2020-11-18 13:47:56 +02:00
Aliaksandr Valialkin
a5413aa438
docs/Cluster-VictoriaMetrics.md: adjust RAM sizing recommendations for vmstorage nodes
...
It is recommended to have at least of 50% of free RAM on vmstorage nodes in order handle possible
RAM usage spikes during rolling upgrade for vmstorage nodes when time series
are re-routed from temporarily unavailable node to the remaining active nodes.
2020-11-18 13:02:38 +02:00
Aliaksandr Valialkin
a0a34e2a26
docs/Single-server-VictoriaMetrics.md: make consistent section title sizes
2020-11-18 12:36:22 +02:00
Aliaksandr Valialkin
bf9b6b77c8
docs/Single-server-VictoriaMetrics.md: mention that /internal/force_flush
endpoint is mostly needed for testing and debugging
2020-11-18 01:37:39 +02:00
Aliaksandr Valialkin
c6adcafedb
app/vminsert: export vm_rpc_vmstorage_is_reachable
metric, which can be used for monitoring reachability of vmstorage nodes from vminsert nodes
2020-11-17 22:13:26 +02:00
Aliaksandr Valialkin
a00df790b1
docs/CHANGELOG.md: cut v1.47.0 release
2020-11-16 21:00:21 +02:00
Aliaksandr Valialkin
5454137504
docs/Cluster-VictoriaMetrics.md: make docs-sync
after 57dc152e9d
2020-11-16 20:20:19 +02:00
Aliaksandr Valialkin
6bcbdb18fb
docs/CHANGELOG.md: mention about Graphite Tags API implementation
2020-11-16 15:34:56 +02:00
Aliaksandr Valialkin
eb763bcb9d
app/vmselect/graphite: add /tags/autoComplete/values
handler from Graphite Tags API
2020-11-16 15:29:29 +02:00
Aliaksandr Valialkin
f2f16d8e79
app/vmselect/graphite: add /tags/autoComplete/tags
handler from Graphite Tags API
...
See https://graphite.readthedocs.io/en/stable/tags.html#auto-complete-support
2020-11-16 14:58:10 +02:00
Aliaksandr Valialkin
852aed62f7
app/vmselect/prometheus: improve performance for /api/v1/labels
and /api/v1/label/<labelName>/values
on time ranges exceeding one day when match[]
query arg is set
2020-11-16 13:46:51 +02:00
Aliaksandr Valialkin
467ed68a37
docs/CHANGELOG.md: mention about improved performance for /api/v1/series
on a time range exceeding one day
2020-11-16 12:52:33 +02:00
Aliaksandr Valialkin
eea1be0d5c
app/vmselect/graphite: add /tags/findSeries handler from Graphite Tags API
...
See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags
2020-11-16 12:52:23 +02:00
Aliaksandr Valialkin
5889273920
app/vmselect/graphite: add /tags/<tag_name>
handler for Graphite Tags API
2020-11-16 03:41:41 +02:00
Aliaksandr Valialkin
99cb1a70cf
app/vmselect/graphite: add /tags
handler from Graphite Tags API
...
See https://graphite.readthedocs.io/en/stable/tags.html#exploring-tags
2020-11-16 02:57:20 +02:00
Aliaksandr Valialkin
4be5b5733a
app/vminsert: add /tags/tagSeries
and /tags/tagMultiSeries
handlers from Graphite Tags API
...
See https://graphite.readthedocs.io/en/stable/tags.html#adding-series-to-the-tagdb
2020-11-16 02:40:04 +02:00
Aliaksandr Valialkin
2ac5f00d98
app/vmselect: propagate errors from vmstorage
to response to the client if -search.denyPartialResponse
command-line flag is set
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/891
This commit also adds `"isPartial":{true|false}` field to `/api/v1/*` responses. `"isPartial":true` is set when the response
is based on a partial data because some of vmstorage nodes weren't available during query processing.
2020-11-14 13:20:10 +02:00
Aliaksandr Valialkin
c329aacedf
docs/Single-server-VictoriaMetrics.md: document /internal/force_flush
endpoint
2020-11-13 18:43:40 +02:00
Aliaksandr Valialkin
f19547039a
docs/Single-server-VictoriaMetrics.md: explain why recently inserted data may be unavailable for querying for a few seconds
2020-11-13 18:34:31 +02:00
Aliaksandr Valialkin
1364dfdd8c
docs/CHANGELOG.md: mentioned that Go builder has been updated from v1.15.4 to v1.15.5
...
See 3fa9ab4a49
for details.
2020-11-13 16:22:18 +02:00
Aliaksandr Valialkin
cc4da051f3
docs/Single-server-VictoriaMetrics.md: sync with single-node README.md
2020-11-13 16:03:50 +02:00
Aliaksandr Valialkin
da6d82a8dd
app/vmselect/promql: assume that time series value doesnt change during gaps when calculating increase() and delta()
...
This should remove unexpected spikes at the end of gaps.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/894
2020-11-13 14:59:32 +02:00
Aliaksandr Valialkin
739b88c1e4
lib/protoparser/promremotewrite: forward errors, which can occur during data ingestion, to the caller of ParseStream, so it could properly return HTTP 503 status code on non-nil error
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/896
2020-11-13 11:00:41 +02:00
Aliaksandr Valialkin
7ceaf4ba8f
all: consistently return text-based HTTP responses with charset=utf-8
...
This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/897
2020-11-13 10:30:21 +02:00
Aliaksandr Valialkin
f7a6ae3d11
docs/vmagent.md: added a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2 into Relabeling
section
2020-11-12 12:27:13 +02:00
Aliaksandr Valialkin
069979c367
docs/vmagent.md: typo fix
2020-11-11 16:05:04 +02:00
Aliaksandr Valialkin
7a0094adae
docs/vmagent.md: add Configuration update
section
2020-11-11 16:01:21 +02:00
Aliaksandr Valialkin
94842ed942
docs/Single-server-VictoriaMetrics.md: document -search.treatDotsAsIsInRegexps
command-line option
2020-11-11 14:59:38 +02:00
Aliaksandr Valialkin
6b979ea5a7
docs/Single-server-VictoriaMetrics.md: small clarifications in VictoriaMetrics features
2020-11-11 13:48:16 +02:00
Aliaksandr Valialkin
20d0ead2f2
docs/Single-server-VictoriaMetrics.md: update the link to enterprise features
2020-11-11 13:42:42 +02:00
Aliaksandr Valialkin
779f591bcc
docs/Single-server-VictoriaMetrics.md: mention that /api/v1/status/tsdb
handler accepts topN
and date
query args
2020-11-11 13:38:26 +02:00
Aliaksandr Valialkin
8033e4885b
docs/Cluster-VictoriaMetrics.md: mention about optional topN and date query args for /api/v1/status/tsdb
handler
2020-11-11 13:35:13 +02:00
Aliaksandr Valialkin
4f2c5877db
app/vmselect: add -search.treatDotsAsIsInRegexps
command-line flag for automatic escaping of dots in regexp label filters
2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin
0769f86a7e
docs/Single-server-VictoriaMetrics.md: clarify which directories can be removed when recovering from data corruption
2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin
346181fd48
docs/Single-server-VictoriaMetrics.md: add a hint that case studies can be read by clicking on the corresponding link
2020-11-11 12:40:28 +02:00
Aliaksandr Valialkin
697fd44158
lib/promscrape: make a copy of ScrapeWork from discovered []ScrapeWork slice instead of referring to an item in this slice
...
This should prevent from holding previously discovered []ScrapeWork slices when a part of discovered targets changes over time.
This should reduce memory usage for the case when big number of discovered scrape targets changes over time.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825
2020-11-10 16:13:31 +02:00
Aliaksandr Valialkin
8f3339fa81
app/vmselect/promql: do not return data points in the end of the selected time range for time series ending in the middle of the selected time range
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/887
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/845
2020-11-10 14:51:55 +02:00
Aliaksandr Valialkin
6ae9d79f6b
docs/CHANGELOG.md: mention abot explicit setting of extra labels in alert entities (see 3adf8c5a6f
)
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/870
2020-11-10 00:41:31 +02:00
Aliaksandr Valialkin
ad82b6ead8
Move CHANGELOG.md to docs/CHANGELOG.md
2020-11-10 00:37:15 +02:00
Aliaksandr Valialkin
a8562d643b
lib/promscrape: add -promscrape.dropOriginalLabels
command-line flag for reducing memory usage when discovering big number of scrape targets
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/825
2020-11-10 00:20:49 +02:00
Aliaksandr Valialkin
96e9deecbc
docs/Single-server-VictoriaMetrics.md: typo fix
2020-11-08 13:40:52 +02:00
Aliaksandr Valialkin
a8ad3091e3
CHANGELOG.md: cut v1.46.0
2020-11-07 17:54:10 +02:00
Aliaksandr Valialkin
d2296b7e09
docs/CHANGELOG.md: make docs-sync
2020-11-07 16:30:41 +02:00
Aliaksandr Valialkin
6ca5a94359
docs/CHANGELOG.md: add CHANGELOG
header
2020-11-07 01:14:49 +02:00
Aliaksandr Valialkin
efebc3b6fb
app/vmselect/promql: code cleanup after 43823addea
2020-11-06 01:31:33 +02:00
Aliaksandr Valialkin
8accbc14d8
docs/Articles.md: add a link to https://valyala.medium.com/how-to-use-relabeling-in-prometheus-and-victoriametrics-8b90fc22c4b2
2020-11-05 19:18:13 +02:00
Aliaksandr Valialkin
6ce80425a6
docs/MetricsQL.md: fix a link to with templates
page
2020-11-05 16:12:59 +02:00
Aliaksandr Valialkin
60747c5f14
docs/Articles.md: move third-party articles to the top
2020-11-05 15:03:50 +02:00
Aliaksandr Valialkin
bf28bc3792
docs: add CHANGELOG.md
2020-11-05 14:59:17 +02:00
Aliaksandr Valialkin
1336e47c86
docs/vmagent.md: update after 4c808d58bf
2020-11-04 20:33:49 +02:00
Nikolay
5b235b902b
Adds ready probe ( #874 )
...
* adds leading forward slash check for scrapeURL path
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/835
* adds ready probe for scrape config initialization,
it should prevent metrics loss during vmagent rolling update,
/ready api will return 425 http code, if some scrape config still waits for initialization.
* updates docs
* Update app/vmagent/README.md
* renames var
* Update app/vmagent/README.md
Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>
2020-11-04 20:33:48 +02:00
Aliaksandr Valialkin
d8a7186019
docs/CaseStudies.md: add case study for Idealo.de
2020-11-04 20:19:26 +02:00
Aliaksandr Valialkin
2cd86d0220
lib/promscrape: docs update after e4182dd896
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878
2020-11-04 17:13:34 +02:00
Nikolay
d0a9b24c5a
reduces memory usage for vmagent, ( #880 )
...
* reduces memory usage for vmagent,
limits count of droppedTarget, that can be stored for /api/v1/targets page up to 999 items,
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/878
* Update app/vmagent/README.md
* Update app/vmagent/README.md
Co-authored-by: Aliaksandr Valialkin <valyala@gmail.com>
2020-11-04 17:13:33 +02:00
Aliaksandr Valialkin
407a46c11e
Revert "docs/vmagent.md: mention about -promscrape.dropOriginalLabels
"
...
This reverts commit 1a80acc712
.
2020-11-04 11:45:35 +02:00
Aliaksandr Valialkin
1a80acc712
docs/vmagent.md: mention about -promscrape.dropOriginalLabels
2020-11-04 11:16:16 +02:00
Aliaksandr Valialkin
40a4f5ded4
docs/MetricsQL.md: add missing whitespace
2020-11-02 23:49:45 +02:00
Aliaksandr Valialkin
ed724d25ba
lib/promscrape: add stream parse
mode for efficient scraping of targets that expose millions of metrics
2020-11-01 23:12:26 +02:00
Aliaksandr Valialkin
abdf22e0bb
app/vmagent: expose /api/v1/targets
page according to https://prometheus.io/docs/prometheus/latest/querying/api/#targets
...
This page is exposed by vmagent and by a single-node VictoriaMetrics
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/643
2020-10-20 21:55:14 +03:00
Aliaksandr Valialkin
c4464594b7
app/vmselect/promql: allow passing optional third argument to topk_*
and bottomk_*
functions in order to obtain sum of time series outside top/bottom K
2020-10-20 20:09:55 +03:00
Aliaksandr Valialkin
0db7c2b500
app/vmstorage: support for -retentionPeriod
smaller than one month
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/173
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/17
2020-10-20 14:42:46 +03:00
Aliaksandr Valialkin
abdf020e22
docs/vmrestore.md: make docs-sync
2020-10-20 10:49:22 +03:00
Aliaksandr Valialkin
9b91305a31
docs/MetricsQL.md: small clarifications
2020-10-17 12:01:33 +03:00
Aliaksandr Valialkin
6227b71a67
docs: add a link to https://smarketshq.com/monitoring-kubernetes-clusters-41a4b24c19e3 article about VictoriaMetrics
2020-10-16 09:07:55 +03:00
Aliaksandr Valialkin
bc446ec62a
docs/Single-server-VictoriaMetrics.md: update docs
2020-10-14 13:27:01 +03:00
Aliaksandr Valialkin
1634415441
docs/CaseStudies.md: actualize numbers for Wix.com
2020-10-14 13:07:41 +03:00
Aliaksandr Valialkin
e9fec0e5b8
docs/vmalert.md: make docs-sync
2020-10-13 18:35:00 +03:00
Aliaksandr Valialkin
de9d3f1332
docs/Cluster-VictoriaMetrics.md: clarify RAM requirements for vmstorage
nodes
2020-10-13 16:47:25 +03:00
Aliaksandr Valialkin
0867dea5fc
app/vmselect: add ability to export data in CSV format via /api/v1/export/csv
2020-10-12 20:08:08 +03:00
Aliaksandr Valialkin
938b3b7ed1
lib/promscrape: code prettifying after 9bd9f67718
2020-10-12 16:13:59 +03:00
Aliaksandr Valialkin
ac525462ce
docs/MetricsQL.md: mention that VictoriaMetrics keeps metric names after applying functions which dont change time series meaning
2020-10-12 13:25:28 +03:00
Aliaksandr Valialkin
85d507f71d
docs/Single-server-VictoriaMetrics.md: add missing whitespace
2020-10-09 20:56:45 +03:00
Aliaksandr Valialkin
35b8ffaa17
docs/vmagent.md: clarify -promscrape.suppressDuplicateScrapeTargetErrors
command-line flag usage
2020-10-08 19:24:05 +03:00
Aliaksandr Valialkin
0d44e371f3
lib/promscrape: add -promscrape.suppressDuplicateScrapeTargetErrors
command-line flag in order to suppress duplicate scrape target
errors
...
Show also original labels for duplicate targets in error message in order to simplify debugging the issue.
Now `/targets` endpoint accepts optional `show_original_labels=1` query arg, which shows original labels for each target.
This may simplify debugging for target relabeling.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/651
2020-10-08 18:59:25 +03:00
Aliaksandr Valialkin
5d5076c4a2
docs/CaseStudies.md: actualize Wix numbers
2020-10-06 16:09:30 +03:00
Aliaksandr Valialkin
70bb5624ad
docs/Articles.md: add https://medium.com/@VictoriaMetrics/anomaly-detection-in-victoriametrics-9528538786a7
2020-10-06 15:30:07 +03:00
Aliaksandr Valialkin
5f15c52d21
docs: make docs-sync
after cbe3cf683b
2020-10-05 16:48:25 +03:00
Aliaksandr Valialkin
40df42e1e5
docs: make docs-sync
2020-09-30 09:51:16 +03:00
Aliaksandr Valialkin
10b6982ef8
docs/Release-Guide.md: mention that CHANGELOG.md must be updated before release
2020-09-30 08:53:27 +03:00
Aliaksandr Valialkin
536aa8779a
app/vmstorage: rename vm_{big|small}_merge_need_free_disk_space
to vm_merge_need_free_disk_space
...
This simplifies alerting.
2020-09-29 22:53:33 +03:00
Aliaksandr Valialkin
a4361a4c07
docs/Single-server-VictoriaMetrics.md: typo fix
2020-09-29 20:30:26 +03:00
Aliaksandr Valialkin
7ae0ab976a
docs/Single-server-VictoriaMetrics.md: typo fix: compations -> compactions
2020-09-29 20:27:37 +03:00
Aliaksandr Valialkin
f4d74ccfec
docs/{vmbackup,vmrestore}: formatting fixes
2020-09-29 13:19:13 +03:00
Aliaksandr Valialkin
5179df7082
docs/vmbackup.md: make docs about minio config more prominent
2020-09-29 13:16:34 +03:00
Aliaksandr Valialkin
79b00f7b6b
docs: improve readability a bit
2020-09-29 13:05:05 +03:00
Aliaksandr Valialkin
aadbd014ff
all: add native format for data export and import
...
The data can be exported via [/api/v1/export/native](https://victoriametrics.github.io/#how-to-export-data-in-native-format ) handler
and imported via [/api/v1/import/native](https://victoriametrics.github.io/#how-to-import-data-in-native-format ) handler.
2020-09-27 17:36:38 +03:00
Aliaksandr Valialkin
00ec2b7189
lib/protoparser: use all the available CPU cores for processing ingested data from a single /api/v1/import stream
...
Previously a single data ingestion stream to /api/v1/import could load only a single CPU core.
2020-09-26 04:22:06 +03:00
Aliaksandr Valialkin
00ff01f766
docs/Single-server-VictoriaMetrics.md: VictoriaMetrics properly stores Inf values after 26115891db
2020-09-22 17:03:16 +03:00
Aliaksandr Valialkin
ed473c94ff
docs/vmagent.md: typo fix
2020-09-21 21:49:08 +03:00
Aliaksandr Valialkin
bedc971398
docs: make docs-sync
2020-09-21 21:48:05 +03:00
Aliaksandr Valialkin
9b15b11f74
app/vmstorage: added -forceMergeAuthKey
command-line flag for protecting /internal/force_merge
endpoint
2020-09-17 14:24:20 +03:00
Aliaksandr Valialkin
d96858b921
lib/storage: add /internal/force_merge
handler for running forced compactions on historical per-month partitions
...
This may be useful for freeing up storage space after time series deletion.
See https://victoriametrics.github.io/#force-merge for more details.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/686
2020-09-17 12:20:56 +03:00
Aliaksandr Valialkin
2084496462
docs/Single-server-VictoriaMetrics.md: document that /api/v1/series/count may count delete time series
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/770
2020-09-17 01:39:09 +03:00