Aliaksandr Valialkin
6f05c4d351
lib/storage: improve prioritizing of data ingestion over querying
...
Prioritize also small merges over big merges.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/291
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/648
2020-07-23 13:23:36 +03:00
Aliaksandr Valialkin
ad8d3b387d
docs/Single-server-VictoriaMetrics.md: mention that it is recommended inspecting logs during troubleshooting
2020-07-22 18:21:29 +03:00
Aliaksandr Valialkin
efcbb51968
docs/vmagent.md: sync with app/vmagent/README.md
2020-07-20 17:08:34 +03:00
Aliaksandr Valialkin
ecb1b2564a
app/vmselect/promql: add mode()
aggregate function
2020-07-20 15:31:20 +03:00
Aliaksandr Valialkin
1c641037e8
app/vmselect/promql: add mode_over_time(m[d])
function
...
See https://en.wikipedia.org/wiki/Mode_(statistics) and https://stackoverflow.com/questions/61134078/promql-query-to-return-the-value-from-a-range-vector-which-occurs-maximum-no-of
2020-07-17 18:28:45 +03:00
Aliaksandr Valialkin
df01836818
app/vmselect/promql: keep all labels for time series from any()
call
2020-07-17 15:17:54 +03:00
Aliaksandr Valialkin
328814ee60
docs/vmagent.md: make filtering rules for init container pods less confusing
2020-07-14 20:32:47 +03:00
Aliaksandr Valialkin
4e770e9120
docs/Single-server-VictoriaMetrics.md: remove Roadmap
chapter, since it became outdated
2020-07-14 19:06:33 +03:00
Aliaksandr Valialkin
6d77bfae4f
docs/Single-server-VictoriaMetrics.md: sync with README.md
2020-07-14 14:19:14 +03:00
Aliaksandr Valialkin
619b0a25c9
docs/vmagent.md: sync with app/vmagent/README.md
2020-07-13 21:25:11 +03:00
Aliaksandr Valialkin
ca74b80f10
docs/Cluster-VictoriaMetrics.md: sync with the original README.md
2020-07-10 12:15:31 +03:00
Aliaksandr Valialkin
cba820e390
app/{vminsert,vmagent}: add ability to import data in Prometheus exposition format via /api/v1/import/prometheus
2020-07-10 12:14:07 +03:00
Aliaksandr Valialkin
b66c7c13ac
docs: add a link to the The CMS monitoring infrastructure and applications
publication from CERN
2020-07-08 20:16:43 +03:00
Aliaksandr Valialkin
4f737d1cbd
docs/Cluster-VictoriaMetrics.md: mention about api/v1/status/active_queries
page
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/528
2020-07-08 19:18:26 +03:00
Aliaksandr Valialkin
742da690f4
app/vmselect: add /api/v1/status/active_queries
page with the list of currently running queries
...
This is a follow-up for https://github.com/VictoriaMetrics/VictoriaMetrics/pull/598
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/575
2020-07-08 18:55:38 +03:00
Aliaksandr Valialkin
6daa5f7500
lib/storage: prioritize data ingestion over heavy queries
...
Heavy queries could result in the lack of CPU resources for processing the current data ingestion stream.
Prevent this by delaying queries' execution until free resources are available for data ingestion.
Expose `vm_search_delays_total` metric, which may be used in for alerting when there is no enough CPU resources
for data ingestion and/or for executing heavy queries.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/291
2020-07-05 19:42:05 +03:00
Aliaksandr Valialkin
91b3482894
app/vminsert: add ability to apply relabeling to all the incoming metrics if -relabelConfig
command-line arg points to a file with a list of relabel_config
entries
...
See https://victoriametrics.github.io/#relabeling
2020-07-02 20:39:28 +03:00
Aliaksandr Valialkin
5d3db3ff7c
app/vmselect: add interpolate
function for filling gaps with linearly interpolated values
...
See https://stackoverflow.com/q/62565021/274937 for details
2020-07-02 14:54:21 +03:00
Aliaksandr Valialkin
4dd3de9286
lib/promscrape: add ability to set disable_compression
and disable_keepalive
options in scrape_config
section of the config passed to -promscrape.config
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/580
2020-07-02 14:19:14 +03:00
Aliaksandr Valialkin
63e5ee0d29
docs: sync with upstream
2020-06-29 22:09:03 +03:00
Aliaksandr Valialkin
8f2e88234f
docs: update the info that docker images are built on top of alpine
image now
...
A follow-up after the commit ff624c9125
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/522
2020-06-26 13:54:10 +03:00
Aliaksandr Valialkin
5e35b87c3d
docs/Cluster-VictoriaMetrics.md: move VictoriaMetrics logo below "Cluster version" heading, since it is heeded for proper navigation at https://victoriametrics.github.io
2020-06-24 12:06:27 +03:00
Aliaksandr Valialkin
c85d926569
docs/SampleSizeCalculations.md: updates
2020-06-24 12:06:25 +03:00
Aliaksandr Valialkin
f0cef4761b
docs/SampleSizeCalculations.md: add a doc with calculations for the "Lowest sample size" graph at https://victoriametrics.com/
2020-06-24 12:00:22 +03:00
Aliaksandr Valialkin
e65b4cb6b1
docs/vmalert.md: sync with app/vmalert/README.md
2020-06-23 22:49:38 +03:00
Aliaksandr Valialkin
2a39ba639d
lib/promrelabel: add support for keep_if_equal
and drop_if_equal
actions to relabel configs
...
These actions may be useful for filtering out unneeded targets and/or metrics if they contain equal label values.
For example, the following rule would leave the target only if __meta_kubernetes_annotation_prometheus_io_port
equals __meta_kubernetes_pod_container_port_number:
- action: keep_if_equal
source_labels: [__meta_kubernetes_annotation_prometheus_io_port, __meta_kubernetes_pod_container_port_number]
2020-06-23 17:29:03 +03:00
Aliaksandr Valialkin
530f7a21e8
docs/Single-server-VictoriaMetrics.md: remove -httpListenAddr
command-line flag from setting up VictoriaMetrics
chapter
...
This flag is optional and it has good default value - `:8428`, so there is no need in mentioning it at this chapter
2020-06-22 12:45:20 +03:00
Aliaksandr Valialkin
a43be95e83
docs/Cluster-VictoriaMetrics.md: add high availability
chapter
2020-06-20 15:53:38 +03:00
Aliaksandr Valialkin
f689164711
docs/Single-server-VictoriaMetrics.md: mention that vmauth
could be used for routing user requests to particular VictoriaMetrics instances
2020-06-19 16:16:47 +03:00
Aliaksandr Valialkin
7976ec8bb1
docs/Single-server-VictoriaMetrics.md: add a link to features available for enterprise customers
2020-06-19 13:17:01 +03:00
Aliaksandr Valialkin
9f3e3a4d7a
docs/vmauth.md: mention that we can provide custom integration with SAML
2020-06-19 13:14:07 +03:00
Aliaksandr Valialkin
b542e50680
app/vminsert: export metrics for determining ingested rows with dropped or truncated labels
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/565
2020-06-19 01:10:37 +03:00
Aliaksandr Valialkin
818abca8f1
make docs-sync
2020-06-18 23:55:28 +03:00
Aliaksandr Valialkin
50c0d8c17d
docs/Articles.md: add a link to article https://stas.starikevich.com/posts/raspberry-pi-4-prometheus/
2020-06-18 23:14:04 +03:00
Aliaksandr Valialkin
a12364ad37
docs/vmbackup.md: mention that backups from single-node and cluster versions are incompatible
2020-06-18 18:52:43 +03:00
Aliaksandr Valialkin
e53ee763f9
docs/vmalert.md: sync with app/vmalert/README.md
2020-06-10 19:38:24 +03:00
Aliaksandr Valialkin
6281549f31
docs/Cluster-VictoriaMetrics.md: remove obsolete line
2020-06-04 20:21:37 +03:00
Aliaksandr Valialkin
9f4e86ac2f
docs/Cluster-VictoriaMetrics.md: update stale info about replication
2020-06-04 20:21:36 +03:00
Aliaksandr Valialkin
a47a05dfd2
docs/Cluster-VictoriaMetrics.md: clarify simultaneous usage of replication and deduplication
2020-06-04 18:01:32 +03:00
Aliaksandr Valialkin
78b28a03b6
docs/Single-server-VictoriaMetrics.md: clarify Replication
section
2020-06-03 21:32:42 +03:00
Aliaksandr Valialkin
854f40acf2
docs/FAQ.md: add a question about the difference between vmagent
and Prometheus
2020-06-03 20:56:22 +03:00
Aliaksandr Valialkin
6d059b28bf
docs/Cluster-VictoriaMetrics.md: update Replication and data safety
chapter
2020-06-03 20:24:58 +03:00
Aliaksandr Valialkin
f26b94cfb6
docs/Single-server-VictoriaMetrics.md: mention vmagent in high availability
section
2020-06-03 20:16:02 +03:00
Aliaksandr Valialkin
ff624c9125
deployment/docker: use alpine base image for docker images in order to improve debuggability
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/522
2020-06-02 22:43:19 +03:00
Aliaksandr Valialkin
13b1358c07
docs: update FAQ.md
2020-06-02 19:58:07 +03:00
Aliaksandr Valialkin
f7ff809c1e
docs/vmalert.md: sync with app/vmalert/README.md via make docs-sync
2020-06-02 19:15:15 +03:00
Aliaksandr Valialkin
3d5f48ec74
docs/CaseStudies.md: add a link to articles about VictoriaMetrics
2020-05-28 21:32:43 +03:00
Aliaksandr Valialkin
0ec43cb8b0
docs/Articles.md: added a link to https://medium.com/@IG1.com/sismology-iguana-solutions-monitoring-system-f46e4170447f
2020-05-28 20:10:21 +03:00
Aliaksandr Valialkin
213c3903c9
docs/Cluster-VictoriaMetrics.md: mention that opentsdb/api/put
handler is disabled by default
2020-05-28 14:28:06 +03:00
Aliaksandr Valialkin
ff6d093e1b
docs/Cluster-VictoriaMetrics.md: mention that nginx
can be used as a load balancer in front of vminsert
and vmselect
2020-05-27 18:10:08 +03:00
Aliaksandr Valialkin
8311193293
docs: refresh docs about replication support
2020-05-27 17:48:10 +03:00
Aliaksandr Valialkin
80609fdf35
docs/Cluster-VictoriaMetrics.md: sync with upstream docs
2020-05-27 17:40:01 +03:00
Aliaksandr Valialkin
4cf7238b73
docs/Single-server-VictoriaMetrics.md: add a video to Zerodha talk about monitoring k8s with VictoriaMetrics
2020-05-24 15:51:56 +03:00
Aliaksandr Valialkin
2f35cf13c6
docs/Cluster-VictoriaMetrics.md: mention that cluster components may be monitored with vmagent
2020-05-23 14:29:50 +03:00
Aliaksandr Valialkin
b4103e055a
docs/CaseStudies.md: add a link to a post about VictoriaMetrics histograms in Zerodha case study
2020-05-23 12:45:00 +03:00
Aliaksandr Valialkin
dde29c3c18
docs/CaseStudies.md: add Zerodha case based on monitoring K8s with VictoriaMetrics
slides at https://docs.google.com/presentation/d/1g7yUyVEaAp4tPuRy-MZbPXKqJ1z78_5VKuV841aQfsg/edit
2020-05-23 12:41:25 +03:00
Aliaksandr Valialkin
aa647637bf
docs/Single-server-VictoriaMetrics.md: mention about vmauth
in Security
section
2020-05-21 23:47:56 +03:00
Aliaksandr Valialkin
84860167d0
docs/Cluster-VictoriaMetrics.md: mention about vmauth
service in Multitenancy
chapter
2020-05-21 22:54:19 +03:00
Aliaksandr Valialkin
0101a2d7ca
docs/Single-server-VictoriaMetrics.md: sync with single-node README.md
2020-05-21 20:45:39 +03:00
Aliaksandr Valialkin
b93b01bc6d
docs/vmagent.md: sync with app/vmagent/README.md
2020-05-21 12:11:15 +03:00
Aliaksandr Valialkin
dbd8beccfa
app/vmselect/promql: add ascent_over_time(m[d])
and descent_over_time(m[d])
functions
...
These functions could be useful in GPS tracking apps for calculating the summary for height gain/loss
over the given duration `d`.
2020-05-21 12:07:48 +03:00
Aliaksandr Valialkin
7705c19720
docs/MetricsQL.md: add a link to https://medium.com/@valyala/promql-tutorial-for-beginners-9ab455142085
2020-05-19 23:20:13 +03:00
Aliaksandr Valialkin
80c18b7275
docs/vmagent.md: mention an alternative to refresh_interval
option in scrape configs
2020-05-19 23:10:06 +03:00
Aliaksandr Valialkin
e6a782498a
docs/Quick-Start.md: mention that vmagent
can be used instead of Prometheus in most cases
2020-05-19 14:09:27 +03:00
Aliaksandr Valialkin
a441cdd1d9
app/vmselect/promql: add outliersk(N, m)
aggregate function for anomaly detection across groups of similar time series
2020-05-19 13:52:36 +03:00
Aliaksandr Valialkin
7a8ef517ae
docs/Articles.md: add https://www.robustperception.io/evaluating-performance-and-correctness to third-party posts
2020-05-17 00:35:44 +03:00
Aliaksandr Valialkin
0890c780c2
docs/Single-server-VictoriaMetrics.md: put contact us
email to the top of the page
2020-05-16 22:36:59 +03:00
Aliaksandr Valialkin
fd1a6ce9ae
docs/Single-server-VictoriaMetrics.md: add Replication
and Backups
sections
2020-05-16 22:27:48 +03:00
Aliaksandr Valialkin
9b90c841c6
docs/Cluster-VictoriaMetrics.md: add missing endpoints to the list: api/v1/import/csv
and api/v1/status/tsdb
2020-05-16 22:13:25 +03:00
Aliaksandr Valialkin
23c55181ef
docs/Quick-Start.md: update old link to Docker hub to new link
2020-05-16 10:23:08 +03:00
Aliaksandr Valialkin
8cb35974af
app/vmrestore: document better that vmrestore
works like rsync --delete
, i.e. it deletes files in -storageDataPath
, which are missing in the backup
2020-05-16 09:22:17 +03:00
Aliaksandr Valialkin
82ffbcb9a6
app/vmstorage: add vm_slow_metric_name_loads_total
metric, which could be used as an indicator when more RAM is needed for improving query performance
2020-05-15 14:11:45 +03:00
Aliaksandr Valialkin
82ccdfaa91
app/vmstorage: add vm_slow_row_inserts_total
and vm_slow_per_day_index_inserts_total
metrics for determining whether VictoriaMetrics required more RAM for the current number of active time series
2020-05-15 13:44:32 +03:00
Aliaksandr Valialkin
ab8f5545bc
docs/vmalert.md: sync with app/vmalert/README.md
2020-05-15 13:27:09 +03:00
Aliaksandr Valialkin
21598ac417
docs/vmalert.md: sync with app/vmalert/README.md
2020-05-13 22:55:35 +03:00
Aliaksandr Valialkin
894e5d2b9b
docs/vmbackup.md: add a link to vmbackuper tool
2020-05-13 22:54:22 +03:00
Aliaksandr Valialkin
cc311e20fe
app/vmselect/promql: add any(x) by (y)
aggregate function, which returns any time series from q
for each group y
2020-05-12 19:45:56 +03:00
Aliaksandr Valialkin
574289c3fb
app/vmselect/promql: support for sum(x) by (y) limit N
syntax in order to limit the number of output time series after aggregation
2020-05-12 19:45:54 +03:00
Aliaksandr Valialkin
de113806bb
docs/CaseStudies.md: add CERN case study
2020-05-11 14:05:20 +03:00
Aliaksandr Valialkin
5bc5d6a1f2
docs/Single-server-VictoriaMetrics.md: small updates for Monitoring
and How to start VictoriaMetrics
sections
2020-05-08 20:34:50 +03:00
Aliaksandr Valialkin
baedb25936
docs/vmauth.md: fix a link to docker images
2020-05-08 14:10:04 +03:00
Aliaksandr Valialkin
6909d845b0
docs/Articles.md: add a link to CERN article at https://indico.cern.ch/event/877333/contributions/3696707/attachments/1972189/3281133/CMS_mon_RD_for_opInt.pdf
2020-05-08 01:25:37 +03:00
Aliaksandr Valialkin
6afb25fd08
docs/{vmagent,vmauth}: small clarifications in the docs
2020-05-07 12:55:20 +03:00
Aliaksandr Valialkin
e8936c9cb3
docs/vmagent.md: small fixes
2020-05-06 14:49:18 +03:00
Aliaksandr Valialkin
3f52a97f9b
lib/promscrape: add Prometheus-compatible DNS-based service discovery aka dns_sd_configs
2020-05-06 00:01:58 +03:00
Aliaksandr Valialkin
08320cfcf4
docs/{vmauth,vmagent}: fix ports for profiling
2020-05-05 20:15:47 +03:00
Aliaksandr Valialkin
f65930b34d
docs/vmauth.md: mention that we can help creating customized proxy
2020-05-05 12:34:42 +03:00
Aliaksandr Valialkin
266327642b
docs/{vmagent,vmauth}: add Profiling
section
2020-05-05 11:45:13 +03:00
Aliaksandr Valialkin
0c7cddfca6
docs: add vmauth.md
2020-05-05 11:17:23 +03:00
Aliaksandr Valialkin
b5a780930d
docs/vmagent.md: /targets
page doesnt expose infomration about imporperly configured scrape configs now. It is written in error log instead
2020-05-05 10:54:14 +03:00
Aliaksandr Valialkin
1aea001532
docs/vmalert.md: sync with app/vmalert/README.md
2020-05-05 07:50:57 +03:00
Aliaksandr Valialkin
40c3ffb359
lib/promscrape: add Prometheus-compatible service discovery for Consul aka consul_sd_configs
...
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/330
2020-05-04 20:51:17 +03:00
Aliaksandr Valialkin
6c68b8aa81
docs/Single-server-VictoriaMetrics.md: mention that it is recommended upgrading to the latest release before reporting issues
2020-05-04 00:41:47 +03:00
Aliaksandr Valialkin
23010e6321
docs/Cluster-VictoriaMetrics.md: add Multitenancy
chapter
2020-05-03 18:01:26 +03:00
Aliaksandr Valialkin
d2af2c8c3e
docs/MetricsQL.md: document first_over_time
and last_over_time
functions
2020-05-02 22:43:29 +03:00
Aliaksandr Valialkin
09f5d0056f
docs/Single-server-VictoriaMetrics.md: hint that \n
is a single newline char
2020-05-01 13:41:55 +03:00
Aliaksandr Valialkin
7d36616b93
docs/Single-server-VictoriaMetrics.md: mention that it is better to increase CPU and RAM per vmselect
node in order to achieve higher query performance
2020-04-30 00:53:53 +03:00
Aliaksandr Valialkin
d0ebbb166e
docs: add vmalert.md
2020-04-29 17:42:06 +03:00
Aliaksandr Valialkin
8b2f54d7cd
docs/Single-server-VictoriaMetrics.md: update Alerting
section
2020-04-29 17:39:21 +03:00
Aliaksandr Valialkin
4470308d5b
docs/Single-server-VictoriaMetrics.md: mention that basic downsampling could be made with the help of de-duplication
2020-04-28 16:38:32 +03:00