github-mirrors/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00
Code Issues Projects Releases Packages Wiki Activity
6481 commits 150 branches 748 tags 347 MiB
Commit graph

6481 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alexander Marshalov
bf081d157e
jsonline support for data ingestion in vlinsert (#4487) 
added json lines / json stream format for ingestion to vlinsert
 2023-06-21 15:31:28 +02:00
Artem Navoiev
e87c38c5d3 use latest image in example for VictoriaLogs and VictoriaMetrics to simplify the flow 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 05:17:30 -07:00
Artem Navoiev
d870d9b948
docs: change wording in victorialogs benchmarks section 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 14:10:56 +02:00
Artem Navoiev
a8dd4a935e
docs: change wording in victorialogs benchmarks section 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 14:09:43 +02:00
Artem Navoiev
67907ed5a2 fix typos 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 04:21:42 -07:00
Zakhar Bessarab
db10aeb525 docs/VictoriaLogs: add benchmarks section into readme 
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
 2023-06-21 04:21:42 -07:00
Zakhar Bessarab
43585d6c39 docs/VictoriaLogs: add reference to benchmark setup in readme 
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
 2023-06-21 04:21:42 -07:00
hagen1778
a525eb06b6 docs/metricsql: fix typo in expression 
Signed-off-by: hagen1778 <roman@victoriametrics.com>
 2023-06-21 04:14:15 -07:00
Alexander Marshalov
cb383f546a improved vector example for victoria logs 
Signed-off-by: Alexander Marshalov <_@marshalov.org>
 2023-06-21 03:59:31 -07:00
Artem Navoiev
678c2cd0a1 remove grafana notion from vector readme 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 03:59:31 -07:00
Artem Navoiev
b43152f1ce examples add README 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 03:59:31 -07:00
Artem Navoiev
bc6427a44f remove docker from filebeat syslog 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 03:59:31 -07:00
Artem Navoiev
b024e46284 Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-21 03:59:31 -07:00
Aliaksandr Valialkin
7346bb4f03
app/vlselect/logsql: sort query results by _time if their summary size doesnt exceed -select.maxSortBufferSize 2023-06-21 01:11:25 -07:00
Roman Khavronenko
94f516df43
docs/vmalert: specify version requirements for new features (#4480) 
Signed-off-by: hagen1778 <roman@victoriametrics.com>
 2023-06-21 09:44:00 +02:00
Zakhar Bessarab
1ebfea34d4
deployment/logs-benchmark: add benchmark setup (#4470) 
* deployment/logs-benchmark: add benchmark setup

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

* deployment/logs-benchmark: update readme info

- add sizes of uncompressed logs
- add more info about dashboard

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>

---------

Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
 2023-06-21 11:04:03 +04:00
Aliaksandr Valialkin
95b54bb178
docs/VictoriaLogs/README.md: typo fix 2023-06-20 22:35:05 -07:00
Aliaksandr Valialkin
1a96b1350c
docs/VictoriaLogs/README.md: add missing link to quick start docs 2023-06-20 22:33:29 -07:00
Aliaksandr Valialkin
332b295268
docs/VictoriaLogs: change the structure of the docs in order to be more maintainable 
The change is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4477
 2023-06-20 22:23:39 -07:00
Aliaksandr Valialkin
3edc548584
app/vlinsert/elasticsearch: allow empty lines in Elasticsearch bulk protocol 
Empty lines may appear there during debugging and custom client implementation
 2023-06-20 21:23:38 -07:00
Aliaksandr Valialkin
07bd118b1a
app/vlinsert/elasticsearch: optimize parsing command line 
Just search for "create" or "index" substrings there instead of spending CPU time on its parsing
 2023-06-20 21:18:12 -07:00
Aliaksandr Valialkin
4e56b4eb36
docs/url-examples.md: add missing Content-Type: application/json header in curl examples for json data ingestion 
If the `Content-Type: application/json` request header isn't set,
then the server can improperly consume the request body when parsing request parameters
 2023-06-20 21:04:28 -07:00
Aliaksandr Valialkin
e7bf36f0b6
app/vlstorage: log -storageDataPath and basic stats for the opened storage 2023-06-20 20:47:53 -07:00
Aliaksandr Valialkin
ed1e82b523
docs/Single-server-VictoriaMetrics.md: update link to JSON stream format, since the previous link became broken 2023-06-20 20:28:34 -07:00
Aliaksandr Valialkin
00c3dbd15d
app/victoria-logs: add ability to debug data ingestion by passing debug query arg to data ingestion API 2023-06-20 20:02:46 -07:00
Aliaksandr Valialkin
e1e48077cc
docs/VictoriaLogs: mention that VictoriaLogs supports multitenancy and out of order logs ingestion 2023-06-20 18:09:39 -07:00
Aliaksandr Valialkin
b9436d3b4e
docs/Single-server-VictoriaMetrics.md: refer to Slack chat at the top of the docs 2023-06-20 18:09:38 -07:00
Artem Navoiev
88993f3124
change title of the operator doc to match title frontmatter 
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
 2023-06-20 13:40:35 +02:00
Roman Khavronenko
79a5499cb2
vmalert: retry all errors except 4XX status codes (#4461) 
vmalert: retry all errors except 4XX status codes

Retry all errors except 4XX status codes while pushing via remote-write
to the remote storage. Previously, errors like broken connection could
prevent vmalert from retrying the request.

Signed-off-by: hagen1778 <roman@victoriametrics.com>
 2023-06-20 13:24:45 +02:00
Yury Molodov
66b42a6772
vmui: memory leak fix (#4455) 
* fix: optimize the preparation of data for the graph

* fix: optimize tooltip rendering

* fix: optimize re-rendering of the chart

* vmui: memory leak fix
 2023-06-20 11:29:24 +02:00
Aliaksandr Valialkin
7b2748e7a1
docs/VictoriaLogs/LogsQL.md: typo fixes 2023-06-20 00:44:59 -07:00
Aliaksandr Valialkin
be9de2b43c
docs/VictoriaLogs/LogsQL.md: typo fixes 2023-06-20 00:42:51 -07:00
Aliaksandr Valialkin
008728e7b9
docs/VictoriaLogs/LogsQL.md: typo fix 2023-06-20 00:30:42 -07:00
Aliaksandr Valialkin
21226911e4
docs/VictoriaLogs/LogsQL.md: typo fix 2023-06-20 00:28:20 -07:00
Aliaksandr Valialkin
06fa70b612
docs/VictoriaLogs/LogsQL.md: typo fixes 2023-06-20 00:23:12 -07:00
Aliaksandr Valialkin
98d327182d
docs/VictoriaLogs/README.md: typo fixes 2023-06-19 23:46:35 -07:00
Aliaksandr Valialkin
d1448e6777
docs/VictoriaLogs/README.md: document how to run docker image for VictoriaLogs 2023-06-19 23:33:07 -07:00
Aliaksandr Valialkin
a638f5e2bf
app/vmctl/utils: properly use timezone in TestGetTime() 2023-06-19 23:16:50 -07:00
Aliaksandr Valialkin
87b66db47d
app/victoria-logs: initial code release 2023-06-19 22:55:12 -07:00
Aliaksandr Valialkin
aeac39cfd1
lib/storage: do not create flock.lock files at partition directories, since it is created at the Storage level 2023-06-19 22:48:37 -07:00
Aliaksandr Valialkin
0f01eea4e9
lib/netutil: ignore arificial timeout generated by net/http.Server 
This prevents from the inflated vm_tcplistener_read_timeouts_total counter
 2023-06-19 22:46:40 -07:00
Aliaksandr Valialkin
298aab3f54
lib/mergeset: do not create flock.lock file at mergeset table, since it is created at the lib/storage.Storage level 2023-06-19 22:45:31 -07:00
Aliaksandr Valialkin
371182f299
lib/fs: add ReaderAt.Path() function 
This function is going to be used in VictoriaLogs
 2023-06-19 22:42:27 -07:00
Aliaksandr Valialkin
497ec3f3e6
lib/encoding: add MarshalBool/UnmarshalBool and GetUint32s/PutUint32s functions 
These functions are going to be used by VictoriaLogs
 2023-06-19 22:40:55 -07:00
Aliaksandr Valialkin
3409317a67
lib/cgroup: add SetGOGC() function 
This function is going to be used by VictoriaLogs
 2023-06-19 22:39:00 -07:00
Aliaksandr Valialkin
c1bed35b39
lib/bytesutil: substitute parentheses with slashes in ByteBuffer.Path() output, so it can be passed to path manipulating functions 
This is needed for the upcoming VictoriaLogs
 2023-06-19 22:37:26 -07:00
Aliaksandr Valialkin
78eaa056c0
app/vmselect: move common http functionality from app/vmselect/searchutils to lib/httputils 
While at it, move app/vmselect/bufferedwriter to lib/bufferedwriter, since it is going to be used in VictoriaLogs
 2023-06-19 22:34:20 -07:00
Aliaksandr Valialkin
b49d04b3dc
lib/promutils.ParseTime(): add support for timestamps in milliseconds 
See https://stackoverflow.com/questions/76437098/how-to-handle-time-unit-and-step-while-ingesting-or-querying-in-victoriametrics/76438405

Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4459
 2023-06-19 22:25:04 -07:00
Nikolay
5eb5df96e2
lib/storage: creates parts.json on start-up if it not exists. (#4450) 
* lib/storage: creates parts.json on start-up if it not exists.
It fixes migrations from versions below v1.90.0.
Previously parts.json was created only after successful merge.
But if merge was interruped for some reason (OOM or shutdown), parts.json wasn't created and partitions left after interruped merge weren't properly deleted.
Since VM cannot check if it must be removed or not.
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4336

* Apply suggestions from code review

Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>

* Update lib/storage/partition.go

Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>

---------

Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
 2023-06-15 11:19:22 +02:00
Roman Khavronenko
f50f35a8e0
lib/storage: add comment for how mustBeDeleted field should be used (#4454) 
Signed-off-by: hagen1778 <roman@victoriametrics.com>
 2023-06-15 11:17:45 +02:00