6681 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Alexander Marshalov	bf081d157e	jsonline support for data ingestion in vlinsert (#4487) ... added json lines / json stream format for ingestion to vlinsert	2023-06-21 15:31:28 +02:00
Artem Navoiev	e87c38c5d3	use latest image in example for VictoriaLogs and VictoriaMetrics to simplify the flow ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 05:17:30 -07:00
Artem Navoiev	d870d9b948	docs: change wording in victorialogs benchmarks section ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 14:10:56 +02:00
Artem Navoiev	a8dd4a935e	docs: change wording in victorialogs benchmarks section ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 14:09:43 +02:00
Artem Navoiev	67907ed5a2	fix typos ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 04:21:42 -07:00
Zakhar Bessarab	db10aeb525	docs/VictoriaLogs: add benchmarks section into readme ... Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-06-21 04:21:42 -07:00
Zakhar Bessarab	43585d6c39	docs/VictoriaLogs: add reference to benchmark setup in readme ... Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-06-21 04:21:42 -07:00
hagen1778	a525eb06b6	docs/metricsql: fix typo in expression ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-06-21 04:14:15 -07:00
Alexander Marshalov	cb383f546a	improved vector example for victoria logs ... Signed-off-by: Alexander Marshalov <_@marshalov.org>	2023-06-21 03:59:31 -07:00
Artem Navoiev	678c2cd0a1	remove grafana notion from vector readme ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 03:59:31 -07:00
Artem Navoiev	b43152f1ce	examples add README ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 03:59:31 -07:00
Artem Navoiev	bc6427a44f	remove docker from filebeat syslog ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 03:59:31 -07:00
Artem Navoiev	b024e46284	Add docker compose examples: filebeat(docker, syslog), fluentbit(docker), logstash, vector(docker) ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-21 03:59:31 -07:00
Aliaksandr Valialkin	7346bb4f03	app/vlselect/logsql: sort query results by _time if their summary size doesnt exceed -select.maxSortBufferSize	2023-06-21 01:11:25 -07:00
Roman Khavronenko	94f516df43	docs/vmalert: specify version requirements for new features (#4480) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-06-21 09:44:00 +02:00
Zakhar Bessarab	1ebfea34d4	deployment/logs-benchmark: add benchmark setup (#4470) ... * deployment/logs-benchmark: add benchmark setup Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> * deployment/logs-benchmark: update readme info - add sizes of uncompressed logs - add more info about dashboard Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com> --------- Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>	2023-06-21 11:04:03 +04:00
Aliaksandr Valialkin	95b54bb178	docs/VictoriaLogs/README.md: typo fix	2023-06-20 22:35:05 -07:00
Aliaksandr Valialkin	1a96b1350c	docs/VictoriaLogs/README.md: add missing link to quick start docs	2023-06-20 22:33:29 -07:00
Aliaksandr Valialkin	332b295268	docs/VictoriaLogs: change the structure of the docs in order to be more maintainable ... The change is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4477	2023-06-20 22:23:39 -07:00
Aliaksandr Valialkin	3edc548584	app/vlinsert/elasticsearch: allow empty lines in Elasticsearch bulk protocol ... Empty lines may appear there during debugging and custom client implementation	2023-06-20 21:23:38 -07:00
Aliaksandr Valialkin	07bd118b1a	app/vlinsert/elasticsearch: optimize parsing command line ... Just search for "create" or "index" substrings there instead of spending CPU time on its parsing	2023-06-20 21:18:12 -07:00
Aliaksandr Valialkin	4e56b4eb36	docs/url-examples.md: add missing Content-Type: application/json header in curl examples for json data ingestion ... If the `Content-Type: application/json` request header isn't set, then the server can improperly consume the request body when parsing request parameters	2023-06-20 21:04:28 -07:00
Aliaksandr Valialkin	e7bf36f0b6	app/vlstorage: log -storageDataPath and basic stats for the opened storage	2023-06-20 20:47:53 -07:00
Aliaksandr Valialkin	ed1e82b523	docs/Single-server-VictoriaMetrics.md: update link to JSON stream format, since the previous link became broken	2023-06-20 20:28:34 -07:00
Aliaksandr Valialkin	00c3dbd15d	app/victoria-logs: add ability to debug data ingestion by passing debug query arg to data ingestion API	2023-06-20 20:02:46 -07:00
Aliaksandr Valialkin	e1e48077cc	docs/VictoriaLogs: mention that VictoriaLogs supports multitenancy and out of order logs ingestion	2023-06-20 18:09:39 -07:00
Aliaksandr Valialkin	b9436d3b4e	docs/Single-server-VictoriaMetrics.md: refer to Slack chat at the top of the docs	2023-06-20 18:09:38 -07:00
Artem Navoiev	88993f3124	change title of the operator doc to match title frontmatter ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2023-06-20 13:40:35 +02:00
Roman Khavronenko	79a5499cb2	vmalert: retry all errors except 4XX status codes (#4461) ... vmalert: retry all errors except 4XX status codes Retry all errors except 4XX status codes while pushing via remote-write to the remote storage. Previously, errors like broken connection could prevent vmalert from retrying the request. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-06-20 13:24:45 +02:00
Yury Molodov	66b42a6772	vmui: memory leak fix (#4455) ... * fix: optimize the preparation of data for the graph * fix: optimize tooltip rendering * fix: optimize re-rendering of the chart * vmui: memory leak fix	2023-06-20 11:29:24 +02:00
Aliaksandr Valialkin	7b2748e7a1	docs/VictoriaLogs/LogsQL.md: typo fixes	2023-06-20 00:44:59 -07:00
Aliaksandr Valialkin	be9de2b43c	docs/VictoriaLogs/LogsQL.md: typo fixes	2023-06-20 00:42:51 -07:00
Aliaksandr Valialkin	008728e7b9	docs/VictoriaLogs/LogsQL.md: typo fix	2023-06-20 00:30:42 -07:00
Aliaksandr Valialkin	21226911e4	docs/VictoriaLogs/LogsQL.md: typo fix	2023-06-20 00:28:20 -07:00
Aliaksandr Valialkin	06fa70b612	docs/VictoriaLogs/LogsQL.md: typo fixes	2023-06-20 00:23:12 -07:00
Aliaksandr Valialkin	98d327182d	docs/VictoriaLogs/README.md: typo fixes	2023-06-19 23:46:35 -07:00
Aliaksandr Valialkin	d1448e6777	docs/VictoriaLogs/README.md: document how to run docker image for VictoriaLogs	2023-06-19 23:33:07 -07:00
Aliaksandr Valialkin	a638f5e2bf	app/vmctl/utils: properly use timezone in TestGetTime()	2023-06-19 23:16:50 -07:00
Aliaksandr Valialkin	87b66db47d	app/victoria-logs: initial code release	2023-06-19 22:55:12 -07:00
Aliaksandr Valialkin	aeac39cfd1	lib/storage: do not create flock.lock files at partition directories, since it is created at the Storage level	2023-06-19 22:48:37 -07:00
Aliaksandr Valialkin	0f01eea4e9	lib/netutil: ignore arificial timeout generated by net/http.Server ... This prevents from the inflated vm_tcplistener_read_timeouts_total counter	2023-06-19 22:46:40 -07:00
Aliaksandr Valialkin	298aab3f54	lib/mergeset: do not create flock.lock file at mergeset table, since it is created at the lib/storage.Storage level	2023-06-19 22:45:31 -07:00
Aliaksandr Valialkin	371182f299	lib/fs: add ReaderAt.Path() function ... This function is going to be used in VictoriaLogs	2023-06-19 22:42:27 -07:00
Aliaksandr Valialkin	497ec3f3e6	lib/encoding: add MarshalBool/UnmarshalBool and GetUint32s/PutUint32s functions ... These functions are going to be used by VictoriaLogs	2023-06-19 22:40:55 -07:00
Aliaksandr Valialkin	3409317a67	lib/cgroup: add SetGOGC() function ... This function is going to be used by VictoriaLogs	2023-06-19 22:39:00 -07:00
Aliaksandr Valialkin	c1bed35b39	lib/bytesutil: substitute parentheses with slashes in ByteBuffer.Path() output, so it can be passed to path manipulating functions ... This is needed for the upcoming VictoriaLogs	2023-06-19 22:37:26 -07:00
Aliaksandr Valialkin	78eaa056c0	app/vmselect: move common http functionality from app/vmselect/searchutils to lib/httputils ... While at it, move app/vmselect/bufferedwriter to lib/bufferedwriter, since it is going to be used in VictoriaLogs	2023-06-19 22:34:20 -07:00
Aliaksandr Valialkin	b49d04b3dc	lib/promutils.ParseTime(): add support for timestamps in milliseconds ... See https://stackoverflow.com/questions/76437098/how-to-handle-time-unit-and-step-while-ingesting-or-querying-in-victoriametrics/76438405 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4459	2023-06-19 22:25:04 -07:00
Nikolay	5eb5df96e2	lib/storage: creates parts.json on start-up if it not exists. (#4450) ... * lib/storage: creates parts.json on start-up if it not exists. It fixes migrations from versions below v1.90.0. Previously parts.json was created only after successful merge. But if merge was interruped for some reason (OOM or shutdown), parts.json wasn't created and partitions left after interruped merge weren't properly deleted. Since VM cannot check if it must be removed or not. https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4336 * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * Update lib/storage/partition.go Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> --------- Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>	2023-06-15 11:19:22 +02:00
Roman Khavronenko	f50f35a8e0	lib/storage: add comment for how mustBeDeleted field should be used (#4454) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2023-06-15 11:17:45 +02:00