287 commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	5143e93534	docs/VictoriaLogs/CHANGELOG.md: cut v0.26.1-victorialogs	2024-07-01 02:33:02 +02:00
Aliaksandr Valialkin	208a624d4d	lib/logstorage: properly search for the surrounding logs in stream_context pipe ... The set of log fields in the found logs may differ from the set of log fields present in the log stream. So compare only the log fields in the found logs when searching for the matching log entry in the log stream. While at it, return _stream field in the delimiter log entry, since this field is used by VictoriaLogs Web UI for grouping logs by log streams.	2024-07-01 02:33:00 +02:00
Aliaksandr Valialkin	516c7b2ca0	docs/VictoriaLogs: remove "preview" warning - VictoriaLogs is ready for prod	2024-07-01 01:52:40 +02:00
Aliaksandr Valialkin	0e6ee55a95	docs/VictoriaLogs/CHANGELOG.md: cut v0.26.0-victorialogs	2024-07-01 01:49:55 +02:00
Aliaksandr Valialkin	76a58ae08d	lib/logstorage: add ability to store sorted log position into a separate field with sort ... rank <fieldName> syntax	2024-07-01 01:46:03 +02:00
Aliaksandr Valialkin	d0dca7b8c5	lib/logstorage: add delimiter between log chunks returned from | stream_context pipe	2024-07-01 01:46:02 +02:00
Aliaksandr Valialkin	76053a0ef0	docs/VictoriaLogs: typo fixes	2024-06-28 19:26:32 +02:00
Aliaksandr Valialkin	75c7b2c07a	docs/VictoriaLogs/CHANGELOG.md: cut v0.25.0-victorialogs	2024-06-28 19:18:21 +02:00
Aliaksandr Valialkin	4b3477e62b	lib/logstorage: add stream_context pipe, which allows selecting surrounding logs for the matching logs	2024-06-28 19:15:19 +02:00
Aliaksandr Valialkin	c9fc8079c4	app/vlinsert/syslog: properly skip empty lines in Syslog protocol ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6548	2024-06-28 14:09:45 +02:00
Aliaksandr Valialkin	bb6424aeca	app/vlselect/logsql: add optional fields_limit query arg to /select/logsql/hits HTTP endpoint ... This query arg is needed for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6545 in order to return top N groups with the biggest number of hits.	2024-06-28 03:10:05 +02:00
Aliaksandr Valialkin	3eecc3de8c	docs/VictoriaLogs: typo fixes	2024-06-28 03:10:05 +02:00
Aliaksandr Valialkin	5a24ea6cc3	docs/VictoriaLogs: document how to export logs from VictoriaLogs ... While at it, mention vmctl-like tool for migrating logs from other systems to VictoriaLogs at docs/VictoriaLogs/Roadmap.md Thanks to the question from Xavier Pestel at https://www.linkedin.com/feed/update/urn:li:activity:7212093021301927937?commentUrn=urn%3Ali%3Acomment%3A%28activity%3A7212093021301927937%2C7212171550651731969%29&dashCommentUrn=urn%3Ali%3Afsd_comment%3A%287212171550651731969%2Curn%3Ali%3Aactivity%3A7212093021301927937%29	2024-06-28 02:06:24 +02:00
Aliaksandr Valialkin	05365999ea	docs/VictoriaLogs/querying/README.md: clarify live tailing docs	2024-06-27 19:12:54 +02:00
Aliaksandr Valialkin	4391ef25e9	docs/VictoriaLogs/Roadmap.md: remove Web UI from roadmap, since it is already implemented ... See https://docs.victoriametrics.com/victorialogs/querying/#web-ui While at it, add DataDog protocol for logs into 'data ingestion protocols' roadmap.	2024-06-27 19:12:54 +02:00
Aliaksandr Valialkin	00899506f7	docs/VictoriaLogs/querying: remove unused and outdated vmui.webp image ... The image has been deleted from the docs/VictoriaLogs/querying/README.md file in the commit 87f1c8bd6c	2024-06-27 15:16:43 +02:00
Aliaksandr Valialkin	13df75a28b	docs/VictoriaLogs/querying/README.md: add a link to live tailing docs from querying log docs	2024-06-27 15:12:59 +02:00
Aliaksandr Valialkin	b26acec9a8	app/vlselect: properly return live tailing results	2024-06-27 15:06:15 +02:00
Aliaksandr Valialkin	dd62a2b9d6	lib/logstorage: work-in-progress	2024-06-27 14:21:03 +02:00
Aliaksandr Valialkin	75d45068a5	docs/VictoriaLogs/README.md: document the relation between -retention.maxDiskSpaceUsageBytes and -retentionPeriod command-line flags	2024-06-26 12:03:29 +02:00
Yury Molodov	6bde0196d8	vmui/logs: fix the update of the relative time range (#6517) ... ### Describe Your Changes - Fixed the update of the relative time range when `Execute Query` is clicked - Optimized server requests: now, if an error occurs in the `/query` request, the `/hits` request will not be executed. #6345 (duplicates: #6440, #6312) (cherry picked from commit 43342745ac)	2024-06-26 11:26:08 +02:00
Aliaksandr Valialkin	d5cbda3424	app/vlstorage: add -retention.maxDiskSpaceUsageBytes command-line flag for limiting the retention at VictoriaLogs by disk space usage	2024-06-25 17:30:46 +02:00
Aliaksandr Valialkin	252ff71a49	docs/VictoriaLogs/data-ingestion/README.md: document that Rsyslog and Syslog-ng can be used for ingesting logs into VictoriaLogs	2024-06-25 15:15:53 +02:00
Aliaksandr Valialkin	0a88a55ae0	docs/VictoriaLogs/CHANGELOG.md: cut v0.23.0-victorialogs release	2024-06-25 14:59:31 +02:00
Aliaksandr Valialkin	f24123a776	lib/logstorage: parse syslog structured data into separate fields in order to simplify further querying of this data	2024-06-25 14:54:25 +02:00
Aliaksandr Valialkin	1716c4e609	lib/logstorage: properly parse timezone offset at TryParseTimestampRFC3339Nano() ... The TryParseTimestampRFC3339Nano() must properly parse RFC3339 timestamps with timezone offsets. While at it, make tryParseTimestampISO8601 function private in order to prevent from improper usage of this function from outside the lib/logstorage package. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6508	2024-06-25 14:54:24 +02:00
Aliaksandr Valialkin	813a7aec6c	docs: return back spellcheck fixes from the commit 92b22581e6, which were accidentally reverted in 45cf83cd8f ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6470	2024-06-25 02:33:59 +02:00
Aliaksandr Valialkin	7f2b491748	Revert "docs: Add spellcheck workflow (#6470)" ... This reverts commit 92b22581e6. Reason for revert: too complex and slow approach for spellchecking task. This approach may significantly slow down development pace. It also may take non-trivial amounts of additional time and resources at CI/CD because of all this npm shit at cspell directory. Note to @arkid15r : the idea with the ability to run spellchecker on all the VictoriaMetrics codebase is great. But this shouldn't be mandatory pre-commit check. It is enough to have a Makefile rule like `make spellcheck`, which could be run manually whenever spellcheck is needed (e.g. once per month or once per quarter).	2024-06-25 02:28:38 +02:00
Aliaksandr Valialkin	7de6f5b4ce	lib/logstorage: work-in-progress	2024-06-25 00:44:57 +02:00
Arkadii Yakovets	c454084eb1	docs: Add spellcheck workflow (#6470) ... ### Describe Your Changes This is a follow-up PR containing workflow related part of the initial [PR#6362](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6362). It adds spell checking control based on [cspell](https://github.com/streetsidesoftware/cspell). The related configs are consolidated under `cspell` directory. You can add VictoriaMetrics specific terms into `cspell/custom-dict.txt` (it contains ~30 items atm). All other absent commonly used terms should be added directly to respective [cspell-dicts](https://github.com/streetsidesoftware/cspell-dicts/blob/main/CONTRIBUTING.md). ### Checklist The following checks are **mandatory**: - [x] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). --------- Signed-off-by: Arkadii Yakovets <ark@victoriametrics.com> (cherry picked from commit 92b22581e6)	2024-06-24 12:50:13 +02:00
Aliaksandr Valialkin	d5224f3363	lib/logstorage: work-in-progress	2024-06-20 03:10:37 +02:00
Yury Molodov	88650abf97	vmui/logs: add bar chart (#6461) ... - Added a bar chart displaying the number of log entries over a time range. #6404 - When `_msg` is empty, all fields are displayed in a single line. - Added double quotes when copying pairs: `key: "value"`. - Minor style adjustments. (cherry picked from commit 32fbffedd9)	2024-06-18 15:28:56 +02:00
Aliaksandr Valialkin	0ee360b48c	docs/VictoriaLogs/CHANGELOG.md: typo fix in the release date for v0.20.2-victorialogs	2024-06-18 00:28:49 +02:00
Aliaksandr Valialkin	ee114ca59c	app/vlinsert: properly parse timestamps with nanosecond precision at /insert/jsonline HTTP endpoint ... This has been broken in 2b6a634ec0	2024-06-18 00:24:11 +02:00
Aliaksandr Valialkin	7658cc36a6	docs/VictoriaLogs/CHANGELOG.md: cut v0.20.1-victorialogs	2024-06-17 23:29:28 +02:00
Aliaksandr Valialkin	c10a646d19	app/vlinsert/syslog: allow accepting syslog messages with different configs at different ports	2024-06-17 23:16:58 +02:00
Aliaksandr Valialkin	f74e6b0674	app/vlinsert: properly parse length-delimited syslog messages sent over TCP according to RFC5425	2024-06-17 22:30:28 +02:00
Aliaksandr Valialkin	938862946c	docs/VictoriaLogs: mention which collectors support sending logs to VictoriaLogs in syslog format	2024-06-17 13:13:51 +02:00
Aliaksandr Valialkin	1750991119	lib/logstorage: work-in-progress	2024-06-17 12:13:25 +02:00
Artem Navoiev	6c587eefbf	docs: add more redirects ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com> (cherry picked from commit d1baa41b6a)	2024-06-14 13:26:47 +02:00
Aliaksandr Valialkin	27efb9499b	docs/VictoriaLogs/logsql-examples.md: added an example on how to search for a phrase with whitespace	2024-06-11 19:13:47 +02:00
Aliaksandr Valialkin	9135b404d9	lib/logstorage: work-in-progress	2024-06-11 17:51:01 +02:00
Aliaksandr Valialkin	37a8cc0b12	lib/logstorage: work-in-progress	2024-06-10 18:42:31 +02:00
Yury Molodov	2300e30ff3	vmui/logs: add markdown support (#6292) ... Add support for markdown format and emoji for the `_msg` field in the "Group" view. Add markdown rendering toggle. Disabled by default. Value is stored in `localStorage`.	2024-06-10 16:39:25 +02:00
Artem Navoiev	d6b56a1460	docs victorialogs: add alias for quickstart for VL to be consistent with other quickstarts ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com> (cherry picked from commit 318e9e9de0)	2024-06-10 12:37:19 +02:00
Aliaksandr Valialkin	53382ae837	lib/logstorage: work-in-progress	2024-06-06 12:27:11 +02:00
Aliaksandr Valialkin	6d986f731b	docs/VictoriaLogs/CHANGELOG.md: document the a68c2c0f17	2024-06-06 12:21:47 +02:00
Aliaksandr Valialkin	c6b6900152	docs/VictoriaLogs/LogsQL.md: typo fix: replace from _json with from _msg where appropriate	2024-06-05 10:15:56 +02:00
Aliaksandr Valialkin	be4aefd133	docs/VictoriaLogs/LogsQL.md: substitute TAG with APP-NAME[PROCID] in rfc3164 syslog message format at unpack_syslog pipe docs	2024-06-05 10:13:58 +02:00
Aliaksandr Valialkin	a200fb433a	lib/logstorage: allow using eval keyword instead of math keyword in math pipe	2024-06-05 10:08:08 +02:00
Aliaksandr Valialkin	f8336783c8	docs/VictoriaLogs/LogsQL.md: typo fix: substitute "'" with "" in front of John`	2024-06-05 09:51:29 +02:00
Aliaksandr Valialkin	9e79a632c1	docs/VictoriaLogs/LogsQL.md: typo fix: its -> it	2024-06-05 09:46:35 +02:00
Aliaksandr Valialkin	b45e466a1b	lib/logstorage: work-in-progress	2024-06-05 03:18:25 +02:00
Aliaksandr Valialkin	1a1ee87b46	docs/VictoriaLogs/LogsQL.md: mention unpack_syslog pipe in the Transformations section	2024-06-04 03:17:14 +02:00
Aliaksandr Valialkin	7d31574071	docs/VictoriaLogs/Roadmap.md: remove LogsQL transformations from roadmap, since they are already implemented	2024-06-04 02:21:23 +02:00
Aliaksandr Valialkin	39d238592c	docs/VictoriaLogs/logsql-examples.md: typo fix	2024-06-04 02:17:59 +02:00
Aliaksandr Valialkin	53928a44d1	docs/VictoriaLogs/logsql-examples.md: typo fix	2024-06-04 02:10:56 +02:00
Aliaksandr Valialkin	b7b3a9e9a3	lib/logstorage: work-in-progress	2024-06-04 01:50:55 +02:00
Arkadii Yakovets	a6655322b1	docs: fix docs/ and README.md spelling errors (#6362) ... Fixes `docs/` and `README.md` typos and errors. Signed-off-by: Arkadii Yakovets <ark@victoriametrics.com> (cherry picked from commit c740a8042e) Signed-off-by: hagen1778 <roman@victoriametrics.com>	2024-06-03 11:53:33 +02:00
Aliaksandr Valialkin	b994e64567	docs/VictoriaLogs: typo fixes	2024-05-30 16:35:25 +02:00
Aliaksandr Valialkin	2fd8cf15c4	deployment/docker: update VictoriaLogs Docker image from v0.14.0-victorialogs to v0.15.0-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.15.0-victorialogs	2024-05-30 16:27:53 +02:00
Aliaksandr Valialkin	540bbb63a2	lib/logstorage: work-in-progress	2024-05-30 16:19:36 +02:00
Aliaksandr Valialkin	e83fd4a117	lib/logstorage: work-in-progress	2024-05-29 01:52:34 +02:00
Aliaksandr Valialkin	6ddc618731	docs/VictoriaLogs: typo fixes	2024-05-28 22:48:57 +02:00
Aliaksandr Valialkin	2395c7e65e	deployment/docker: update VictoriaLogs image from v0.12.1-victorialogs to v0.13.0-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.13.0-victorialogs	2024-05-28 22:16:30 +02:00
Aliaksandr Valialkin	79c03fc35f	lib/logstorage: work-in-progress	2024-05-28 19:29:50 +02:00
Aliaksandr Valialkin	d429c0b83e	deployment: update VictoriaLogs image from v0.12.0-victorialogs to v0.12.1-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.12.1-victorialogs	2024-05-26 02:08:52 +02:00
Aliaksandr Valialkin	afa597ce2a	lib/logstorage: work-in-progress	2024-05-26 01:56:12 +02:00
Aliaksandr Valialkin	6427b3c3c0	lib/logstorage: work-in-progress	2024-05-25 22:59:21 +02:00
Aliaksandr Valialkin	f02c5cb79a	docs/VictoriaLogs/CHANGELOG.md: cut v0.12.0-victorialogs	2024-05-25 21:40:20 +02:00
Aliaksandr Valialkin	03fe4c8963	lib/logstorage: work-in-progress	2024-05-25 21:36:24 +02:00
Aliaksandr Valialkin	3152df2bce	lib/logstorage: work-in-progress	2024-05-25 00:31:55 +02:00
Aliaksandr Valialkin	db48642302	deployment: update Docker image tag for VictoriaLogs from v0.8.0-victorialogs to v0.10.0-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.10.0-victorialogs	2024-05-24 03:16:06 +02:00
Aliaksandr Valialkin	e5ca4fff76	docs/VictoriaLogs/CHANGELOG.md: cut v0.10.0-victorialogs	2024-05-24 03:08:29 +02:00
Aliaksandr Valialkin	7a2a2f173e	lib/logstorage: work-in-progress	2024-05-24 03:07:07 +02:00
Aliaksandr Valialkin	ae8b2bcf2e	app/vlselect: fix loading web UI	2024-05-22 23:25:00 +02:00
Aliaksandr Valialkin	2befafa264	docs/VictoriaLogs/LogsQL.md: mention that it is better from performance PoV parsing JSON and logfmt logs before the ingestion into VictoriaLogs	2024-05-22 23:04:48 +02:00
Aliaksandr Valialkin	181b5c5437	docs/VictoriaLogs/LogsQL.md: typo fixes	2024-05-22 22:24:56 +02:00
Aliaksandr Valialkin	802d7edd0e	docs/VictoriaLogs/CHANGELOG.md: cut v0.8.0-victorialogs	2024-05-22 22:07:38 +02:00
Alexander Marshalov	0b70c4c1f1	[vmlogs] fixed time parsing with millisecond precision time (#6293) (#6295) ... fix for #6293 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2024-05-22 21:54:50 +02:00
Yury Molodov	252a196405	vmui/logs: fix parsing long _msg values (#6310) ... This PR fixes an issue where parsing long `_msg` values caused errors, resulting in some log records not being displayed. The error occurred due to partial processing of strings. In some cases, a long record could be split into multiple chunks, causing only part of the record to be processed instead of the entire entry. #6281 Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2024-05-22 21:44:49 +02:00
Aliaksandr Valialkin	04d0dd2542	lib/logstorage: work-in-progress	2024-05-22 21:01:28 +02:00
Artem Navoiev	f4743dcef2	docs: victorialogs mention that our bench suite can be run against Loki as well ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com> (cherry picked from commit cee4bfebd7)	2024-05-21 16:37:21 +02:00
Yury Molodov	97c3c946a7	vmui/logs: change time range to start and end query args (#6296) ... change time range limitation from `_time` in the expression to `start` and `end` query args. (cherry picked from commit a6a599cbdc)	2024-05-20 14:46:39 +02:00
Aliaksandr Valialkin	10dd940c54	docs/VictoriaLogs: typo fixes	2024-05-20 04:48:42 +02:00
Aliaksandr Valialkin	18982e1ab7	docs/VictoriaLogs/LogsQL.md: typo fix	2024-05-20 04:27:44 +02:00
Aliaksandr Valialkin	b02d085a52	docs/VictoriaLogs/LogsQL.md: typo fix	2024-05-20 04:24:34 +02:00
Aliaksandr Valialkin	400f43dd48	deployment: update VictoriaLogs from v0.6.0-victorialogs to v0.8.0-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.8.0-victorialogs	2024-05-20 04:17:51 +02:00
Aliaksandr Valialkin	582e7d5439	lib/logstorage: work-in-progress	2024-05-20 04:09:15 +02:00
Aliaksandr Valialkin	473c7a344c	docs/VictoriaLogs/CHANGELOG.md: cut v0.7.0-victorialogs ... (cherry picked from commit 6fdba8599d)	2024-05-16 09:35:57 +02:00
Aliaksandr Valialkin	28626db066	lib/logstorage: work-in-progress ... (cherry picked from commit 0aa19a2837)	2024-05-16 09:35:55 +02:00
Aliaksandr Valialkin	8af6c80bf2	docs/VictoriaLogs/CHANGELOG.md: cut v0.6.1-victorialogs	2024-05-14 03:07:02 +02:00
Aliaksandr Valialkin	b1ee7bca1a	lib/logstorage: work-in-progress	2024-05-14 03:06:02 +02:00
Aliaksandr Valialkin	f52275bbd7	lib/logstorage: work-in-progress ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6258	2024-05-14 01:49:58 +02:00
Aliaksandr Valialkin	3c645c4a79	deployment: update VictoriaLogs Docker image from v0.5.2-victorialogs to v0.6.0-victorialogs ... See https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.6.0-victorialogs	2024-05-12 23:23:05 +02:00
Aliaksandr Valialkin	b24daf7712	docs/VictoriaLogs/LogsQL.md: cross-reference uniq pipe with uniq_values stats function	2024-05-12 16:48:12 +02:00
Aliaksandr Valialkin	3ba65c5804	docs/VictoriaLogs/CHANGELOG.md: cut v0.6.0-victorialogs	2024-05-12 16:38:09 +02:00
Aliaksandr Valialkin	147704aab0	lib/logstorage: initial implementation of pipes in LogsQL ... See https://docs.victoriametrics.com/victorialogs/logsql/#pipes	2024-05-12 16:36:01 +02:00
Aliaksandr Valialkin	baf5c8d6d0	all: replace old https://docs.victoriametrics.com/keyConcepts.html url with the new one - https://docs.victoriametrics.com/keyconcepts/	2024-04-18 02:34:09 +02:00
Aliaksandr Valialkin	728aceebfe	all: replace old https://docs.victoriametrics.com/vmauth.html url with the new one - https://docs.victoriametrics.com/vmauth/	2024-04-18 01:50:16 +02:00