From 5ee582f07f36b25ca65dc9c73c240e0b2ed55683 Mon Sep 17 00:00:00 2001 From: Aliaksandr Valialkin Date: Sun, 19 May 2024 18:54:23 +0200 Subject: [PATCH] wip --- docs/VictoriaLogs/LogsQL.md | 12 ++++++++---- docs/VictoriaLogs/Roadmap.md | 6 +++--- 2 files changed, 11 insertions(+), 7 deletions(-) diff --git a/docs/VictoriaLogs/LogsQL.md b/docs/VictoriaLogs/LogsQL.md index d991af72b..ff4696709 100644 --- a/docs/VictoriaLogs/LogsQL.md +++ b/docs/VictoriaLogs/LogsQL.md @@ -1834,12 +1834,13 @@ See the [Roadmap](https://docs.victoriametrics.com/VictoriaLogs/Roadmap.html) fo ## Transformations -It is possible to perform various transformations on the [selected log entries](#filters) at client side -with `jq`, `awk`, `cut`, etc. Unix commands according to [these docs](https://docs.victoriametrics.com/VictoriaLogs/querying/#command-line). +LogsQL supports the following transformations on the log entries selected with [filters](#filters): -LogsQL will support the following transformations for the [selected](#filters) log entries: +- Extracting arbitrary text from [log fields](https://docs.victoriametrics.com/VictoriaLogs/keyConcepts.html#data-model) according to the provided pattern. + See [these docs](#extract-pipe) for details. + +LogsQL will support the following transformations in the future: -- Extracting the specified fields from text [log fields](https://docs.victoriametrics.com/VictoriaLogs/keyConcepts.html#data-model) according to the provided pattern. - Extracting the specified fields from JSON strings stored inside [log fields](https://docs.victoriametrics.com/VictoriaLogs/keyConcepts.html#data-model). - Extracting the specified fields from [logfmt](https://brandur.org/logfmt) strings stored inside [log fields](https://docs.victoriametrics.com/VictoriaLogs/keyConcepts.html#data-model). @@ -1850,6 +1851,9 @@ LogsQL will support the following transformations for the [selected](#filters) l See the [Roadmap](https://docs.victoriametrics.com/VictoriaLogs/Roadmap.html) for details. +It is also possible to perform various transformations on the [selected log entries](#filters) at client side +with `jq`, `awk`, `cut`, etc. Unix commands according to [these docs](https://docs.victoriametrics.com/VictoriaLogs/querying/#command-line). + ## Post-filters Post-filtering of query results can be performed at any step by using [`filter` pipe](#filter-pipe). diff --git a/docs/VictoriaLogs/Roadmap.md b/docs/VictoriaLogs/Roadmap.md index 4210307b8..67bd62b8e 100644 --- a/docs/VictoriaLogs/Roadmap.md +++ b/docs/VictoriaLogs/Roadmap.md @@ -35,13 +35,13 @@ The following functionality is planned in the future versions of VictoriaLogs: - Syslog - Journald (systemd) - Add missing functionality to [LogsQL](https://docs.victoriametrics.com/VictoriaLogs/LogsQL.html): - - [Stream context](https://docs.victoriametrics.com/VictoriaLogs/LogsQL.html#stream-context). - [Transformation functions](https://docs.victoriametrics.com/VictoriaLogs/LogsQL.html#transformations). + - [Stream context](https://docs.victoriametrics.com/VictoriaLogs/LogsQL.html#stream-context). - Live tailing for [LogsQL filters](https://docs.victoriametrics.com/VictoriaLogs/LogsQL.html#filters) aka `tail -f`. - Web UI with the following abilities: - Explore the ingested logs ([partially done](https://docs.victoriametrics.com/VictoriaLogs/querying/#web-ui)). - - Build graphs over time for the ingested logs. -- Integration with Grafana. + - Build graphs over time for the ingested logs via [hits HTTP API](https://docs.victoriametrics.com/victorialogs/querying/#querying-hits-stats). +- Integration with Grafana ([partially done](https://github.com/VictoriaMetrics/victorialogs-datasource)). - Ability to make instant snapshots and backups in the way [similar to VictoriaMetrics](https://docs.victoriametrics.com/#how-to-work-with-snapshots). - Cluster version of VictoriaLogs. - Ability to store data to object storage (such as S3, GCS, Minio).