github-mirrors/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-11-21 14:44:00 +00:00
Code Issues Projects Releases Packages Wiki Activity

fixed victorialogs relative links (#6693)

Browse source 
### Describe Your Changes

Please provide a brief description of the changes you made. Be as
specific as possible to help others understand the purpose and impact of
your modifications.

### Checklist

The following checks are **mandatory**:

- [ ] My change adheres [VictoriaMetrics contributing
guidelines](https://docs.victoriametrics.com/contributing/).
This commit is contained in:
Andrii Chubatiuk 2024-07-24 21:26:02 +03:00 committed by GitHub
parent 386e48eb23
commit 683a69d53d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 422 additions and 422 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

292
docs/VictoriaLogs/CHANGELOG.md
View file

@ -12,7 +12,7 @@ aliases:
- /VictoriaLogs/CHANGELOG.html
---
The following `tip` changes can be tested by building VictoriaLogs from the latest commit of [VictoriaMetrics](https://github.com/VictoriaMetrics/VictoriaMetrics/) repository
according to [these docs](./VictoriaLogs/QuickStart.md#building-from-source-code)
according to [these docs](./QuickStart.md#building-from-source-code)
## tip
@ -20,21 +20,21 @@ according to [these docs](./VictoriaLogs/QuickStart.md#building-from-source-code
Released at 2024-07-10
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): show a spinner on top of bar chart until user's request is finished. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6558).
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): use compact representation of JSON lines at `JSON` tab if only a single [log field](./VictoriaLogs/keyConcepts.md#data-model) is queried. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6559).
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): properly show the number of matching logs on the selected time range at bar chart for queries with arbitrary [pipes](./VictoriaLogs/LogsQL.md#pipes), including [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe) and [`top` pipe](./VictoriaLogs/LogsQL.md#top-pipe).
* FEATURE: [web UI](./querying/README.md#web-ui): show a spinner on top of bar chart until user's request is finished. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6558).
* FEATURE: [web UI](./querying/README.md#web-ui): use compact representation of JSON lines at `JSON` tab if only a single [log field](./keyConcepts.md#data-model) is queried. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6559).
* FEATURE: [web UI](./querying/README.md#web-ui): properly show the number of matching logs on the selected time range at bar chart for queries with arbitrary [pipes](./LogsQL.md#pipes), including [`stats` pipe](./LogsQL.md#stats-pipe) and [`top` pipe](./LogsQL.md#top-pipe).
## [v0.27.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.27.1-victorialogs)
Released at 2024-07-05
* BUGFIX: properly JSON-encode strings with special chars in [HTTP querying API](./VictoriaLogs/querying/README.md#http-api) responses. This fixes the `error decode response: invalid character 'x' in string escape code` error in [VictoriaLogs datasource for Grafana](https://github.com/VictoriaMetrics/victorialogs-datasource/). See [this issue](https://github.com/VictoriaMetrics/victorialogs-datasource/issues/24). The issue has been introduced in the release [v0.9.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.0-victorialogs).
* BUGFIX: properly JSON-encode strings with special chars in [HTTP querying API](./querying/README.md#http-api) responses. This fixes the `error decode response: invalid character 'x' in string escape code` error in [VictoriaLogs datasource for Grafana](https://github.com/VictoriaMetrics/victorialogs-datasource/). See [this issue](https://github.com/VictoriaMetrics/victorialogs-datasource/issues/24). The issue has been introduced in the release [v0.9.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.0-victorialogs).
## [v0.27.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.27.0-victorialogs)
Released at 2024-07-02
* FEATURE: add `-syslog.useLocalTimestamp.tcp` and `-syslog.useLocalTimestamp.udp` command-line flags, which could be used for using the local timestamp as [`_time` field](./VictoriaLogs/keyConcepts.md#time-field) for the logs ingested via the corresponding `-syslog.listenAddr.tcp` / `-syslog.listenAddr.udp`. By default the timestap from the syslog message is used as [`_time` field](./VictoriaLogs/keyConcepts.md#time-field). See [these docs](./VictoriaLogs/data-ingestion/syslog.md).
* FEATURE: add `-syslog.useLocalTimestamp.tcp` and `-syslog.useLocalTimestamp.udp` command-line flags, which could be used for using the local timestamp as [`_time` field](./keyConcepts.md#time-field) for the logs ingested via the corresponding `-syslog.listenAddr.tcp` / `-syslog.listenAddr.udp`. By default the timestap from the syslog message is used as [`_time` field](./keyConcepts.md#time-field). See [these docs](./data-ingestion/syslog.md).
* BUGFIX: make slowly ingested logs visible for search as soon as they are ingested into VictoriaLogs. Previously slowly ingested logs could remain invisible for search for long time.
@ -42,89 +42,89 @@ Released at 2024-07-02
Released at 2024-07-01
* BUGFIX: return the proper surrounding logs for [`stream_context` pipe](./VictoriaLogs/LogsQL.md#stream_context-pipe) when additional [pipes](./VictoriaLogs/LogsQL.md#pipes) are put after the `stream_context` pipe. This has been broken in [v0.26.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.26.0-victorialogs).
* BUGFIX: return the proper surrounding logs for [`stream_context` pipe](./LogsQL.md#stream_context-pipe) when additional [pipes](./LogsQL.md#pipes) are put after the `stream_context` pipe. This has been broken in [v0.26.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.26.0-victorialogs).
## [v0.26.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.26.0-victorialogs)
Released at 2024-07-01
* FEATURE: add ability to return log position (aka rank) after sorting logs with [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe). This can be done by adding `rank as <fieldName>` to the end of `| sort ...` pipe. For example, `_time:5m | sort by (_time) rank as position` instructs storing position of every sorted log line into `position` [field name](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: add delimiter log with `---` message between log chunks returned by [`stream_context` pipe](./VictoriaLogs/LogsQL.md#stream_context-pipe). This should simplify investigation of the returned logs.
* FEATURE: reduce memory usage when big number of context logs are requested from [`stream_context` pipe](./VictoriaLogs/LogsQL.md#stream_context-pipe).
* FEATURE: add ability to return log position (aka rank) after sorting logs with [`sort` pipe](./LogsQL.md#sort-pipe). This can be done by adding `rank as <fieldName>` to the end of `| sort ...` pipe. For example, `_time:5m | sort by (_time) rank as position` instructs storing position of every sorted log line into `position` [field name](./keyConcepts.md#data-model).
* FEATURE: add delimiter log with `---` message between log chunks returned by [`stream_context` pipe](./LogsQL.md#stream_context-pipe). This should simplify investigation of the returned logs.
* FEATURE: reduce memory usage when big number of context logs are requested from [`stream_context` pipe](./LogsQL.md#stream_context-pipe).
## [v0.25.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.25.0-victorialogs)
Released at 2024-06-28
* FEATURE: add ability to select surrounding logs in front and after the selected logs via [`stream_context` pipe](./VictoriaLogs/LogsQL.md#stream_context-pipe). This functionality may be useful for investigating stacktraces, panics or some correlated log messages. This functionality is similar to `grep -A` and `grep -B`.
* FEATURE: add ability to return top `N` `"fields"` groups from [`/select/logsql/hits` HTTP endpoint](./VictoriaLogs/querying/README.md#querying-hits-stats), by specifying `fields_limit=N` query arg. This query arg is going to be used in [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6545).
* FEATURE: add ability to select surrounding logs in front and after the selected logs via [`stream_context` pipe](./LogsQL.md#stream_context-pipe). This functionality may be useful for investigating stacktraces, panics or some correlated log messages. This functionality is similar to `grep -A` and `grep -B`.
* FEATURE: add ability to return top `N` `"fields"` groups from [`/select/logsql/hits` HTTP endpoint](./querying/README.md#querying-hits-stats), by specifying `fields_limit=N` query arg. This query arg is going to be used in [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6545).
* BUGFIX: fix `runtime error: index out of range [0] with length 0` panic when empty lines are ingested via [Syslog format](./VictoriaLogs/data-ingestion/syslog.md) by Cisco controllers. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6548).
* BUGFIX: fix `runtime error: index out of range [0] with length 0` panic when empty lines are ingested via [Syslog format](./data-ingestion/syslog.md) by Cisco controllers. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6548).
## [v0.24.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.24.0-victorialogs)
Released at 2024-06-27
* FEATURE: add `/select/logsql/tail` HTTP endpoint, which can be used for live tailing of [LogsQL query](./VictoriaLogs/LogsQL.md) results. See [these docs](./VictoriaLogs/querying/README.md#live-tailing) for details.
* FEATURE: add `/select/logsql/stream_ids` HTTP endpoint, which can be used for returning [`_stream_id` values](./VictoriaLogs/keyConcepts.md#stream-fields) with the number of hits for the given [LogsQL query](./VictoriaLogs/LogsQL.md). See [these docs](./VictoriaLogs/querying/README.md#querying-stream_ids) for details.
* FEATURE: add `-retention.maxDiskSpaceUsageBytes` command-line flag, which allows limiting disk space usage for [VictoriaLogs data](./VictoriaLogs/README.md#storage) by automatic dropping the oldest per-day partitions if the storage disk space usage becomes bigger than the `-retention.maxDiskSpaceUsageBytes`. See [these docs](./VictoriaLogs/README.md#retention-by-disk-space-usage).
* FEATURE: add `/select/logsql/tail` HTTP endpoint, which can be used for live tailing of [LogsQL query](./LogsQL.md) results. See [these docs](./querying/README.md#live-tailing) for details.
* FEATURE: add `/select/logsql/stream_ids` HTTP endpoint, which can be used for returning [`_stream_id` values](./keyConcepts.md#stream-fields) with the number of hits for the given [LogsQL query](./LogsQL.md). See [these docs](./querying/README.md#querying-stream_ids) for details.
* FEATURE: add `-retention.maxDiskSpaceUsageBytes` command-line flag, which allows limiting disk space usage for [VictoriaLogs data](./README.md#storage) by automatic dropping the oldest per-day partitions if the storage disk space usage becomes bigger than the `-retention.maxDiskSpaceUsageBytes`. See [these docs](./README.md#retention-by-disk-space-usage).
* BUGFIX: properly take into account query timeout specified via `-search.maxQueryDuration` command-line flag and/or via `timeout` query arg. Previously these timeouts could be ignored during query execution.
* BUGFIX: [web UI](./VictoriaLogs/querying/README.md#web-ui): fix the update of the relative time range when `Execute Query` is clicked. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6345).
* BUGFIX: [web UI](./querying/README.md#web-ui): fix the update of the relative time range when `Execute Query` is clicked. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6345).
## [v0.23.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.23.0-victorialogs)
Released at 2024-06-25
* FEATURE: [syslog data ingestion](./VictoriaLogs/data-ingestion/syslog.md): parse [STRUCTURED-DATA](https://datatracker.ietf.org/doc/html/rfc5424#section-6.3) into `SD-ID.field1=value1`, `SD-ID.field2=value2`, ..., `SD-ID.fieldN=valueN` [log fields](./VictoriaLogs/keyConcepts.md#data-model). Previously the `STRUCTURED-DATA` was parsed into a single log field with the `SD-ID` name and `field1=value1 field2=value2 ... fieldN=valueN` value. This could complicate querying of such data.
* FEATURE: [syslog data ingestion](./data-ingestion/syslog.md): parse [STRUCTURED-DATA](https://datatracker.ietf.org/doc/html/rfc5424#section-6.3) into `SD-ID.field1=value1`, `SD-ID.field2=value2`, ..., `SD-ID.fieldN=valueN` [log fields](./keyConcepts.md#data-model). Previously the `STRUCTURED-DATA` was parsed into a single log field with the `SD-ID` name and `field1=value1 field2=value2 ... fieldN=valueN` value. This could complicate querying of such data.
* BUGFIX: properly parse timestamps with timezones during [data ingestion](./VictoriaLogs/data-ingestion/README.md) and [querying](./VictoriaLogs/querying/README.md). This has been broken in [v0.20.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.0-victorialogs). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6508).
* BUGFIX: properly parse timestamps with timezones during [data ingestion](./data-ingestion/README.md) and [querying](./querying/README.md). This has been broken in [v0.20.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.0-victorialogs). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6508).
## [v0.22.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.22.0-victorialogs)
Released at 2024-06-24
* FEATURE: allow specifying multiple `_stream_id` values in [`_stream_id` filter](./VictoriaLogs/LogsQL.md#_stream_id-filter) via `_stream_id:in(id1, ..., idN)` syntax.
* FEATURE: allow specifying subquery for searching for `_stream_id` values inside [`_stream_id` filter](./VictoriaLogs/LogsQL.md#_stream_id-filter). For example, `_stream_id:in(_time:5m error | fields _stream_id)` returns logs for [logs streams](./VictoriaLogs/keyConcepts.md#stream-fields) with the `error` word across logs for the last 5 minutes.
* FEATURE: allow specifying multiple `_stream_id` values in [`_stream_id` filter](./LogsQL.md#_stream_id-filter) via `_stream_id:in(id1, ..., idN)` syntax.
* FEATURE: allow specifying subquery for searching for `_stream_id` values inside [`_stream_id` filter](./LogsQL.md#_stream_id-filter). For example, `_stream_id:in(_time:5m error | fields _stream_id)` returns logs for [logs streams](./keyConcepts.md#stream-fields) with the `error` word across logs for the last 5 minutes.
## [v0.21.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.21.0-victorialogs)
Released at 2024-06-20
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): add a bar chart displaying the number of log entries over a time range. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6404).
* FEATURE: expose `_stream_id` field, which uniquely identifies [log streams](./VictoriaLogs/keyConcepts.md#stream-fields). This field can be used for quick obtaining of all the logs belonging to a particular stream via [`_stream_id` filter](./VictoriaLogs/LogsQL.md#_stream_id-filter).
* FEATURE: [web UI](./querying/README.md#web-ui): add a bar chart displaying the number of log entries over a time range. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6404).
* FEATURE: expose `_stream_id` field, which uniquely identifies [log streams](./keyConcepts.md#stream-fields). This field can be used for quick obtaining of all the logs belonging to a particular stream via [`_stream_id` filter](./LogsQL.md#_stream_id-filter).
## [v0.20.2](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.2-victorialogs)
Released at 2024-06-18
* BUGFIX: properly parse timestamps with nanosecond precision for logs ingested via [jsonline format](./VictoriaLogs/data-ingestion/README.md#json-stream-api). The bug has been introduced in [v0.20.0 release](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.0-victorialogs).
* BUGFIX: properly parse timestamps with nanosecond precision for logs ingested via [jsonline format](./data-ingestion/README.md#json-stream-api). The bug has been introduced in [v0.20.0 release](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.0-victorialogs).
## [v0.20.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.1-victorialogs)
Released at 2024-06-18
* FEATURE: allow configuring multiple receivers with distinct configs for syslog messages. See [these docs](./VictoriaLogs/data-ingestion/syslog.md#multiple-configs).
* FEATURE: allow configuring multiple receivers with distinct configs for syslog messages. See [these docs](./data-ingestion/syslog.md#multiple-configs).
* BUGFIX: properly read syslog messages over TCP and TLS connections according to [RFC5425](https://datatracker.ietf.org/doc/html/rfc5425) when [data ingestion for syslog protocol](./VictoriaLogs/data-ingestion/syslog.md) is enabled.
* BUGFIX: properly read syslog messages over TCP and TLS connections according to [RFC5425](https://datatracker.ietf.org/doc/html/rfc5425) when [data ingestion for syslog protocol](./data-ingestion/syslog.md) is enabled.
## [v0.20.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.20.0-victorialogs)
Released at 2024-06-17
* FEATURE: add ability to accept logs in [Syslog format](https://en.wikipedia.org/wiki/Syslog). See [these docs](./VictoriaLogs/data-ingestion/syslog.md).
* FEATURE: add ability to specify timezone offset when parsing [rfc3164](https://datatracker.ietf.org/doc/html/rfc3164) syslog messages with [`unpack_syslog` pipe](./VictoriaLogs/LogsQL.md#unpack_syslog-pipe).
* FEATURE: add [`top` pipe](./VictoriaLogs/LogsQL.md#top-pipe) for returning top N sets of the given fields with the maximum number of matching log entries.
* FEATURE: add ability to accept logs in [Syslog format](https://en.wikipedia.org/wiki/Syslog). See [these docs](./data-ingestion/syslog.md).
* FEATURE: add ability to specify timezone offset when parsing [rfc3164](https://datatracker.ietf.org/doc/html/rfc3164) syslog messages with [`unpack_syslog` pipe](./LogsQL.md#unpack_syslog-pipe).
* FEATURE: add [`top` pipe](./LogsQL.md#top-pipe) for returning top N sets of the given fields with the maximum number of matching log entries.
## [v0.19.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.19.0-victorialogs)
Released at 2024-06-11
* FEATURE: do not allow starting the [filter](./VictoriaLogs/LogsQL.md#filters) with [pipe names](./VictoriaLogs/LogsQL.md#pipes) and [stats function names](./VictoriaLogs/LogsQL.md#stats-pipe-functions). This prevents from unexpected results returned by incorrect queries, which miss mandatory [filter](./VictoriaLogs/LogsQL.md#query-syntax).
* FEATURE: treat unexpected syslog message as [RFC3164](https://datatracker.ietf.org/doc/html/rfc3164) containing only the `message` field when using [`unpack_syslog` pipe](./VictoriaLogs/LogsQL.md#unpack_syslog-pipe).
* FEATURE: allow using `where` prefix instead of `filter` prefix in [`filter` pipe](./VictoriaLogs/LogsQL.md#filter-pipe).
* FEATURE: disallow unescaped `!` char in [LogsQL](./VictoriaLogs/LogsQL.md) queries, since it permits writing incorrect query, which may look like correct one. For example, `foo!:bar` instead of `foo:!bar`.
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): add markdown support to the `Group` view. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6292).
* FEATURE: do not allow starting the [filter](./LogsQL.md#filters) with [pipe names](./LogsQL.md#pipes) and [stats function names](./LogsQL.md#stats-pipe-functions). This prevents from unexpected results returned by incorrect queries, which miss mandatory [filter](./LogsQL.md#query-syntax).
* FEATURE: treat unexpected syslog message as [RFC3164](https://datatracker.ietf.org/doc/html/rfc3164) containing only the `message` field when using [`unpack_syslog` pipe](./LogsQL.md#unpack_syslog-pipe).
* FEATURE: allow using `where` prefix instead of `filter` prefix in [`filter` pipe](./LogsQL.md#filter-pipe).
* FEATURE: disallow unescaped `!` char in [LogsQL](./LogsQL.md) queries, since it permits writing incorrect query, which may look like correct one. For example, `foo!:bar` instead of `foo:!bar`.
* FEATURE: [web UI](./querying/README.md#web-ui): add markdown support to the `Group` view. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6292).
* BUGFIX: return back the improved performance for queries with `*` filters (aka `SELECT *`). This has been broken in [v0.16.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.16.0-victorialogs).
@ -132,42 +132,42 @@ Released at 2024-06-11
Released at 2024-06-06
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): improve displaying of logs. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6419) and the following issues: [6408](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6408), [6405](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6405), [6406](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6406) and [6407](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6407).
* FEATURE: add support for [day range filter](./VictoriaLogs/LogsQL.md#day-range-filter) and [week range filter](./VictoriaLogs/LogsQL.md#week-range-filter). These filters allow selecting logs on a particular time range per every day or on a particular day of the week.
* FEATURE: allow using `eval` instead of `math` keyword in [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe).
* FEATURE: [web UI](./querying/README.md#web-ui): improve displaying of logs. See [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6419) and the following issues: [6408](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6408), [6405](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6405), [6406](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6406) and [6407](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6407).
* FEATURE: add support for [day range filter](./LogsQL.md#day-range-filter) and [week range filter](./LogsQL.md#week-range-filter). These filters allow selecting logs on a particular time range per every day or on a particular day of the week.
* FEATURE: allow using `eval` instead of `math` keyword in [`math` pipe](./LogsQL.md#math-pipe).
## [v0.17.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.17.0-victorialogs)
Released at 2024-06-05
* FEATURE: add [`pack_logfmt` pipe](./VictoriaLogs/LogsQL.md#pack_logfmt-pipe) for formatting [log fields](./VictoriaLogs/keyConcepts.md#data-model) into [logfmt](https://brandur.org/logfmt) messages.
* FEATURE: allow using IPv4 addresses in [range comparison filters](./VictoriaLogs/LogsQL.md#range-comparison-filter). For example, `ip:>'12.34.56.78'` is valid filter now.
* FEATURE: add `ceil()` and `floor()` functions to [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe).
* FEATURE: add support for bitwise `and`, `or` and `xor` operations at [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe).
* FEATURE: add support for automatic conversion of [RFC3339 time](https://www.rfc-editor.org/rfc/rfc3339) and IPv4 addresses into numeric representation at [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe).
* FEATURE: add ability to format numeric fields into string representation of time, duration and IPv4 with [`format` pipe](./VictoriaLogs/LogsQL.md#format-pipe).
* FEATURE: set `format` field to `rfc3164` or `rfc5424` depending on the [Syslog format](https://en.wikipedia.org/wiki/Syslog) parsed via [`unpack_syslog` pipe](./VictoriaLogs/LogsQL.md#unpack_syslog-pipe).
* FEATURE: add [`pack_logfmt` pipe](./LogsQL.md#pack_logfmt-pipe) for formatting [log fields](./keyConcepts.md#data-model) into [logfmt](https://brandur.org/logfmt) messages.
* FEATURE: allow using IPv4 addresses in [range comparison filters](./LogsQL.md#range-comparison-filter). For example, `ip:>'12.34.56.78'` is valid filter now.
* FEATURE: add `ceil()` and `floor()` functions to [`math` pipe](./LogsQL.md#math-pipe).
* FEATURE: add support for bitwise `and`, `or` and `xor` operations at [`math` pipe](./LogsQL.md#math-pipe).
* FEATURE: add support for automatic conversion of [RFC3339 time](https://www.rfc-editor.org/rfc/rfc3339) and IPv4 addresses into numeric representation at [`math` pipe](./LogsQL.md#math-pipe).
* FEATURE: add ability to format numeric fields into string representation of time, duration and IPv4 with [`format` pipe](./LogsQL.md#format-pipe).
* FEATURE: set `format` field to `rfc3164` or `rfc5424` depending on the [Syslog format](https://en.wikipedia.org/wiki/Syslog) parsed via [`unpack_syslog` pipe](./LogsQL.md#unpack_syslog-pipe).
* BUGFIX: always respect the limit set in [`limit` pipe](./VictoriaLogs/LogsQL.md#limit-pipe). Previously the limit could be exceeded in some cases.
* BUGFIX: always respect the limit set in [`limit` pipe](./LogsQL.md#limit-pipe). Previously the limit could be exceeded in some cases.
## [v0.16.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.16.0-victorialogs)
Released at 2024-06-04
* FEATURE: add [`unpack_syslog` pipe](./VictoriaLogs/LogsQL.md#unpack_syslog-pipe) for unpacking [syslog](https://en.wikipedia.org/wiki/Syslog) messages from [log fields](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: parse timestamps in [`_time` filter](./VictoriaLogs/LogsQL.md#time-filter) with nanosecond precision.
* FEATURE: return the last `N` matching logs from [`/select/logsql/query` HTTP API](./VictoriaLogs/querying/README.md#querying-logs) with the maximum timestamps if `limit=N` query arg is passed to it. Previously a random subset of matching logs could be returned, which could complicate investigation of the returned logs.
* FEATURE: add [`drop_empty_fields` pipe](./VictoriaLogs/LogsQL.md#drop_empty_fields-pipe) for dropping [log fields](./VictoriaLogs/keyConcepts.md#data-model) with empty values.
* FEATURE: add [`unpack_syslog` pipe](./LogsQL.md#unpack_syslog-pipe) for unpacking [syslog](https://en.wikipedia.org/wiki/Syslog) messages from [log fields](./keyConcepts.md#data-model).
* FEATURE: parse timestamps in [`_time` filter](./LogsQL.md#time-filter) with nanosecond precision.
* FEATURE: return the last `N` matching logs from [`/select/logsql/query` HTTP API](./querying/README.md#querying-logs) with the maximum timestamps if `limit=N` query arg is passed to it. Previously a random subset of matching logs could be returned, which could complicate investigation of the returned logs.
* FEATURE: add [`drop_empty_fields` pipe](./LogsQL.md#drop_empty_fields-pipe) for dropping [log fields](./keyConcepts.md#data-model) with empty values.
## [v0.15.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.15.0-victorialogs)
Released at 2024-05-30
* FEATURE: add [`row_any`](./VictoriaLogs/LogsQL.md#row_any-stats) function for [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe). This function returns a sample log entry per every calculated [group of results](./VictoriaLogs/LogsQL.md#stats-by-fields).
* FEATURE: add `default` operator to [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe). It allows overriding `NaN` results with the given default value.
* FEATURE: add `exp()` and `ln()` functions to [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe).
* FEATURE: allow omitting result name in [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe) expresions. In this case the result name is automatically set to string representation of the corresponding math expression. For example, `_time:5m | math duration / 1000` is equivalent to `_time:5m | math (duration / 1000) as "duration / 1000"`.
* FEATURE: allow omitting result name in [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe). In this case the result name is automatically set to string representation of the corresponding [stats function expression](./VictoriaLogs/LogsQL.md#stats-pipe-functions). For example, `_time:5m | count(*)` is valid [LogsQL query](./VictoriaLogs/LogsQL.md) now. It is equivalent to `_time:5m | stats count(*) as "count(*)"`.
* FEATURE: add [`row_any`](./LogsQL.md#row_any-stats) function for [`stats` pipe](./LogsQL.md#stats-pipe). This function returns a sample log entry per every calculated [group of results](./LogsQL.md#stats-by-fields).
* FEATURE: add `default` operator to [`math` pipe](./LogsQL.md#math-pipe). It allows overriding `NaN` results with the given default value.
* FEATURE: add `exp()` and `ln()` functions to [`math` pipe](./LogsQL.md#math-pipe).
* FEATURE: allow omitting result name in [`math` pipe](./LogsQL.md#math-pipe) expresions. In this case the result name is automatically set to string representation of the corresponding math expression. For example, `_time:5m | math duration / 1000` is equivalent to `_time:5m | math (duration / 1000) as "duration / 1000"`.
* FEATURE: allow omitting result name in [`stats` pipe](./LogsQL.md#stats-pipe). In this case the result name is automatically set to string representation of the corresponding [stats function expression](./LogsQL.md#stats-pipe-functions). For example, `_time:5m | count(*)` is valid [LogsQL query](./LogsQL.md) now. It is equivalent to `_time:5m | stats count(*) as "count(*)"`.
* BUGFIX: properly calculate the number of matching rows in `* | field_values x | stats count() rows` and in `* | unroll (x) | stats count() rows` queries.
@ -175,185 +175,185 @@ Released at 2024-05-30
Released at 2024-05-29
* FEATURE: allow specifying fields, which must be packed into JSON in [`pack_json` pipe](./VictoriaLogs/LogsQL.md#pack_json-pipe) via `pack_json fields (field1, ..., fieldN)` syntax.
* FEATURE: allow specifying fields, which must be packed into JSON in [`pack_json` pipe](./LogsQL.md#pack_json-pipe) via `pack_json fields (field1, ..., fieldN)` syntax.
* BUGFIX: properly apply `if (...)` filters to calculated results in [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe) when [grouping by fields](./VictoriaLogs/LogsQL.md#stats-by-fields) is enabled. For example, `_time:5m | stats by (host) count() logs, count() if (error) errors` now properly calculates per-`host` `errors`.
* BUGFIX: properly apply `if (...)` filters to calculated results in [`stats` pipe](./LogsQL.md#stats-pipe) when [grouping by fields](./LogsQL.md#stats-by-fields) is enabled. For example, `_time:5m | stats by (host) count() logs, count() if (error) errors` now properly calculates per-`host` `errors`.
## [v0.13.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.13.0-victorialogs)
Released at 2024-05-28
* FEATURE: add [`extract_regexp` pipe](./VictoriaLogs/LogsQL.md#extract_regexp-pipe) for extracting arbitrary substrings from [log fields](./VictoriaLogs/keyConcepts.md#data-model) with [RE2 regular expressions](https://github.com/google/re2/wiki/Syntax).
* FEATURE: add [`math` pipe](./VictoriaLogs/LogsQL.md#math-pipe) for mathematical calculations over [log fields](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: add [`field_values` pipe](./VictoriaLogs/LogsQL.md#field_values-pipe), which returns unique values for the given [log field](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: allow omitting `stats` prefix in [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe). For example, `_time:5m | count() rows` is a valid query now. It is equivalent to `_time:5m | stats count() as rows`.
* FEATURE: allow omitting `filter` prefix in [`filter` pipe](./VictoriaLogs/LogsQL.md#filter-pipe) if the filter doesn't clash with [pipe names](#./VictoriaLogs/LogsQL.md#pipes). For example, `_time:5m | stats by (host) count() rows | rows:>1000` is a valid query now. It is equivalent to `_time:5m | stats by (host) count() rows | filter rows:>1000`.
* FEATURE: allow [`head` pipe](./VictoriaLogs/LogsQL.md#limit-pipe) without number. For example, `error | head`. In this case 10 first values are returned as `head` Unix command does by default.
* FEATURE: allow using [comparison filters](./VictoriaLogs/LogsQL.md#range-comparison-filter) with strings. For example, `some_text_field:>="foo"` matches [log entries](./VictoriaLogs/keyConcepts.md#data-model) with `some_text_field` field values bigger or equal to `foo`.
* FEATURE: add [`extract_regexp` pipe](./LogsQL.md#extract_regexp-pipe) for extracting arbitrary substrings from [log fields](./keyConcepts.md#data-model) with [RE2 regular expressions](https://github.com/google/re2/wiki/Syntax).
* FEATURE: add [`math` pipe](./LogsQL.md#math-pipe) for mathematical calculations over [log fields](./keyConcepts.md#data-model).
* FEATURE: add [`field_values` pipe](./LogsQL.md#field_values-pipe), which returns unique values for the given [log field](./keyConcepts.md#data-model).
* FEATURE: allow omitting `stats` prefix in [`stats` pipe](./LogsQL.md#stats-pipe). For example, `_time:5m | count() rows` is a valid query now. It is equivalent to `_time:5m | stats count() as rows`.
* FEATURE: allow omitting `filter` prefix in [`filter` pipe](./LogsQL.md#filter-pipe) if the filter doesn't clash with [pipe names](#./LogsQL.md#pipes). For example, `_time:5m | stats by (host) count() rows | rows:>1000` is a valid query now. It is equivalent to `_time:5m | stats by (host) count() rows | filter rows:>1000`.
* FEATURE: allow [`head` pipe](./LogsQL.md#limit-pipe) without number. For example, `error | head`. In this case 10 first values are returned as `head` Unix command does by default.
* FEATURE: allow using [comparison filters](./LogsQL.md#range-comparison-filter) with strings. For example, `some_text_field:>="foo"` matches [log entries](./keyConcepts.md#data-model) with `some_text_field` field values bigger or equal to `foo`.
## [v0.12.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.12.1-victorialogs)
Released at 2024-05-26
* FEATURE: add support for comments in multi-line LogsQL queries. See [these docs](./VictoriaLogs/LogsQL.md#comments).
* FEATURE: add support for comments in multi-line LogsQL queries. See [these docs](./LogsQL.md#comments).
* BUGFIX: properly apply [`in(...)` filter](./VictoriaLogs/LogsQL.md#multi-exact-filter) inside `if (...)` conditions at various [pipes](./VictoriaLogs/LogsQL.md#pipes). This bug has been introduced in [v0.12.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.12.0-victorialogs).
* BUGFIX: properly apply [`in(...)` filter](./LogsQL.md#multi-exact-filter) inside `if (...)` conditions at various [pipes](./LogsQL.md#pipes). This bug has been introduced in [v0.12.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.12.0-victorialogs).
## [v0.12.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.12.0-victorialogs)
Released at 2024-05-26
* FEATURE: add [`pack_json` pipe](./VictoriaLogs/LogsQL.md#pack_json-pipe), which packs all the [log fields](./VictoriaLogs/keyConcepts.md#data-model) into a JSON object and stores it into the given field.
* FEATURE: add [`unroll` pipe](./VictoriaLogs/LogsQL.md#unroll-pipe), which can be used for unrolling JSON arrays stored in [log fields](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: add [`replace_regexp` pipe](./VictoriaLogs/LogsQL.md#replace_regexp-pipe), which allows updating [log fields](./VictoriaLogs/keyConcepts.md#data-model) with regular expressions.
* FEATURE: improve performance for [`format`](./VictoriaLogs/LogsQL.md#format-pipe) and [`extract`](./VictoriaLogs/LogsQL.md#extract-pipe) pipes.
* FEATURE: improve performance for [`/select/logsql/field_names` HTTP API](./VictoriaLogs/querying/README.md#querying-field-names).
* FEATURE: add [`pack_json` pipe](./LogsQL.md#pack_json-pipe), which packs all the [log fields](./keyConcepts.md#data-model) into a JSON object and stores it into the given field.
* FEATURE: add [`unroll` pipe](./LogsQL.md#unroll-pipe), which can be used for unrolling JSON arrays stored in [log fields](./keyConcepts.md#data-model).
* FEATURE: add [`replace_regexp` pipe](./LogsQL.md#replace_regexp-pipe), which allows updating [log fields](./keyConcepts.md#data-model) with regular expressions.
* FEATURE: improve performance for [`format`](./LogsQL.md#format-pipe) and [`extract`](./LogsQL.md#extract-pipe) pipes.
* FEATURE: improve performance for [`/select/logsql/field_names` HTTP API](./querying/README.md#querying-field-names).
* BUGFIX: prevent from panic in [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe) when VictoriaLogs runs on a system with one CPU core.
* BUGFIX: prevent from panic in [`sort` pipe](./LogsQL.md#sort-pipe) when VictoriaLogs runs on a system with one CPU core.
* BUGFIX: do not return referenced fields if they weren't present in the original logs. For example, `_time:5m | format if (non_existing_field:"") "abc"` could return empty `non_exiting_field`, while it shouldn't be returned because it is missing in the original logs.
* BUGFIX: properly initialize values for [`in(...)` filter](./VictoriaLogs/LogsQL.md#multi-exact-filter) inside [`filter` pipe](./VictoriaLogs/LogsQL.md#filter-pipe) if the `in(...)` contains other [filters](./VictoriaLogs/LogsQL.md#filters). For example, `_time:5m | filter ip:in(user_type:admin | fields ip)` now works correctly.
* BUGFIX: properly initialize values for [`in(...)` filter](./LogsQL.md#multi-exact-filter) inside [`filter` pipe](./LogsQL.md#filter-pipe) if the `in(...)` contains other [filters](./LogsQL.md#filters). For example, `_time:5m | filter ip:in(user_type:admin | fields ip)` now works correctly.
## [v0.11.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.11.0-victorialogs)
Released at 2024-05-25
* FEATURE: add [`replace` pipe](./VictoriaLogs/LogsQL.md#replace-pipe), which allows replacing substrings in [log fields](./VictoriaLogs/keyConcepts.md#data-model).
* FEATURE: support [comparing](./VictoriaLogs/LogsQL.md#range-filter) log field values with [special numeric values](./VictoriaLogs/LogsQL.md#numeric-values). For example, `duration:>1.5s` and `response_size:<15KiB` are valid filters now.
* FEATURE: properly sort [durations](./VictoriaLogs/LogsQL.md#duration-values) and [short numeric values](./VictoriaLogs/LogsQL.md#short-numeric-values) in [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe). For example, `10s` goes in front of `1h`, while `10KB` goes in front of `1GB`.
* FEATURE: add an ability to preserve the original non-empty field values when executing [`extract`](./VictoriaLogs/LogsQL.md#extract-pipe), [`unpack_json`](./VictoriaLogs/LogsQL.md#unpack_json-pipe), [`unpack_logfmt`](./VictoriaLogs/LogsQL.md#unpack_logfmt-pipe) and [`format`](./VictoriaLogs/LogsQL.md#format-pipe) pipes.
* FEATURE: add an ability to preserve the original field values if the corresponding unpacked values are empty when executing [`extract`](./VictoriaLogs/LogsQL.md#extract-pipe), [`unpack_json`](./VictoriaLogs/LogsQL.md#unpack_json-pipe), [`unpack_logfmt`](./VictoriaLogs/LogsQL.md#unpack_logfmt-pipe) and [`format`](./VictoriaLogs/LogsQL.md#format-pipe) pipes.
* FEATURE: add [`replace` pipe](./LogsQL.md#replace-pipe), which allows replacing substrings in [log fields](./keyConcepts.md#data-model).
* FEATURE: support [comparing](./LogsQL.md#range-filter) log field values with [special numeric values](./LogsQL.md#numeric-values). For example, `duration:>1.5s` and `response_size:<15KiB` are valid filters now.
* FEATURE: properly sort [durations](./LogsQL.md#duration-values) and [short numeric values](./LogsQL.md#short-numeric-values) in [`sort` pipe](./LogsQL.md#sort-pipe). For example, `10s` goes in front of `1h`, while `10KB` goes in front of `1GB`.
* FEATURE: add an ability to preserve the original non-empty field values when executing [`extract`](./LogsQL.md#extract-pipe), [`unpack_json`](./LogsQL.md#unpack_json-pipe), [`unpack_logfmt`](./LogsQL.md#unpack_logfmt-pipe) and [`format`](./LogsQL.md#format-pipe) pipes.
* FEATURE: add an ability to preserve the original field values if the corresponding unpacked values are empty when executing [`extract`](./LogsQL.md#extract-pipe), [`unpack_json`](./LogsQL.md#unpack_json-pipe), [`unpack_logfmt`](./LogsQL.md#unpack_logfmt-pipe) and [`format`](./LogsQL.md#format-pipe) pipes.
## [v0.10.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.10.0-victorialogs)
Released at 2024-05-24
* FEATURE: return the number of matching log entries per returned value in [HTTP API](./VictoriaLogs/querying/README.md#http-api) results. This simplifies detecting [field](./VictoriaLogs/keyConcepts.md#data-model) / [stream](./VictoriaLogs/keyConcepts.md#stream-fields) values with the biggest number of logs for the given [LogsQL query](./VictoriaLogs/LogsQL.md).
* FEATURE: improve performance for [regexp filter](./VictoriaLogs/LogsQL.md#regexp-filter) in the following cases:
* FEATURE: return the number of matching log entries per returned value in [HTTP API](./querying/README.md#http-api) results. This simplifies detecting [field](./keyConcepts.md#data-model) / [stream](./keyConcepts.md#stream-fields) values with the biggest number of logs for the given [LogsQL query](./LogsQL.md).
* FEATURE: improve performance for [regexp filter](./LogsQL.md#regexp-filter) in the following cases:
- If the regexp contains just a phrase without special regular expression chars. For example, `~"foo"`.
- If the regexp starts with `.*` or ends with `.*`. For example, `~".*foo.*"`.
- If the regexp contains multiple strings delimited by `|`. For example, `~"foo|bar|baz"`.
- If the regexp contains multiple [words](./VictoriaLogs/LogsQL.md#word). For example, `~"foo bar baz"`.
* FEATURE: allow disabling automatic unquoting of the matched placeholders in [`extract` pipe](./VictoriaLogs/LogsQL.md#extract-pipe). See [these docs](./VictoriaLogs/LogsQL.md#format-for-extract-pipe-pattern).
- If the regexp contains multiple [words](./LogsQL.md#word). For example, `~"foo bar baz"`.
* FEATURE: allow disabling automatic unquoting of the matched placeholders in [`extract` pipe](./LogsQL.md#extract-pipe). See [these docs](./LogsQL.md#format-for-extract-pipe-pattern).
* BUGFIX: properly parse `!` in front of [exact filter](./VictoriaLogs/LogsQL.md#exact-filter), [exact-prefix filter](./VictoriaLogs/LogsQL.md#exact-prefix-filter) and [regexp filter](./VictoriaLogs/LogsQL.md#regexp-filter). For example, `!~"some regexp"` is properly parsed as `not ="some regexp"`. Previously it was incorrectly parsed as `'~="some regexp"'` [phrase filter](./VictoriaLogs/LogsQL.md#phrase-filter).
* BUGFIX: properly sort results by [`_time` field](./VictoriaLogs/keyConcepts.md#time-field) when [`limit` pipe](./VictoriaLogs/LogsQL.md#limit-pipe) is applied. For example, `_time:5m | sort by (_time) desc | limit 10` properly works now.
* BUGFIX: properly parse `!` in front of [exact filter](./LogsQL.md#exact-filter), [exact-prefix filter](./LogsQL.md#exact-prefix-filter) and [regexp filter](./LogsQL.md#regexp-filter). For example, `!~"some regexp"` is properly parsed as `not ="some regexp"`. Previously it was incorrectly parsed as `'~="some regexp"'` [phrase filter](./LogsQL.md#phrase-filter).
* BUGFIX: properly sort results by [`_time` field](./keyConcepts.md#time-field) when [`limit` pipe](./LogsQL.md#limit-pipe) is applied. For example, `_time:5m | sort by (_time) desc | limit 10` properly works now.
## [v0.9.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.1-victorialogs)
Released at 2024-05-22
* BUGFIX: [web UI](./VictoriaLogs/querying/README.md#web-ui): fix loading web UI, which has been broken in [v0.9.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.0-victorialogs).
* BUGFIX: [web UI](./querying/README.md#web-ui): fix loading web UI, which has been broken in [v0.9.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.0-victorialogs).
## [v0.9.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.9.0-victorialogs)
Released at 2024-05-22
* FEATURE: allow using `~"some_regexp"` [regexp filter](./VictoriaLogs/LogsQL.md#regexp-filter) instead of `re("some_regexp")`.
* FEATURE: allow using `="some phrase"` [exact filter](./VictoriaLogs/LogsQL.md#exact-filter) instead of `exact("some phrase")`.
* FEATURE: allow using `="some prefix"*` [exact prefix filter](./VictoriaLogs/LogsQL.md#exact-prefix-filter) instead of `exact("some prefix"*)`.
* FEATURE: add ability to generate output fields according to the provided format string. See [these docs](./VictoriaLogs/LogsQL.md#format-pipe).
* FEATURE: add ability to extract fields with [`extract` pipe](./VictoriaLogs/LogsQL.md#extract-pipe) only if the given condition is met. See [these docs](./VictoriaLogs/LogsQL.md#conditional-extract).
* FEATURE: add ability to unpack JSON fields with [`unpack_json` pipe](./VictoriaLogs/LogsQL.md#unpack_json-pipe) only if the given condition is met. See [these docs](./VictoriaLogs/LogsQL.md#conditional-unpack_json).
* FEATURE: add ability to unpack [logfmt](https://brandur.org/logfmt) fields with [`unpack_logfmt` pipe](./VictoriaLogs/LogsQL.md#unpack_logfmt-pipe) only if the given condition is met. See [these docs](./VictoriaLogs/LogsQL.md#conditional-unpack_logfmt).
* FEATURE: add [`row_min`](./VictoriaLogs/LogsQL.md#row_min-stats) and [`row_max`](./VictoriaLogs/LogsQL.md#row_max-stats) functions for [`stats` pipe](./VictoriaLogs/LogsQL.md#stats-pipe), which allow returning all the [log fields](./VictoriaLogs/keyConcepts.md#data-model) for the log entry with the minimum / maximum value at the given field.
* FEATURE: add `/select/logsql/streams` HTTP endpoint for returning [streams](./VictoriaLogs/keyConcepts.md#stream-fields) from results of the given query. See [these docs](./VictoriaLogs/querying/README.md#querying-streams) for details.
* FEATURE: add `/select/logsql/stream_field_names` HTTP endpoint for returning [stream](./VictoriaLogs/keyConcepts.md#stream-fields) field names from results of the given query. See [these docs](./VictoriaLogs/querying/README.md#querying-stream-field-names) for details.
* FEATURE: add `/select/logsql/stream_field_values` HTTP endpoint for returning [stream](./VictoriaLogs/keyConcepts.md#stream-fields) field values for the given label from results of the given query. See [these docs](./VictoriaLogs/querying/README.md#querying-stream-field-values) for details.
* FEATURE: [web UI](./VictoriaLogs/querying/README.md#web-ui): change time range limitation from `_time` in the expression to `start` and `end` query args.
* FEATURE: allow using `~"some_regexp"` [regexp filter](./LogsQL.md#regexp-filter) instead of `re("some_regexp")`.
* FEATURE: allow using `="some phrase"` [exact filter](./LogsQL.md#exact-filter) instead of `exact("some phrase")`.
* FEATURE: allow using `="some prefix"*` [exact prefix filter](./LogsQL.md#exact-prefix-filter) instead of `exact("some prefix"*)`.
* FEATURE: add ability to generate output fields according to the provided format string. See [these docs](./LogsQL.md#format-pipe).
* FEATURE: add ability to extract fields with [`extract` pipe](./LogsQL.md#extract-pipe) only if the given condition is met. See [these docs](./LogsQL.md#conditional-extract).
* FEATURE: add ability to unpack JSON fields with [`unpack_json` pipe](./LogsQL.md#unpack_json-pipe) only if the given condition is met. See [these docs](./LogsQL.md#conditional-unpack_json).
* FEATURE: add ability to unpack [logfmt](https://brandur.org/logfmt) fields with [`unpack_logfmt` pipe](./LogsQL.md#unpack_logfmt-pipe) only if the given condition is met. See [these docs](./LogsQL.md#conditional-unpack_logfmt).
* FEATURE: add [`row_min`](./LogsQL.md#row_min-stats) and [`row_max`](./LogsQL.md#row_max-stats) functions for [`stats` pipe](./LogsQL.md#stats-pipe), which allow returning all the [log fields](./keyConcepts.md#data-model) for the log entry with the minimum / maximum value at the given field.
* FEATURE: add `/select/logsql/streams` HTTP endpoint for returning [streams](./keyConcepts.md#stream-fields) from results of the given query. See [these docs](./querying/README.md#querying-streams) for details.
* FEATURE: add `/select/logsql/stream_field_names` HTTP endpoint for returning [stream](./keyConcepts.md#stream-fields) field names from results of the given query. See [these docs](./querying/README.md#querying-stream-field-names) for details.
* FEATURE: add `/select/logsql/stream_field_values` HTTP endpoint for returning [stream](./keyConcepts.md#stream-fields) field values for the given label from results of the given query. See [these docs](./querying/README.md#querying-stream-field-values) for details.
* FEATURE: [web UI](./querying/README.md#web-ui): change time range limitation from `_time` in the expression to `start` and `end` query args.
* BUGFIX: fix `invalid memory address or nil pointer dereference` panic when using [`extract`](./VictoriaLogs/LogsQL.md#extract-pipe), [`unpack_json`](./VictoriaLogs/LogsQL.md#unpack_json-pipe) or [`unpack_logfmt`](./VictoriaLogs/LogsQL.md#unpack_logfmt-pipe) pipes. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6306).
* BUGFIX: [web UI](./VictoriaLogs/querying/README.md#web-ui): fix an issue where logs with long `_msg` values might not display. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6281).
* BUGFIX: fix `invalid memory address or nil pointer dereference` panic when using [`extract`](./LogsQL.md#extract-pipe), [`unpack_json`](./LogsQL.md#unpack_json-pipe) or [`unpack_logfmt`](./LogsQL.md#unpack_logfmt-pipe) pipes. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6306).
* BUGFIX: [web UI](./querying/README.md#web-ui): fix an issue where logs with long `_msg` values might not display. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6281).
* BUGFIX: properly handle time range boundaries with millisecond precision. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6293).
## [v0.8.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.8.0-victorialogs)
Released at 2024-05-20
* FEATURE: add ability to extract JSON fields from [log fields](./VictoriaLogs/keyConcepts.md#data-model). See [these docs](./VictoriaLogs/LogsQL.md#unpack_json-pipe).
* FEATURE: add ability to extract [logfmt](https://brandur.org/logfmt) fields from [log fields](./VictoriaLogs/keyConcepts.md#data-model). See [these docs](./VictoriaLogs/LogsQL.md#unpack_logfmt-pipe).
* FEATURE: add ability to extract arbitrary text from [log fields](./VictoriaLogs/keyConcepts.md#data-model) into the output fields. See [these docs](./VictoriaLogs/LogsQL.md#extract-pipe).
* FEATURE: add ability to put arbitrary [queries](./VictoriaLogs/LogsQL.md#query-syntax) inside [`in()` filter](./VictoriaLogs/LogsQL.md#multi-exact-filter).
* FEATURE: add support for post-filtering of query results with [`filter` pipe](./VictoriaLogs/LogsQL.md#filter-pipe).
* FEATURE: allow applying individual [filters](./VictoriaLogs/LogsQL.md#filters) per each [stats function](./VictoriaLogs/LogsQL.md#stats-pipe-functions). See [these docs](./VictoriaLogs/LogsQL.md#stats-with-additional-filters).
* FEATURE: allow passing string values to [`min`](./VictoriaLogs/LogsQL.md#min-stats) and [`max`](./VictoriaLogs/LogsQL.md#max-stats) functions. Previously only numeric values could be passed to them.
* FEATURE: speed up [`sort ... limit N` pipe](./VictoriaLogs/LogsQL.md#sort-pipe) for typical cases.
* FEATURE: allow using more convenient syntax for [`range` filters](./VictoriaLogs/LogsQL.md#range-filter) if upper or lower bound isn't needed. For example, it is possible to write `response_size:>=10KiB` instead of `response_size:range[10KiB, inf)`, or `temperature:<42` instead of `temperature:range(-inf, 42)`.
* FEATURE: add `/select/logsql/hits` HTTP endpoint for returning the number of matching logs per the given time bucket over the selected time range. See [these docs](./VictoriaLogs/querying/README.md#querying-hits-stats) for details.
* FEATURE: add `/select/logsql/field_names` HTTP endpoint for returning [field](./VictoriaLogs/keyConcepts.md#data-model) names from results of the given query. See [these docs](./VictoriaLogs/querying/README.md#querying-field-names) for details.
* FEATURE: add `/select/logsql/field_values` HTTP endpoint for returning unique values for the given [field](./VictoriaLogs/keyConcepts.md#data-model) obtained from results of the given query. See [these docs](./VictoriaLogs/querying/README.md#querying-field-values) for details.
* FEATURE: add ability to extract JSON fields from [log fields](./keyConcepts.md#data-model). See [these docs](./LogsQL.md#unpack_json-pipe).
* FEATURE: add ability to extract [logfmt](https://brandur.org/logfmt) fields from [log fields](./keyConcepts.md#data-model). See [these docs](./LogsQL.md#unpack_logfmt-pipe).
* FEATURE: add ability to extract arbitrary text from [log fields](./keyConcepts.md#data-model) into the output fields. See [these docs](./LogsQL.md#extract-pipe).
* FEATURE: add ability to put arbitrary [queries](./LogsQL.md#query-syntax) inside [`in()` filter](./LogsQL.md#multi-exact-filter).
* FEATURE: add support for post-filtering of query results with [`filter` pipe](./LogsQL.md#filter-pipe).
* FEATURE: allow applying individual [filters](./LogsQL.md#filters) per each [stats function](./LogsQL.md#stats-pipe-functions). See [these docs](./LogsQL.md#stats-with-additional-filters).
* FEATURE: allow passing string values to [`min`](./LogsQL.md#min-stats) and [`max`](./LogsQL.md#max-stats) functions. Previously only numeric values could be passed to them.
* FEATURE: speed up [`sort ... limit N` pipe](./LogsQL.md#sort-pipe) for typical cases.
* FEATURE: allow using more convenient syntax for [`range` filters](./LogsQL.md#range-filter) if upper or lower bound isn't needed. For example, it is possible to write `response_size:>=10KiB` instead of `response_size:range[10KiB, inf)`, or `temperature:<42` instead of `temperature:range(-inf, 42)`.
* FEATURE: add `/select/logsql/hits` HTTP endpoint for returning the number of matching logs per the given time bucket over the selected time range. See [these docs](./querying/README.md#querying-hits-stats) for details.
* FEATURE: add `/select/logsql/field_names` HTTP endpoint for returning [field](./keyConcepts.md#data-model) names from results of the given query. See [these docs](./querying/README.md#querying-field-names) for details.
* FEATURE: add `/select/logsql/field_values` HTTP endpoint for returning unique values for the given [field](./keyConcepts.md#data-model) obtained from results of the given query. See [these docs](./querying/README.md#querying-field-values) for details.
* BUGFIX: properly take into account `offset` at [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe) when it already has `limit`. For example, `_time:5m | sort by (foo) offset 20 limit 10`.
* BUGFIX: properly take into account `offset` at [`sort` pipe](./LogsQL.md#sort-pipe) when it already has `limit`. For example, `_time:5m | sort by (foo) offset 20 limit 10`.
## [v0.7.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.7.0-victorialogs)
Released at 2024-05-15
* FEATURE: add support for optional `start` and `end` query args to [HTTP querying API](./VictoriaLogs/querying/README.md#http-api), which can be used for limiting the time range for [LogsQL query](./VictoriaLogs/LogsQL.md).
* FEATURE: add ability to return the first `N` results from [`sort` pipe](#./VictoriaLogs/LogsQL.md#sort-pipe). This is useful when `N` biggest or `N` smallest values must be returned from large amounts of logs.
* FEATURE: add [`quantile`](./VictoriaLogs/LogsQL.md#quantile-stats) and [`median`](./VictoriaLogs/LogsQL.md#median-stats) [stats functions](./VictoriaLogs/LogsQL.md#stats-pipe).
* FEATURE: add support for optional `start` and `end` query args to [HTTP querying API](./querying/README.md#http-api), which can be used for limiting the time range for [LogsQL query](./LogsQL.md).
* FEATURE: add ability to return the first `N` results from [`sort` pipe](#./LogsQL.md#sort-pipe). This is useful when `N` biggest or `N` smallest values must be returned from large amounts of logs.
* FEATURE: add [`quantile`](./LogsQL.md#quantile-stats) and [`median`](./LogsQL.md#median-stats) [stats functions](./LogsQL.md#stats-pipe).
## [v0.6.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.6.1-victorialogs)
Released at 2024-05-14
* FEATURE: use [natural sort order](https://en.wikipedia.org/wiki/Natural_sort_order) when sorting logs via [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe).
* FEATURE: use [natural sort order](https://en.wikipedia.org/wiki/Natural_sort_order) when sorting logs via [`sort` pipe](./LogsQL.md#sort-pipe).
* BUGFIX: properly return matching logs in [streams](./VictoriaLogs/keyConcepts.md#stream-fields) with small number of entries. Previously they could be skipped. The issue has been introduced in [the release v0.6.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.6.0-victorialogs).
* BUGFIX: fix `runtime error: index out of range` panic when using [`sort` pipe](./VictoriaLogs/LogsQL.md#sort-pipe) like `_time:1h | sort by (_time)`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6258).
* BUGFIX: properly return matching logs in [streams](./keyConcepts.md#stream-fields) with small number of entries. Previously they could be skipped. The issue has been introduced in [the release v0.6.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.6.0-victorialogs).
* BUGFIX: fix `runtime error: index out of range` panic when using [`sort` pipe](./LogsQL.md#sort-pipe) like `_time:1h | sort by (_time)`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6258).
## [v0.6.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.6.0-victorialogs)
Released at 2024-05-12
* FEATURE: return all the log fields by default in query results. Previously only [`_stream`](./VictoriaLogs/keyConcepts.md#stream-fields), [`_time`](./VictoriaLogs/keyConcepts.md#time-field) and [`_msg`](./VictoriaLogs/keyConcepts.md#message-field) fields were returned by default.
* FEATURE: add support for returning only the requested log [fields](./VictoriaLogs/keyConcepts.md#data-model). See [these docs](./VictoriaLogs/LogsQL.md#fields-pipe).
* FEATURE: add support for calculating various stats over [log fields](./VictoriaLogs/keyConcepts.md#data-model). Grouping by arbitrary set of [log fields](./VictoriaLogs/keyConcepts.md#data-model) is supported. See [these docs](./VictoriaLogs/LogsQL.md#stats-pipe) for details.
* FEATURE: add support for sorting the returned results. See [these docs](./VictoriaLogs/LogsQL.md#sort-pipe).
* FEATURE: add support for returning unique results. See [these docs](./VictoriaLogs/LogsQL.md#uniq-pipe).
* FEATURE: add support for limiting the number of returned results. See [these docs](./VictoriaLogs/LogsQL.md#limiters).
* FEATURE: add support for copying and renaming the selected log fields. See [these](./VictoriaLogs/LogsQL.md#copy-pipe) and [these](./VictoriaLogs/LogsQL.md#rename-pipe) docs.
* FEATURE: allow using `_` inside numbers. For example, `score:range[1_000, 5_000_000]` for [`range` filter](./VictoriaLogs/LogsQL.md#range-filter).
* FEATURE: allow numbers in hexadecimal and binary form. For example, `response_size:range[0xff, 0b10001101101]` for [`range` filter](./VictoriaLogs/LogsQL.md#range-filter).
* FEATURE: allow using duration and byte size suffixes in numeric values inside LogsQL queries. See [these docs](./VictoriaLogs/LogsQL.md#numeric-values).
* FEATURE: return all the log fields by default in query results. Previously only [`_stream`](./keyConcepts.md#stream-fields), [`_time`](./keyConcepts.md#time-field) and [`_msg`](./keyConcepts.md#message-field) fields were returned by default.
* FEATURE: add support for returning only the requested log [fields](./keyConcepts.md#data-model). See [these docs](./LogsQL.md#fields-pipe).
* FEATURE: add support for calculating various stats over [log fields](./keyConcepts.md#data-model). Grouping by arbitrary set of [log fields](./keyConcepts.md#data-model) is supported. See [these docs](./LogsQL.md#stats-pipe) for details.
* FEATURE: add support for sorting the returned results. See [these docs](./LogsQL.md#sort-pipe).
* FEATURE: add support for returning unique results. See [these docs](./LogsQL.md#uniq-pipe).
* FEATURE: add support for limiting the number of returned results. See [these docs](./LogsQL.md#limiters).
* FEATURE: add support for copying and renaming the selected log fields. See [these](./LogsQL.md#copy-pipe) and [these](./LogsQL.md#rename-pipe) docs.
* FEATURE: allow using `_` inside numbers. For example, `score:range[1_000, 5_000_000]` for [`range` filter](./LogsQL.md#range-filter).
* FEATURE: allow numbers in hexadecimal and binary form. For example, `response_size:range[0xff, 0b10001101101]` for [`range` filter](./LogsQL.md#range-filter).
* FEATURE: allow using duration and byte size suffixes in numeric values inside LogsQL queries. See [these docs](./LogsQL.md#numeric-values).
* FEATURE: improve data ingestion performance by up to 50%.
* FEATURE: optimize performance for [LogsQL query](./VictoriaLogs/LogsQL.md), which contains multiple filters for [words](./VictoriaLogs/LogsQL.md#word-filter) or [phrases](./VictoriaLogs/LogsQL.md#phrase-filter) delimited with [`AND` operator](./VictoriaLogs/LogsQL.md#logical-filter). For example, `foo AND bar` query must find [log messages](./VictoriaLogs/keyConcepts.md#message-field) with `foo` and `bar` words at faster speed.
* FEATURE: optimize performance for [LogsQL query](./LogsQL.md), which contains multiple filters for [words](./LogsQL.md#word-filter) or [phrases](./LogsQL.md#phrase-filter) delimited with [`AND` operator](./LogsQL.md#logical-filter). For example, `foo AND bar` query must find [log messages](./keyConcepts.md#message-field) with `foo` and `bar` words at faster speed.
* BUGFIX: prevent from possible corruption of short [log fields](./VictoriaLogs/keyConcepts.md#data-model) during data ingestion.
* BUGFIX: prevent from possible corruption of short [log fields](./keyConcepts.md#data-model) during data ingestion.
* BUGFIX: prevent from additional CPU usage for up to a few seconds after canceling the query.
* BUGFIX: prevent from returning log entries with emtpy `_stream` field in the form `"_stream":""` in [search query results](./VictoriaLogs/querying/README.md). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6042).
* BUGFIX: prevent from returning log entries with emtpy `_stream` field in the form `"_stream":""` in [search query results](./querying/README.md). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6042).
## [v0.5.2](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.2-victorialogs)
Released at 2024-04-11
* BUGFIX: properly register new [log streams](./VictoriaLogs/keyConcepts.md#stream-fields) under high data ingestion rate. The issue has been introduced in [v0.5.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.0-victorialogs).
* BUGFIX: properly register new [log streams](./keyConcepts.md#stream-fields) under high data ingestion rate. The issue has been introduced in [v0.5.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.0-victorialogs).
## [v0.5.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.1-victorialogs)
Released at 2024-04-04
* BUGFIX: properly apply time range filter for queries containing [`OR` operators](./VictoriaLogs/LogsQL.md#logical-filter). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5920).
* BUGFIX: properly apply time range filter for queries containing [`OR` operators](./LogsQL.md#logical-filter). See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5920).
* BUGFIX: do not log debug lines `DEBUG: start trimLines` and `DEBUG: end trimLines`. This bug has been introduced in [v0.5.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.0-victorialogs) in [this commit](https://github.com/VictoriaMetrics/VictoriaMetrics/commit/0514091948cf8e00e42f44318c0e5e5b63b6388f).
## [v0.5.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.5.0-victorialogs)
Released at 2024-03-01
* FEATURE: support the ability to limit the number of returned log entries from [HTTP querying API](./VictoriaLogs/querying/README.md#http-api) by passing `limit` query arg. Previously all the matching log entries were returned until closing the response stream. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5674). Thanks to @dmitryk-dk for [the pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5778).
* FEATURE: support the ability to limit the number of returned log entries from [HTTP querying API](./querying/README.md#http-api) by passing `limit` query arg. Previously all the matching log entries were returned until closing the response stream. See [this feature request](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5674). Thanks to @dmitryk-dk for [the pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5778).
* BUGFIX: do not panic on incorrect regular expression in [stream filter](./VictoriaLogs/LogsQL.md#stream-filter). Thanks to @XLONG96 for [the bugfix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5897).
* BUGFIX: do not panic on incorrect regular expression in [stream filter](./LogsQL.md#stream-filter). Thanks to @XLONG96 for [the bugfix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5897).
* BUGFIX: properly determine when the assisted merge is needed. Previously the logs for determining whether the assisted merge is needed was broken. This could lead to too big number of parts under high data ingestion rate. Thanks to @lujiajing1126 for [the fix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5447).
* BUGFIX: properly stop execution of aborted query when the query doesn't contain [`_stream` filter](./VictoriaLogs/LogsQL.md#stream-filter). Previously such a query could continue consuming resources after being aborted by the client. Thanks to @z-anshun for [the fix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5400).
* BUGFIX: properly stop execution of aborted query when the query doesn't contain [`_stream` filter](./LogsQL.md#stream-filter). Previously such a query could continue consuming resources after being aborted by the client. Thanks to @z-anshun for [the fix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5400).
## [v0.4.2](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.4.2-victorialogs)
Released at 2023-11-15
* BUGFIX: properly locate logs for the [requested streams](./VictoriaLogs/LogsQL.md#stream-filter). Previously logs for some streams may be missing in query results. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4856). Thanks to @XLONG96 for [the fix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5295)!
* BUGFIX: [web UI](./VictoriaLogs/querying/README.md#web-ui): properly sort found logs by time. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5300).
* BUGFIX: properly locate logs for the [requested streams](./LogsQL.md#stream-filter). Previously logs for some streams may be missing in query results. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4856). Thanks to @XLONG96 for [the fix](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5295)!
* BUGFIX: [web UI](./querying/README.md#web-ui): properly sort found logs by time. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5300).
## [v0.4.1](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.4.1-victorialogs)
@ -365,12 +365,12 @@ Released at 2023-10-04
Released at 2023-10-03
* FEATURE: add `-elasticsearch.version` command-line flag, which can be used for specifying Elasticsearch version returned by VictoriaLogs to Filebeat at [elasticsearch bulk API](./VictoriaLogs/data-ingestion/README.md#elasticsearch-bulk-api). This helps resolving [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4777).
* FEATURE: expose the following metrics at [/metrics](./VictoriaLogs/README.md#monitoring) page:
* `vl_data_size_bytes{type="storage"}` - on-disk size for data excluding [log stream](./VictoriaLogs/keyConcepts.md#stream-fields) indexes.
* `vl_data_size_bytes{type="indexdb"}` - on-disk size for [log stream](./VictoriaLogs/keyConcepts.md#stream-fields) indexes.
* FEATURE: add `-elasticsearch.version` command-line flag, which can be used for specifying Elasticsearch version returned by VictoriaLogs to Filebeat at [elasticsearch bulk API](./data-ingestion/README.md#elasticsearch-bulk-api). This helps resolving [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4777).
* FEATURE: expose the following metrics at [/metrics](./README.md#monitoring) page:
* `vl_data_size_bytes{type="storage"}` - on-disk size for data excluding [log stream](./keyConcepts.md#stream-fields) indexes.
* `vl_data_size_bytes{type="indexdb"}` - on-disk size for [log stream](./keyConcepts.md#stream-fields) indexes.
* FEATURE: add `-insert.maxFieldsPerLine` command-line flag, which can be used for limiting the number of fields per line in logs sent to VictoriaLogs via ingestion protocols. This helps to avoid issues like [this](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4762).
* FEATURE: expose `vl_http_request_duration_seconds` histogram at the [/metrics](./VictoriaLogs/README.md#monitoring) page. Thanks to @crossoverJie for [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4934).
* FEATURE: expose `vl_http_request_duration_seconds` histogram at the [/metrics](./README.md#monitoring) page. Thanks to @crossoverJie for [this pull request](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/4934).
* FEATURE: add support of `-storage.minFreeDiskSpaceBytes` command-line flag to allow switching to read-only mode when running out of disk space at `-storageDataPath`. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4737).
* BUGFIX: fix possible panic when no data is written to VictoriaLogs for a long time. See [this issue](https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4895). Thanks to @crossoverJie for filing and fixing the issue.
@ -381,15 +381,15 @@ Released at 2023-10-03
Released at 2023-07-20
* FEATURE: add support for data ingestion via Promtail (aka default log shipper for Grafana Loki). See [these](./VictoriaLogs/data-ingestion/Promtail.md) and [these](./VictoriaLogs/data-ingestion/README.md#loki-json-api) docs.
* FEATURE: add support for data ingestion via Promtail (aka default log shipper for Grafana Loki). See [these](./data-ingestion/Promtail.md) and [these](./data-ingestion/README.md#loki-json-api) docs.
## [v0.2.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.2.0-victorialogs)
Released at 2023-07-17
* FEATURE: support short form of `_time` filters over the last X minutes/hours/days/etc. For example, `_time:5m` is a short form for `_time:(now-5m, now]`, which matches logs with [timestamps](./VictoriaLogs/keyConcepts.md#time-field) for the last 5 minutes. See [these docs](./VictoriaLogs/LogsQL.md#time-filter) for details.
* FEATURE: add ability to specify offset for the selected time range. For example, `_time:5m offset 1h` is equivalent to `_time:(now-5m-1h, now-1h]`. See [these docs](./VictoriaLogs/LogsQL.md#time-filter) for details.
* FEATURE: [LogsQL](./VictoriaLogs/LogsQL.md): replace `exact_prefix("...")` with `exact("..."*)`. This makes it consistent with [i()](./VictoriaLogs/LogsQL.md#case-insensitive-filter) filter, which can accept phrases and prefixes, e.g. `i("phrase")` and `i("phrase"*)`. See [these docs](./VictoriaLogs/LogsQL.md#exact-prefix-filter).
* FEATURE: support short form of `_time` filters over the last X minutes/hours/days/etc. For example, `_time:5m` is a short form for `_time:(now-5m, now]`, which matches logs with [timestamps](./keyConcepts.md#time-field) for the last 5 minutes. See [these docs](./LogsQL.md#time-filter) for details.
* FEATURE: add ability to specify offset for the selected time range. For example, `_time:5m offset 1h` is equivalent to `_time:(now-5m-1h, now-1h]`. See [these docs](./LogsQL.md#time-filter) for details.
* FEATURE: [LogsQL](./LogsQL.md): replace `exact_prefix("...")` with `exact("..."*)`. This makes it consistent with [i()](./LogsQL.md#case-insensitive-filter) filter, which can accept phrases and prefixes, e.g. `i("phrase")` and `i("phrase"*)`. See [these docs](./LogsQL.md#exact-prefix-filter).
## [v0.1.0](https://github.com/VictoriaMetrics/VictoriaMetrics/releases/tag/v0.1.0-victorialogs)

552
docs/VictoriaLogs/LogsQL.md
View file

File diff suppressed because it is too large Load diff