Commit graph

80 commits

Author SHA1 Message Date
Aliaksandr Valialkin
6339cae5de
wip 2024-04-29 03:22:27 +02:00
Aliaksandr Valialkin
d9fdbf907c
wip 2024-04-29 03:20:43 +02:00
Aliaksandr Valialkin
449eade980
wip 2024-04-29 03:08:35 +02:00
Aliaksandr Valialkin
cb42a1a6fc
wip 2024-04-29 02:18:48 +02:00
Aliaksandr Valialkin
ccb4031e62
wip 2024-04-29 02:04:42 +02:00
Aliaksandr Valialkin
fcbad5ac1b
wip 2024-04-29 01:32:11 +02:00
Aliaksandr Valialkin
53c3384bf7
wip 2024-04-29 00:54:32 +02:00
Aliaksandr Valialkin
1b67995907
wip 2024-04-29 00:35:16 +02:00
Aliaksandr Valialkin
20fd87f86f
wip 2024-04-29 00:05:31 +02:00
Aliaksandr Valialkin
24f07dfdc3
wip 2024-04-28 23:19:40 +02:00
Aliaksandr Valialkin
0850e13eb3
wip 2024-04-28 22:52:15 +02:00
Aliaksandr Valialkin
a941bdcdbd
wip 2024-04-28 22:42:50 +02:00
Aliaksandr Valialkin
59b7bef051
wip 2024-04-28 22:15:27 +02:00
Aliaksandr Valialkin
0f31264e83
wip 2024-04-28 16:21:08 +02:00
Aliaksandr Valialkin
3008c58ac8
wip 2024-04-28 12:52:55 +02:00
Aliaksandr Valialkin
75914210ec
wip 2024-04-27 22:08:03 +02:00
Aliaksandr Valialkin
f9d0b21bb9
wip 2024-04-27 21:15:56 +02:00
Aliaksandr Valialkin
56d6496319
wip 2024-04-27 20:36:02 +02:00
Aliaksandr Valialkin
d282056124
wip 2024-04-27 04:43:38 +02:00
Aliaksandr Valialkin
91c7902555
wip 2024-04-27 04:26:15 +02:00
Aliaksandr Valialkin
75bbe51a05
wip 2024-04-27 03:31:19 +02:00
Aliaksandr Valialkin
16a91539bd
wip 2024-04-27 03:14:00 +02:00
Aliaksandr Valialkin
2270c42c82
wip 2024-04-27 02:50:19 +02:00
Aliaksandr Valialkin
51b869d458
wip 2024-04-27 01:53:32 +02:00
Aliaksandr Valialkin
9f8dd1ef31
wip 2024-04-27 00:52:15 +02:00
Aliaksandr Valialkin
640b18cd66
wip 2024-04-26 23:47:50 +02:00
Aliaksandr Valialkin
65f09bc641
wip 2024-04-26 00:19:58 +02:00
Aliaksandr Valialkin
5512787b72
lib/logstorage: add support for fields modifier 2024-04-25 03:44:07 +02:00
Aliaksandr Valialkin
d304785936
wip 2024-04-25 02:16:06 +02:00
Aliaksandr Valialkin
984dd2abaf
lib/logstorage: optimize typical AND case 2024-04-25 00:57:48 +02:00
Aliaksandr Valialkin
ffdafc32c6
lib/logstorage: skip scheduled work when stopCh is closed
This saves CPU time
2024-04-24 23:41:20 +02:00
Aliaksandr Valialkin
e42b9d26a9
lib/logstorage: skip log entries if it is impossible to find stream tags for them
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6042
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6127
2024-04-24 23:24:09 +02:00
Aliaksandr Valialkin
543a6b9cee
lib/logstorage: search in partitions in parallel 2024-04-24 23:04:29 +02:00
Aliaksandr Valialkin
e7685164f5
wip 2024-04-24 18:32:58 +02:00
Aliaksandr Valialkin
522415bf56
lib/logstorage: small clarifications in comments 2024-04-23 15:49:58 +02:00
wanshuangcheng
83216e956c
chore: fix function names in comment (#6076)
Signed-off-by: wanshuangcheng <wanshuangcheng@outlook.com>
2024-04-08 01:11:12 -07:00
Aliaksandr Valialkin
918cccaddf
all: fix golangci-lint(revive) warnings after 0c0ed61ce7
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6001
2024-04-02 23:16:29 +03:00
XLONG96
a5795f533d
lib/logstorage: avoid panic when parsing regex with stream filter (#5897) 2024-02-29 15:31:54 +02:00
Aliaksandr Valialkin
4617dc8bbe
lib/logstorage: consistently use atomic.* types instead of atomic.* functions on regular types
See ea9e2b19a5
2024-02-23 23:46:13 +02:00
Aliaksandr Valialkin
f81b480905
lib/mergeset: consistently use atomic.* types instead of atomic.* function calls on ordinary types
See ea9e2b19a5
2024-02-23 23:29:35 +02:00
Aliaksandr Valialkin
275335c181
lib/logstorage: consistently use atomic.* type for refCount and mustDrop fields in datadb and storage structs in the same way as it is used in lib/storage
See ea9e2b19a5 and a204fd69f1
2024-02-23 23:04:42 +02:00
Aliaksandr Valialkin
0514091948
app/vlselect: follow-up for 451d2abf50
- Consistently return the first `limit` log entries if the total size of found log entries doesn't exceed 1Mb.
  See app/vlselect/logsql/sort_writer.go . Previously random log entries could be returned with each request.
- Document the change at docs/VictoriaLogs/CHANGELOG.md
- Document the `limit` query arg at docs/VictoriaLogs/querying/README.md
- Make the change less intrusive.

Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5674
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5778
2024-02-18 23:05:51 +02:00
Dmytro Kozlov
451d2abf50
Enable the limit query param for the /select/logsql/query (#5778)
* app/vlselect: add limit for logs query

* app/vlselect: CHANGELOG.md

* app/vlselect: stop search process if limit is reached, update logic, remove default limit

* app/vlselect: fix tests

* app/vlselect: fix filter tests

* app/vlselect: fix tests
2024-02-18 22:58:47 +02:00
noodles2hg
cafd6f08b3
lib/logstorage: proper exit during block search (#5400) 2024-02-01 12:11:05 +00:00
Jiajing LU
333bda8702
count inmemoryParts that have not been taken for merge (#5447) 2024-02-01 12:06:28 +00:00
Aliaksandr Valialkin
2655c02d5e
lib/logstorage: make sure that WaitGroup.Add isnt called after stopCh is closed and WaitGroup.Wait is called
This protects from rare panic, which may occur during graceful shutdown of VictoriaLogs
2024-01-26 21:17:02 +01:00
Aliaksandr Valialkin
3449d563bd
all: add up to 10% random jitter to the interval between periodic tasks performed by various components
This should smooth CPU and RAM usage spikes related to these periodic tasks,
by reducing the probability that multiple concurrent periodic tasks are performed at the same time.
2024-01-22 18:40:32 +02:00
Aliaksandr Valialkin
cef7a39ba3
lib/logstorage: always check the previous indexBlockHeader for blocks with matching tenantID and/or streamID
The previous indexBlockHeader may contain blocks for the matching tenantID and/or streamID,
so it must be scanned unconditionally during the search.

Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/5295
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4856

This is a follow-up for 89dcbc2fe7
2023-11-13 23:13:53 +01:00
XLONG96
89dcbc2fe7
lib/logstorage: fix streamID and tenantID search (#4856) (#5295) 2023-11-13 23:09:39 +01:00
Aliaksandr Valialkin
42dd71bb63
all: consistently use %w instead of %s in when error is passed to fmt.Errorf()
This allows consistently using errors.Is() for verifying whether the given error wraps some other known error.
2023-10-25 21:24:03 +02:00