Aliaksandr Valialkin
|
99d67ac8ad
|
lib/storage: validate timestamps in the block only if they use encoding, which needs validation
This reduces CPU usage when there is no sense in validating timestamps.
This is a follow-up for 5fa9525498
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011
|
2022-10-21 00:52:32 +03:00 |
|
Aliaksandr Valialkin
|
5fa9525498
|
lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block
This should reduce chances of unnoticed on-disk data corruption.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011
This change modifies the format for data exported via /api/v1/export/native -
now this data contains MaxTimestamp and PrecisionBits fields from blockHeader.
This is OK, since the native export format is undocumented.
|
2022-09-06 13:08:09 +03:00 |
|
Aliaksandr Valialkin
|
4ff647137a
|
lib/storage: deduplicate samples more thoroughly
Previously some duplicate samples may be left on disk for time series with high churn rate.
This may result in higher disk space usage.
|
2021-12-15 15:59:58 +02:00 |
|
Aliaksandr Valialkin
|
1d20a19c7d
|
lib/storage: explicitly pass dedupInterval to DeduplicateSamples() and deduplicateSamplesDuringMerge()
This improves the code readability and debuggability, since the output of these functions
stops depending on global state.
|
2021-12-14 20:49:12 +02:00 |
|
Aliaksandr Valialkin
|
29e4e7f422
|
lib/storage: drop more samples outside the given retention during background merge
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/17
|
2020-11-01 23:35:06 +02:00 |
|
Aliaksandr Valialkin
|
38789e4aa0
|
lib/storage: fix 32-bit builds for GOARH=386 or GOARCH=arm
|
2020-09-29 12:40:35 +03:00 |
|
Aliaksandr Valialkin
|
95688cbfc5
|
all: add native format for data export and import
The data can be exported via [/api/v1/export/native](https://victoriametrics.github.io/#how-to-export-data-in-native-format) handler
and imported via [/api/v1/import/native](https://victoriametrics.github.io/#how-to-import-data-in-native-format) handler.
|
2020-09-27 19:54:07 +03:00 |
|
Aliaksandr Valialkin
|
24ca30bf66
|
lib/storage: correctly use maxBlockSize in various checks
Previously `maxBlockSize` has been multiplied by 8 in certain checks. This is unnecessary.
|
2020-09-24 18:12:56 +03:00 |
|
Aliaksandr Valialkin
|
18af31a4c2
|
all: properly split vm_deduplicated_samples_total among cluster components
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/345
|
2020-02-27 23:48:07 +02:00 |
|
Aliaksandr Valialkin
|
c3d86eef96
|
all: add -dedup.minScrapeInterval command-line flag for data de-duplication
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/86
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/278
|
2020-01-31 01:16:57 +02:00 |
|
Aliaksandr Valialkin
|
3748fb24b6
|
lib/storage: skip recovering timestamps order for lossless compression (PrecisionBits=64)
|
2020-01-18 00:09:33 +02:00 |
|
Aliaksandr Valialkin
|
0b488f1e37
|
lib/storage: do not change timestamps to constant rate if values are constant or have constant delta
This breaks the original timestamps, which results in issues like
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/120 and
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/141 .
|
2019-08-06 15:40:07 +03:00 |
|
Aliaksandr Valialkin
|
1836c415e6
|
all: open-sourcing single-node version
|
2019-05-23 00:18:06 +03:00 |
|