VictoriaMetrics/app/vmstorage
Aliaksandr Valialkin 5f52eb7653 lib/fs: do not postpone directory removal on NFS error
Continue trying to remove NFS directory on temporary errors for up to a minute.

The previous async removal process breaks in the following case during VictoriaMetrics start

- VictoriaMetrics opens index, finds incomplete merge transactions and starts replaying them.
- The transaction instructs removing old directories for parts, which were already merged into bigger part.
- VictoriaMetrics removes these directories, but their removal is delayed due to NFS errors.
- VictoriaMetrics scans partition directory after all the incomplete merge transactions are finished
  and finds directories, which should be removed, but weren't still removed due to NFS errors.
- VictoriaMetrics panics when it finds unexpected empty directory.

Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/162
2019-11-10 13:27:16 +02:00
..
deployment all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00
transport all: report the number of bytes read on io.ReadFull error 2019-09-11 14:50:24 +03:00
main.go lib/fs: do not postpone directory removal on NFS error 2019-11-10 13:27:16 +02:00
Makefile all: small updates after PR #114 2019-07-24 17:43:43 +03:00
README.md all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00

vmstorage performs the following tasks:

  • Accepts inserts from vminsert nodes and stores them to local storage.

  • Performs select requests from vmselect nodes.