MM crawler: skip lost+found during rsync crawl

The rsync based crawler has two excludes hardcoded:

 cmd = "rsync --temp-dir=/tmp -r --exclude=.snapshot --exclude='*.~tmp~'"

To avoid failures during rsync crawling this adds 'lost+found' to the
exclude list via the configuration file.

Signed-off-by: Adrian Reber <adrian@lisas.de>
This commit is contained in:
Adrian Reber 2018-03-12 10:14:44 +01:00
parent 47242c6716
commit 9e13fede63
Failed to extract signature

View file

@ -161,7 +161,7 @@ CHECK_SESSION_IP = True
# Specify additional rsync parameters for the crawler
# # --timeout 14400: abort rsync crawl after 4 hours
CRAWLER_RSYNC_PARAMETERS = '--no-motd --timeout 14400'
CRAWLER_RSYNC_PARAMETERS = '--no-motd --timeout 14400 --exclude=lost+found'
###
# Configuration options used by the crons