Infrastructure/ansible
3
0
Fork 0
Code Issues Pull requests 6 Projects Releases Packages Wiki Activity Actions

Increase the number of parallel crawls from 35 to 38.

Browse source
This commit is contained in:
Adrian Reber 2015-05-06 12:36:06 +00:00
parent 3357ba0d37
commit c7f31e41bb
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
roles/mirrormanager/crawler/files/crawler.cron
View file

@ -1,4 +1,4 @@
# run the crawler twice a day # run the crawler twice a day
# logs sent to /var/log/mirrormanager/crawler.log and crawl/* by default # logs sent to /var/log/mirrormanager/crawler.log and crawl/* by default
# 32GB of RAM is not enough for 75 threads, 35 seems to work so far # 32GB of RAM is not enough for 75 threads, 38 seems to work so far
0 */12 * * * mirrormanager /usr/bin/mm2_crawler --threads 35 `/usr/local/bin/run_crawler.sh 2` > /dev/null 2>&1 0 */12 * * * mirrormanager /usr/bin/mm2_crawler --threads 35 `/usr/local/bin/run_crawler.sh 2` > /dev/null 2>&1