grab-site is an easy preconfigured web crawler designed for backing up and #archive websites.
https://github.com/ArchiveTeam/grab-site
Shows a dashboard with all of your crawls, showing which URLs are being grabbed, how many URLs are left in the queue, and more.