The archivist’s web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns Created by ArchiveTeam on Feb 05, 2015.
