path: root/README.mdwn

Feed Crawler
============

Download all links from a feed using httrack.

    curl $URL > urls.txt
    httrack -r$LEVEL -e%$EXT_LEVEL -m$FILESIZE -Y -%L urls.txt