diff options
Diffstat (limited to 'README.mdwn')
| -rw-r--r-- | README.mdwn | 7 |
1 files changed, 7 insertions, 0 deletions
diff --git a/README.mdwn b/README.mdwn new file mode 100644 index 0000000..b5aff85 --- /dev/null +++ b/README.mdwn @@ -0,0 +1,7 @@ +Feed Crawler +============ + +Download all links from a feed using httrack. + + curl $URL > urls.txt + httrack -r$LEVEL -e%$EXT_LEVEL -m$FILESIZE -Y -%L urls.txt |