From 399d75317c9adf4c22fdbb3b6bf4be579ce1b9f2 Mon Sep 17 00:00:00 2001 From: Silvio Rhatto Date: Sun, 25 Aug 2013 16:08:20 -0300 Subject: Initial import --- README.mdwn | 7 +++++++ 1 file changed, 7 insertions(+) create mode 100644 README.mdwn (limited to 'README.mdwn') diff --git a/README.mdwn b/README.mdwn new file mode 100644 index 0000000..b5aff85 --- /dev/null +++ b/README.mdwn @@ -0,0 +1,7 @@ +Feed Crawler +============ + +Download all links from a feed using httrack. + + curl $URL > urls.txt + httrack -r$LEVEL -e%$EXT_LEVEL -m$FILESIZE -Y -%L urls.txt -- cgit v1.2.3