diff options
| author | Silvio Rhatto <rhatto@riseup.net> | 2013-08-25 16:16:56 -0300 |
|---|---|---|
| committer | Silvio Rhatto <rhatto@riseup.net> | 2013-08-25 16:16:56 -0300 |
| commit | 7a029cd60ca04b64d76d5b0d87a608c0fdd93106 (patch) | |
| tree | f7c96ea1553492b74640cadc92555380923f6b67 | |
| parent | 399d75317c9adf4c22fdbb3b6bf4be579ce1b9f2 (diff) | |
| download | httruta-7a029cd60ca04b64d76d5b0d87a608c0fdd93106.tar.gz httruta-7a029cd60ca04b64d76d5b0d87a608c0fdd93106.tar.bz2 | |
Initial httracker code
| -rw-r--r-- | README.mdwn | 6 | ||||
| -rwxr-xr-x[-rw-r--r--] | scuttler (renamed from scuttle.sh) | 3 |
2 files changed, 7 insertions, 2 deletions
diff --git a/README.mdwn b/README.mdwn index b5aff85..48f9eca 100644 --- a/README.mdwn +++ b/README.mdwn @@ -3,5 +3,7 @@ Feed Crawler Download all links from a feed using httrack. - curl $URL > urls.txt - httrack -r$LEVEL -e%$EXT_LEVEL -m$FILESIZE -Y -%L urls.txt +TODO +---- + +- Auto sync git-annex at arquivo.sarava.org. diff --git a/scuttle.sh b/scuttler index d41405f..be0cabc 100644..100755 --- a/scuttle.sh +++ b/scuttler @@ -1,4 +1,7 @@ #!/bin/bash +# +# Download all links from a Semantic Scuttle instance. +# BASEDIR=/var/sites/links SCUTTLEDIR=`basename $( find ${BASEDIR} -maxdepth 1 -iname "SemanticScuttle-*" | head -n 1 )` |