diff options
| -rw-r--r-- | README.mdwn | 4 | ||||
| -rwxr-xr-x | httracker | 2 |
2 files changed, 4 insertions, 2 deletions
diff --git a/README.mdwn b/README.mdwn index c07521b..cf1b36f 100644 --- a/README.mdwn +++ b/README.mdwn @@ -1,10 +1,12 @@ Feed Crawler ============ -Download all links from a feed using httrack. +Download all links from a feed using httrack. This is the engine behind the +"Cache" feature used by https://links.sarava.org Semantic Scuttle instance. TODO ---- - Auto sync git-annex at arquivo.sarava.org. - Cronjob for httracker. +- Include all sites already donwloaded by scuttler. @@ -1,6 +1,6 @@ #!/bin/bash # -# Httrack feed downloader +# Httrack feed downloader. # # Configuration |