aboutsummaryrefslogtreecommitdiff
path: root/README.mdwn
blob: cf1b36f3f9efacd4ec216386c001f7181a86fdd5 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
Feed Crawler
============

Download all links from a feed using httrack. This is the engine behind the
"Cache" feature used by https://links.sarava.org Semantic Scuttle instance.

TODO
----

- Auto sync git-annex at arquivo.sarava.org.
- Cronjob for httracker.
- Include all sites already donwloaded by scuttler.