blob: 6d9bbbf106578afe0c2fe876f890ec8acedfc9cf (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
|
HTTRUTA Feed Crawler Project
============================
Download all links from a feed using httrack. This is the engine behind the
"Cache" feature used by https://links.fluxo.info Semantic Scuttle instance.
Usage
-----
Place this script somewhere and setup a cronjob like this:
`*/5 * * * * /var/sites/cache/httruta/httracker &> /dev/null`
|