now with configuration
This commit is contained in:
parent
65b1520697
commit
34d26f7def
10 changed files with 497 additions and 83 deletions
26
README.md
26
README.md
|
|
@ -1,12 +1,34 @@
|
|||
# republisher-redux
|
||||
|
||||
``` shell
|
||||
mkdir -p logs out
|
||||
nix develop
|
||||
uv sync --all-groups
|
||||
uv run repub
|
||||
cat > repub.toml <<'EOF'
|
||||
out_dir = "out"
|
||||
|
||||
[[feeds]]
|
||||
name = "gp-pod"
|
||||
url = "https://guardianproject.info/podcast/podcast.xml"
|
||||
|
||||
[[feeds]]
|
||||
name = "nasa"
|
||||
url = "https://www.nasa.gov/rss/dyn/breaking_news.rss"
|
||||
EOF
|
||||
uv run repub --config repub.toml
|
||||
```
|
||||
|
||||
`out_dir` may be relative or absolute. Relative paths are resolved against the
|
||||
directory containing the config file. Optional Scrapy runtime overrides can be
|
||||
set in the same file:
|
||||
|
||||
```toml
|
||||
[scrapy.settings]
|
||||
LOG_LEVEL = "DEBUG"
|
||||
DOWNLOAD_TIMEOUT = 30
|
||||
```
|
||||
|
||||
See [`demo/README.md`](/home/abel/src/guardianproject/anynews/republisher-redux/demo/README.md) for a self-contained example config.
|
||||
|
||||
## TODO
|
||||
|
||||
- [x] Offlines RSS feed xml
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue