Update readme

master
float-trip 2023-07-11 05:05:24 +00:00
parent 04ea9c9e5e
commit 70bad811bb
1 changed files with 11 additions and 1 deletions

View File

@ -1,3 +1,11 @@
# Reddit Ingest
Distributed server/client setup for ingesting all of reddit.
- Scales to multiple clients.
- Supports reddit authentication.
- Tolerant to clients losing state/going offline.
```bash
# ...install PostgreSQL...
pip install -r requirements.txt
@ -7,8 +15,10 @@ mv fetcher_config.example.yaml fetcher_config.yaml
mkdir logs
bash compile_proto.sh
# Then run both of these files:
# Run one instance of batcher.py:
python batcher.py
# And several instances of fetcher.py:
python fetcher.py
```