Drama Harvester is a dynamic tool designed to interface seamlessly with rDrama's public APIs, capturing and caching content like comments and posts in Redis for efficient access and processing. Perfect for developers seeking to integrate or analyze rDrama data, it offers automatic and incremental fetching to ensure up-to-date content retrieval without redundancy. With its focus on performance and scalability, Drama Harvester serves as a robust foundation for applications requiring real-time or near-real-time access to rDrama content.

Go to file

j b9547d652c tree shaking		2024-03-22 01:25:26 -04:00
src	Initial commit	2024-03-19 01:16:12 -04:00
tests/api	Initial commit	2024-03-19 01:16:12 -04:00
.gitignore	Initial commit	2024-03-19 01:16:12 -04:00
README.MD	Initial commit	2024-03-19 01:16:12 -04:00
package-lock.json	tree shaking	2024-03-22 01:25:26 -04:00
package.json	tree shaking	2024-03-22 01:25:26 -04:00
tsconfig.json	Initial commit	2024-03-19 01:16:12 -04:00
tsconfig.tests.json	Initial commit	2024-03-19 01:16:12 -04:00

README.MD

Drama Harvester

Introduction

Drama Harvester is a specialized tool designed to interface with rDrama's public APIs, retrieve content such as comments and posts, and publish them to Redis for caching and further processing. Its goal is to facilitate the real-time ingestion of rDrama content, serving as a foundational layer for applications requiring streamlined access to rDrama data.

Features

Retrieves comments and posts from rDrama's endpoints.
Publishes content to Redis, ensuring efficient caching.
Supports incremental fetching to minimize redundant data retrieval.

Getting Started

Prerequisites

Node.js (version 14 or later recommended)
Redis server instance

Installation

Clone the repository:

git clone https://fsdfsd.net/J/DramaHarvester.git

Navigate to the project directory:
```
cd DramaHarvester
```
Install dependencies:
```
npm install
```

Configuration

Copy the .env.example file to a new file named .env.
```
cp .env.example .env
```
Edit the .env file to include your Redis connection details and any other configuration variables.

Running Drama Harvester

To start the application, run:

npm start