Drama Harvester is a dynamic tool designed to interface seamlessly with rDrama's public APIs, capturing and caching content like comments and posts in Redis for efficient access and processing. Perfect for developers seeking to integrate or analyze rDrama data, it offers automatic and incremental fetching to ensure up-to-date content retrieval without redundancy. With its focus on performance and scalability, Drama Harvester serves as a robust foundation for applications requiring real-time or near-real-time access to rDrama content.
 
Go to file
j 5ab8150b33 Initial commit 2024-03-19 01:16:12 -04:00
src Initial commit 2024-03-19 01:16:12 -04:00
tests/api Initial commit 2024-03-19 01:16:12 -04:00
.gitignore Initial commit 2024-03-19 01:16:12 -04:00
README.MD Initial commit 2024-03-19 01:16:12 -04:00
package-lock.json Initial commit 2024-03-19 01:16:12 -04:00
package.json Initial commit 2024-03-19 01:16:12 -04:00
tsconfig.json Initial commit 2024-03-19 01:16:12 -04:00
tsconfig.tests.json Initial commit 2024-03-19 01:16:12 -04:00

README.MD

Drama Harvester

Introduction

Drama Harvester is a specialized tool designed to interface with rDrama's public APIs, retrieve content such as comments and posts, and publish them to Redis for caching and further processing. Its goal is to facilitate the real-time ingestion of rDrama content, serving as a foundational layer for applications requiring streamlined access to rDrama data.

Features

  • Retrieves comments and posts from rDrama's endpoints.
  • Publishes content to Redis, ensuring efficient caching.
  • Supports incremental fetching to minimize redundant data retrieval.

Getting Started

Prerequisites

  • Node.js (version 14 or later recommended)
  • Redis server instance

Installation

  1. Clone the repository:

    git clone https://fsdfsd.net/J/DramaHarvester.git
    
  2. Navigate to the project directory:

    cd DramaHarvester
    
  3. Install dependencies:

    npm install
    

Configuration

  1. Copy the .env.example file to a new file named .env.

    cp .env.example .env
    
  2. Edit the .env file to include your Redis connection details and any other configuration variables.

Running Drama Harvester

To start the application, run:

npm start