Skip to content
← Projects

ReliaDL

Production-grade resilient parallel download engine for data pipelines

Domain
Systems
Status
Beta
Year
2026
Stars
★ 7

ReliaDL is a fault-tolerant parallel file download framework and streaming engine for unreliable or non-stationary links. It combines resumable chunked transfer, per-chunk SHA-256 verification, proxy tunneling, async rate limiting and Prometheus observability. Status: beta.

The problem

Large data transfers over unreliable or corporate-proxied links fail, corrupt or stall without resumable, verified, rate-controlled downloading.

How it works

  1. 01

    Resumable chunked transfer with streaming per-chunk SHA-256/384/512 verification and Ed25519-signed Merkle manifests

  2. 02

    SOCKS5 and HTTP CONNECT proxy tunneling

  3. 03

    Token-bucket rate limiting

  4. 04

    Prometheus metrics and structured JSON logging

  5. 05

    Adaptive chunk sizing (BL-DCS) and EXP3.S mirror routing implemented as a library, not yet wired into the download path