Skip to content

feat: implement asynchronous streaming database dump using R2 and DO Alarms#122

Open
Angelebeats wants to merge 2 commits intoouterbase:mainfrom
Angelebeats:feat/streaming-dump
Open

feat: implement asynchronous streaming database dump using R2 and DO Alarms#122
Angelebeats wants to merge 2 commits intoouterbase:mainfrom
Angelebeats:feat/streaming-dump

Conversation

@Angelebeats
Copy link
Copy Markdown

This PR addresses Issue #59 by implementing an asynchronous streaming dump solution for large databases.

  • Uses Cloudflare Durable Object Alarms to generate the dump in background chunks.
  • Streams data directly to Cloudflare R2 using Multipart Upload to solve the 1GB memory limit.
  • Resilient to Durable Object reboots via persistent state in ctx.storage.
  • Adds /export/status/:taskId and /export/download/:taskId endpoints for progress monitoring and final retrieval.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant