Show HN: Buquet – Durable queues and workflows using only S3
19 hours ago
- #workflow-orchestration
- #S3-storage
- #distributed-systems
- buquet is a Rust and Python library for building durable queues and workflows using S3-compatible object storage.
- Motivated by experiences with Temporal, buquet offers a simpler alternative for workflow orchestration.
- Key S3 features enabling buquet include Read-after-write consistency, Write-Once Semantic, and Compare-and-Swap (CAS).
- Atomic task claiming, state transitions, duplication prevention, and audit trails are managed via S3's features.
- Simplifies infrastructure by reducing dependencies to just S3, lowering costs and increasing transparency.
- Workflow capabilities include DAGs, task dependencies, fan-out/fan-in patterns, conditional branching, and signaling.
- Estimated cost is about $100/month for 1 million tasks, leveraging cheap object storage.
- Source code is available for further exploration and use.