Full backend Infrastructure for DuckDB production and analytics system
Published: March 7, 2026
DuckDB needs backend infra to run as a production service - REST API, auth, monitoring, storage policies. Came across Arc - a solid backend implementation for DuckDB. Written in Go by Ignacio Van Droogenbroeck. Open source (AGPL-3.0).
- REST API layer with multiple response formats (JSON/Arrow)
- Auth with management API
- Multiple storage backends (Local/S3/MinIO/Azure)
- Automatic file compaction for query performance
- Time-based partitioning, Retention policies
- Connection pooling, continuous queries
- Prometheus metrics and structured logging
- Write-Ahead Log (optional)
Built on DuckDB + Parquet + Arrow - all DuckDB SQL. Originally built for time series, but the backend patterns apply to any DuckDB deployments. Wonderful library.