Bilingual

<antirez>
2 days ago
- GEO API for indexing and querying by latitude and longitude.
- BITFIELD command for manipulating strings as bit arrays of integers.
- Redis Cluster improvements including rebalancing and better replica migration.
- Lua scripts replication now supports effects replication for scripts with side effects.
- New Lua scripts debugger with redis-cli support.
- Memory efficiency improvements via SDS and Jemalloc changes, plus a new List internal representation.
- Consistent expiration of keys across slaves and masters during read operations.
- SPOP command now accepts an optional count argument.
- RDB AUX fields storing metadata like server version and date.
- Faster RDB loading.
- Sentinel can now monitor many masters (advanced beta).
We're Building Postgres in Rust. Using the LLVM of Databases
13 days ago
- Turso is becoming the LLVM of databases, with SQLite as the first frontend and Postgres as the next.
- Turso is a modern rewrite of SQLite in Rust, featuring concurrent writes via MVCC, a rich type system, and self-updating materialized views.
- The project aims to build a Postgres-compatible database with a modern architecture, including embedded browser support and file-based operation.
- Turso uses a bytecode language (VDBE) and has demonstrated running Doom via this bytecode in a browser.
- The approach involves compiling Postgres SQL to Turso's bytecode, merging pgmicro into Turso as an official project.
- Turso is open-source with over 260 contributors, emphasizing reliability through rigorous testing methods.
- The FAQ addresses compatibility, server support, AI contributions, development pace, and extension handling via WASM.
Let's Build PlanetScale from Scratch: Infrastructure
13 days ago
- The author is building Homescale, a tool for creating writable database instances and point-in-time branches from immutable snapshots without full database copies.
- Homescale uses a Docker-like model with images, containers, and branches, supporting multiple database engines like Postgres.
- It separates storage from compute, enabling branching in the storage layer using copy-on-write (COW) to share unchanged data across branches.
- Ceph provides the underlying block storage with RBD for immutable snapshots and writable COW clones, integrated via Kubernetes and Rook.
- Homescale leverages Kubernetes as a control plane for managing resources like PVCs and VolumeSnapshots, with plans for local and cloud deployments.
Rad: The relational database, redesigned. OLTP backed by durable object storage
15 days ago
- Rad is a redesigned relational database with a declarative schema as the source of truth for databases, migrations, and type-safe clients.
- It generates type-safe clients directly from the schema, eliminating the need for ORMs, query builders, and string-gluing in queries.
- The toolchain includes database migration handling, with schema changes automatically computed and run, and supports rename hints to maintain intent.
- Rad is built for object storage from day one, featuring stateless compute and durable data storage, and uses a JSON-over-HTTP protocol for generated clients.
- It runs as a single executable on Windows, macOS, or Linux, including both the database server and CLI developer tools.
Lightning Memory-Mapped Database Manager (LMDB) 1.0
a month ago
- LMDB is a Btree-based embedded database management library with a simplified BerkeleyDB-like API.
- It uses memory-mapped files for direct data access, eliminating the need for malloc or memcpy during fetches, resulting in high performance and simplicity.
- The database is fully transactional with ACID semantics, thread-aware, and supports concurrent read/write access across multiple processes and threads.
- Data pages employ copy-on-write, preventing overwrites and ensuring corruption resistance without special recovery after system crashes.
- Writes are serialized to avoid deadlocks, while readers operate without locks due to multi-versioning, allowing non-blocking read/write concurrency.
- Unlike write-ahead logs or append-only databases, LMDB requires no maintenance like checkpointing, as it reuses free pages to prevent unbounded file growth.
- Memory maps can be read-only (for corruption immunity) or read-write (for higher write performance, but with risk from buggy application code).
- Stale reader transactions or broken lockfiles can cause issues; fixes include using mdb_reader_check and handling semaphore ownership on BSD systems.

database

<antirez>

We're Building Postgres in Rust. Using the LLVM of Databases

Let's Build PlanetScale from Scratch: Infrastructure

Rad: The relational database, redesigned. OLTP backed by durable object storage

Lightning Memory-Mapped Database Manager (LMDB) 1.0