The Latest Linux File-System: TernFS
3 hours ago
- #File-System
- #Open-Source
- #Linux
- XTX Markets, a major algorithmic trading firm, has open-sourced its Linux file-system, TernFS.
- TernFS is designed for distributed storage, handling large immutable files (at least a few megabytes in size).
- It supports up to 10EB of logical file storage, one trillion files, 100 billion directories, and one million clients.
- TernFS runs on commodity hardware and Ethernet networking, with no single point of failure for metadata.
- The file-system spans multiple geographic regions and stores data redundantly to protect against drive failures.
- TernFS has been in development for over three years and is used in all XTX machine learning efforts.
- XTX reports no data loss on TernFS to date.
- TernFS is now open-source under GPLv2+ and Apache 2.0 licenses, available on GitHub.