CDC File Transfer
11 hours ago
- #file-sync
- #Stadia
- #CDC
- Tools developed from Stadia's ashes for syncing and streaming files between Windows and Linux using Content Defined Chunking (CDC).
- cdc_rsync optimizes file syncing by skipping unchanged files, using fast compression, and transferring only changed parts, making it up to 30x faster than traditional rsync.
- cdc_stream allows for efficient file streaming from Windows to Linux with caching and delta updates, offering 2x to 5x speed improvements over sshfs.
- Both tools leverage CDC for efficient diffing, reducing data transfer by focusing on changed chunks rather than entire files.
- Setup requires SSH and SFTP access without password prompts, with support for key-based authentication and optional SSH config files.
- Precompiled binaries are available for quick setup, with detailed instructions for building from source on both Windows and Linux platforms.
- Debugging and logging options are provided for troubleshooting, including verbosity levels and log file locations.