Velox: A composable and extensible C++ execution engine library
a day ago
- #data-processing
- #C++
- #open-source
- Velox is an open-source C++ library for building high-performance data processing components.
- It supports various analytical workloads including batch, interactive, stream processing, and AI/ML.
- Developed by Meta in partnership with companies like IBM, Intel, and Microsoft.
- Velox does not include a SQL parser or optimizer; it's designed for integration into other compute engines.
- Key components include Type system, Vector memory layout, Expression Eval, Functions, Operators, I/O connectors, and Resource Management.
- Extensible for custom types, functions, operators, file formats, storage adapters, and network serializers.
- Supports multiple compilers and platforms with specific version requirements.
- Includes setup scripts for macOS, Ubuntu, and CentOS to simplify dependency installation.
- Can be built and tested using Docker for convenience.
- Licensed under Apache 2.0, with community engagement via Slack, GitHub Issues, and Discussions.