21 GB/s CSV Parsing Using SIMD on AMD 9950X
a year ago
- #CSV Parsing
- #Performance Optimization
- #SIMD
- Sep 0.10.0 achieves 21 GB/s CSV parsing speed on AMD 9950X (Zen 5).
- Performance improved from ~7 GB/s (0.1.0) to ~21 GB/s (0.10.0) in under 2 years.
- AVX-512 optimizations and hardware upgrades (Zen 3 to Zen 5) contributed to the speed boost.
- New AVX-512-to-256 parser circumvents .NET 9.0's suboptimal AVX-512 code generation, achieving faster speeds.
- Multi-threaded Sep parses 1 million rows in 72 ms (8 GB/s) on the 9950X.
- Cross-platform Vector256 parser performs on par with AVX2, ensuring broad compatibility.