Bloom filters: the niche trick behind a 16× faster API – Blog – incident.io
6 hours ago
- #API latency
- #performance optimization
- #bloom filters
- Improved API endpoint P95 latency from 5 seconds to 0.3 seconds using a bloom filter technique.
- Address performance issues in alert filtering by implementing mandatory time-bound filters and bloom filters for efficient attribute filtering.
- Explored and compared GIN indexes vs. bloom filters, opting for bloom filters due to better long-term scalability and control.
- Reduced data processing by leveraging ULID-based pagination and time partitioning, significantly cutting down query times.
- Achieved a 16x performance improvement, enhancing user experience for large organizations with high alert volumes.