Hasty Briefsbeta

Bilingual

Hyperpb: 10x faster dynamic Protobuf parsing that's faster than generated code

9 months ago
  • #Performance
  • #OpenSource
  • #Protobuf
  • hyperpb is a fully-dynamic Protobuf parser that is 10x faster than dynamicpb and 3x faster than parsing with generated code.
  • It matches or beats vtprotobuf’s generated code in benchmarks without compromising correctness.
  • hyperpb enables processing and validating large amounts of arbitrary streamed data in a type-aware manner.
  • It was developed to solve bottlenecks encountered while building Bufstream, enabling broker-side validation with Protobuf.
  • hyperpb supports all proto2, proto3, and editions-mode schemas, matching Protobuf Go perfectly.
  • The parser requires compilation at runtime, similar to a regular expression library, and includes advanced features like profile-guided optimization.
  • hyperpb is open-sourced to foster wider Protobuf adoption and to engage with the community for further improvements.
  • Buf is hiring for those interested in working on novel projects like hyperpb.