Skip to content

Brackit 0.9

Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 13 Apr 18:44
· 31 commits to master since this release
v0.9
81673bf

Highlights

Performance: 1 Billion JSON Records in 16 seconds

  • Parallel group-by: 1B records at 3.0 GB/s (97% of disk I/O speed)
  • bjq native 2-5x faster than jq on all scales
  • 100M+ records with only 4GB heap (jq OOMs at 100M)

New Architecture

  • FastJSONParser: byte-level parser with field interning, CompactObject, Int32 cache
  • StreamingJSONParser: SIMD structural index, zero-copy slices for >2GB files
  • MappedJsonScanner: Foreign Memory API mmap for multi-GB files
  • ParallelGroupByExec: 1BRC-inspired parallel chunk processing with open-addressing byte-key hash map
  • SpillableGroupBy: disk-spill for large aggregations
  • MorselPipeline: DuckDB-inspired morsel-driven parallelism
  • TupleSerializer: binary serialization for external merge sort

Native Binaries

All binaries built with Oracle GraalVM, PGO (Profile-Guided Optimization), G1 GC, and -O3:

  • bjq-linux-amd64
  • bjq-linux-arm64
  • bjq-macos-amd64
  • bjq-macos-arm64
  • bjq-windows-amd64.exe

Install

curl -L https://github.com/sirixdb/brackit/releases/latest/download/bjq-linux-amd64 -o bjq
chmod +x bjq
sudo mv bjq /usr/local/bin/

Full Changelog: v0.7...v0.9

Assets 2
Loading