0.76.0 (Draft)#

Draft — GitHub Release

Changes#

⚠️ Breaks#

✨ Features#

  • Expose array buffer replacement (#8606) @gatesn

  • bool -> Primitive casts (#8621) @myrrc

  • feat: add metadata bridge for Python CUDA export (#8604) @0ax1

  • Add list_length scalar function (#8495) @mhk197

  • feat(file): make Footer::new public (#8602) @tobias-fire

  • feat(array): push struct validity into children (#8589) @miniex

  • Support session-time source configuration in DataFusion, and clear up precedence between config sources (#8575) @AdamGS

  • feat(python): package CUDA as an optional extension (#8510) @0ax1

  • Decimal casting (#8562) @gatesn

  • Add JSON to Parquet Variant conversion with shredding (#8391) @AdamGS

  • Add extension storage scalar function (#8540) @gatesn

  • Numerical aggregate functions have an option to skip or include nans in calculation, skip by default (#8457) @robert3005

  • feat(vortex-geo): ST_Distance via the geo crate + Polygon type (#8497) @HarukiMoriarty

  • feat[gpu]: arrow device array stream support (#8483) @0ax1

  • feat(vortex-datafusion): struct scalar conversion + extension-over-struct scan (#8453) @HarukiMoriarty

  • feat: DeltaScheme adjustable compression ratio threshold (#8461) @joseph-isaacs

  • Add Delta scheme to the integer compressor (unstable_encodings) (#8212) @joseph-isaacs

  • Push down some expressions to Dict layout reader’s cached values (#8341) @myrrc

  • –patterns flag for random-access-bench (#8446) @myrrc

  • ffi: create data source from memory buffer (#8426) @myrrc

  • Constant comparison and byte_length OnPair kernels (#8371) @myrrc

  • REGEX support for sqllogictests (#8392) @myrrc

  • feat(vortex-geo): Arrow import/export for the native Point type (#8374) @HarukiMoriarty

🚀 Performance#

🐛 Bug Fixes#

20 changes

  • fix(vortex-bench): map gs:// scheme to gcs storage label (#8630) @brancz

  • fix: CUDA bitpacked sliced output allocation (#8622) @0ax1

  • Fix wasm32 build by gating MultiFileSession on non-wasm targets (#8612) @robert3005

  • fix: support 64K alignment (#8599) @a10y

  • Guard calling is_nan on scalar value on dtype being a float (#8593) @robert3005

  • vortex-datafusion: Pipe session through to converter (#8591) @brancz

  • Save children dtypes/length in ZstdBuffersMetadata (#8572) @myrrc

  • fix(array): don’t panic on unsupported arrow types (#8564) @miniex

  • fix(layout): don’t panic collecting an empty stream (#8472) @miniex

  • Correctly calculate FSST compressed output size (#8551) @robert3005

  • refactor[fsst]: take ArrayRef in fsst_compress, decide offset width upfront (#7900) @mprammer

  • Move optimizer kernels into a dedicated KernelSession (#8511) @gatesn

  • Fix is_zero() for FixedSizeList and Struct scalar types (#8500) @connortsui20

  • Handle null lanes in primitive take (#8505) @gatesn

  • Preserve dict referenced values metadata (#8499) @gatesn

  • fix: preserve operand width in DecimalValue checked arithmetic (#7380) @abnobdoss

  • fix Fuzz constant OOM for CUDA (#8481) @a10y

  • vortex-tui: query tab should work for non-*.vortex files (#8473) @a10y

  • Ignore PyO3 rustsec (#8381) @connortsui20

  • fix: vx_data_source_new_buffer sem-merge conflict (#8437) @joseph-isaacs

📖 Documentation#

🧰 Maintenance#

49 changes