0.91.0 (Draft)

Draft — GitHub Release

Changes

✨ Features

• Add lambdas and variables for higher-order scalar functions (#10502) @mhk197

🚀 Performance

• Optimise take on dictionaries with constant codes (#10643) @robert3005

• Add Filter/Split/Project planner and add Datafusion usage of this (#10706) @joseph-isaacs

🐛 Bug Fixes

• fix: write empty nested list streams with structural layouts (#10533) @danking

• Propagate child writer errors from the struct writer (#10710) @robert3005

• fix(spark): return the requested field when Spark prunes nested fields (#10724) @gitRasheed

🧰 Maintenance

• ci: cache Python wheel compilation on prebuilt runners (#10727) @robert3005

• ci: use the SQL fixture profile for Vortex conversion (#10728) @robert3005

• Parallelize TPC-DS generation within each table (#10692) @robert3005