Skip to content
Vortex
GitHub
PyPI
crates.io
Quickstart
Install
Convert
Explore and Query
Python Quickstart
Rust Quickstart
C++ Quickstart
Java Quickstart
Concepts
DTypes
Arrays
Expressions
Layouts
File Format
Scan API
User Guides
DataFusion
DuckDB
Pandas
Polars
PyArrow
Ray Data
Spark
Vortex Python
Work In Progress
Developer Guide
Extending Vortex
Extension DTypes
Writing a Vortex Encoding
Writing a Layout
Writing a Compute Function
Language Bindings
Benchmarking
Crate Architecture
Session and Registries
Runtime and Threading Model
Vtables and Dispatch
Execution
Scan Plans
Stats Pruning
I/O Subsystem
Serialization
CUDA Support
DataFusion
Spark
Specifications
File Format
Editions
IPC Format
DType Format
Scalar Format
Row Encoding Byte Sort Specification
API Reference
Python API
Data Types
Scalars
Arrays
Expressions
Compression
Registry
Input and Output
Object Store support
Dataset
Hugging Face Datasets
Runtime
Type Aliases
Rust API
C API
DTypes
Arrays
Java API
Project
Community
Roadmap
Language Bindings Evolution
Contributing
Changelog
0.85.0 (Draft)
0.84.0
0.83.0
0.82.0
0.81.0
0.80.0
References
User Guides
¶
Using Vortex with query engines, table formats, and data tools.
DataFusion
Setup
Reading Vortex Files
Writing Vortex Files
Querying
DuckDB
Setup
Reading files
Writing files
Python
Pandas
Reading a Vortex File into Pandas
Converting In-Memory Arrays
Polars
PyArrow
Writing Vortex Files
Reading Vortex Files
Arrow Interop
Ray Data
Spark
Getting Vortex into Spark
Installation as a Build Dependency
Reading Vortex Files
Writing Vortex Files
Spark SQL
Direct File Queries
Supported Types
S3 Support
Vortex Python
Installation
Creating Arrays
DTypes
Array Operations
Expressions
VortexFile
ArrayIterator
Threading Model
Conversion
Work In Progress
Iceberg
Substrait
cuDF
Trino