Fast, small, open: pick three.
Vortex is an open-source columnar file format for fast scans, random access, and compression.
$ cargo add vortex$ uv add vortex-data$ uvx --from vortex-data vx --helpINSTALL vortex; LOAD vortex; SELECT * FROM read_vortex('data.vortex');$ cargo add vortex-datafusionimplementation("dev.vortex:vortex-spark_2.13:0.90.0:all")File format benchmarksread 3 Nov 2026
| Benchmark | Vortex | Parquet | Lance | Arrow | vs Parquet |
|---|---|---|---|---|---|
| Scan | 5.18× | 1.00× | 0.95× | — | 5.2× faster |
| Write | 2.04× | 1.00× | 0.72× | — | 2.0× faster |
| ClickBench | 41.91 ms | 65.52 ms | 570.94 ms | — | 56% faster |
| GPU, cuDF, end to end, hot, on GH200, NDS-H SF10, Parquet the fastest of four configurations per query, from the Vortex UW–Madison talk | 17.00 ms | 65.88 ms | N/A | — | 3.9× faster |
| Random access | 0.67 ms | 67.88 ms | 2.08 ms | 3.57 ms | 101× faster |
| File size | 1.14× | 1× | 2.11× | 5.95× | 14% larger |
Underlined: the best in each rowbench.vortex.dev