Loading benchmark summaries…
This can take a few seconds after new results are published.
Compressionⓘ17 charts
Write Throughput
#1vortex2.98x1762 MB/s
#2lance1.83x1226 MB/s
#3parquet1.00x605 MB/s
Scan Throughput
#1vortex32.01x84.90 GB/s
#2lance7.04x17.05 GB/s
#3parquet1.00x3.20 GB/s
Geomean throughput ratio to Parquet | Aggregate throughput (higher is better)
Compression Sizeⓘ26 charts
#1parquet8.53x
#2vortex8x
#3lance4.29x
#4arrow-ipc1.07x
parquet: minimum 1x, mean 1x, maximum 1x1x1x1x
vortex: minimum 0.551x, mean 1.07x, maximum 1.43x0.551x
Random Accessⓘ9 charts
Hot
#1vortex1.15x1.84 ms
#2lance1.79x3.60 ms
#3arrow-ipc2.71x15.80 ms
#4parquet976.82x56.92 s
Cold
#1vortex1.38x3.28 ms
#2arrow-ipc
Clickbenchⓘ43 charts
Performance Summary
#1datafusion:vortex1.12x3.94 s
#2duckdb:vortex1.31x4.74 s
#3datafusion:vortex-compact1.40x4.85 s
#4duckdb:vortex-compact1.52x5.25 s
#5duckdb:parquet1.70x5.47 s
#6datafusion:parquet1.76x6.09 s
TPC-H (NVMe) (SF=1)ⓘ22 charts
Performance Summary
#1duckdb:duckdb1.15x398.01 ms
#2duckdb:vortex1.32x448.37 ms
#3duckdb:vortex-compact1.42x476.39 ms
#4datafusion:vortex1.56x537.25 ms
#5datafusion:vortex-compact1.67x567.79 ms
#6datafusion:arrow2.90x1.08 s
#7
TPC-H (S3) (SF=1)ⓘ22 charts
Performance Summary
#1datafusion:parquet1.15x5.26 s
#2datafusion:vortex-compact1.38x6.25 s
#3datafusion:vortex1.51x7.11 s
#4duckdb:vortex-compact1.55x7.04 s
#5datafusion:lance1.61x7.69 s
#6duckdb:vortex1.66x7.61 s
#7
TPC-H (NVMe) (SF=10)ⓘ22 charts
Performance Summary
#1duckdb:duckdb1.19x1.37 s
#2duckdb:vortex1.34x1.61 s
#3datafusion:vortex1.46x1.87 s
#4duckdb:vortex-compact1.46x1.74 s
#5datafusion:vortex-compact1.58x1.95 s
#6duckdb:parquet2.67x3.36 s
#7
TPC-H (S3) (SF=10)ⓘ22 charts
Performance Summary
#1datafusion:vortex-compact1.21x12.29 s
#2datafusion:parquet1.21x12.96 s
#3datafusion:vortex1.28x13.38 s
#4duckdb:parquet1.57x16.18 s
#5duckdb:vortex-compact2.31x24.39 s
#6duckdb:vortex2.44x26.17 s
#7
TPC-H (NVMe) (SF=100)ⓘ22 charts
Performance Summary
#1duckdb:vortex1.21x11.85 s
#2datafusion:vortex1.53x18.96 s
#3duckdb:parquet1.60x14.26 s
#4datafusion:parquet2.06x20.42 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=100)ⓘ22 charts
Performance Summary
#1duckdb:parquet1.16x44.73 s
#2datafusion:parquet1.25x50.81 s
#3datafusion:vortex1.42x60.95 s
#4duckdb:vortex6.80x304.24 s
Geomean of query time ratio to fastest (lower is better)
TPC-DS (NVMe) (SF=1)ⓘ99 charts
Performance Summary
#1duckdb:duckdb1.13x2.27 s
#2duckdb:vortex1.32x2.21 s
#3duckdb:parquet1.52x2.71 s
#4duckdb:vortex-compact1.79x2.96 s
#5datafusion:vortex2.15x4.37 s
#6datafusion:vortex-compact2.46x4.96 s
#7
Statistical and Population Geneticsⓘ11 charts
Performance Summary
#1datafusion:vortex1.18x3.71 s
#2datafusion:parquet1.60x3.95 s
#3datafusion:vortex-compact1.70x5.68 s
#4duckdb:vortex1.98x6.74 s
#5duckdb:vortex-compact2.54x8.43 s
#6duckdb:parquet
PolarSignals Profilingⓘ10 charts
Performance Summary
#1datafusion:vortex1.00x480.31 ms
Geomean of query time ratio to fastest (lower is better)
fineweb [nvme]9 charts
Performance Summary
#1datafusion:vortex1.26x244.80 ms
#2duckdb:vortex1.31x281.03 ms
#3duckdb:vortex-compact3.33x888.08 ms
#4datafusion:vortex-compact3.57x791.80 ms
#5duckdb:parquet3.78x668.59 ms
#6datafusion:parquet3.79x625.85 ms
Geomean of query time ratio to fastest (lower is better)
fineweb [s3]9 charts
Performance Summary
#1datafusion:vortex-compact1.14x4.16 s
#2datafusion:vortex1.19x4.50 s
#3duckdb:vortex1.80x6.97 s
#4duckdb:vortex-compact1.98x7.63 s
#5datafusion:parquet2.18x6.72 s
#6duckdb:parquet2.43x8.03 s
Geomean of query time ratio to fastest (lower is better)
appian [nvme]8 charts
Performance Summary
#1duckdb:duckdb1.23x1.78 s
#2duckdb:parquet1.26x1.82 s
#3duckdb:vortex1.32x2.08 s
#4duckdb:vortex-compact1.35x2.13 s
#5datafusion:vortex1.71x11.31 s
#6datafusion:vortex-compact1.74x11.33 s
#7datafusion:parquet2.17x11.72 s
Geomean of query time ratio to fastest (lower is better)
clickbench-sorted [nvme]10 charts
Performance Summary
#1datafusion:vortex1.15x325.05 ms
#2duckdb:vortex1.36x265.15 ms
#3datafusion:vortex-compact1.51x413.13 ms
#4duckdb:vortex-compact1.58x312.11 ms
#5duckdb:parquet1.70x398.84 ms
#6duckdb:duckdb2.91x629.37 ms
#7datafusion:parquet
vortex [nvme]3 charts
Performance Summary
#1datafusion:parquet1.19x497.07 ms
#2datafusion:vortex1.24x443.70 ms
#3duckdb:vortex1.56x565.44 ms
#4duckdb:parquet2.32x840.11 ms
Geomean of query time ratio to fastest (lower is better)
1.07x
1.43x
lance: minimum 1.29x, mean 1.99x, maximum 2.59x1.29x1.99x2.59x
arrow-ipc: minimum 2.68x, mean 8x, maximum 30.6x2.68x8x30.6x
Geometric means of compressed sizes versus Arrow (higher is better) and versus Parquet-zstd (lower is better)
1.82x10.21 ms
Geomean of take time ratio to fastest across every dataset (lower is better)
#7
duckdb:duckdb
2.22x6.35 s
#8datafusion:lance15.67x52.47 s
Geomean of query time ratio to fastest (lower is better)
duckdb:parquet
4.49x1.59 s
#8datafusion:lance5.36x1.98 s
#9datafusion:parquet5.53x1.83 s
Geomean of query time ratio to fastest (lower is better)
duckdb:parquet
2.69x12.22 s
Geomean of query time ratio to fastest (lower is better)
datafusion:parquet
3.30x3.81 s
#8datafusion:arrow11.25x16.39 s
#9datafusion:lance16.58x23.15 s
Geomean of query time ratio to fastest (lower is better)
datafusion:lance
3.53x43.02 s
Geomean of query time ratio to fastest (lower is better)
datafusion:parquet
2.81x5.38 s
Geomean of query time ratio to fastest (lower is better)
4.25x
7.56 s
Geomean of query time ratio to fastest (lower is better)
3.21x1.30 s
#8datafusion:lance68.95x21.29 s
Geomean of query time ratio to fastest (lower is better)
