Loading benchmark summaries…
This can take a few seconds after new results are published.
Compressionⓘ17 charts
Write Throughput
#1vortex3.29x1900 MB/s
#2lance1.86x1245 MB/s
#3parquet1.00x605 MB/s
Scan Throughput
#1vortex38.50x110.89 GB/s
#2lance6.79x16.62 GB/s
#3parquet1.00x3.20 GB/s
Geomean throughput ratio to Parquet | Aggregate throughput (higher is better)
Compression Sizeⓘ26 charts
#1parquet8.53x
#2vortex7.99x
#3lance4.29x
#4arrow-ipc1.07x
parquet: minimum 1x, mean 1x, maximum 1x1x1x1x
vortex: minimum 0.551x, mean 1.07x, maximum 1.47x0.551x
Random Accessⓘ18 charts
Hot
#1vortex1.15x132.05 ms
#2lance1.37x121.69 ms
#3arrow-ipc2.38x15.95 ms
#4parquet166.44x72.50 s
Clickbenchⓘ43 charts
Performance Summary
#1duckdb:vortex1.16x4.20 s
#2datafusion:vortex1.23x3.94 s
#3duckdb:vortex-compact1.35x4.65 s
#4datafusion:vortex-compact1.35x4.21 s
#5duckdb:parquet1.85x5.43 s
#6datafusion:parquet1.95x6.14 s
TPC-H (NVMe) (SF=1)ⓘ22 charts
Performance Summary
#1duckdb:duckdb1.15x408.99 ms
#2duckdb:vortex1.27x439.07 ms
#3duckdb:vortex-compact1.36x466.56 ms
#4datafusion:vortex1.54x541.48 ms
#5datafusion:vortex-compact1.64x567.39 ms
#6datafusion:arrow2.82x1.08 s
#7
TPC-H (S3) (SF=1)ⓘ22 charts
Performance Summary
#1datafusion:lance1.19x7.69 s
#2datafusion:parquet1.29x7.86 s
#3datafusion:vortex-compact1.41x8.69 s
#4duckdb:vortex-compact1.53x9.75 s
#5datafusion:vortex1.74x11.10 s
#6duckdb:vortex1.75x10.88 s
#7
TPC-H (NVMe) (SF=10)ⓘ22 charts
Performance Summary
#1duckdb:duckdb1.19x1.37 s
#2duckdb:vortex1.30x1.57 s
#3duckdb:vortex-compact1.41x1.67 s
#4datafusion:vortex1.45x1.85 s
#5datafusion:vortex-compact1.55x1.91 s
#6duckdb:parquet2.69x3.36 s
#7
TPC-H (S3) (SF=10)ⓘ22 charts
Performance Summary
#1datafusion:parquet1.18x15.91 s
#2datafusion:vortex-compact1.27x16.57 s
#3datafusion:vortex1.32x17.25 s
#4duckdb:parquet1.81x23.31 s
#5duckdb:vortex-compact2.22x30.11 s
#6duckdb:vortex2.29x31.98 s
#7
TPC-H (NVMe) (SF=100)ⓘ22 charts
Performance Summary
#1duckdb:vortex1.28x11.75 s
#2datafusion:vortex1.40x16.58 s
#3duckdb:parquet1.69x14.22 s
#4datafusion:parquet2.20x20.53 s
Geomean of query time ratio to fastest (lower is better)
TPC-H (S3) (SF=100)ⓘ22 charts
Performance Summary
#1datafusion:vortex1.12x43.48 s
#2duckdb:parquet1.29x49.61 s
#3datafusion:parquet1.30x51.97 s
#4duckdb:vortex10.28x492.47 s
Geomean of query time ratio to fastest (lower is better)
TPC-DS (NVMe) (SF=1)ⓘ99 charts
Performance Summary
#1duckdb:duckdb1.14x2.30 s
#2duckdb:vortex1.26x2.15 s
#3duckdb:vortex-compact1.44x2.41 s
#4duckdb:parquet1.51x2.71 s
#5datafusion:vortex2.13x4.36 s
#6datafusion:vortex-compact2.29x4.73 s
#7
Statistical and Population Geneticsⓘ11 charts
Performance Summary
#1datafusion:vortex1.16x3.59 s
#2datafusion:vortex-compact1.54x5.06 s
#3datafusion:parquet1.60x3.88 s
#4duckdb:vortex2.01x6.74 s
#5duckdb:vortex-compact2.43x7.97 s
#6duckdb:parquet
PolarSignals Profilingⓘ10 charts
Performance Summary
#1datafusion:vortex1.00x363.89 ms
Geomean of query time ratio to fastest (lower is better)
fineweb [nvme]9 charts
Performance Summary
#1datafusion:vortex1.13x255.22 ms
#2duckdb:vortex1.27x291.44 ms
#3duckdb:vortex-compact3.08x877.07 ms
#4datafusion:vortex-compact3.34x844.52 ms
#5datafusion:parquet3.35x622.24 ms
#6duckdb:parquet3.39x679.68 ms
Geomean of query time ratio to fastest (lower is better)
fineweb [s3]9 charts
Performance Summary
#1datafusion:vortex1.07x4.53 s
#2datafusion:vortex-compact1.21x5.23 s
#3duckdb:vortex-compact1.62x7.14 s
#4duckdb:vortex1.62x7.10 s
#5datafusion:parquet2.47x8.99 s
#6duckdb:parquet2.55x9.91 s
Geomean of query time ratio to fastest (lower is better)
appian [nvme]8 charts
Performance Summary
#1duckdb:duckdb1.23x1.77 s
#2duckdb:parquet1.25x1.81 s
#3duckdb:vortex1.31x2.05 s
#4duckdb:vortex-compact1.33x2.08 s
#5datafusion:vortex1.72x11.29 s
#6datafusion:vortex-compact1.74x11.33 s
#7datafusion:parquet2.19x11.75 s
Geomean of query time ratio to fastest (lower is better)
clickbench-sorted [nvme]10 charts
Performance Summary
#1duckdb:vortex1.07x195.07 ms
#2datafusion:vortex1.29x351.25 ms
#3duckdb:vortex-compact1.33x244.41 ms
#4datafusion:vortex-compact1.59x374.23 ms
#5duckdb:parquet1.84x397.01 ms
#6duckdb:duckdb3.18x621.55 ms
#7datafusion:parquet
vortex [nvme]3 charts
Performance Summary
#1datafusion:parquet1.20x502.86 ms
#2datafusion:vortex1.22x438.31 ms
#3duckdb:vortex1.57x570.56 ms
#4duckdb:parquet2.30x839.07 ms
Geomean of query time ratio to fastest (lower is better)
1.07x
1.47x
lance: minimum 1.29x, mean 1.99x, maximum 2.59x1.29x1.99x2.59x
arrow-ipc: minimum 2.68x, mean 8x, maximum 30.6x2.68x8x30.6x
Geometric means of compressed sizes versus Arrow (higher is better) and versus Parquet-zstd (lower is better)
arrow-ipc
1.93x10.11 ms
Geomean of take time ratio to fastest across every dataset (lower is better)
#7
duckdb:duckdb
2.45x6.32 s
#8datafusion:lance17.65x52.04 s
Geomean of query time ratio to fastest (lower is better)
duckdb:parquet
4.41x1.60 s
#8datafusion:lance5.37x2.03 s
#9datafusion:parquet5.40x1.84 s
Geomean of query time ratio to fastest (lower is better)
duckdb:parquet
3.00x18.38 s
Geomean of query time ratio to fastest (lower is better)
datafusion:parquet
3.29x3.80 s
#8datafusion:arrow11.28x16.39 s
#9datafusion:lance17.03x23.61 s
Geomean of query time ratio to fastest (lower is better)
datafusion:lance
2.79x43.02 s
Geomean of query time ratio to fastest (lower is better)
datafusion:parquet
2.79x5.38 s
Geomean of query time ratio to fastest (lower is better)
4.35x
7.65 s
Geomean of query time ratio to fastest (lower is better)
3.61x1.30 s
#8datafusion:lance78.32x21.50 s
Geomean of query time ratio to fastest (lower is better)
