Vortex Benchmarks

Compressionⓘ17 charts

Compression Throughput

#1vortex3.01x

#2lance1.05x

#3parquet1.00x

Decompression Throughput

#1vortex21.28x

#2lance14.79x

#3parquet1.00x

Geomean throughput ratio to Parquet (higher is better)

arade

loading…

bimbo

loading…

cmsprovider

loading…

euro2016

loading…

food

loading…

hashtags

loading…

taxi

loading…

tpc-h l_comment canonical

loading…

tpc-h l_comment chunked

loading…

wide table cols=10000 chunks=1 rows=1000

loading…

wide table cols=10000 chunks=50 rows=1000

loading…

Compression Sizeⓘ26 charts

Compression Size Summary

#1parquet1.00x

#2vortex1.07x

#3lance5.10x

Geomean size ratio to Parquet (lower is better)

appian

loading…

arade

loading…

bimbo

loading…

clickbench

loading…

cmsprovider

loading…

Random Accessⓘ9 charts

Random Access Performance

#1vortex346.00 us1.00x

#2lance356.10 us1.03x

#3parquet8.81 s25453.97x

Random access time | Ratio to fastest (lower is better)

feature-vectors/correlated

loading…

feature-vectors/uniform

loading…

nested-lists/correlated

loading…

nested-lists/uniform

loading…

nested-structs/correlated

loading…

Clickbenchⓘ43 charts

Performance Summary

#1datafusion:vortex1.17x10.65 s

#2duckdb:parquet1.39x10.23 s

#3duckdb:vortex1.43x10.99 s

#4datafusion:vortex-compact1.59x13.54 s

#5duckdb:vortex-compact1.59x11.59 s

#6duckdb:duckdb1.64x10.63 s

TPC-H (NVMe) (SF=1)ⓘ22 charts

Performance Summary

#1duckdb:duckdb1.20x603.98 ms

#2datafusion:vortex1.45x723.39 ms

#3datafusion:vortex-compact1.71x822.89 ms

#4duckdb:vortex1.86x893.72 ms

#5duckdb:vortex-compact2.01x955.07 ms

#6datafusion:arrow2.02x1.08 s

TPC-H (S3) (SF=1)ⓘ22 charts

Performance Summary

#1datafusion:parquet1.24x6.74 s

#2datafusion:vortex-compact1.33x7.06 s

#3datafusion:lance1.35x7.69 s

#4datafusion:vortex1.37x7.43 s

#5duckdb:vortex-compact1.66x9.16 s

#6duckdb:vortex1.73x9.52 s

#7duckdb:parquet

TPC-H (NVMe) (SF=10)ⓘ22 charts

Performance Summary

#1duckdb:duckdb1.09x2.17 s

#2duckdb:vortex1.58x3.20 s

#3duckdb:vortex-compact1.66x3.31 s

#4datafusion:vortex1.85x4.53 s

#5datafusion:vortex-compact2.21x4.94 s

#6duckdb:parquet2.27x4.69 s

TPC-H (S3) (SF=10)ⓘ22 charts

Performance Summary

#1datafusion:vortex1.14x13.07 s

#2datafusion:vortex-compact1.19x13.40 s

#3datafusion:parquet1.35x16.16 s

#4duckdb:vortex-compact1.70x20.06 s

#5duckdb:vortex1.70x20.35 s

#6duckdb:parquet1.88x22.09 s

TPC-H (NVMe) (SF=100)ⓘ22 charts

Performance Summary

#1duckdb:vortex1.11x23.51 s

#2duckdb:parquet1.31x25.62 s

#3datafusion:vortex1.89x52.61 s

#4datafusion:parquet2.41x54.38 s

Geomean of query time ratio to fastest (lower is better)

Q1

loading…

TPC-H (S3) (SF=100)ⓘ22 charts

Performance Summary

#1datafusion:vortex1.13x75.90 s

#2datafusion:parquet1.31x80.06 s

#3duckdb:vortex2.22x139.51 s

#4duckdb:parquet2.55x164.66 s

Geomean of query time ratio to fastest (lower is better)

Q1

loading…

TPC-DS (NVMe) (SF=1)ⓘ99 charts

Performance Summary

#1duckdb:duckdb1.11x3.40 s

#2duckdb:parquet1.40x3.96 s

#3duckdb:vortex1.65x4.29 s

#4datafusion:vortex1.87x6.90 s

#5duckdb:vortex-compact2.27x5.86 s

#6datafusion:parquet2.38x7.34 s

#7datafusion:vortex-compact

Statistical and Population Geneticsⓘ11 charts

Performance Summary

#1duckdb:vortex1.18x11.35 s

#2duckdb:vortex-compact1.82x15.19 s

#3duckdb:parquet2.41x10.09 s

Geomean of query time ratio to fastest (lower is better)

Q0

loading…

Q1

loading…

PolarSignals Profilingⓘ10 charts

Performance Summary

#1datafusion:vortex1.00x810.50 ms

Geomean of query time ratio to fastest (lower is better)

Q0

loading…

Q1

loading…

Q2

loading…

fineweb [nvme]9 charts

Q0

loading…

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

fineweb [s3]9 charts

Q0

loading…

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

appian [nvme]8 charts

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

Q5

loading…

clickbench-sorted [nvme]10 charts

Q23

loading…

Q24

loading…

Q26

loading…

Q36

loading…

vortex [nvme]3 charts

Q0

loading…

Q1

loading…

Q2

loading…

Loading benchmark summaries…

This can take a few seconds after new results are published.

Compressionⓘ17 charts

Compression Throughput

#1vortex3.01x

#2lance1.05x

#3parquet1.00x

Decompression Throughput

#1vortex21.28x

#2lance14.79x

#3parquet1.00x

Geomean throughput ratio to Parquet (higher is better)

arade

loading…

bimbo

loading…

cmsprovider

loading…

euro2016

loading…

food

loading…

hashtags

loading…

taxi

loading…

tpc-h l_comment canonical

loading…

tpc-h l_comment chunked

loading…

wide table cols=10000 chunks=1 rows=1000

loading…

wide table cols=10000 chunks=50 rows=1000

loading…

Compression Sizeⓘ26 charts

Compression Size Summary

#1parquet1.00x

#2vortex1.07x

#3lance5.10x

Geomean size ratio to Parquet (lower is better)

appian

loading…

arade

loading…

bimbo

loading…

clickbench

loading…

cmsprovider

loading…

Random Accessⓘ9 charts

Random Access Performance

#1vortex346.00 us1.00x

#2lance356.10 us1.03x

#3parquet8.81 s25453.97x

Random access time | Ratio to fastest (lower is better)

feature-vectors/correlated

loading…

feature-vectors/uniform

loading…

nested-lists/correlated

loading…

nested-lists/uniform

loading…

nested-structs/correlated

loading…

Clickbenchⓘ43 charts

Performance Summary

#1datafusion:vortex1.17x10.65 s

#2duckdb:parquet1.39x10.23 s

#3duckdb:vortex1.43x10.99 s

#4datafusion:vortex-compact1.59x13.54 s

#5duckdb:vortex-compact1.59x11.59 s

#6duckdb:duckdb1.64x10.63 s

TPC-H (NVMe) (SF=1)ⓘ22 charts

Performance Summary

#1duckdb:duckdb1.20x603.98 ms

#2datafusion:vortex1.45x723.39 ms

#3datafusion:vortex-compact1.71x822.89 ms

#4duckdb:vortex1.86x893.72 ms

#5duckdb:vortex-compact2.01x955.07 ms

#6datafusion:arrow2.02x1.08 s

TPC-H (S3) (SF=1)ⓘ22 charts

Performance Summary

#1datafusion:parquet1.24x6.74 s

#2datafusion:vortex-compact1.33x7.06 s

#3datafusion:lance1.35x7.69 s

#4datafusion:vortex1.37x7.43 s

#5duckdb:vortex-compact1.66x9.16 s

#6duckdb:vortex1.73x9.52 s

#7duckdb:parquet

TPC-H (NVMe) (SF=10)ⓘ22 charts

Performance Summary

#1duckdb:duckdb1.09x2.17 s

#2duckdb:vortex1.58x3.20 s

#3duckdb:vortex-compact1.66x3.31 s

#4datafusion:vortex1.85x4.53 s

#5datafusion:vortex-compact2.21x4.94 s

#6duckdb:parquet2.27x4.69 s

TPC-H (S3) (SF=10)ⓘ22 charts

Performance Summary

#1datafusion:vortex1.14x13.07 s

#2datafusion:vortex-compact1.19x13.40 s

#3datafusion:parquet1.35x16.16 s

#4duckdb:vortex-compact1.70x20.06 s

#5duckdb:vortex1.70x20.35 s

#6duckdb:parquet1.88x22.09 s

TPC-H (NVMe) (SF=100)ⓘ22 charts

Performance Summary

#1duckdb:vortex1.11x23.51 s

#2duckdb:parquet1.31x25.62 s

#3datafusion:vortex1.89x52.61 s

#4datafusion:parquet2.41x54.38 s

Geomean of query time ratio to fastest (lower is better)

Q1

loading…

TPC-H (S3) (SF=100)ⓘ22 charts

Performance Summary

#1datafusion:vortex1.13x75.90 s

#2datafusion:parquet1.31x80.06 s

#3duckdb:vortex2.22x139.51 s

#4duckdb:parquet2.55x164.66 s

Geomean of query time ratio to fastest (lower is better)

Q1

loading…

TPC-DS (NVMe) (SF=1)ⓘ99 charts

Performance Summary

#1duckdb:duckdb1.11x3.40 s

#2duckdb:parquet1.40x3.96 s

#3duckdb:vortex1.65x4.29 s

#4datafusion:vortex1.87x6.90 s

#5duckdb:vortex-compact2.27x5.86 s

#6datafusion:parquet2.38x7.34 s

#7datafusion:vortex-compact

Statistical and Population Geneticsⓘ11 charts

Performance Summary

#1duckdb:vortex1.18x11.35 s

#2duckdb:vortex-compact1.82x15.19 s

#3duckdb:parquet2.41x10.09 s

Geomean of query time ratio to fastest (lower is better)

Q0

loading…

Q1

loading…

PolarSignals Profilingⓘ10 charts

Performance Summary

#1datafusion:vortex1.00x810.50 ms

Geomean of query time ratio to fastest (lower is better)

Q0

loading…

Q1

loading…

Q2

loading…

fineweb [nvme]9 charts

Q0

loading…

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

fineweb [s3]9 charts

Q0

loading…

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

appian [nvme]8 charts

Q1

loading…

Q2

loading…

Q3

loading…

Q4

loading…

Q5

loading…

clickbench-sorted [nvme]10 charts

Q23

loading…

Q24

loading…

Q26

loading…

Q36

loading…

vortex [nvme]3 charts

Q0

loading…

Q1

loading…

Q2

loading…