Conversation
Polar Signals Profiling ResultsLatest Run
Previous Runs (16)
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 0.920x ➖ datafusion / vortex-file-compressed (0.920x ➖, 4↑ 0↓)
|
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.056x ➖, 0↑ 2↓)
datafusion / vortex-compact (1.050x ➖, 0↑ 3↓)
datafusion / parquet (1.012x ➖, 3↑ 1↓)
datafusion / arrow (1.093x ➖, 0↑ 11↓)
duckdb / vortex-file-compressed (1.080x ➖, 0↑ 7↓)
duckdb / vortex-compact (1.092x ➖, 0↑ 9↓)
duckdb / parquet (1.077x ➖, 1↑ 6↓)
duckdb / duckdb (1.061x ➖, 0↑ 4↓)
Full attributed analysis
|
Benchmarks: FineWeb NVMeVerdict: No clear signal (medium confidence) datafusion / vortex-file-compressed (0.916x ➖, 3↑ 0↓)
datafusion / vortex-compact (0.753x ✅, 8↑ 0↓)
datafusion / parquet (0.951x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.311x ❌, 1↑ 8↓)
duckdb / vortex-compact (1.063x ➖, 0↑ 1↓)
duckdb / parquet (0.953x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.970x ➖, 6↑ 0↓)
datafusion / vortex-compact (0.997x ➖, 0↑ 1↓)
datafusion / parquet (1.012x ➖, 1↑ 2↓)
duckdb / vortex-file-compressed (0.999x ➖, 1↑ 2↓)
duckdb / vortex-compact (0.956x ➖, 19↑ 1↓)
duckdb / parquet (1.001x ➖, 1↑ 3↓)
duckdb / duckdb (0.882x ✅, 64↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
datafusion / vortex-compact (0.999x ➖, 0↑ 0↓)
datafusion / parquet (1.013x ➖, 0↑ 0↓)
datafusion / arrow (1.003x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.023x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
duckdb / parquet (1.002x ➖, 0↑ 0↓)
duckdb / duckdb (0.995x ➖, 1↑ 0↓)
Full attributed analysis
|
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.000x ➖, 1↑ 0↓)
datafusion / parquet (0.999x ➖, 1↑ 0↓)
duckdb / vortex-file-compressed (0.983x ➖, 6↑ 2↓)
duckdb / parquet (1.001x ➖, 0↑ 0↓)
duckdb / duckdb (1.036x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: FineWeb S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.028x ➖, 1↑ 1↓)
datafusion / vortex-compact (0.845x ➖, 0↑ 0↓)
datafusion / parquet (0.904x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (1.492x ❌, 0↑ 7↓)
duckdb / vortex-compact (1.400x ❌, 0↑ 6↓)
duckdb / parquet (0.993x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.947x ➖, 2↑ 1↓)
datafusion / vortex-compact (0.865x ➖, 2↑ 0↓)
datafusion / parquet (0.872x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (1.111x ➖, 0↑ 2↓)
duckdb / vortex-compact (1.029x ➖, 0↑ 1↓)
duckdb / parquet (0.990x ➖, 0↑ 0↓)
Full attributed analysis
|
|
Do you think the vortex-compact improvements are from more parallelism in decompression? |
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (1.006x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.982x ➖, 1↑ 0↓)
duckdb / parquet (1.009x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (0.885x ➖, 6↑ 3↓)
datafusion / vortex-compact (0.880x ➖, 4↑ 1↓)
datafusion / parquet (0.898x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.008x ➖, 0↑ 0↓)
duckdb / parquet (1.032x ➖, 0↑ 1↓)
Full attributed analysis
|
Benchmarks: Random AccessVortex (geomean): 0.831x ✅ unknown / unknown (0.938x ➖, 10↑ 1↓)
|
Benchmarks: CompressionVortex (geomean): 0.983x ➖ unknown / unknown (0.950x ➖, 32↑ 2↓)
|
Merging this PR will not alter performance
Comparing Footnotes
|
139e226 to
3732c5a
Compare
55a9552 to
24baf98
Compare
f477ab1 to
d4979d2
Compare
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
d4979d2 to
cbaab6f
Compare
This is a mostly codex-driven experiment to play around with some general ideas I had and never got around to diving into, at least locally I've reached a point where perf looks interesting enough that I want to actually run benchmarks.
While I wat for benchmarks to run, some initial numbers from f3c23a6, running clickbench with datafusion against develop (using GNU time):