fix: array correctly update their validity#7307
Conversation
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Polar Signals Profiling ResultsLatest Run
Powered by Polar Signals Cloud |
Benchmarks: PolarSignals ProfilingVortex (geomean): 0.891x ✅ datafusion / vortex-file-compressed (0.891x ✅, 6↑ 0↓)
|
File Sizes: PolarSignals ProfilingNo file size changes detected. |
Benchmarks: TPC-H SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.958x ➖, 1↑ 0↓)
datafusion / vortex-compact (0.974x ➖, 0↑ 0↓)
datafusion / parquet (0.988x ➖, 1↑ 1↓)
datafusion / arrow (0.959x ➖, 3↑ 0↓)
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.971x ➖, 0↑ 0↓)
duckdb / parquet (0.976x ➖, 4↑ 1↓)
duckdb / duckdb (0.982x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=1 on NVMENo file size changes detected. |
Benchmarks: FineWeb NVMeVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.999x ➖, 1↑ 0↓)
datafusion / vortex-compact (1.007x ➖, 0↑ 0↓)
datafusion / parquet (1.018x ➖, 0↑ 1↓)
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 1↓)
duckdb / vortex-compact (1.036x ➖, 0↑ 1↓)
duckdb / parquet (1.026x ➖, 0↑ 1↓)
Full attributed analysis
|
File Sizes: FineWeb NVMeNo file size changes detected. |
Benchmarks: TPC-DS SF=1 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (0.944x ➖, 13↑ 0↓)
datafusion / vortex-compact (0.917x ➖, 30↑ 0↓)
datafusion / parquet (0.918x ➖, 32↑ 0↓)
duckdb / vortex-file-compressed (0.912x ➖, 40↑ 0↓)
duckdb / vortex-compact (0.964x ➖, 3↑ 0↓)
duckdb / parquet (0.949x ➖, 8↑ 1↓)
duckdb / duckdb (0.919x ➖, 26↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-DS SF=1 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=10 on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
datafusion / vortex-compact (1.007x ➖, 0↑ 0↓)
datafusion / parquet (1.008x ➖, 0↑ 1↓)
datafusion / arrow (1.011x ➖, 0↑ 0↓)
duckdb / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.007x ➖, 0↑ 0↓)
duckdb / parquet (1.006x ➖, 0↑ 0↓)
duckdb / duckdb (1.002x ➖, 0↑ 0↓)
Full attributed analysis
|
File Sizes: TPC-H SF=10 on NVMENo file size changes detected. |
Benchmarks: TPC-H SF=1 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.073x ➖, 0↑ 2↓)
datafusion / vortex-compact (1.146x ➖, 0↑ 4↓)
datafusion / parquet (1.074x ➖, 0↑ 5↓)
duckdb / vortex-file-compressed (1.033x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.992x ➖, 0↑ 0↓)
duckdb / parquet (1.032x ➖, 0↑ 0↓)
Full attributed analysis
|
🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨Benchmark |
Benchmarks: Random AccessVortex (geomean): 0.909x ➖ unknown / unknown (0.977x ➖, 6↑ 1↓)
|
Benchmarks: Statistical and Population GeneticsVerdict: No clear signal (low confidence) duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
duckdb / vortex-compact (1.034x ➖, 0↑ 0↓)
duckdb / parquet (0.942x ➖, 2↑ 0↓)
Full attributed analysis
|
File Sizes: Statistical and Population GeneticsNo file size changes detected. |
Benchmarks: Clickbench on NVMEVerdict: No clear signal (low confidence) datafusion / vortex-file-compressed (1.013x ➖, 1↑ 1↓)
datafusion / parquet (0.865x ✅, 29↑ 0↓)
duckdb / vortex-file-compressed (0.898x ✅, 16↑ 1↓)
duckdb / parquet (0.977x ➖, 0↑ 0↓)
duckdb / duckdb (0.924x ➖, 19↑ 0↓)
Full attributed analysis
|
File Sizes: Clickbench on NVME
Totals:
|
Benchmarks: TPC-H SF=10 on S3Verdict: No clear signal (environment too noisy confidence) datafusion / vortex-file-compressed (1.132x ➖, 0↑ 6↓)
datafusion / vortex-compact (1.007x ➖, 1↑ 0↓)
datafusion / parquet (1.125x ➖, 0↑ 2↓)
duckdb / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
duckdb / parquet (0.981x ➖, 0↑ 0↓)
Full attributed analysis
|
Benchmarks: CompressionVortex (geomean): 1.006x ➖ unknown / unknown (1.027x ➖, 1↑ 10↓)
|
After #7287
The validity of some arrays as in-corrected cached. This PR fixes that.