From c5fa8d3638f7debc37a8748849cf3d1e49643c82 Mon Sep 17 00:00:00 2001 From: Davide Angelocola Date: Tue, 7 Jul 2026 08:09:39 +0200 Subject: [PATCH] =?UTF-8?q?test:=20triage=20round=204=20=E2=80=94=2010=20m?= =?UTF-8?q?ore=20corpus=20slugs=20(38=20ok=20total)?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit 8 ok incl. bi-food (5.2M rows), bi-corporations (742k×27), sf-salaries (1M×26, decimal path clean), uci-automobile, uci-thyroid-disease. 2 new gaps, both silent null loss in lazy decoders: uci-online-retail (gap:225, RunEnd nullable run-values validity dropped) and world-energy-consumption (gap:226, Sparse null fill coerced to 0 + nullable patch values stripped). Both the same class as the fixed #210. Co-Authored-By: Claude Opus 4.8 --- docs/compatibility.md | 21 +++++++------------ .../resources/raincloud/expected-status.csv | 20 +++++++++--------- 2 files changed, 17 insertions(+), 24 deletions(-) diff --git a/docs/compatibility.md b/docs/compatibility.md index f44a2a9a..18b7e362 100644 --- a/docs/compatibility.md +++ b/docs/compatibility.md @@ -62,20 +62,13 @@ Per-slug status lives in `integration/src/test/resources/raincloud/expected-stat (`ok` must pass; `gap:` must still fail, so a fix flips the entry in the same change; `untriaged` runs and reports without failing the build). A scheduled workflow (`raincloud-conformance.yml`) hydrates a size-capped subset weekly. Current triage — -30 `ok`, 0 known gaps; 217 slugs untriaged. Fixed so far -by this suite: misaligned per-column chunk grids -([#221](https://github.com/dfa1/vortex-java/issues/221) — scan now splits at the merged boundary -grid, slicing each column's covering chunk per window), lazy dict U8/U16 values -([#206](https://github.com/dfa1/vortex-java/issues/206)), -nested struct columns in scan ([#207](https://github.com/dfa1/vortex-java/issues/207)), -unsigned integers rendered signed ([#208](https://github.com/dfa1/vortex-java/issues/208) / -[#216](https://github.com/dfa1/vortex-java/issues/216) — silent corruption, incl. wrong filter -and Calcite results), RLE over F64 ([#209](https://github.com/dfa1/vortex-java/issues/209)), -row validity dropped by wrapper decoders -([#210](https://github.com/dfa1/vortex-java/issues/210) — silent corruption), all-null columns -in CSV export ([#211](https://github.com/dfa1/vortex-java/issues/211)), narrow dict-offset -ptypes in string dicts ([#215](https://github.com/dfa1/vortex-java/issues/215)), struct -columns in CSV export ([#217](https://github.com/dfa1/vortex-java/issues/217)). +38 `ok`, 2 known gaps (both silent null loss in lazy decoders: +[#225](https://github.com/dfa1/vortex-java/issues/225) RunEnd run-values validity, +[#226](https://github.com/dfa1/vortex-java/issues/226) Sparse null fill / nullable patches); +207 slugs untriaged. Every gap found by earlier rounds is fixed +([#206](https://github.com/dfa1/vortex-java/issues/206)–[#211](https://github.com/dfa1/vortex-java/issues/211), +[#215](https://github.com/dfa1/vortex-java/issues/215)–[#217](https://github.com/dfa1/vortex-java/issues/217), +[#221](https://github.com/dfa1/vortex-java/issues/221)). ## Encodings diff --git a/integration/src/test/resources/raincloud/expected-status.csv b/integration/src/test/resources/raincloud/expected-status.csv index 6b284d3e..00fbd697 100644 --- a/integration/src/test/resources/raincloud/expected-status.csv +++ b/integration/src/test/resources/raincloud/expected-status.csv @@ -27,16 +27,16 @@ bi-bimbo,untriaged bi-citymaxcapita,untriaged bi-cmsprovider,untriaged bi-commongovernment,untriaged -bi-corporations,untriaged +bi-corporations,ok bi-eixo,untriaged bi-euro2016,untriaged -bi-food,untriaged +bi-food,ok bi-generico,untriaged bi-hashtags,untriaged bi-hatred,untriaged -bi-iglocations1,untriaged +bi-iglocations1,ok bi-iglocations2,untriaged -bi-iublibrary,untriaged +bi-iublibrary,ok bi-medicare1,untriaged bi-medicare2,untriaged bi-medicare3,untriaged @@ -130,7 +130,7 @@ laion-400m,untriaged librispeech-test-clean,untriaged loan-default-dataset,untriaged lung-cancer,untriaged -marketing-data,untriaged +marketing-data,ok mbpp,untriaged medmcqa,untriaged mlcourse,untriaged @@ -171,7 +171,7 @@ peoples-speech-clean-validation,untriaged personal-key-indicators-of-heart-disease,untriaged pleias-synth,untriaged pubmedqa-labeled,untriaged -sf-salaries,untriaged +sf-salaries,ok slimpajama-6b,untriaged squad-v2,untriaged stack-overflow-2018-developer-survey,untriaged @@ -191,7 +191,7 @@ uci-adult,ok uci-ai4i-2020-predictive-maintenance,untriaged uci-air-quality,ok uci-auto-mpg,ok -uci-automobile,untriaged +uci-automobile,ok uci-bank-marketing,ok uci-beijing-multi-site-air-quality,ok uci-bike-sharing-dataset,ok @@ -219,7 +219,7 @@ uci-individual-household-electric-power-consumption,untriaged uci-iris,ok uci-magic-gamma-telescope,ok uci-mushroom,ok -uci-online-retail,untriaged +uci-online-retail,gap:225 uci-online-retail-ii,untriaged uci-online-shoppers-purchasing-intention,untriaged uci-optical-recognition-of-handwritten-digits,ok @@ -233,7 +233,7 @@ uci-sms-spam-collection,ok uci-spambase,untriaged uci-statlog-german-credit-data,untriaged uci-student-performance,untriaged -uci-thyroid-disease,untriaged +uci-thyroid-disease,ok uci-wholesale-customers,untriaged uci-wine,ok uci-wine-quality,ok @@ -250,7 +250,7 @@ waxal-dagbani-asr-test,untriaged wdi,untriaged websight-v01,untriaged wikipedia-en,untriaged -world-energy-consumption,untriaged +world-energy-consumption,gap:226 yellow_tripdata_2025,untriaged youtube-commons-sample,untriaged zoo-animal-classification,untriaged