fix(connectors): unify extract_column_value into single free function#3199
fix(connectors): unify extract_column_value into single free function#3199atharvalade wants to merge 1 commit into
Conversation
Codecov Report❌ Patch coverage is
❌ Your patch check has failed because the patch coverage (0.00%) is below the target coverage (50.00%). You can increase the patch coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## master #3199 +/- ##
=============================================
- Coverage 74.18% 18.33% -55.86%
Complexity 943 943
=============================================
Files 1200 1198 -2
Lines 109645 94898 -14747
Branches 86534 71804 -14730
=============================================
- Hits 81345 17396 -63949
- Misses 25553 77084 +51531
+ Partials 2747 418 -2329
🚀 New features to boost your workflow:
|
6a3e441 to
08153c5
Compare
|
@atharvalade Also remeber about #3196 where you also add Date |
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. If you need a review, please ensure CI is green and the PR is rebased on the latest master. Don't hesitate to ping the maintainers - either @core on Discord or by mentioning them directly here on the PR. Thank you for your contribution! |
|
/author |
|
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. If you need a review, please ensure CI is green and the PR is rebased on the latest master. Don't hesitate to ping the maintainers - either Thank you for your contribution! |
Good catch, the second copy ( |
08153c5 to
d8fc00e
Compare
|
/ready |
There was a problem hiding this comment.
no reason to include these changes in this PR.
| .map(serde_json::Value::from) | ||
| .unwrap_or(serde_json::Value::Null)) | ||
| } | ||
| "VARCHAR" | "TEXT" | "CHAR" | "BPCHAR" => { |
There was a problem hiding this comment.
BPCHAR is the only new behavior in this PR but nothing exercises it. codecov flags 0% patch coverage (101 missing lines). a single round-trip test reading a char(n) column closes the gap and prevents the same divergence the issue is trying to prevent.
if possible, just make it part of some existing tests instead of making a new tc.
Which issue does this PR close?
Closes #3172
Rationale
Bug fixes or new type support added to one copy of
extract_column_valuesilently won't apply to the other, causing divergence between sequential and parallel code paths.What changed?
The Postgres source connector had
extract_column_valueas a method onPostgresSource(&self), making it impossible to call from static/parallel contexts without duplicating the function. Any future parallel/chunked path would need its own copy.Converted it to a single free function callable from any context. Added missing
DATE(viachrono::NaiveDate) andBPCHARtype handling that the parallel copy on the benchmark branch had but this version lacked.Local Execution
AI Usage