Conversation
|
run benchmarks |
|
run benchmark clickbench_partitioned |
|
run benchmark tpch |
|
🤖 Benchmark running (GKE) | trigger CPU Details (lscpu)Comparing alamb/morsel_api_2 (9d4457c) to c8aefab (merge-base) diff using: tpcds File an issue against this benchmark runner |
|
🤖 Benchmark running (GKE) | trigger CPU Details (lscpu)Comparing alamb/morsel_api_2 (9d4457c) to c8aefab (merge-base) diff using: clickbench_partitioned File an issue against this benchmark runner |
|
🤖 Benchmark running (GKE) | trigger CPU Details (lscpu)Comparing alamb/morsel_api_2 (9d4457c) to c8aefab (merge-base) diff using: clickbench_partitioned File an issue against this benchmark runner |
|
🤖 Benchmark running (GKE) | trigger CPU Details (lscpu)Comparing alamb/morsel_api_2 (9d4457c) to c8aefab (merge-base) diff using: tpch File an issue against this benchmark runner |
|
🤖 Benchmark running (GKE) | trigger CPU Details (lscpu)Comparing alamb/morsel_api_2 (9d4457c) to c8aefab (merge-base) diff using: tpch File an issue against this benchmark runner |
|
It would be nice to see the path for the morsel APIs to supplant the existing ones in a backward compatible manner. In my previous attempts I made |
|
🤖 Benchmark completed (GKE) | trigger Instance: CPU Details (lscpu)Details
Resource Usagetpch — base (merge-base)
tpch — branch
File an issue against this benchmark runner |
|
🤖 Benchmark completed (GKE) | trigger Instance: CPU Details (lscpu)Details
Resource Usagetpch — base (merge-base)
tpch — branch
File an issue against this benchmark runner |
|
🤖 Benchmark completed (GKE) | trigger Instance: CPU Details (lscpu)Details
Resource Usageclickbench_partitioned — base (merge-base)
clickbench_partitioned — branch
File an issue against this benchmark runner |
|
🤖 Benchmark completed (GKE) | trigger Instance: CPU Details (lscpu)Details
Resource Usagetpcds — base (merge-base)
tpcds — branch
File an issue against this benchmark runner |
|
🤖 Benchmark completed (GKE) | trigger Instance: CPU Details (lscpu)Details
Resource Usageclickbench_partitioned — base (merge-base)
clickbench_partitioned — branch
File an issue against this benchmark runner |
|
I like how small the PR is! |
Though it it doesn't do anything useful yet :) |
(Draft until I am sure I can use this API to make FileStream behave better)
Which issue does this PR close?
Rationale for this change
I am reworking how the FileStream works so that it can reorder operations at runtime. Eventually that will include both CPU and IO
This PR is a step in the direction by introducing the main Morsel API and implementing it for Parquet
What changes are included in this PR?
MorselAPIMy next PR will rewrite the FileStream to use the Morsel API
Are these changes tested?
Yes by existing CI.
I will work on adding additional tests for just Parquet opener in a follow on PR
Are there any user-facing changes?
No