Skip to content

Add new vector-search-bench benchmarking crate#7458

Merged
connortsui20 merged 1 commit intodevelopfrom
ct/parquet-to-vortex-vector
Apr 16, 2026
Merged

Add new vector-search-bench benchmarking crate#7458
connortsui20 merged 1 commit intodevelopfrom
ct/parquet-to-vortex-vector

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented Apr 15, 2026

Summary

Tracking issue: #7297

Adds a new vector-search-bench crate.

Right now this is just utilities is preparation for adding proper vector search benchmarks (that are pulled from disk, not just in-memory). This just includes data downloading and file preparation, conversion (from parquet lists to vortex vector arrays), and some different compression and scan utilities.

Testing

Some basic unit tests but the real stress test will come later when we actually benchmark stuff.

@connortsui20 connortsui20 added the changelog/feature A new feature label Apr 15, 2026
Base automatically changed from ct/tq-example to develop April 16, 2026 13:30
@connortsui20 connortsui20 force-pushed the ct/parquet-to-vortex-vector branch 2 times, most recently from eddf88a to 35e5b9a Compare April 16, 2026 14:16
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 16, 2026

Merging this PR will improve performance by 19.89%

⚡ 9 improved benchmarks
✅ 1154 untouched benchmarks
⏩ 1457 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_map[(0.1, 1.0)] 2 ms 1.7 ms +19.06%
Simulation take_map[(0.1, 0.5)] 1,154.5 µs 990.4 µs +16.57%
Simulation patched_take_10k_contiguous_not_patches 258.4 µs 228.1 µs +13.29%
Simulation patched_take_10k_contiguous_patches 258.1 µs 227.7 µs +13.32%
Simulation patched_take_10k_random 270.3 µs 240 µs +12.64%
Simulation take_10k_dispersed 284.4 µs 239.5 µs +18.76%
Simulation patched_take_10k_dispersed 316 µs 285.8 µs +10.58%
Simulation take_10k_first_chunk_only 270.6 µs 225.7 µs +19.89%
Simulation patched_take_10k_first_chunk_only 302 µs 271.8 µs +11.14%

Comparing ct/parquet-to-vortex-vector (5e8fb2d) with develop (12f63a4)

Open in CodSpeed

Footnotes

  1. 1457 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@connortsui20 connortsui20 force-pushed the ct/parquet-to-vortex-vector branch 2 times, most recently from 0b40867 to 3c957e3 Compare April 16, 2026 14:35
@connortsui20 connortsui20 requested a review from AdamGS April 16, 2026 14:36
@connortsui20 connortsui20 marked this pull request as ready for review April 16, 2026 14:36
@@ -0,0 +1,156 @@
// SPDX-License-Identifier: Apache-2.0
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit - move to vector-search-bench/tests?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

decided to just delete the tests

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20 connortsui20 force-pushed the ct/parquet-to-vortex-vector branch from 3c957e3 to 5e8fb2d Compare April 16, 2026 16:06
@connortsui20 connortsui20 enabled auto-merge (squash) April 16, 2026 16:06
@connortsui20 connortsui20 merged commit b4dca29 into develop Apr 16, 2026
59 of 61 checks passed
@connortsui20 connortsui20 deleted the ct/parquet-to-vortex-vector branch April 16, 2026 16:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants