Skip to content

[core][spark][python] Reject full-text hybrid route options#8324

Open
QuakeWang wants to merge 1 commit into
apache:masterfrom
QuakeWang:ft-route-options
Open

[core][spark][python] Reject full-text hybrid route options#8324
QuakeWang wants to merge 1 commit into
apache:masterfrom
QuakeWang:ft-route-options

Conversation

@QuakeWang

Copy link
Copy Markdown
Member

Purpose

Hybrid full-text routes accepted options from Spark SQL, Java, and Python APIs, but the execution path never consumed them. HybridSearchRoute stored the map, while FullTextSearchBuilder and FullTextSearch have no options channel, so non-empty full-text route options were silently ignored.

This PR rejects non-empty full-text route options fail-fast, keeps empty Spark map() valid for named_struct type consistency, updates the docs, and adds regression tests.

Tests

  • mvn -pl paimon-common -am -DfailIfNoTests=false -Dtest=FullTextQueryTest test
  • mvn -pl paimon-spark/paimon-spark-common -am -DfailIfNoTests=false -DwildcardSuites=org.apache.paimon.spark.catalyst.plans.logical.VectorSearchQueryTest -Dtest=none test
  • python -m unittest pypaimon.tests.vector_search_filter_test.HybridSearchBuilderTest
  • python dev/check_license_header.py

Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant