Skip to content

Resizable MediaPipe graph pool#4189

Open
atobiszei wants to merge 1 commit intoatobisze_check_graph_pool_2026from
atobisze_check_graph_pool_2026_resizable
Open

Resizable MediaPipe graph pool#4189
atobiszei wants to merge 1 commit intoatobisze_check_graph_pool_2026from
atobisze_check_graph_pool_2026_resizable

Conversation

@atobiszei
Copy link
Copy Markdown
Collaborator

feat: resizable MediaPipe graph pool with OVMS_GRAPH_INITIAL_QUEUE_SI…ZE and OVMS_GRAPH_QUEUE_MAX_SIZE directives

  • GraphQueue now supports dynamic expansion from initial to max size
  • Two pbtxt directives: OVMS_GRAPH_INITIAL_QUEUE_SIZE (initial pool) and OVMS_GRAPH_QUEUE_MAX_SIZE (ceiling)
  • Shared CLI helper (graph_queue_cli_options.hpp) for --graph_initial_queue_size and --graph_queue_max_size
  • All 6 task CLI parsers use shared helper
  • Python export templates updated
  • Default: initial=1, max=AUTO for text_gen/embeddings/rerank; initial=1, max=1 for image_gen

…ZE and OVMS_GRAPH_QUEUE_MAX_SIZE directives

- GraphQueue now supports dynamic expansion from initial to max size
- Two pbtxt directives: OVMS_GRAPH_INITIAL_QUEUE_SIZE (initial pool) and OVMS_GRAPH_QUEUE_MAX_SIZE (ceiling)
- Shared CLI helper (graph_queue_cli_options.hpp) for --graph_initial_queue_size and --graph_queue_max_size
- All 6 task CLI parsers use shared helper
- Python export templates updated
- Default: initial=1, max=AUTO for text_gen/embeddings/rerank; initial=1, max=1 for image_gen
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant