Skip to content

docs: Add dependencies example to load-balanced endpoint pattern#575

Merged
muhsinking merged 2 commits intomainfrom
promptless/flash-lb-endpoint-dependencies
Mar 23, 2026
Merged

docs: Add dependencies example to load-balanced endpoint pattern#575
muhsinking merged 2 commits intomainfrom
promptless/flash-lb-endpoint-dependencies

Conversation

@promptless
Copy link
Copy Markdown
Contributor

@promptless promptless bot commented Mar 23, 2026

Open this suggestion in Promptless to view citations and reasoning process

Updates the load-balanced endpoint example in the "Create endpoints" docs to include the dependencies parameter. This confirms that dependencies work with the variable assignment pattern (api = Endpoint(...)) used for load-balanced endpoints, not just decorator patterns.

Trigger Events

runpod/flash PR #252: fix: extract dependencies from Endpoint() patterns during build

Promptless Research (7 files, 1 GitHub PR)

  • Reviewed runpod/flash#252
  • Viewed .long_term_context/product_knowledge/product_overview.md
  • Viewed .long_term_context/doc_workflow/client_instructions.md
  • Viewed flash/cli/build.mdx
  • Viewed flash/configuration/parameters.mdx
  • Viewed flash/create-endpoints.mdx
  • Viewed flash/apps/build-app.mdx
  • Viewed .long_term_context/style/client_style_guide.md

Agent Response

I've reviewed PR #252 and created a documentation suggestion.

Summary

PR #252 fixes a bug where flash build wasn't extracting dependencies from Endpoint() variable assignment patterns (used for load-balanced endpoints). Previously, dependencies were only extracted from @remote() and @Endpoint() decorator patterns.

Documentation Update

I created a suggestion that updates the load-balanced endpoint example in the "Create endpoints" documentation to include the dependencies parameter:

api = Endpoint(
    name="inference-api",
    gpu=GpuType.NVIDIA_GEFORCE_RTX_4090,
    workers=(1, 5),
    dependencies=["torch"]  # Added
)

This confirms to users that dependencies work correctly with the load-balanced endpoint pattern (api = Endpoint(...)), not just decorator patterns.

Suggestion: Add dependencies example to load-balanced endpoint pattern

  • File: flash/create-endpoints.mdx
  • Change: Added dependencies=["torch"] to the load-balanced endpoint example and a comment clarifying that imports should be inside the function body

Tip: Planning a big docs refactor? Use Deep Analysis to get help with the heavy lifting 🔍

gpu=GpuType.NVIDIA_GEFORCE_RTX_4090,
workers=(1, 5)
workers=(1, 5),
dependencies=["torch"]
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Citation: PR #252 fixes flash build to extract dependencies from Endpoint() variable assignment patterns (load-balanced endpoints). Adding this example confirms the pattern is fully supported after the fix.
View source

@mintlify
Copy link
Copy Markdown

mintlify bot commented Mar 23, 2026

Preview deployment for your docs. Learn more about Mintlify Previews.

Project Status Preview Updated (UTC)
runpod-docs 🟢 Ready View Preview Mar 23, 2026, 4:28 PM

@promptless
Copy link
Copy Markdown
Contributor Author

promptless bot commented Mar 23, 2026

Just a reminder: If you'd like me to act on any feedback you have via Github comments, just type @Promptless in your suggestion and I'll get right on it! (I won't show up in the user dropdown, but I'll process any request that has @Promptless in the comment body.)

@muhsinking muhsinking merged commit 3a4d2c4 into main Mar 23, 2026
3 checks passed
@muhsinking muhsinking deleted the promptless/flash-lb-endpoint-dependencies branch March 23, 2026 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant