Skip to content

issue/244 feat(llm): add prefix cache reuse for static KV cache#262

Open
ma-hang wants to merge 1 commit intomainfrom
issue/244
Open

issue/244 feat(llm): add prefix cache reuse for static KV cache#262
ma-hang wants to merge 1 commit intomainfrom
issue/244

Conversation

@ma-hang
Copy link
Contributor

@ma-hang ma-hang commented Mar 9, 2026

No description provided.

@ma-hang ma-hang requested review from a team, Ceng23333 and wooway777 March 9, 2026 06:52
@ma-hang ma-hang linked an issue Mar 9, 2026 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[DEV] 推理服务static cache支持缓存复用

2 participants