Skip to content

GLM5.1-FP4-MI355X-SGLang: bump Image to v0.5.12.post1-rocm720-mi35x-20260529 #1593

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
chunfangamd wants to merge 2 commits into
base: main
Choose a base branch
from
+9 −1
Open

GLM5.1-FP4-MI355X-SGLang: bump Image to v0.5.12.post1-rocm720-mi35x-20260529 #1593

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
633ce94
glm5.1-fp4-mi355x-sglang: bump SGLang ROCm image to v0.5.12.post1-202…
chunfangamd May 30, 2026
857aeea
Update Perf-Changelog
chunfangamd May 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/configs/amd-master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -684,7 +684,7 @@ glm5-fp8-mi355x-atom:
- { tp: 8, conc-start: 4, conc-end: 256 }

glm5.1-fp4-mi355x-sglang:
image: lmsysorg/sglang-rocm:v0.5.10rc0-rocm720-mi35x-20260415
image: lmsysorg/sglang-rocm:v0.5.12.post1-rocm720-mi35x-20260529
model: amd/GLM-5.1-MXFP4
model-prefix: glm5.1
runner: mi355x
Expand Down
8 changes: 8 additions & 0 deletions perf-changelog.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3220,3 +3220,11 @@
description:
- "Update GB300 FP4 GLM-5 8k1k low-latency sweep to mirror NVIDIA/srt-slurm#175: add a 5th 1p17d topology (decode_nodes/workers=17), and lower decode max-running-requests / cuda-graph-max-bs / benchmark concurrency per-zip-index from a flat 4096/1024 to 128/64/32/16/1 (mrr & cuda-graph) and 128/64/32/16/12 (concurrency)"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1583

- config-keys:
- glm5.1-fp4-mi355x-sglang
description:
- "Bump SGLang ROCm image from v0.5.10rc0-rocm720-mi35x-20260415 to v0.5.12.post1-rocm720-mi35x-20260529"
- "Picks up the fix for the GSM8K accuracy regression reported in sgl-project/sglang#25742 (v0.5.12-20260517 collapsed to ~0.32 at TP=2)"
- "Local eval-only runs on MI355X recover to gsm8k strict-match 0.975 at TP=2/conc=64 and 0.974 at TP=4/conc=16, well above the 0.92 upstream gate added in sgl-project/sglang#26396"
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/1593