Skip to content

Commit 00e679d

Browse files
committed
Lower prefill p90 degraded threshold from 1000ms to 500ms
1 parent 4e3eb3e commit 00e679d

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

web/src/server/free-session/fireworks-health.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ export type FireworksHealth = 'healthy' | 'degraded' | 'unhealthy'
2020
* instead of p50 gives a better early-warning signal — the tail starts
2121
* rising before the median does, so we can halt admission before most
2222
* users feel it. */
23-
export const PREFILL_QUEUE_P90_DEGRADED_MS = 1000
23+
export const PREFILL_QUEUE_P90_DEGRADED_MS = 500
2424

2525
/** Leading indicator of load — responds instantly to memory pressure, while
2626
* prefill-queue p90 is a lagging window statistic. Degrading here lets us

0 commit comments

Comments
 (0)