We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 4e3eb3e commit 00e679dCopy full SHA for 00e679d
1 file changed
web/src/server/free-session/fireworks-health.ts
@@ -20,7 +20,7 @@ export type FireworksHealth = 'healthy' | 'degraded' | 'unhealthy'
20
* instead of p50 gives a better early-warning signal — the tail starts
21
* rising before the median does, so we can halt admission before most
22
* users feel it. */
23
-export const PREFILL_QUEUE_P90_DEGRADED_MS = 1000
+export const PREFILL_QUEUE_P90_DEGRADED_MS = 500
24
25
/** Leading indicator of load — responds instantly to memory pressure, while
26
* prefill-queue p90 is a lagging window statistic. Degrading here lets us
0 commit comments