Add /_skill-validation monitoring endpoint (CS-11093)#5472
Draft
backspace wants to merge 4 commits into
Draft
Conversation
monitoringAuthToken is async, but handle-queue-status interpolated the un-awaited Promise into its comparison string, so /_queue-status actually authorized the literal token "[object Promise]" (and the test passed because it interpolated the same Promise client-side). Move the comparison into utils/monitoring.ts as isAuthorizedToViewMonitoring and await the token on both sides. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Validates that every skill in a realm still resolves: enumerates Skill cards via the index, imports each unique command codeRef module through the prerenderer (a real host in headless Chrome, with the same shims and virtual network a user's browser has), and returns structured pass/fail per skill with the failing module path. Motivated by the CS-10992/CS-11046 staging incident where a renamed host command path silently broke the AI assistant while API health checks stayed green. The module prerender response now carries all export names (not just BaseDef definitions) so the endpoint can also catch a renamed export whose module still loads. Authenticated with the monitoring bearer token, same as /_queue-status. A Checkly check in cardstack/infra will poll this per environment. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Contributor
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Drop the CS-11093 tracker references and the staging-incident narrative from the handler and route comments; state the threat model as the live invariant instead. Rename the failure-reporting test timelessly. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.