Add AI-powered issue classification agent#920
Draft
MackinnonBuck wants to merge 2 commits intomainfrom
Draft
Conversation
![github-code-quality[bot]](https://avatars.githubusercontent.com/u/9919?s=60&v=4){kind=small}
New agentic workflow that classifies newly opened issues with routing labels (bug, enhancement, question, documentation) plus an ai-triaged review signal. Leaves a comment for issues that don't fit any category. - issue-classification.md: agentic workflow with staged mode for testing - shared/triage-classification.md: reusable classification instructions - Updated gh-aw agent files and recompiled lock files for v0.62.5 Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
MackinnonBuck
force-pushed
the
mackinnonbuck/triage-agent
branch
from
71c2e1d to
13ead9a
Compare
MackinnonBuck
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an agentic workflow that classifies newly opened issues with routing labels (
bug,enhancement,question,documentation) and anai-triagedreview signal. Issues that don't fit any category get a comment explaining why. Labels are applied automatically (no staged approval).Also updates gh-aw agent files and recompiles lock files for v0.62.5.
What's in this PR
issue-classification.md— agentic workflow triggered onissues.openedandworkflow_dispatch, with classification instructions inlineRoadmap
We're merging the classifier first so it can start producing data. The plan is to iterate in phases:
Classification agent (this PR) — Classify issues and apply routing labels. Human reviewers correct misclassifications by changing the label. These corrections are visible in issue timelines.
Self-improvement agent — A separate agentic workflow that queries
ai-triagedissues, reconstructs corrections from timelines, identifies patterns the classifier gets wrong, and proposes prompt improvements via PR. This will be a separate draft PR, activated once we have enough correction data to act on.Investigation agents — Once the classifier has proven reliable, we'll expand the system with agents tailored to each issue type. Rather than the classifier directly labeling an issue as
bug, it will hand off to a bug investigator that can request reproduction steps, check for duplicates, or identify the affected SDK. Similarly for enhancement requests, questions, and documentation issues.