Skip to content

Add agchk — AI agent architecture audit tool#3084

Open
huangrichao2020 wants to merge 1 commit intovinta:masterfrom
huangrichao2020:feat/agchk-agent-audit-tool
Open

Add agchk — AI agent architecture audit tool#3084
huangrichao2020 wants to merge 1 commit intovinta:masterfrom
huangrichao2020:feat/agchk-agent-audit-tool

Conversation

@huangrichao2020
Copy link
Copy Markdown

Project

Description

agchk audits any AI agent system or LLM-integrated project for 7 categories of architectural failures:

Scanner Severity What It Catches
Hardcoded Secrets critical API keys, tokens, credentials in source code
Tool Enforcement Gap high "Must use tool X" in prompt but no code validation
Hidden LLM Calls high Secret second-pass LLM calls in fallback/repair loops
Unrestricted Code Execution critical exec(), eval(), subprocess(shell=True) without sandbox
Memory Pattern Issues medium Unbounded context growth, missing TTL, no retention policy
Output Pipeline Mutation medium Response transformation corrupting correct answers
Missing Observability medium No tracing, logging, or cost tracking

Usage

pip install agchk
agchk /path/to/your/agent/project
from agchk import run_audit, generate_report
results = run_audit("/path/to/your/agent/project")
print(generate_report(results))

Why It Belongs

As AI agent frameworks grow rapidly, developers need tools to audit their architectures for security holes, reliability issues, and hidden failures. agchk fills this gap.

Integrated into: Langflow, GenericAgent, superpowers, Everything Claude Code, OpenCode, Anthropic Skills.

agchk is a Python CLI and library that audits any AI agent system or
LLM-integrated project for 7 categories of architectural failures:
hardcoded secrets, tool enforcement gaps, hidden LLM calls, unrestricted
code execution, memory growth hazards, output mutation, and missing
observability.

Co-authored-by: Qwen-Coder <qwen-coder@alibabacloud.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant