Skip to content

refactor(cli): discover provider catalogs from providers yaml#1732

Merged
christso merged 1 commit into
mainfrom
av-kfik533-providers-yaml
Jul 7, 2026
Merged

refactor(cli): discover provider catalogs from providers yaml#1732
christso merged 1 commit into
mainfrom
av-kfik533-providers-yaml

Conversation

@christso

@christso christso commented Jul 7, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • rename the CLI provider catalog discovery utility from target-oriented naming to provider-oriented naming
  • keep current eval, bundle, interactive, and Dashboard discovery on providers.yaml/providers.yml candidates
  • retain targets.yaml reads only behind the existing rerun-only old generated bundle carveout
  • add focused coverage for explicit directory discovery of providers.yaml

Validation

  • bun --filter @agentv/core build
  • bun test apps/cli/test/commands/eval/targets.test.ts apps/cli/test/commands/eval/bundle.test.ts apps/cli/test/commands/runs/rerun.test.ts
  • bun test apps/cli/test/eval.integration.test.ts
  • bun --filter @agentv/sdk build
  • bun --filter agentv typecheck
  • bun --filter agentv build
  • bunx biome check apps/cli/src/utils/providers.ts apps/cli/src/commands/eval/targets.ts apps/cli/src/commands/eval/commands/bundle.ts apps/cli/src/commands/eval/interactive.ts apps/cli/src/commands/results/eval-runner.ts apps/cli/test/commands/eval/targets.test.ts
  • git diff --check

Dogfood

No live provider/grader dogfood was run. This slice is parser/discovery-only and does not change provider execution, grader behavior, or run artifact semantics.

Legacy path

The only retained targets.yaml path is the existing reader-only rerun fallback for old generated run bundles that stored captured provider catalogs as test/targets.yaml or targets_path. Current eval discovery rejects authored targets.yaml with migration guidance.

Bead: av-kfik.53.3

@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying agentv with  Cloudflare Pages  Cloudflare Pages

Latest commit: 9168557
Status: ✅  Deploy successful!
Preview URL: https://6123c528.agentv.pages.dev
Branch Preview URL: https://av-kfik533-providers-yaml.agentv.pages.dev

View logs

@christso christso merged commit 4ce368a into main Jul 7, 2026
9 checks passed
@christso christso deleted the av-kfik533-providers-yaml branch July 7, 2026 22:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant