Skip to content

--mcp option seems not to work #265

@GregOnNet

Description

@GregOnNet

Hello everyone,

I try to use web-codegen-scorer with the Angular MCP.
After configuring it and starting the evaluation, an error is thrown.
I tried OpenAI and Anthropic models:

  • gpt-5.1-no-thinking
  • gpt-5.1-thinking-low
  • claude-sonnet-4.5-no-thinking

That's why think the problem is not related to a specific model.

Command

export ANTHROPIC_API_KEY="..." && web-codegen-scorer eval --env=./config.mjs --model claude-sonnet-4.5-no-thinking --prompt-filter=goal-tracker --mcp

The error occurs just a few moments after running the command in the terminal

✘ [goal-tracker] Failed to generate code with AI
  AI_NoOutputGeneratedError: No output generated.
Stack: AI_NoOutputGeneratedError: No output generated.
    at get output (file:///Users/gregor/Library/pnpm/global/5/.pnpm/ai@6.0.49_zod@3.25.76/node_modules/ai/dist/index.mjs:4331:13)
    at AiSdkRunner.generateConstrained (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/codegen/ai-sdk/ai-sdk-runner.js:57:30)
    at process.processTicksAndRejections (node:internal/process/task_queues:105:5)
    at async AiSdkRunner.generateFiles (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/codegen/ai-sdk/ai-sdk-runner.js:68:26)
    at async generateCodeWithAI (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/orchestration/codegen.js:15:26)
    at async LocalExecutor.generateInitialFiles (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/orchestration/executors/local-executor.js:27:16)
    at async generateInitialFiles (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/orchestration/generate-initial-files.js:42:22)
    at async startEvaluationTask (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/orchestration/generate-eval-task.js:31:33)
    at async callWithTimeout (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/utils/timeout.js:17:16)
    at async evaluate (file:///Users/gregor/Library/pnpm/global/5/.pnpm/web-codegen-scorer@0.0.69_postcss@8.5.6/node_modules/web-codegen-scorer/runner/orchestration/generate.js:126:35)

Reproduction

You can find my setup here: https://github.com/GregOnNet/web-codegen-scorer-playground

I am glad to provide more information if needed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions