Skip to content

fix: fix missing details in json output when running uipath eval#1382

Open
bai-uipath wants to merge 1 commit intomainfrom
bai/fix-missing-details-eval
Open

fix: fix missing details in json output when running uipath eval#1382
bai-uipath wants to merge 1 commit intomainfrom
bai/fix-missing-details-eval

Conversation

@bai-uipath
Copy link
Collaborator

Fixes issue #1369:

  • Adds --verbose cli flag to set eval_context.verbose which controls whether agent trace is included in the json.
  • Fix bug where details was missing because the BaseModel serializer rather than the runtime type (eg: LLMJudgeJustification).

After this change, the following command works as expected in the calculator sample:

uv run uipath eval main default.json --output-file eval_results.json --verbose

@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Feb 26, 2026
@bai-uipath bai-uipath changed the title Fix missing details in json output when running uipath eval fix: fix missing details in json output when running uipath eval Feb 26, 2026
@bai-uipath bai-uipath force-pushed the bai/fix-missing-details-eval branch from 6823ddb to 8c9672a Compare February 26, 2026 22:07
@bai-uipath bai-uipath force-pushed the bai/fix-missing-details-eval branch from b91b18c to cab154f Compare February 26, 2026 22:33
@bai-uipath bai-uipath force-pushed the bai/fix-missing-details-eval branch from cab154f to fcc29ed Compare February 26, 2026 22:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant