Skip to content

Fix/v3 tests#5996

Open
lucasjia-aws wants to merge 7 commits into
aws:masterfrom
lucasjia-aws:fix/v3-tests
Open

Fix/v3 tests#5996
lucasjia-aws wants to merge 7 commits into
aws:masterfrom
lucasjia-aws:fix/v3-tests

Conversation

@lucasjia-aws

Copy link
Copy Markdown
Collaborator

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

The dummy_container_with_user_and_workdir fixture failed to build because
the standalone `RUN apt install -y sudo` step ran several layers after the
initial apt-get update, using a stale package index and failing to connect
to deb.debian.org when fetching the sudo .deb.

Install sudo in the same layer as the initial apt-get update against a fresh
index, switch from `apt` to `apt-get`, and add Acquire::Retries so transient
network failures are retried automatically.
The judge model anthropic.claude-3-5-haiku-20241022-v1:0 has reached
end-of-life in Bedrock, causing integ test evaluation pipelines to fail
with a ValidationException. Switch to the active successor
anthropic.claude-haiku-4-5-20251001-v1:0 and add it to the allowed
evaluator models list.
… tests

Add tests/integ/conftest.py with an autouse session fixture that gives
boto3's default session adaptive retries (absorbed by the SDK's internal
IAM role-validation client), plus a makereport hook that xfails residual
SimulatePrincipalPolicy throttling under concurrent test load.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant