Skip to content

chore: add e2e and integ tests for web-search connector#1711

Open
nborges-aws wants to merge 1 commit into
mainfrom
ws-test-suite
Open

chore: add e2e and integ tests for web-search connector#1711
nborges-aws wants to merge 1 commit into
mainfrom
ws-test-suite

Conversation

@nborges-aws

Copy link
Copy Markdown
Contributor

Description

Add back integ and e2e test suite for web search, refactored to match latest connector devEx and config output schema.

Related Issue

Closes #

Documentation PR

Type of Change

  • Bug fix
  • New feature
  • Breaking change
  • Documentation update
  • Other (please describe):

Testing

How have you tested the change?

  • I ran npm run test:unit and npm run test:integ
  • I ran npm run typecheck
  • I ran npm run lint
  • If I modified src/assets/, I ran npm run test:update-snapshots and committed the updated snapshots

Checklist

  • I have read the CONTRIBUTING document
  • I have added any necessary tests that prove my fix is effective or my feature works
  • I have updated the documentation accordingly
  • I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
  • My changes generate no new warnings
  • Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the
terms of your choice.

@nborges-aws nborges-aws requested a review from a team July 8, 2026 19:23
@github-actions github-actions Bot added the size/m PR size: M label Jul 8, 2026
@github-actions github-actions Bot added the agentcore-harness-reviewing AgentCore Harness review in progress label Jul 8, 2026
@agentcore-devx-automation agentcore-devx-automation Bot added the claude-security-reviewing Claude Code /security-review in progress label Jul 8, 2026
@agentcore-devx-automation

Copy link
Copy Markdown
Contributor

Claude Security Review: no high-confidence findings. (run)

@agentcore-devx-automation agentcore-devx-automation Bot removed the claude-security-reviewing Claude Code /security-review in progress label Jul 8, 2026
@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Package Tarball

aws-agentcore-0.23.0.tgz

How to install

gh release download pr-1711-tarball --repo aws/agentcore-cli --pattern "*.tgz" --dir /tmp/pr-tarball
npm install -g /tmp/pr-tarball/aws-agentcore-0.23.0.tgz

@agentcore-cli-automation agentcore-cli-automation left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Test-only PR that re-adds e2e and integ suites for the web-search connector, refactored for the current --type connector --connector web-search shape and the configurations[] output schema.

Verified:

  • No excessive mocking — tests use real temp projects and shell out to the real CLI.
  • Telemetry helper is used at the correct boundaries (add and remove success paths).
  • Config assertions match the current translator output (parameterValues: {}, parameterOverrides: [], configurations[0].name === 'WebSearch', domainFilter.exclude).
  • Negative paths cover repeated --exclude-domains, wrong connector, removed --type web-search alias, and duplicate names.
  • E2E cleanup is safe when canRun is false (testDir and projectPath guarded), and the region env var is restored in afterAll.

Non-blocking observation: the previous version of web-search-lifecycle.test.ts had a comment above the region pin explaining that "Web search is only available in us-east-1" — that comment was dropped in this refactor. Might be worth adding back so a future maintainer doesn't remove the override thinking it's unnecessary. Not a merge blocker.

@github-actions github-actions Bot removed the agentcore-harness-reviewing AgentCore Harness review in progress label Jul 8, 2026
@github-actions

github-actions Bot commented Jul 8, 2026

Copy link
Copy Markdown
Contributor

Coverage Report

Status Category Percentage Covered / Total
🔵 Lines 39.36% 14567 / 37002
🔵 Statements 38.64% 15527 / 40178
🔵 Functions 33.54% 2484 / 7405
🔵 Branches 32.81% 9646 / 29394
Generated in workflow #4024 for commit 6a35a59 by the Vitest Coverage Report Action

import { afterAll, beforeAll, describe, expect, it } from 'vitest';

const hasAws = hasAwsCredentials();
const canRun = prereqs.npm && prereqs.git && prereqs.uv && hasAws;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: this has prereqs uv but the project is created with --skip-python-setup --no-agent so it might not be needed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size/m PR size: M

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants