Skip to content

acceptance: don't apply Ignore filter to out* files#4762

Open
denik wants to merge 7 commits intomainfrom
denik/ignore-output
Open

acceptance: don't apply Ignore filter to out* files#4762
denik wants to merge 7 commits intomainfrom
denik/ignore-output

Conversation

@denik
Copy link
Contributor

@denik denik commented Mar 16, 2026

Summary

  • Inherited Ignore patterns (e.g. databricks.yml from bundle/test.toml) were silently swallowing output files in template tests, preventing them from being detected as new/changed and updated with -update.
  • Fix: skip the Ignore filter for paths starting with "out", matching the existing convention for output files.
  • Reject (detectable) patterns starting with "out" in Ignore setting.

Test plan

  • Existing acceptance tests pass
  • go test ./acceptance -run TestAccept/bundle/templates/lakeflow-pipelines/python -update -v now correctly detects and writes output/my_lakeflow_pipelines/databricks.yml

🤖 Generated with Claude Code

@eng-dev-ecosystem-bot
Copy link
Collaborator

eng-dev-ecosystem-bot commented Mar 16, 2026

Commit: 5dc612c

Run: 23295434564

Env 🟨​KNOWN 🔄​flaky 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
🟨​ aws linux 7 1 9 268 797 9:37
🟨​ aws windows 7 1 9 270 795 8:18
🔄​ aws-ucws linux 2 7 9 364 712 7:17
🔄​ aws-ucws windows 2 7 9 366 710 5:59
💚​ azure linux 2 11 271 795 7:16
💚​ azure windows 2 11 273 793 4:54
🔄​ azure-ucws linux 2 1 11 369 708 8:48
🔄​ azure-ucws windows 2 1 11 371 706 6:04
💚​ gcp linux 2 11 267 798 7:27
💚​ gcp windows 2 11 269 796 5:06
18 interesting tests: 9 SKIP, 7 KNOWN, 2 flaky
Test Name aws linux aws windows aws-ucws linux aws-ucws windows azure linux azure windows azure-ucws linux azure-ucws windows gcp linux gcp windows
🟨​ TestAccept 🟨​K 🟨​K 🔄​f 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/resources/permissions 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/with_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions 🟨​K 🟨​K 💚​R 💚​R 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=direct 🟨​K 🟨​K 💚​R 💚​R
🟨​ TestAccept/bundle/resources/permissions/jobs/destroy_without_mgmtperms/without_permissions/DATABRICKS_BUNDLE_ENGINE=terraform 🟨​K 🟨​K 💚​R 💚​R
🙈​ TestAccept/bundle/resources/postgres_branches/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/recreate 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/update_protected 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_branches/without_branch_id 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_endpoints/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_endpoints/recreate 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/postgres_projects/update_display_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/synced_database_tables/basic 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🔄​ TestAccept/ssh/connect-serverless-gpu 🙈​s 🙈​s 🔄​f 🔄​f 🙈​s 🙈​s 🔄​f 🔄​f 🙈​s 🙈​s
🔄​ TestAccept/ssh/connection 💚​R 💚​R 💚​R 🔄​f 💚​R 💚​R 🔄​f 🔄​f 💚​R 💚​R
Top 23 slowest tests (at least 2 minutes):
duration env testname
5:29 aws linux TestSecretsPutSecretStringValue
4:12 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:11 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
4:07 aws windows TestSecretsPutSecretStringValue
3:19 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:18 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:17 aws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:12 gcp linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:11 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
3:09 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:08 aws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
3:05 gcp windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:54 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:51 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:47 azure windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:42 aws-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:40 aws-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:22 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:16 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:15 azure-ucws linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:11 azure-ucws windows TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=direct
2:10 azure linux TestAccept/bundle/resources/apps/inline_config/DATABRICKS_BUNDLE_ENGINE=terraform
2:08 gcp linux TestSecretsPutSecretStringValue

@denik denik force-pushed the denik/ignore-output branch 2 times, most recently from 0618943 to bd00434 Compare March 18, 2026 16:43
@denik denik temporarily deployed to test-trigger-is March 18, 2026 16:44 — with GitHub Actions Inactive
@denik denik force-pushed the denik/ignore-output branch from bd00434 to c6fa6ef Compare March 18, 2026 16:44
@denik denik temporarily deployed to test-trigger-is March 18, 2026 16:45 — with GitHub Actions Inactive
@denik denik enabled auto-merge March 18, 2026 16:51
@denik denik temporarily deployed to test-trigger-is March 18, 2026 16:55 — with GitHub Actions Inactive
@denik denik temporarily deployed to test-trigger-is March 19, 2026 10:18 — with GitHub Actions Inactive
@github-actions
Copy link

Suggested reviewers

Based on git history of the changed files, these people are best suited to review:

  • @pietern -- recent work in acceptance/, acceptance/bundle/resources/postgres_branches/without_branch_id/, acceptance/bundle/resources/postgres_branches/basic/
  • @ilyakuz-db -- recent work in acceptance/bundle/config-remote-sync/output_no_changes/, acceptance/bundle/config-remote-sync/output_json/, acceptance/bundle/deploy/snapshot-comparison/
  • @shreyas-goenka -- recent work in acceptance/, acceptance/internal/, acceptance/bundle/resources/postgres_branches/recreate/

Confidence: low

Eligible reviewers

Based on CODEOWNERS, these people or teams could also review:

@andrewnester, @anton-107, @simonfaltum

Suggestions based on git history of 23 changed files (20 scored). See CODEOWNERS for path-specific ownership rules.

@denik denik temporarily deployed to test-trigger-is March 19, 2026 10:38 — with GitHub Actions Inactive
@denik denik temporarily deployed to test-trigger-is March 19, 2026 11:18 — with GitHub Actions Inactive
@denik denik disabled auto-merge March 19, 2026 11:19
@denik denik enabled auto-merge March 19, 2026 11:19
@denik denik temporarily deployed to test-trigger-is March 19, 2026 11:19 — with GitHub Actions Inactive
@denik denik temporarily deployed to test-trigger-is March 19, 2026 12:42 — with GitHub Actions Inactive
denik and others added 3 commits March 19, 2026 13:43
Inherited Ignore patterns (e.g. `databricks.yml` from bundle/test.toml)
were silently swallowing output files in template tests, preventing them
from being tracked and updated with -update.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
…se time

Rename test artifacts from out.json/out.app-run to tmp.json/tmp.app-run
to comply with the new validation.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
- snapshot-comparison: rename out.bundle*.json to tmp.bundle*.json
- postgres_endpoints/projects: set RecordRequests=false, remove out.requests.txt from Ignore
- git_source: update output.txt to match renamed tmp.app-run

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@denik denik force-pushed the denik/ignore-output branch from 3d47cd9 to 5dc612c Compare March 19, 2026 12:44
@denik denik temporarily deployed to test-trigger-is March 19, 2026 12:44 — with GitHub Actions Inactive
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants