Add Datadog code coverage upload#262
Conversation
Add DataDog/coverage-upload-github-action step to the coverage job in test.yml to upload coverage reports to Datadog Code Coverage side-by-side with the existing Codecov upload. This enables comparison of coverage data between both systems as part of the Codecov-to-Datadog migration.
Required by DataDog org policy: all actions must be pinned to full-length commit SHAs.
The DataDog/coverage-upload-github-action is blocked by the enterprise action allowlist (it depends on datadog/install-datadog-ci-github-action which is not permitted). Fall back to npx @datadog/datadog-ci CLI directly.
|
🎯 Code Coverage (details) 🔗 Commit SHA: 724d9e5 | Docs | Datadog PR Page | Was this helpful? React with 👍/👎 or give us feedback! |
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 101cefaed1
ℹ️ About Codex in GitHub
Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".
| - name: Upload coverage to Datadog | ||
| if: steps.dd-sts.outputs.api_key != '' | ||
| continue-on-error: true | ||
| run: npx @datadog/datadog-ci coverage upload coverage_data |
There was a problem hiding this comment.
Invoke datadog-ci with a fixed version instead of bare npx @datadog/datadog-ci, because this currently resolves the latest package on every workflow run and makes coverage uploads non-deterministic. A future CLI release can change behavior or flags and silently stop Datadog uploads here (especially since this step is continue-on-error), which undermines parity validation with Codecov for the same commit.
Useful? React with 👍 / 👎.
There was a problem hiding this comment.
If possible and if you agree I'd rather indeed use a pined version of the tool, for reproducibility. Thanks in advance!
2 participants
What does this PR do?
We're migrating Datadog repositories from Codecov to Datadog Code Coverage for tracking test coverage. This PR adds a Datadog coverage upload alongside the existing Codecov upload so we can run both systems in parallel and verify parity before switching over.
Replaces fork PR #249.