Skip to content

refactor(metadata-db): replace with append-only ledger#1880

Open
shiyasmohd wants to merge 1 commit intomainfrom
shiyasmohd/job-ledger-events-table
Open

refactor(metadata-db): replace with append-only ledger#1880
shiyasmohd wants to merge 1 commit intomainfrom
shiyasmohd/job-ledger-events-table

Conversation

@shiyasmohd
Copy link
Contributor

  • Introduce an immutable job_events table that logs every job lifecycle transition (SCHEDULED, RUNNING, COMPLETED, ERROR, FATAL, etc.). Retry counts are now derived from SCHEDULED event counts rather than a dedicated job_attempts table, which is dropped in this migration.
  • Rename JobStatus::FailedRecoverableError and FailedFatalFatal so that both the jobs and job_events tables use the same canonical ERROR/FATAL values. The migration backfills events from existing jobs and updates legacy status strings in the jobs table.

@shiyasmohd shiyasmohd self-assigned this Mar 2, 2026
@shiyasmohd shiyasmohd force-pushed the shiyasmohd/job-ledger-events-table branch from 8f8ebff to e86e41b Compare March 2, 2026 14:28
@shiyasmohd shiyasmohd force-pushed the shiyasmohd/job-ledger-events-table branch from e86e41b to 78b4399 Compare March 2, 2026 14:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant