Skip to content

Added headers for CRR Cascaded #24

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
bert-e merged 2 commits into from
Jun 19, 2026
+52 −5
Merged

Added headers for CRR Cascaded #24

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
266c512
Add new headers for CRR Cascaded
SylvainSenechal May 21, 2026
05e36f3
Bump version to 1.0.9
SylvainSenechal May 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 32 additions & 2 deletions models/backbeatRoutes/putMetadata.smithy
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,8 @@ namespace cloudserver.backbeatRoutes
@http(method: "PUT", uri: "/_/backbeat/metadata/{Bucket}/{Key+}")
operation PutMetadata {
input: PutMetadataInput,
output: PutMetadataOutput
output: PutMetadataOutput,
errors: [MicroVersionIdAlreadyStoredException, StaleMicroVersionIdException]
}

structure PutMetadataInput {
Expand Down Expand Up @@ -33,12 +34,41 @@ structure PutMetadataInput {

@httpHeader("X-Scal-Request-Uids")
RequestUids: String,


/// MicroVersionId of the metadata being written. If specified, call will be rejected if
/// the existing metadata document already has a newer `micro-version-id`:
/// this ensures `micro-version-id` is monotonic, and thus allows handling
/// conflicting writes. If not specified, the update will be performed inconditionnally.
@httpHeader("x-scal-micro-version-id")
MicroVersionId: String,

@francoisferrand francoisferrand Jun 1, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: to make the semantic explicit, field could be name something like IfMicroVersionIdOlderThan (i.e. semantics is part of the API)

@SylvainSenechal SylvainSenechal Jun 2, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Leaving for now, what do other ppl think about the naming ?

@francoisferrand francoisferrand Jun 3, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@scality/raving-robots WDYT?

@maeldonn maeldonn Jun 5, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

x-scal-micro-version-id is simpler and easier to understand.

@francoisferrand francoisferrand Jun 12, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤝ok.

We however should document the semantics of this field here: i.e. it will conflict (and not write metadata) if micro version id is older than the one already stored

@francoisferrand francoisferrand Jun 16, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@SylvainSenechal please add a comment to explain the semantics of this field

@francoisferrand francoisferrand Jun 19, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"can be used to detect conflicts on writes" is not the semantics.
The semantics should explain how it behaves: something like "If specified, PutMetadata will be rejected if the existing object version already has a newer micro-version-id"

Suggested change
MicroVersionId: String,
/// MicroVersionId of the metadata being written. If specified, call will be rejected if the existing metadata document
/// already has a newer `micro-version-id`: this ensures `micro-version-id` is monotonic, and thus allows handling
/// conflicting writes. If not specified, the update will be performed inconditionnally.
@httpHeader("x-scal-micro-version-id")
MicroVersionId: String,


@httpPayload
Body: Blob
}

structure PutMetadataOutput {
/// Version ID of the stored metadata
versionId: String
}

/// Returned by PutMetadata when the incoming microVersionId matches the one
/// already at the destination. The write is skipped.
@error("client")
@httpError(409)
structure MicroVersionIdAlreadyStoredException {
@required
message: String
}

/// Returned by PutMetadata when the incoming microVersionId is older than

@francoisferrand francoisferrand Jun 19, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
/// Returned by PutMetadata when the incoming microVersionId is older than
/// Returned by PutMetadata when the incoming microVersionId is older or equal than

@SylvainSenechal SylvainSenechal Jun 19, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

stale is only older, equal is MicroVersionIdAlreadyStoredException

/// the destination's current value (can happen with stale cascade events for example).
/// In that case there is no write.
@error("client")
Comment thread
francoisferrand marked this conversation as resolved.
@httpError(409)
structure StaleMicroVersionIdException {
Comment thread
maeldonn marked this conversation as resolved.
@required
message: String,

@httpHeader("x-scal-micro-version-id")
microVersionId: String
}
21 changes: 19 additions & 2 deletions models/backbeatRoutes/putdata.smithy
View file
Open in desktop
Comment thread
maeldonn marked this conversation as resolved.

@SylvainSenechal SylvainSenechal May 29, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

First I added some tests in this codebase, but they were too functional and not really oriented toward just testing the client itself. + we already have test testing the client itself for putData/putMetadata

So I added the tests in Cloudserver : They are functional tests using CloudserverClient with the micro version id, testing 409 error, actual api behavior etc. I think they are better in cloudserver than in here

Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,8 @@ use aws.auth#unsignedPayload
@unsignedPayload
operation PutData {
input: PutDataInput,
output: PutDataOutput
output: PutDataOutput,
errors: [VersionIdCollisionException]
}

structure PutDataInput {
Expand All @@ -31,6 +32,9 @@ structure PutDataInput {
@httpHeader("X-Scal-Request-Uids")
RequestUids: String,

@httpHeader("x-scal-version-id")
VersionId: String,

@httpPayload
@default("")
Body: StreamingBlob
Expand All @@ -45,7 +49,20 @@ structure PutDataOutput {

@httpHeader("x-amz-server-side-encryption-customer-algorithm")
SSECustomerAlgorithm: String,

@httpHeader("x-amz-server-side-encryption-aws-kms-key-id")
SSEKMSKeyId: String
}

/// Returned by PutData when the destination already has an object at this
/// versionId. The existing microVersionId is included in the response header
/// so the caller can run the cascade loop/stale/proceed classification.
@error("client")
@httpError(409)
structure VersionIdCollisionException {
Comment thread
maeldonn marked this conversation as resolved.
@required
message: String,

@httpHeader("x-scal-micro-version-id")
microVersionId: String
}
2 changes: 1 addition & 1 deletion package.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "@scality/cloudserverclient",
"version": "1.0.8",
"version": "1.0.9",
"engines": {
"node": ">=20"
},
Expand Down
Loading