RANGER-5640: Bump Docker Ozone to 2.1 and package audit-server JARs in ozone plugin#1007
Open
ramackri wants to merge 4 commits into
Open
RANGER-5640: Bump Docker Ozone to 2.1 and package audit-server JARs in ozone plugin#1007ramackri wants to merge 4 commits into
ramackri wants to merge 4 commits into
Conversation
…n ozone plugin. Align ranger-docker runtime with the Ozone 2.1.0 plugin compile target (RANGER-5393) and explicitly include ranger-audit-core / ranger-audit-dest-auditserver in the plugin assembly so auditserver destination initializes on OM. Co-authored-by: Cursor <cursoragent@cursor.com>
…on-api to ozone plugin. Ozone 2.1 runner entrypoint falls back to obsolete -createObjectStore when ENSURE_*_INITIALIZED is set; use explicit scm/om --init in compose commands instead. Package javax.annotation-api for RangerAuditServerDestination JAX-RS on OM. Co-authored-by: Cursor <cursoragent@cursor.com>
…ta chown. Add runtime javax.annotation-api to plugin-ozone so assembly packages Priority; qualify the assembly include with version. Pre-create and chown /data on the jdk21 runner before datanode start. Co-authored-by: Cursor <cursoragent@cursor.com>
…assembly. The moduleSet already selects Ranger reactor modules; listing them again in binaries <includes> is redundant (same pattern as hdfs-agent.xml). Co-authored-by: Cursor <cursoragent@cursor.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes were proposed in this pull request?
Ranger’s Ozone plugin compiles against Ozone 2.1.0 (
pom.xml, RANGER-5393 / AssumeRole), butdev-support/ranger-dockerstill ran Ozone 1.4.0 at runtime after RANGER-5637 (#1006). That mismatch breaks the Ozone Docker /plugins-docker-buildsmoke path:NoSuchMethodError: RequestContext.getSessionPolicy()— plugin bytecode references a 2.1 API; Ozone 1.4 OM classpath has no such method.plugin-ozone.xmlmoduleSet must includeranger-audit-core/ranger-audit-dest-auditserverso they are packaged intolib/libext/ranger-ozone-plugin-impl/.ENSURE_*_INITIALIZEDtriggers runner entrypoint fallback to obsolete-createObjectStore(removed in Ozone 2.1).javax.annotation.PriorityCNFE — audit-server JAX-RS on OM needsjavax.annotation-apias a runtime Maven dependency onplugin-ozoneplus assembly include (assembly<include>alone is insufficient)./data: Operation not permittedon datanode — jdk21ozone-runnerrequires pre-create/chown of/databeforeozone datanode.This PR:
OZONE_VERSION=2.1.0in.env, aligned with the plugin compile target.ozone-runnerto JDK 21 —OZONE_RUNNER_VERSION=20260106-1-jdk21(Ozone 2.0+ requires jdk21 runner; multi-arch arm64+amd64).Dockerfile.ranger-ozonedefault ARG kept in sync.ranger-audit-core,ranger-audit-dest-auditserver, and related Ranger modules to the implmoduleSetindistro/src/main/assembly/plugin-ozone.xml(same pattern ashdfs-agent.xml; redundant duplicate entries inbinaries <includes>removed).ozone scm --init/ozone om --init; datanode command pre-creates andchowns/datafor jdk21 runner.javax.annotation-api—runtimedependency inplugin-ozone/pom.xmland version-qualified assembly include.Commits
764b513e2.env, audit modules in moduleSet, compose--init33c1bd600javax.annotation-apiassembly includec10983219javax.annotation-apipom runtime dep; datanode/datachown008c88667:jarlines frombinaries <includes>(hdfs-agent parity)Files changed
dev-support/ranger-docker/.envOZONE_VERSION1.4.0 → 2.1.0; runner →20260106-1-jdk21dev-support/ranger-docker/Dockerfile.ranger-ozoneOZONE_RUNNER_VERSIONdev-support/ranger-docker/docker-compose.ranger-ozone.yml--init; datanode/datachownplugin-ozone/pom.xmljavax.annotation-apiruntime dependencydistro/src/main/assembly/plugin-ozone.xmljavax.annotation-api; hdfs-style binaries filterHow was this patch tested?
plugins-docker-build— pass (ozone-scm,ozone-datanode,ozone-omup with Ozone 2.1 / jdk21 runner).docker-config) — all five containers (ranger,ranger-solr,ozone-scm,ozone-datanode,ozone-om) running; nojavax.annotation.Priority/ClassNotFoundExceptionon OM start.Manual testing
Performed on macOS (Apple Silicon):
ozone-scm/ozone-omozone-datanode/datachown fixNoSuchMethodError: getSessionPolicy()ClassNotFoundException: javax.annotation.Priorityplugins-docker-build(CI)Note: Export
OZONE_VERSIONandOZONE_RUNNER_VERSIONexplicitly if shell env overrides.env.Test plan (CI / reviewers)
plugins-docker-build—ozone-scm,ozone-datanode,ozone-omstart with Ozone 2.1 / jdk21javax.annotation-api-*.jarpackaged underlib/libext/ranger-ozone-plugin-impl/(viaplugin-ozonepom + assembly)mvn clean verify— confirm fatranger-*-ozone-plugin.tar.gzcontainsranger-audit-core-*.jarandranger-audit-dest-auditserver-*.jar(full reactor build;-pl distroalone produces a stub tarball)