morningman opened a new pull request, #70662: URL: https://github.com/apache/doris/pull/70662
### Background FE, BE and MS runtime images share a base image and copy Doris release binaries into it. The base previously included development packages, two JDKs and prebuilt operator tools. ### What problem does this PR solve? Issue Number: #69975 Related PR: None PR Type: Enhancement Problem Summary: Runtime images inherited outdated OS packages, an old JDK and Go dependencies, and unnecessary diagnostic and development software. Build a minimal patched base with one maintained JDK and rebuilt operator tools, verify release downloads, and remove Arthas and shared example private keys before the final FE image layer. Make component builds consume the base produced by the build script. ### Details - **Change map:** 402 changed lines in runtime Dockerfiles and shell scripts, 230 lines of tests and layer verification, and 198 changed documentation lines. No generated files or Doris application dependency changes. - **Before and after:** Replace base-6.0, jdk-latest and debug-latest with a minimal base built from pinned Ubuntu 22.04, Temurin 17.0.21+9 or 8u512-b09, and Go 1.27.4 images. Rebuild the pinned doris-operator tools with x/net v0.62.0 and edwards25519 v1.1.1. Apply available OS updates over HTTPS and retain runtime package and Go build inventories. - **Configs and defaults:** Use base-7.0-jdk17 or base-7.0-jdk8. The build script preserves its release-based Java selection, verifies SHA512 before extraction, and passes the newly built base to every component. Manual component builds default to Java 17; older releases require JAVA_VERSION=8 or an explicit Java 8 BASE_IMAGE. The slim Dockerfile aliases the minimal default base. - **Impact on existing users:** General profiling tools, development headers, Python 2 and Arthas are no longer bundled. MySQL SSL users must supply their own certificate stores and configure the existing certificate properties. Keep both operator commands and MySQL client TLS options. - **Behavior change:** Packaging and build defaults change as described above. Doris application code and dependencies, doris-compose and all-in-one build paths are unchanged. ### Testing - Six release-build tests pass, covering SHA512 success and failure, GNU/BSD checksum documents, ambiguous checksum rejection, invalid versions, architecture selection, Java 8 selection, optional MS and base-image handoff. - Bash syntax, ShellCheck with repository configuration, Python syntax and git diff --check pass. - Built and ran the Java 8 and Java 17 bases for both ARM64 and AMD64. Built the slim alias. Used mirrors with the same pinned digests where Docker Hub authentication is unavailable. - Repackaged the official ARM64 Doris 4.1.5 FE, BE and MS binaries using the modified component Dockerfiles. Ran FE/BE entry points, node registration, table creation, inserts and a Java UDF query through BE JNI. - Verified a MySQL connection with VERIFY_IDENTITY using runtime-provided PKCS12 stores and ran the Java UDF query through that connection. - Ran the MS entry point with a newly initialized FoundationDB 7.3.69 instance and verified its health endpoint. Exercised the rebuilt operator debug mode and dorisctl node-tag lookup. - Inspected every saved image layer of FE, BE, MS and representative bases for removed default keys, Arthas and the unselected JDK. - Trivy 0.76.2 scans of all four base variants report zero Critical/High findings, zero Go findings and 48 OS Medium/Low findings, all without published fixed versions in the scan database. ### Notes for Reviewers Doris application jars and their shaded dependencies require separate updates. This change does not claim that all scanner findings disappear. Full AMD64 Doris cluster, cloud compute-group and external-catalog compatibility matrices have not been run. ### Release note Runtime images use updated OS packages, maintained OpenJDK builds and rebuilt operator tools, with fewer bundled tools and no shared example MySQL private keys. MySQL SSL deployments must provide their own certificate stores. Manual builds for older Java 8 releases must select the Java 8 base. ### Check List (For Author) - Behavior changed: Yes (see Details). - Does this need documentation: Yes, updated docker/runtime/README.md is included. - Pre-submission status: Partially verified: no full AMD64 Doris cluster or complete cloud/external-catalog test matrix. ### AI Disclosure - Tool: Codex (GPT-6). - Generated: Dockerfiles, scripts, tests, documentation and this description. - Human review: Pending author review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
