[
https://issues.apache.org/jira/browse/FLINK-39572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dian Fu closed FLINK-39572.
---------------------------
Fix Version/s: 1.20.6
2.3.1
2.4.0
Resolution: Fixed
Merged in:
- master via 3b51b5b3d7a35c937608e6799f13e028de1a1ceb
- release-2.3 via cf7fbd3317dd9524096bf7d97580460935dc2501
- release-1.20 via 2b0b62f899beaa8a5088ea7bbde4795999929ee0
> Hide sensitive information when pyflink's beam runner is closed
> ----------------------------------------------------------------
>
> Key: FLINK-39572
> URL: https://issues.apache.org/jira/browse/FLINK-39572
> Project: Flink
> Issue Type: Improvement
> Reporter: Biao Geng
> Assignee: Martijn Visser
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.20.6, 2.3.1, 2.4.0
>
>
> Currently when pyflink finishes a job execution,
> DefaultJobBundleFactory will be closed, which will unref underlying
> WrappedSdkHarnessClient.
> Given the current implementation, environment.getEnvironment() would be
> logged, we may need to use helper method like
> ConfigurationUtils.hideSensitiveValues to hide the sensitive information
> :
> {code:java}
> private int unref() {
> int refCount = bundleRefCount.decrementAndGet();
> Preconditions.checkState(refCount >= 0, "Reference count must not be
> negative.");
> if (refCount == 0) {
> // Close environment after it was removed from cache and all bundles
> finished.
> LOG.info("Closing environment {}", environment.getEnvironment());
> close();
> }
> return refCount;
> } {code}
>
> 2026-04-28 20:44:34,591 INFO
> org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory [] -
> Closing environment urn: "beam:env:process:v1"
> payload:
> "\032`/root/multi-modal-benchmark/.venv/lib/python3.11/site-packages/pyflink/bin/pyflink-udf-runner.sh\"\367\001\n\004PATH\022\356\001/usr/lib/jvm/java-11-openj
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
