Re: Use different S3 access key for different S3 bucket

Hi Qing The S3 credentials are associated with Flink SQL tables. I assume you are talking about processing/joining from two different tables, backed up by two different S3 buckets. If so, you can provide different credentials for different tables, then use the two tables in your pipeline. Jun

Re: Slow restart from savepoint with large broadcast state when increasing parallelism

> > Broadcast state is weird in that it’s duplicated, apparently avoid “hot > spots” when restoring from state. So I’m wondering how Flink handles the case > of restoring broadcast state when the parallelism increases. > > Regards, > > — Ken > > >> O

回复：Slow restart from savepoint with large broadcast state when increasing parallelism

Hi Ken,Without knowning the details, the first thing I would suggest to check is whether you have reached a threshold which is configured in your state storage (e.g., s3) therefore your further download were throttled. Checking your storage metrics or logs should help to confirm whether this is the

Re: videos Flink Forward San Francisco 2022

Hi Totally agree, rest assured that it was some venue limitations and some post-pandemic organizational challenges that meant no videos this year. Thanks a lot for the feedback and please let's stay positive and not draw the wrong conclusions. Thanks Jun > On Oct 10, 2022, at 2:39 PM, guente

Re: Fail to build Flink 1.15.1

t-utils-parent/flink-test-utils-junit/src/main/java/org/apache/flink/core/testutils/CommonTestUtils.java> > > On 09/09/2022 22:01, Jun Qin wrote: >> I have an issue when build a clean Flink 1.15.1 on MacOS w

Fail to build Flink 1.15.1

I have an issue when build a clean Flink 1.15.1 on MacOS with: mvn clean install -DskipTests -Dfast % echo $JAVA_HOME /usr/local/Cellar/ope

Re: Issues with watermark alignment in Flink 1.15

llowedWatermark=-9223372036854765808 to subTaskIds=[] to avoid streaming logs filling up the disk space. Thanks Jun > On Jul 10, 2022, at 9:10 AM, Jun Qin wrote: > > Hi All > > I am trying watermark alignment in Flink 1.15 with: > > watermarkStrategy = Watermark

Issues with watermark alignment in Flink 1.15

Hi All I am trying watermark alignment in Flink 1.15 with: watermarkStrategy = WatermarkStrategy.<~>forBoundedOutOfOrderness( Duration.ofMillis(outOfOrderness)) .withWatermarkAlignment("wm-group", Duration.ofSeconds(10), Duration.ofSeconds(1)) .withTimestampAssign

Status of File Sink Common (flink-file-sink-common)

Hi, Has File Sink Common (flink-file-sink-common) been dropped? If so, since which version? I do not seem to find anything related in the release notes of 1.13.x, 1.14.x and 1.15.0. Thanks Jun

Re: how to expose the current in-flight async i/o requests as metrics?

Hi Dongwon Did you override AsyncFunction#timeout()? If so, did you call resultFuture.complete()/completeExceptionally() in your override? Not calling them can result in checkpoint timeout. Thanks Jun > On Nov 9, 2021, at 7:37 AM, Dongwon Kim wrote: > > Hi David, > > There are currently