Re: [VOTE] Release 1.9.2, release candidate #1

+1 (binding) - checked signatures - built from source - started a cluster and submitted examples via WebUI - log files look good I also went over the release notes and updated a few things. On 24/01/2020 11:03, Hequn Cheng wrote: Hi everyone, Please review and vote on the release candidate #1

[jira] [Created] (FLINK-15801) Timestamp extractor created from properties does not work for some physical fields

Dawid Wysakowicz created FLINK-15801: Summary: Timestamp extractor created from properties does not work for some physical fields Key: FLINK-15801 URL: https://issues.apache.org/jira/browse/FLINK-15801

[jira] [Created] (FLINK-15802) Expose the new type inference for table functions

Timo Walther created FLINK-15802: Summary: Expose the new type inference for table functions Key: FLINK-15802 URL: https://issues.apache.org/jira/browse/FLINK-15802 Project: Flink Issue Type:

[jira] [Created] (FLINK-15803) Expose the new type inference for aggregate functions

Timo Walther created FLINK-15803: Summary: Expose the new type inference for aggregate functions Key: FLINK-15803 URL: https://issues.apache.org/jira/browse/FLINK-15803 Project: Flink Issue T

[jira] [Created] (FLINK-15804) Support the new type inference in Scala Table API functions

Timo Walther created FLINK-15804: Summary: Support the new type inference in Scala Table API functions Key: FLINK-15804 URL: https://issues.apache.org/jira/browse/FLINK-15804 Project: Flink

[jira] [Created] (FLINK-15805) StreamingFileSink on S3 fails when firing processing time timers after recovery.

Kostas Kloudas created FLINK-15805: -- Summary: StreamingFileSink on S3 fails when firing processing time timers after recovery. Key: FLINK-15805 URL: https://issues.apache.org/jira/browse/FLINK-15805

Re: Join of three streams with different frequency

Hey, But isn't the temporal table join generating output only on watermark ??? I have found such info here: https://stackoverflow.com/questions/54441594/how-to-use-flink-temporal-tables. But since one of the tables will have data that changes very rarely, this would mean that using a temporal table

Re: Join of three streams with different frequency

Hey, Yes that’s true for temporal table joins with event time. You would have to make sure that watermarks are progressing, like periodically publish them [1], or some other custom logic. I’m not sure what’s works out of the box in the Table API, however you can always register DataStream as a

Re: connection timeout during shuffle initialization

Hi Stephan, I've actually managed to narrow problem down to blocked netty server threads. I'm using 1.9.1 with few custom patches , that are not relevant to this issue. To highlight the problem, I've added these checks to ResultPartitionManager

Re: connection timeout during shuffle initialization

/CC Piotr and Zhijiang Sounds reasonable at first glance. Would like to hear Piotr's and Zhijiang's take, though, they know that code better than me. On Wed, Jan 29, 2020 at 1:58 PM David Morávek wrote: > Hi Stephan, > > I've actually managed to narrow problem down to blocked netty server > thr

Re: [ANNOUNCE] Yu Li became a Flink committer

Congrats! On Wed, Jan 29, 2020 at 10:37 aihua li wrote: > Congratulations Yu LI, well deserved. > > > 2020年1月23日 下午4:59，Stephan Ewen 写道： > > > > Hi all! > > > > We are announcing that Yu Li has joined the rank of Flink committers. > > > > Yu joined already in late December, but the announcement

[jira] [Created] (FLINK-15806) Update recommended way to shut down detached Yarn session cluster

Till Rohrmann created FLINK-15806: - Summary: Update recommended way to shut down detached Yarn session cluster Key: FLINK-15806 URL: https://issues.apache.org/jira/browse/FLINK-15806 Project: Flink

Re: [VOTE] Release 1.9.2, release candidate #1

@Chesnay Schepler Thanks a lot! The release notes look much better now. I have updated the release notes in the website PR accordingly. Thanks, Hequn On Wed, Jan 29, 2020 at 5:34 PM Chesnay Schepler wrote: > +1 (binding) > > - checked signatures > - built from source > - started a cluster and

Re: connection timeout during shuffle initialization

Hi David, > with high load and io waits How high values are talking about? Could you attach a CPU profiler and post the results somehow? Which threads are busy on what call trees? Regarding the idea of removing of the locks in the `ResultPartitionManager`. I guess it could help a bit, but

Re: connection timeout during shuffle initialization

Hi Piotr, removal of buffer prefetch in BoundedBlockingSubpartitionReader did not help, I've already tried that (there are still other problematic code paths, eg. releasePartition). I think it's perfectly ok to perform IO ops in netty threads, we just have to make sure, we can leverage multiple th

Re: connection timeout during shuffle initialization

Just to clarify, these are bare metal nodes (128G ram, 16 cpus + hyperthreading, 4xHDDS, 10g network), which run yarn, hdfs and hbase. D. On Wed, Jan 29, 2020 at 5:03 PM David Morávek wrote: > Hi Piotr, > > removal of buffer prefetch in BoundedBlockingSubpartitionReader did not > help, I've alr

Re: [VOTE] Release 1.9.2, release candidate #1

+1 (binding) - checked signatures and hashes - built from source (mvn clean package, Scala 2.12) - ran e2e tests locally - checked new dependencies for licenses, no new ones were included since 1.9.1 - ran Kafka example with local cluster - quickstart worked without errors, logs looked good - Webs

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

+1 (non-binding) No more maintenance work for us Patrick! Just kidding :), it was mostly done by Patrick, all kudos to him. Just one question, we will be able to still be featured as an official docker image in this case? Best, Ismaël ps. Hope having an official Helm chart becomes also a future

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

+1 -- Rong On Wed, Jan 29, 2020 at 8:51 AM Ismaël Mejía wrote: > +1 (non-binding) > > No more maintenance work for us Patrick! Just kidding :), it was mostly > done by Patrick, all kudos to him. > Just one question, we will be able to still be featured as an official > docker image in this case

[jira] [Created] (FLINK-15807) Document Java 11 support

Chesnay Schepler created FLINK-15807: Summary: Document Java 11 support Key: FLINK-15807 URL: https://issues.apache.org/jira/browse/FLINK-15807 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15808) Upgrade Parquet to version 1.11.0

Ismaël Mejía created FLINK-15808: Summary: Upgrade Parquet to version 1.11.0 Key: FLINK-15808 URL: https://issues.apache.org/jira/browse/FLINK-15808 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-15809) component stack page needs to be updated for blink planner

Bowen Li created FLINK-15809: Summary: component stack page needs to be updated for blink planner Key: FLINK-15809 URL: https://issues.apache.org/jira/browse/FLINK-15809 Project: Flink Issue Type

[jira] [Created] (FLINK-15810) Add more description for FlinkKafkaProducerMigrationOperatorTest

vinoyang created FLINK-15810: Summary: Add more description for FlinkKafkaProducerMigrationOperatorTest Key: FLINK-15810 URL: https://issues.apache.org/jira/browse/FLINK-15810 Project: Flink Iss

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

+1 (non-binding) Best, Yang Rong Rong 于2020年1月30日周四 上午12:53写道： > +1 > > -- > Rong > > On Wed, Jan 29, 2020 at 8:51 AM Ismaël Mejía wrote: > > > +1 (non-binding) > > > > No more maintenance work for us Patrick! Just kidding :), it was mostly > > done by Patrick, all kudos to him. > > Just one

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

+1 (non-binding) On Wed, Jan 29, 2020 at 5:54 PM Yang Wang wrote: > +1 (non-binding) > > > Best, > Yang > > Rong Rong 于2020年1月30日周四 上午12:53写道： > > > +1 > > > > -- > > Rong > > > > On Wed, Jan 29, 2020 at 8:51 AM Ismaël Mejía wrote: > > > > > +1 (non-binding) > > > > > > No more maintenance w

Re: [VOTE] Release 1.9.2, release candidate #1

+1 (binding) - Release notes looks good. - Check end-to-end tests passed. - Signatures and hash are correct. - All artifacts have been deployed to the maven central repository. - Started a local Flink cluster and ran the streaming WordCount example. - Verified web UI and log output, nothing unexpe

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

+1 Even though I prefer to contribute the Dockerfiles into the Flink main repo, but I think a dedicate repo is also a good idea. Thanks a lot for driving this! @Ufuk Celebi On Thu, Jan 30, 2020 at 12:02 PM Peter Huang wrote: > +1 (non-binding) > > > > On Wed, Jan 29, 2020 at 5:54 PM Yang Wang

Re: [VOTE] Release 1.9.2, release candidate #1

+1 (non-binding) - check release note - check signatures and hashes - run e2e test on Travis - built from source, without Hadoop and using Scala 2.11,2.12 - checked that all POM files point to the same version - ran examples on a standalone cluster. Best, Hequn On Thu, Jan 30, 2020 at 12:58 PM j

Re: [VOTE] Release 1.9.2, release candidate #1

Hi everyone, Thanks a lot for your checking and voting for the release! I’ll summarize the result in another email. Thanks, Hequn On Thu, Jan 30, 2020 at 1:16 PM Hequn Cheng wrote: > +1 (non-binding) > > - check release note > - check signatures and hashes > - run e2e test on Travis > - built

[RESULT] [VOTE] Release 1.9.2, release candidate #1

Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 4 approving votes, 3 of which are binding: * Chesnay (binding) * Gordon (binding) * Jincheng (binding) * Hequn There are no disapproving votes. Thanks, everyone!