[jira] [Created] (FLINK-15800) Refactor download page to make hadoop less prominant

2020-01-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15800: Summary: Refactor download page to make hadoop less prominant Key: FLINK-15800 URL: https://issues.apache.org/jira/browse/FLINK-15800 Project: Flink

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-28 Thread aihua li
Congratulations Yu LI, well deserved. > 2020年1月23日 下午4:59,Stephan Ewen 写道: > > Hi all! > > We are announcing that Yu Li has joined the rank of Flink committers. > > Yu joined already in late December, but the announcement got lost because > of the Christmas and New Years season, so here is a b

Re: connection timeout during shuffle initialization

2020-01-28 Thread Stephan Ewen
Hi! Concerning JAR files: I think this has nothing to do with it, it is a batch shuffle after all. The previous stage must have completed already. A few things that come to my mind: - What Flink version are you using? 1.9? - Are you sure that the source TaskManager is still running? Earlier F

[jira] [Created] (FLINK-15799) Support running kubernetes.sh against different context than the current context

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15799: - Summary: Support running kubernetes.sh against different context than the current context Key: FLINK-15799 URL: https://issues.apache.org/jira/browse/FLINK-15799 Pr

[jira] [Created] (FLINK-15798) Running ./bin/kubernetes-session.sh -Dkubernetes.cluster-id= -Dexecution.attached=true fails with exception

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15798: - Summary: Running ./bin/kubernetes-session.sh -Dkubernetes.cluster-id= -Dexecution.attached=true fails with exception Key: FLINK-15798 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-15797) Reduce logging noise of Fabric8FlinkKubeClient

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15797: - Summary: Reduce logging noise of Fabric8FlinkKubeClient Key: FLINK-15797 URL: https://issues.apache.org/jira/browse/FLINK-15797 Project: Flink Issue Type:

[jira] [Created] (FLINK-15796) Extend Kubernetes documentation on how to use a custom image

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15796: - Summary: Extend Kubernetes documentation on how to use a custom image Key: FLINK-15796 URL: https://issues.apache.org/jira/browse/FLINK-15796 Project: Flink

[jira] [Created] (FLINK-15795) KubernetesClusterDescriptor seems to report unreachable JobManager interface URL

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15795: - Summary: KubernetesClusterDescriptor seems to report unreachable JobManager interface URL Key: FLINK-15795 URL: https://issues.apache.org/jira/browse/FLINK-15795 Pr

[jira] [Created] (FLINK-15794) Rethink default value of kubernetes.container.image

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15794: - Summary: Rethink default value of kubernetes.container.image Key: FLINK-15794 URL: https://issues.apache.org/jira/browse/FLINK-15794 Project: Flink Issue T

[jira] [Created] (FLINK-15793) Move kubernetes-entry.sh out of FLINK_HOME/bin

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15793: - Summary: Move kubernetes-entry.sh out of FLINK_HOME/bin Key: FLINK-15793 URL: https://issues.apache.org/jira/browse/FLINK-15793 Project: Flink Issue Type:

[jira] [Created] (FLINK-15792) Make Flink logs accessible via kubectl logs per default

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15792: - Summary: Make Flink logs accessible via kubectl logs per default Key: FLINK-15792 URL: https://issues.apache.org/jira/browse/FLINK-15792 Project: Flink Iss

[jira] [Created] (FLINK-15791) Don't use ForkJoinPool#commonPool() for executing asynchronous operations in Fabric8FlinkKubeClient

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15791: - Summary: Don't use ForkJoinPool#commonPool() for executing asynchronous operations in Fabric8FlinkKubeClient Key: FLINK-15791 URL: https://issues.apache.org/jira/browse/FLINK-15

[jira] [Created] (FLINK-15790) Make FlinkKubeClient and its implementations asynchronous

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15790: - Summary: Make FlinkKubeClient and its implementations asynchronous Key: FLINK-15790 URL: https://issues.apache.org/jira/browse/FLINK-15790 Project: Flink I

[jira] [Created] (FLINK-15789) ActionWatcher.await should throw InterruptedException

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15789: - Summary: ActionWatcher.await should throw InterruptedException Key: FLINK-15789 URL: https://issues.apache.org/jira/browse/FLINK-15789 Project: Flink Issue

[jira] [Created] (FLINK-15788) Various Kubernetes integration improvements

2020-01-28 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15788: - Summary: Various Kubernetes integration improvements Key: FLINK-15788 URL: https://issues.apache.org/jira/browse/FLINK-15788 Project: Flink Issue Type: Imp

Re: connection timeout during shuffle initialization

2020-01-28 Thread Piotr Nowojski
Hi, > In case of large jar, wouldn't this happen in previous stages as well (if > so this should not be the case)? I’m not exactly sure how jars are distributed, but if they are being sent/uploaded from one (or some other static/fixed number, like uploading to and reading from a DFS) node to al

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Fabian Hueske
+1 Am Di., 28. Jan. 2020 um 15:23 Uhr schrieb Yun Tang : > +1 (non-binding) > > From: Stephan Ewen > Sent: Tuesday, January 28, 2020 21:36 > To: dev ; patr...@ververica.com < > patr...@ververica.com> > Subject: Re: [VOTE] Integrate Flink Docker image publication

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Yun Tang
+1 (non-binding) From: Stephan Ewen Sent: Tuesday, January 28, 2020 21:36 To: dev ; patr...@ververica.com Subject: Re: [VOTE] Integrate Flink Docker image publication into Flink release process +1 On Tue, Jan 28, 2020 at 2:20 PM Patrick Lucas wrote: > Thanks

Re: connection timeout during shuffle initialization

2020-01-28 Thread David Morávek
Hi Piotr, thanks for suggestions! In case of large jar, wouldn't this happen in previous stages as well (if so this should not be the case)? Also there shouldn't be any state involved (unless Beam IO's use it internally). I'll get back to you with with the results after checking TM's io stats.

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Stephan Ewen
+1 On Tue, Jan 28, 2020 at 2:20 PM Patrick Lucas wrote: > Thanks for kicking this off, Ufuk. > > +1 (non-binding) > > -- > Patrick > > On Mon, Jan 27, 2020 at 5:50 PM Ufuk Celebi wrote: > > > Hey all, > > > > there is a proposal to contribute the Dockerfiles and scripts of > > https://github.co

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Patrick Lucas
Thanks for kicking this off, Ufuk. +1 (non-binding) -- Patrick On Mon, Jan 27, 2020 at 5:50 PM Ufuk Celebi wrote: > Hey all, > > there is a proposal to contribute the Dockerfiles and scripts of > https://github.com/docker-flink/docker-flink to the Flink project. The > discussion corresponding

Re: [DISCUSS] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Patrick Lucas
Thanks everyone for your input on this! @Fabian: I concur with utilizing the ASF infra and ASF Docker Hub organization to build and host any "less-critical" images like you propose. I would also add RC builds to that list, as alluded to in my original email. -- Patrick On Sun, Jan 26, 2020 at 4:

[jira] [Created] (FLINK-15787) Upgrade REST API response to remove '-' from key names.

2020-01-28 Thread Daryl Roberts (Jira)
Daryl Roberts created FLINK-15787: - Summary: Upgrade REST API response to remove '-' from key names. Key: FLINK-15787 URL: https://issues.apache.org/jira/browse/FLINK-15787 Project: Flink Iss

[jira] [Created] (FLINK-15786) Load connector code with separate classloader

2020-01-28 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-15786: - Summary: Load connector code with separate classloader Key: FLINK-15786 URL: https://issues.apache.org/jira/browse/FLINK-15786 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-15785) Rework E2E test activations

2020-01-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15785: Summary: Rework E2E test activations Key: FLINK-15785 URL: https://issues.apache.org/jira/browse/FLINK-15785 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-15784) Show the Watermark metrics of source node in the web UI.

2020-01-28 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-15784: - Summary: Show the Watermark metrics of source node in the web UI. Key: FLINK-15784 URL: https://issues.apache.org/jira/browse/FLINK-15784 Project: Flink Issue Type

[jira] [Created] (FLINK-15783) Test release candidate of Flink 1.10 on EMR

2020-01-28 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-15783: -- Summary: Test release candidate of Flink 1.10 on EMR Key: FLINK-15783 URL: https://issues.apache.org/jira/browse/FLINK-15783 Project: Flink Issue Type: T

Re: connection timeout during shuffle initialization

2020-01-28 Thread Piotr Nowojski
Hi David, The usual cause for connection time out is long deployment. For example if your Job's jar is large and takes long time to distribute across the cluster. I’m not sure if large state could affect this as well or not. Are you sure that’s not the case? The think you are suggesting, I hav

[jira] [Created] (FLINK-15782) Rework JDBC sinks

2020-01-28 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-15782: - Summary: Rework JDBC sinks Key: FLINK-15782 URL: https://issues.apache.org/jira/browse/FLINK-15782 Project: Flink Issue Type: Improvement

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Till Rohrmann
+1 (binding) Cheers, Till On Mon, Jan 27, 2020 at 7:17 PM Konstantin Knauf wrote: > +1 (non-binding) > > On Mon, Jan 27, 2020 at 5:50 PM Ufuk Celebi wrote: > > > Hey all, > > > > there is a proposal to contribute the Dockerfiles and scripts of > > https://github.com/docker-flink/docker-flink t

Re: connection timeout during shuffle initialization

2020-01-28 Thread Till Rohrmann
Hi David, I'm unfortunately not familiar with these parts of Flink but I'm pulling Piotr in who might be able to tell you more. Cheers, Till On Mon, Jan 27, 2020 at 5:58 PM David Morávek wrote: > Hello community, > > I'm currently struggling with an Apache Beam batch pipeline on top of > Flink

[jira] [Created] (FLINK-15781) Manual Smoke Test with Batch Job

2020-01-28 Thread Gary Yao (Jira)
Gary Yao created FLINK-15781: Summary: Manual Smoke Test with Batch Job Key: FLINK-15781 URL: https://issues.apache.org/jira/browse/FLINK-15781 Project: Flink Issue Type: Task Affects Version

[jira] [Created] (FLINK-15780) Manual Smoke Test of Native Kubernetes Integration

2020-01-28 Thread Gary Yao (Jira)
Gary Yao created FLINK-15780: Summary: Manual Smoke Test of Native Kubernetes Integration Key: FLINK-15780 URL: https://issues.apache.org/jira/browse/FLINK-15780 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-15779) Manual Smoke Test of Python API

2020-01-28 Thread Gary Yao (Jira)
Gary Yao created FLINK-15779: Summary: Manual Smoke Test of Python API Key: FLINK-15779 URL: https://issues.apache.org/jira/browse/FLINK-15779 Project: Flink Issue Type: Task Components

[jira] [Created] (FLINK-15778) SQL Client end-to-end test for Kafka 0.10 nightly run hung on travis

2020-01-28 Thread Yu Li (Jira)
Yu Li created FLINK-15778: - Summary: SQL Client end-to-end test for Kafka 0.10 nightly run hung on travis Key: FLINK-15778 URL: https://issues.apache.org/jira/browse/FLINK-15778 Project: Flink Issue

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-28 Thread Yun Tang
Congratulations Yu, well deserved and happy Chinese new year ~ Best Yun Tang From: Xintong Song Sent: Tuesday, January 28, 2020 11:24 To: dev Subject: Re: [ANNOUNCE] Yu Li became a Flink committer Congratulations Yu, well deserved. Thank you~ Xintong Song