[jira] [Created] (FLINK-12623) Flink on yarn encountered AMRMClientImpl does not update AMRM token properly

2019-05-24 Thread dalongliu (JIRA)
dalongliu created FLINK-12623: - Summary: Flink on yarn encountered AMRMClientImpl does not update AMRM token properly Key: FLINK-12623 URL: https://issues.apache.org/jira/browse/FLINK-12623 Project: Flink

[jira] [Created] (FLINK-12622) The process function compiles error in MyProcessWindowFunction in windows.md

2019-05-24 Thread chaiyongqiang (JIRA)
chaiyongqiang created FLINK-12622: - Summary: The process function compiles error in MyProcessWindowFunction in windows.md Key: FLINK-12622 URL: https://issues.apache.org/jira/browse/FLINK-12622 Projec

[jira] [Created] (FLINK-12621) Use MiniCluster instead of JobExecutor

2019-05-24 Thread Jeff Zhang (JIRA)
Jeff Zhang created FLINK-12621: -- Summary: Use MiniCluster instead of JobExecutor Key: FLINK-12621 URL: https://issues.apache.org/jira/browse/FLINK-12621 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12620) Deadlock in task deserialization

2019-05-24 Thread Mike Kaplinskiy (JIRA)
Mike Kaplinskiy created FLINK-12620: --- Summary: Deadlock in task deserialization Key: FLINK-12620 URL: https://issues.apache.org/jira/browse/FLINK-12620 Project: Flink Issue Type: Bug Af

Re: Checkpoint / Two Phase Commit

2019-05-24 Thread vijikarthi
Pinging again on this thread to see if anyone has any recommendations? Particularly, I am interested to understand whether this scenario is also applicable for Kafka Connector? -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

[DISCUSS] Proposal to support disk spilling in HeapKeyedStateBackend

2019-05-24 Thread Yu Li
Hi All, As mentioned in our speak[1] given in FlinkForwardChina2018, we have improved HeapKeyedStateBackend to support disk spilling and put it in production here in Alibaba for last year's Singles' Day. Now we're ready to upstream our work and the design doc is up for review[2]. Please let us kno

[jira] [Created] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-05-24 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-12619: - Summary: Support TERMINATE/SUSPEND Job with Checkpoint Key: FLINK-12619 URL: https://issues.apache.org/jira/browse/FLINK-12619 Project: Flink

[jira] [Created] (FLINK-12618) jdk.tools exclusion interfering with swift-fs-hadoop build

2019-05-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12618: Summary: jdk.tools exclusion interfering with swift-fs-hadoop build Key: FLINK-12618 URL: https://issues.apache.org/jira/browse/FLINK-12618 Project: Flink

[jira] [Created] (FLINK-12617) StandaloneJobClusterEntrypoint should default to random JobID for non-HA setups

2019-05-24 Thread Konstantin Knauf (JIRA)
Konstantin Knauf created FLINK-12617: Summary: StandaloneJobClusterEntrypoint should default to random JobID for non-HA setups Key: FLINK-12617 URL: https://issues.apache.org/jira/browse/FLINK-12617

Re: [DISCUSS] Proposal for Flink job execution/availability metrics impovement

2019-05-24 Thread Piotr Nowojski
Hi Hwanju, I looked through the document, however I’m not the best person to review/judge/discuss about implementation details here. I hope that Chesney will be able to help in this regard. Piotrek > On 24 May 2019, at 09:09, Kim, Hwanju wrote: > > Hi, > > As suggested by Piotrek, the first

[jira] [Created] (FLINK-12616) Maintain connection between JM<->TM until all partitions have been released

2019-05-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12616: Summary: Maintain connection between JM<->TM until all partitions have been released Key: FLINK-12616 URL: https://issues.apache.org/jira/browse/FLINK-12616 P

[jira] [Created] (FLINK-12615) Track allocated partitions on the JM

2019-05-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12615: Summary: Track allocated partitions on the JM Key: FLINK-12615 URL: https://issues.apache.org/jira/browse/FLINK-12615 Project: Flink Issue Type: Sub-

Re: [Discuss] Add JobListener (hook) in flink job lifecycle

2019-05-24 Thread Chesnay Schepler
This issue is another case where we have problems figuring out the boundaries and responsibilities between the ExecutionEnvironments and the ClusterClient. I believe we should figure this out first, and decide whether the ClusterClient (or anything based on it) should be made public to accomo

[jira] [Created] (FLINK-12614) Refactor YARN tests to not do assertion in @After methods

2019-05-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12614: Summary: Refactor YARN tests to not do assertion in @After methods Key: FLINK-12614 URL: https://issues.apache.org/jira/browse/FLINK-12614 Project: Flink

[jira] [Created] (FLINK-12613) Move SinkFunction to flink-core

2019-05-24 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-12613: Summary: Move SinkFunction to flink-core Key: FLINK-12613 URL: https://issues.apache.org/jira/browse/FLINK-12613 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-12612) Track stored paritions on the TM

2019-05-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12612: Summary: Track stored paritions on the TM Key: FLINK-12612 URL: https://issues.apache.org/jira/browse/FLINK-12612 Project: Flink Issue Type: Sub-task

Re: [VOTE] Release flink-shaded 7.0, release candidate 2

2019-05-24 Thread jincheng sun
Thanks for your quickly merged the PR! @Chesnay Schepler ! I’m hereby canceling the VOTE for RC2 of flink-shaded 7.0 release, because of the aforementioned issues. I’ll create an RC3 for flink-shaded 7.0 release ASAP. due to all issues are already resolved! :) Thanks, Jincheng jincheng sun 于20

Re: [DISCUSS] Proposal for Flink job execution/availability metrics impovement

2019-05-24 Thread Kim, Hwanju
Hi, As suggested by Piotrek, the first part, execution state tracking, is now split to a separate doc: https://docs.google.com/document/d/1oLF3w1wYyr8vqoFoQZhw1QxTofmAtlD8IF694oPLjNI/edit?usp=sharing We'd appreciate any feedback. I am still using the same email thread to provide a full context

Re: [DISCUSS] A more restrictive JIRA workflow

2019-05-24 Thread Robert Metzger
Hey, I started working on step 1 and proposed some changes to the Flink website: https://github.com/apache/flink-web/pull/217 On Tue, Apr 30, 2019 at 4:08 PM Robert Metzger wrote: > Hi Fabian, > You are right, I made a mistake. I don't think it makes sense to introduce > a new permission clas