[jira] [Created] (FLINK-10968) Implement TaskManager Entrypoint

JIN SUN created FLINK-10968: --- Summary: Implement TaskManager Entrypoint Key: FLINK-10968 URL: https://issues.apache.org/jira/browse/FLINK-10968 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10939) Add documents for Flink on native k8s

JIN SUN created FLINK-10939: --- Summary: Add documents for Flink on native k8s Key: FLINK-10939 URL: https://issues.apache.org/jira/browse/FLINK-10939 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10934) Implement KubernetesJobClusterEntrypoint

JIN SUN created FLINK-10934: --- Summary: Implement KubernetesJobClusterEntrypoint Key: FLINK-10934 URL: https://issues.apache.org/jira/browse/FLINK-10934 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10938) Enable Flink on native k8s E2E Tests in Travis CI

JIN SUN created FLINK-10938: --- Summary: Enable Flink on native k8s E2E Tests in Travis CI Key: FLINK-10938 URL: https://issues.apache.org/jira/browse/FLINK-10938 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10937) Add scripts to create docker image for k8s

JIN SUN created FLINK-10937: --- Summary: Add scripts to create docker image for k8s Key: FLINK-10937 URL: https://issues.apache.org/jira/browse/FLINK-10937 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10936) Implement Command line tools

JIN SUN created FLINK-10936: --- Summary: Implement Command line tools Key: FLINK-10936 URL: https://issues.apache.org/jira/browse/FLINK-10936 Project: Flink Issue Type: Sub-task Reporter

[jira] [Created] (FLINK-10935) Implement KubeClient with Faric8 Kubernetes clients

JIN SUN created FLINK-10935: --- Summary: Implement KubeClient with Faric8 Kubernetes clients Key: FLINK-10935 URL: https://issues.apache.org/jira/browse/FLINK-10935 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10933) Implement KubernetesSessionClusterEntrypoint

JIN SUN created FLINK-10933: --- Summary: Implement KubernetesSessionClusterEntrypoint Key: FLINK-10933 URL: https://issues.apache.org/jira/browse/FLINK-10933 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-10932) Initial flink-kubernetes module with empty implementation

JIN SUN created FLINK-10932: --- Summary: Initial flink-kubernetes module with empty implementation Key: FLINK-10932 URL: https://issues.apache.org/jira/browse/FLINK-10932 Project: Flink Issue Type

Re: [DISCUSS] Task speculative execution for Flink batch

I think this is target for batch at the very beginning, the idea should be also work for both case, with different algorithm/strategy. Ryan, since you are working on this, I will assign FLINK-10644 to you. Jin > On Nov 6, 2018, at 4:45 AM, T

Re: [DISCUSS] Proposal of external shuffle service

Thanks Zhijiang for the proposal. I like the idea of external shuffle service, have left some comments on the document. > On Oct 31, 2018, at 2:26 AM, Till Rohrmann wrote: > > Thanks for the update Zhijiang! The community is currently quite busy with > the next Flink release. I hope that we ca

Run Flink Natively On Kubernetes

Hi all, FLIP-6 outlines improvements in how Flink is used on top of various cluster managers. we already have implementation on Yarn and Mesos, however, no native implementation on K8s. As a follow up, FLINK-9953 was opened by Till to track th

Re: reaching out from k8s Big Data SIG

@Erik, I’m working with Till regarding together for the Flink K8s native integration, we have a draft of design document, and plan to post the document next week and collect feedbacks. @Anand, operator is a interesting topic, look forward to see your design document. I will keep you updated.

[jira] [Created] (FLINK-10657) TPCHQuery3 fail with IllegalAccessException

JIN SUN created FLINK-10657: --- Summary: TPCHQuery3 fail with IllegalAccessException Key: FLINK-10657 URL: https://issues.apache.org/jira/browse/FLINK-10657 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-10656) Refactor org.apache.flink.runtime.io.network.api.reader.ReaderBase

JIN SUN created FLINK-10656: --- Summary: Refactor org.apache.flink.runtime.io.network.api.reader.ReaderBase Key: FLINK-10656 URL: https://issues.apache.org/jira/browse/FLINK-10656 Project: Flink

[jira] [Created] (FLINK-10644) Batch Job: Speculative execution

JIN SUN created FLINK-10644: --- Summary: Batch Job: Speculative execution Key: FLINK-10644 URL: https://issues.apache.org/jira/browse/FLINK-10644 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-10643) Bubble execution: Resource aware job execution

JIN SUN created FLINK-10643: --- Summary: Bubble execution: Resource aware job execution Key: FLINK-10643 URL: https://issues.apache.org/jira/browse/FLINK-10643 Project: Flink Issue Type: New Feature

Re: [DISCUSS] [Contributing] (3) - Review Tooling

> > > >> Whether it is possible to explicitly assign a PR to a committer > > familiar > > > >> with the module, which will reduce the unnecessary ping operation of > > > many > > > >> contributors. > > > >> Because some people don

[jira] [Created] (FLINK-10576) Introduce Machine/Node/TM health management

JIN SUN created FLINK-10576: --- Summary: Introduce Machine/Node/TM health management Key: FLINK-10576 URL: https://issues.apache.org/jira/browse/FLINK-10576 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-10575) Remove deprecated ExecutionGraphBuilder.buildGraph method

JIN SUN created FLINK-10575: --- Summary: Remove deprecated ExecutionGraphBuilder.buildGraph method Key: FLINK-10575 URL: https://issues.apache.org/jira/browse/FLINK-10575 Project: Flink Issue Type

[jira] [Created] (FLINK-10574) Update documents of new batch job failover strategy

JIN SUN created FLINK-10574: --- Summary: Update documents of new batch job failover strategy Key: FLINK-10574 URL: https://issues.apache.org/jira/browse/FLINK-10574 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10573) Support task revocation

JIN SUN created FLINK-10573: --- Summary: Support task revocation Key: FLINK-10573 URL: https://issues.apache.org/jira/browse/FLINK-10573 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-10572) Enable Per-job level failover strategy.

JIN SUN created FLINK-10572: --- Summary: Enable Per-job level failover strategy. Key: FLINK-10572 URL: https://issues.apache.org/jira/browse/FLINK-10572 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Flink Cluster Overview Dashboard Improvement Proposal

Great job! That would very helpful for debug. I would suggest to use small icons for this Job Manager/Managers when there are too many instances (like a thousand) May be we can also introduce locality, that task managers belongs to same rack shows together? Small icons can be like this:

Re: [DISCUSS] [Contributing] (2) - Review Steps

+1, look forward to see the change. > On Oct 9, 2018, at 12:07 AM, Fabian Hueske wrote: > > Hi everyone, > > Since we have addressed all comments (please raise your voice if not!), I > would like to move forward and convert the proposal [1] into a page for > Flink's website [2]. > I will create

Re: Future of JobManager.scala

e/FLINK-10392 [2] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65147077 Best, tison. Jin Sun 于2018年10月4日周四 上午8:06写道： > Hi Team, > > > > What is the future of JobManager in > org/apache/fli

[jira] [Created] (FLINK-10494) Rename 'JobManager' to J'obMaster' for some classes in JobMaster folder

JIN SUN created FLINK-10494: --- Summary: Rename 'JobManager' to J'obMaster' for some classes in JobMaster folder Key: FLINK-10494 URL: https://issues.apache.org/jira/browse/FLINK-10494

Future of JobManager.scala

Hi Team, What is the future of JobManager in org/apache/flink/runtime/jobmanager/JobManager.scala? I noticed that there are some duplicate logic between JobManager.scala and JobMaster/Dispatcher, that somehow confuse me, and I also saw LegacyYarnClusterDescriptor.java depends on JobManag

TPCH/TPCDS benchmark

Hi team, Do we have a tpch/tpcds benchmark located somewhere that we can run to validate performance? Some people did the benchmark and compare between Hive, Presto, and spark, but no flink: https://www.slideshare.net/ssuser6bb12d/hive-presto-and-spark-on-tpcds-benchmark , the benchmark the

Re: Flink operators for Kubernetes

Sounds interesting. Currently Flink can run in standalone mode in a kubernets cluster, details see here.   There is also a JIRA Flink-9953: Active kubernetes integration is target for run Flink on Kubernetes natively. Jin On 10/2/18, 1:30 PM, "Anand Swaminathan" wrote:     Hello

Re: Codespeed deployment for Flink

Great tool! > On Sep 24, 2018, at 10:59 PM, Zhijiang(wangzhijiang999) > wrote: > > Thanks @Piotr Nowojski and @Nico Kruber for the good job! > > I already benefit from this benchmark in the previous PRs. Wish the > visualization tool becoming stronger to benefit more for the community! > >

Re: [DISCUSS] [Contributing] (3) - Review Tooling

As a new contributor I cared about how to make my contribution accepted by the community, some questions: 1) When will it get reviewed? Is there a rule about review timeline? 2) There are long backlog of pull requests, What happened if a pull request not get noticed, do we have some mechanism

[jira] [Created] (FLINK-10298) Batch Job Failover Strategy

JIN SUN created FLINK-10298: --- Summary: Batch Job Failover Strategy Key: FLINK-10298 URL: https://issues.apache.org/jira/browse/FLINK-10298 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-10289) Classify Exceptions to different category for apply different failover strategy

JIN SUN created FLINK-10289: --- Summary: Classify Exceptions to different category for apply different failover strategy Key: FLINK-10289 URL: https://issues.apache.org/jira/browse/FLINK-10289 Project: Flink

[jira] [Created] (FLINK-10288) Failover Strategy improvement

JIN SUN created FLINK-10288: --- Summary: Failover Strategy improvement Key: FLINK-10288 URL: https://issues.apache.org/jira/browse/FLINK-10288 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-10205) Batch Job: InputSplit Fault tolerant for DataSourceTask

JIN SUN created FLINK-10205: --- Summary: Batch Job: InputSplit Fault tolerant for DataSourceTask Key: FLINK-10205 URL: https://issues.apache.org/jira/browse/FLINK-10205 Project: Flink Issue Type