Re: Please please please review : Re: PubSub connector (FLINK-9311)

2018-11-02 Thread Niels Basjes
Hi all We created this feature almost 2 months ago. Please review this so it becomes part ofthe release so that others can use it too. So far we have not seen any feedback on what we should change/improve to make this happen. What should we do? Niels & Richard On Wed, Oct 17, 2018, 10:52 Richar

Re: Please please please review : Re: PubSub connector (FLINK-9311)

2018-11-02 Thread Chesnay Schepler
Hi! We're currently in the release process for 1.7.0 with a feature-freeze in effect, which locks down most (all?) committers to bug-fixes and testing. I apologize for this PR being ignored for so long, especially so since you started a discussion beforehand as to whether the Flink community

Re: Flink operators for Kubernetes

2018-11-02 Thread Till Rohrmann
Thanks for sharing your work with the community. Cheers, Till On Fri, Nov 2, 2018 at 1:16 AM Anand Swaminathan wrote: > Hello, > > I have documented our work of running Flink applications on Kubernetes > using FlinkK8sOperator - here > < > https://docs.google.com/document/d/1_AITTq0fay-NwUIqNfq

Re: Why dont't have a csv formatter for kafka table source

2018-11-02 Thread Till Rohrmann
Hi Jocean, these kind of issues should go to the user mailing list. I've cross posted it there and put dev to bcc. Cheers, Till On Fri, Nov 2, 2018 at 6:43 AM Jocean shi wrote: > Hi all, > I have encountered a error When i want to register a table from kafka > using csv formatter. >

Re: [DISCUSS] Change underlying Frontend Architecture for Flink Web Dashboard

2018-11-02 Thread Fabian Wollert
Hi Yadong, this looks awesome. is there any chance you can already share the code of the new web UI, so we can take a look at what you guys build there? I think that would speed up the discussion. If there is already a fully fledged new Version with everything updated out there, and its even battle

Re: Please please please review : Re: PubSub connector (FLINK-9311)

2018-11-02 Thread Niels Basjes
Thank you. On Fri, Nov 2, 2018, 08:37 Chesnay Schepler Hi! > > We're currently in the release process for 1.7.0 with a feature-freeze > in effect, which locks down most (all?) committers to bug-fixes and > testing. > > I apologize for this PR being ignored for so long, especially so since > you s

[jira] [Created] (FLINK-10761) MetricGroup#getAllVariables can deadlock

2018-11-02 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-10761: Summary: MetricGroup#getAllVariables can deadlock Key: FLINK-10761 URL: https://issues.apache.org/jira/browse/FLINK-10761 Project: Flink Issue Type:

[jira] [Created] (FLINK-10762) Do not try to request partitions in SingleInputGate per getRecord

2018-11-02 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-10762: --- Summary: Do not try to request partitions in SingleInputGate per getRecord Key: FLINK-10762 URL: https://issues.apache.org/jira/browse/FLINK-10762 Project: Flink

[jira] [Created] (FLINK-10763) Cannot union streams of different types in the union method of DataStream class

2018-11-02 Thread wangjinhai (JIRA)
wangjinhai created FLINK-10763: -- Summary: Cannot union streams of different types in the union method of DataStream class Key: FLINK-10763 URL: https://issues.apache.org/jira/browse/FLINK-10763 Project:

[jira] [Created] (FLINK-10764) Add S3 entropy injection end-to-end/IT test

2018-11-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-10764: - Summary: Add S3 entropy injection end-to-end/IT test Key: FLINK-10764 URL: https://issues.apache.org/jira/browse/FLINK-10764 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-10765) Modify one of the s3 tests to use the Presto S3 s3p schema

2018-11-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-10765: - Summary: Modify one of the s3 tests to use the Presto S3 s3p schema Key: FLINK-10765 URL: https://issues.apache.org/jira/browse/FLINK-10765 Project: Flink

[jira] [Created] (FLINK-10766) Add a link to flink-china.org in Flink website

2018-11-02 Thread Jark Wu (JIRA)
Jark Wu created FLINK-10766: --- Summary: Add a link to flink-china.org in Flink website Key: FLINK-10766 URL: https://issues.apache.org/jira/browse/FLINK-10766 Project: Flink Issue Type: Wish

[jira] [Created] (FLINK-10767) Update compatibility table for Flink 1.7

2018-11-02 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-10767: - Summary: Update compatibility table for Flink 1.7 Key: FLINK-10767 URL: https://issues.apache.org/jira/browse/FLINK-10767 Project: Flink Issue Type: Task

[DISCUSS]Enhancing flink scheduler by implementing blacklist mechanism

2018-11-02 Thread yingjie
Hi everyone, This post proposes the blacklist mechanism as an enhancement of flink scheduler. The motivation is as follows. In our clusters, jobs encounter Hardware and software environment problems occasionally, including software library missing,bad hardware,resource shortage like out of disk

Re: [DISCUSS] Flink SQL DDL Design

2018-11-02 Thread Bowen Li
Thanks Shuyi! I left some comments there. I think the design of SQL DDL and Flink-Hive integration/External catalog enhancements will work closely with each other. Hope we are well aligned on the directions of the two designs, and I look forward to working with you guys on both! Bowen On Thu, N

Re: [DISCUSS] FLIP-27: Refactor Source Interface

2018-11-02 Thread Piotr Nowojski
Hey Becket, Re 2. With: If source is purely single threaded and blocking, then it could be implemented in the following way: /* * Return a future, which when completed means that source has more data and getNext() will not block. * If you wish to use benefits of non blocking connectors, plea

[jira] [Created] (FLINK-10768) Move Calcite related code from TableEnvironment to CatalogManager

2018-11-02 Thread Bowen Li (JIRA)
Bowen Li created FLINK-10768: Summary: Move Calcite related code from TableEnvironment to CatalogManager Key: FLINK-10768 URL: https://issues.apache.org/jira/browse/FLINK-10768 Project: Flink Is

[jira] [Created] (FLINK-10769) port InMemoryExternalCatalog to java

2018-11-02 Thread Bowen Li (JIRA)
Bowen Li created FLINK-10769: Summary: port InMemoryExternalCatalog to java Key: FLINK-10769 URL: https://issues.apache.org/jira/browse/FLINK-10769 Project: Flink Issue Type: Sub-task C