[jira] [Created] (FLINK-12826) Unify FunctionInterfacesWithException implementations

2019-06-12 Thread TisonKun (JIRA)
TisonKun created FLINK-12826: Summary: Unify FunctionInterfacesWithException implementations Key: FLINK-12826 URL: https://issues.apache.org/jira/browse/FLINK-12826 Project: Flink Issue Type: Imp

[jira] [Created] (FLINK-12825) Remove deprecation from BatchTableSource/Sink

2019-06-12 Thread Dawid Wysakowicz (JIRA)
Dawid Wysakowicz created FLINK-12825: Summary: Remove deprecation from BatchTableSource/Sink Key: FLINK-12825 URL: https://issues.apache.org/jira/browse/FLINK-12825 Project: Flink Issue T

[jira] [Created] (FLINK-12824) set parallelism for stream SQL

2019-06-12 Thread XuPingyong (JIRA)
XuPingyong created FLINK-12824: -- Summary: set parallelism for stream SQL Key: FLINK-12824 URL: https://issues.apache.org/jira/browse/FLINK-12824 Project: Flink Issue Type: Task Compone

Re: [DISCUSS] Adopting a Code Style and Quality Guide

2019-06-12 Thread Bowen Li
Hi Stephan, Definitely a good guide in principle IMO! I personally already find it useful in practice to learn from it myself, and also promote and cultivate a better coding habit around by referencing it. So big +1 to adopt it. Also want to highlight that we need to make real use of it, and keep

[jira] [Created] (FLINK-12823) PartitionTransformation supports DataExchangeMode property

2019-06-12 Thread Biao Liu (JIRA)
Biao Liu created FLINK-12823: Summary: PartitionTransformation supports DataExchangeMode property Key: FLINK-12823 URL: https://issues.apache.org/jira/browse/FLINK-12823 Project: Flink Issue Type

[jira] [Created] (FLINK-12822) Add explicit transformer from SerializableOptional to Optional

2019-06-12 Thread TisonKun (JIRA)
TisonKun created FLINK-12822: Summary: Add explicit transformer from SerializableOptional to Optional Key: FLINK-12822 URL: https://issues.apache.org/jira/browse/FLINK-12822 Project: Flink Issue

Re: Support for controlling slot assignment based on CPU requirements

2019-06-12 Thread Xintong Song
Hi Ken, There is a discussion in issue about a feature related to your demand. It proposes spread tasks evenly across TMs. However, the feature is still in progress, and it spreads all tasks evenly instead of specific operators. For the time bei

Re: [DISCUSS] FLIP-33: Standardize connector metrics

2019-06-12 Thread Becket Qin
Thanks all for the feedback and discussion. Since there wasn't any concern raised, I've started the voting thread for this FLIP, but please feel free to continue the discussion here if you think something still needs to be addressed. Thanks, Jiangjie (Becket) Qin On Mon, Jun 10, 2019 at 9:10

[VOTE] FLIP-33: Standardize connector metrics

2019-06-12 Thread Becket Qin
Hi Flink devs, I would like to start the voting for FLIP-33 which aims to standardize connector metrics. FLIP wiki: https://cwiki.apache.org/confluence/display/FLINK/FLIP-33%3A+Standardize+Connector+Metrics Discussion thread: https://lists.apache.org/thread.html/65078bad6e047578d502e1e5d9202

Re: [DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-12 Thread leesf
+1 for the FLIP, thank vino for your efforts. Best, Leesf vino yang 于2019年6月12日周三 下午5:46写道: > Hi folks, > > I would like to start the FLIP discussion thread about supporting local > aggregation in Flink. > > In short, this feature can effectively alleviate data skew. This is the > FLIP: > > > h

Support for controlling slot assignment based on CPU requirements

2019-06-12 Thread Ken Krugler
Hi all, I’m running a complex (batch) workflow that has a step where it trains Fasttext models. This is very CPU-intensive, to the point where it will use all available processing power on a server. The Flink configuration I’m using is one TaskManager per server, with N slots == available cor

[DISCUSS] Adopting a Code Style and Quality Guide

2019-06-12 Thread Stephan Ewen
Hi all! I want to propose that we try and adopt a code style and quality guide. Its a big endeavor, but I think it's worth trying :-) The Apache Flink community and contributor base is growing quite a bit, new committers and contributors are coming on board frequently. Everyone comes from a diffe

[jira] [Created] (FLINK-12821) Fix the bug that fix time quantifier can not be the last element of a pattern

2019-06-12 Thread Dian Fu (JIRA)
Dian Fu created FLINK-12821: --- Summary: Fix the bug that fix time quantifier can not be the last element of a pattern Key: FLINK-12821 URL: https://issues.apache.org/jira/browse/FLINK-12821 Project: Flink

Re: [DISCUSS] Deprecate previous Python APIs

2019-06-12 Thread Chesnay Schepler
I would just remove them. As you said, there are very limited as to what features they support, and haven't been under active development for several releases. Existing users (if there even are any) could continue to use older version against newer releases. It's is slightly more involved than

[jira] [Created] (FLINK-12820) Support ignoring null fields when writing to Cassandra

2019-06-12 Thread Ozan Cicekci (JIRA)
Ozan Cicekci created FLINK-12820: Summary: Support ignoring null fields when writing to Cassandra Key: FLINK-12820 URL: https://issues.apache.org/jira/browse/FLINK-12820 Project: Flink Issue

Re: [DISCUSS] Putting Table API jars in /lib by default

2019-06-12 Thread Aljoscha Krettek
+1 I agree that Table API should be in lib because it will become a first-class-citizen. Currently, both the classic Flink Table Runner and the new Blink-based Table Runner share the same package structure, i.e they are both rooted in org.apache.flink.table. We have to resolve this before we ca

[jira] [Created] (FLINK-12819) Reuse TableEnvironment between different SQL statements

2019-06-12 Thread Zhenghua Gao (JIRA)
Zhenghua Gao created FLINK-12819: Summary: Reuse TableEnvironment between different SQL statements Key: FLINK-12819 URL: https://issues.apache.org/jira/browse/FLINK-12819 Project: Flink Issue

[jira] [Created] (FLINK-12818) Improve stability of twoInputMapSink benchmark

2019-06-12 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-12818: -- Summary: Improve stability of twoInputMapSink benchmark Key: FLINK-12818 URL: https://issues.apache.org/jira/browse/FLINK-12818 Project: Flink Issue Type

Re: [DISCUSS] Support Local Aggregation in Flink

2019-06-12 Thread vino yang
Hi all, Thanks for all the feedback and comments. Based on @Aljoscha Krettek 's suggestion, I have created a new FLIP: "FLIP-44: Support Local Aggregation in Flink" and started a new mail thread for it in the dev mailing list. So any further feedback and discussion can be moved to the new threa

Re: [DISCUSS] Deprecate previous Python APIs

2019-06-12 Thread vino yang
+1 from my side Best, Vino Terry Wang 于2019年6月12日周三 下午5:45写道: > +1 for deprecation. It’s very reasonable. > > 在 2019年6月12日,下午5:32,Till Rohrmann 写道: > > +1 for deprecation. > > Cheers, > Till > > On Wed, Jun 12, 2019 at 4:31 AM Hequn Cheng wrote: > >> +1 on the proposal! >> Maintaining only on

[jira] [Created] (FLINK-12817) Correct the import in Processing function example

2019-06-12 Thread TANG Wen-hui (JIRA)
TANG Wen-hui created FLINK-12817: Summary: Correct the import in Processing function example Key: FLINK-12817 URL: https://issues.apache.org/jira/browse/FLINK-12817 Project: Flink Issue Type:

Re: [DISCUSS] Putting Table API jars in /lib by default

2019-06-12 Thread Till Rohrmann
Given that the Table API is going to be Flink's main API for analytical workloads, it makes sense to make it as easy as possible for users to actually use it. The question I would have is which other transitive dependencies are we gonna add to Flink's system class path by adding the Table API jars

[DISCUSS] FLIP-44: Support Local Aggregation in Flink

2019-06-12 Thread vino yang
Hi folks, I would like to start the FLIP discussion thread about supporting local aggregation in Flink. In short, this feature can effectively alleviate data skew. This is the FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-44%3A+Support+Local+Aggregation+in+Flink *Motivation* (co

Re: [DISCUSS] Deprecate previous Python APIs

2019-06-12 Thread Terry Wang
+1 for deprecation. It’s very reasonable. > 在 2019年6月12日,下午5:32,Till Rohrmann 写道: > > +1 for deprecation. > > Cheers, > Till > > On Wed, Jun 12, 2019 at 4:31 AM Hequn Cheng > wrote: > +1 on the proposal! > Maintaining only one Python API is helpful for users and c

Re: [DISCUSS] Deprecate previous Python APIs

2019-06-12 Thread Till Rohrmann
+1 for deprecation. Cheers, Till On Wed, Jun 12, 2019 at 4:31 AM Hequn Cheng wrote: > +1 on the proposal! > Maintaining only one Python API is helpful for users and contributors. > > Best, Hequn > > On Wed, Jun 12, 2019 at 9:41 AM Jark Wu wrote: > >> +1 and looking forward to the new Python AP

apply for contributor permission

2019-06-12 Thread kevin sun
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is kevinsun1000

[jira] [Created] (FLINK-12816) set maxParallelism to 1 when DataStreamSource is not isParallel

2019-06-12 Thread XuPingyong (JIRA)
XuPingyong created FLINK-12816: -- Summary: set maxParallelism to 1 when DataStreamSource is not isParallel Key: FLINK-12816 URL: https://issues.apache.org/jira/browse/FLINK-12816 Project: Flink

[jira] [Created] (FLINK-12815) Supports CatalogManager in blink planner

2019-06-12 Thread godfrey he (JIRA)
godfrey he created FLINK-12815: -- Summary: Supports CatalogManager in blink planner Key: FLINK-12815 URL: https://issues.apache.org/jira/browse/FLINK-12815 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12814) Support a traditional and scrolling view of result (non-interactive)

2019-06-12 Thread Zhenghua Gao (JIRA)
Zhenghua Gao created FLINK-12814: Summary: Support a traditional and scrolling view of result (non-interactive) Key: FLINK-12814 URL: https://issues.apache.org/jira/browse/FLINK-12814 Project: Flink

Re: [DISCUSS] Change threading-model in StreamTask to a mailbox-based approach

2019-06-12 Thread Stefan Richter
As there have been no objections, we are moving forward with this effort. Progress is tracked here: https://issues.apache.org/jira/browse/FLINK-12477 Best, Stefan > On 7. May 2019, at 17:39, Stefan Richter wrote: > > Hi, > > we want to star

[jira] [Created] (FLINK-12813) Add Hadoop profile in building from source docs

2019-06-12 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-12813: --- Summary: Add Hadoop profile in building from source docs Key: FLINK-12813 URL: https://issues.apache.org/jira/browse/FLINK-12813 Project: Flink Issue Type: Bug

Re: Apply for confluence Wiki create and edit permission

2019-06-12 Thread vino yang
Hi Aljoscha, Thanks! Aljoscha Krettek 于2019年6月12日周三 下午3:25写道: > I gave you the permissions 👌 > > > On 12. Jun 2019, at 05:26, vino yang wrote: > > > > Hi, > > > > I am going to create a new FLIP for Proposal of supporting local > > aggregation in Flink. > > > > The discussion thread in the Fli

Re: Apply for confluence Wiki create and edit permission

2019-06-12 Thread Aljoscha Krettek
I gave you the permissions 👌 > On 12. Jun 2019, at 05:26, vino yang wrote: > > Hi, > > I am going to create a new FLIP for Proposal of supporting local > aggregation in Flink. > > The discussion thread in the Flink dev mailing list is here.[1] > > Could you please give me the create and edit