[jira] [Created] (FLINK-13092) Translate "kubernetes" page into Chinese

2019-07-04 Thread yelun (JIRA)
yelun created FLINK-13092: - Summary: Translate "kubernetes" page into Chinese Key: FLINK-13092 URL: https://issues.apache.org/jira/browse/FLINK-13092 Project: Flink Issue Type: Sub-task Com

Re: Application for contributor permission

2019-07-04 Thread jincheng sun
Hi wudi, Thanks for your confirmation, usually, the contributor permissions are authorized as needed. I have not found that you have created Flink-related JIRA, nor have found any relevant discussions about your participation(by your id). So which JIRAs do you want to take now, I appreciate it if

Re: RE: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-07-04 Thread vino yang
Hi Jiayi, Thanks for your comments. It's valuable. I have accepted it and refined my design document. You can have another review when you have time. Best, Vino bupt_ljy 于2019年7月3日周三 下午2:48写道: > Hi vino, > Big +1 for this. > > Glad to see new progress on this topic! I’ve left some comments o

[jira] [Created] (FLINK-13093) Provide an easy way to modify max parallelism using the State Processor API

2019-07-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-13093: --- Summary: Provide an easy way to modify max parallelism using the State Processor API Key: FLINK-13093 URL: https://issues.apache.org/jira/browse/FLINK-13093

[jira] [Created] (FLINK-13094) Provide an easy way to read / bootstrap timers using the State Processor API

2019-07-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-13094: --- Summary: Provide an easy way to read / bootstrap timers using the State Processor API Key: FLINK-13094 URL: https://issues.apache.org/jira/browse/FLINK-13094

[jira] [Created] (FLINK-13095) Provide an easy way to read / bootstrap window state using the State Processor API

2019-07-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-13095: --- Summary: Provide an easy way to read / bootstrap window state using the State Processor API Key: FLINK-13095 URL: https://issues.apache.org/jira/browse/FLINK-13095

Re: [DISCUSS] Publish the PyFlink into PyPI

2019-07-04 Thread jincheng sun
Hi All, Thanks for the feedback @Chesnay Schepler @Dian! I think using `apache-flink` for the project name also makes sense to me. due to we should always keep in mind that Flink is owned by Apache. (And beam also using this pattern `apache-beam` for Python API) Regarding the Python API release

JIRA Contributor apply

2019-07-04 Thread Nuist_Hook
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is geyx881105.

[jira] [Created] (FLINK-13096) Typo in Utils

2019-07-04 Thread Charles Xu (JIRA)
Charles Xu created FLINK-13096: -- Summary: Typo in Utils Key: FLINK-13096 URL: https://issues.apache.org/jira/browse/FLINK-13096 Project: Flink Issue Type: Improvement Components: Deplo

Re: RE: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-07-04 Thread Yu Li
Hi Vino, Thanks for the write up. I've left some comments on google doc, please check. Thanks. Best Regards, Yu On Thu, 4 Jul 2019 at 15:37, vino yang wrote: > Hi Jiayi, > > Thanks for your comments. > > It's valuable. I have accepted it and refined my design document. > > You can have anothe

[jira] [Created] (FLINK-13097) Buffer depletion in SimpleCollectingOutputView throws non-obvious EOFException

2019-07-04 Thread JIRA
Cyrille Chépélov created FLINK-13097: Summary: Buffer depletion in SimpleCollectingOutputView throws non-obvious EOFException Key: FLINK-13097 URL: https://issues.apache.org/jira/browse/FLINK-13097

Application to Flink Contributor

2019-07-04 Thread Yi Huang
Hi, I would like to contribute to Apache Flink and my Jira ID is huangyi345. Thanks. Regards

Re: [DISCUSS]Support Upsert mode for Streaming Non-window FlatAggregate

2019-07-04 Thread jincheng sun
Hi All, @Kurt Young one user-defined table aggregate function can be used in both with(out) keys case, and we do not introduce any other aggregations. just like the explanation from @Hequn. @Hequn Cheng thanks for your explanation! One thing should be mentioned here: When a user uses a User-d

[VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Chesnay Schepler
I've raised a JIRA with INFRA to inquire whether it would be possible to switch to a different Travis account, and if so what steps would need to be taken. We need a proper confirmation from INFRA since we are not in full control of the flink r

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-04 Thread Chesnay Schepler
@Robert what's the state here? On 24/06/2019 16:16, Robert Metzger wrote: Hey all, I would like to drive this discussion to an end soon. I've just merged the updated contribution guide to the Flink website: https://flink.apache.org/contributing/contribute-code.html I will now ask Apache IINFRA

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Stephan Ewen
+1 to move to a private Travis account. I can confirm that Ververica will sponsor a Travis CI plan that is equivalent or a bit higher than the previous ASF quota (10 concurrent build queues) Best, Stephan On Thu, Jul 4, 2019 at 10:46 AM Chesnay Schepler wrote: > I've raised a JIRA >

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Aljoscha Krettek
+1 Aljoscha > On 4. Jul 2019, at 11:09, Stephan Ewen wrote: > > +1 to move to a private Travis account. > > I can confirm that Ververica will sponsor a Travis CI plan that is > equivalent or a bit higher than the previous ASF quota (10 concurrent build > queues) > > Best, > Stephan > > On Th

[jira] [Created] (FLINK-13098) Add a new type UNDEFINED of shuffle mode

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13098: Summary: Add a new type UNDEFINED of shuffle mode Key: FLINK-13098 URL: https://issues.apache.org/jira/browse/FLINK-13098 Project: Flink Issue Type: Improvement

When publish the flink 1.9 Doc

2019-07-04 Thread LakeShen
Hi community,I want to know when publish the flink 1.9 document? Thanks.

[jira] [Created] (FLINK-13099) Add a new type UNDEFINED of shuffle mode

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13099: Summary: Add a new type UNDEFINED of shuffle mode Key: FLINK-13099 URL: https://issues.apache.org/jira/browse/FLINK-13099 Project: Flink Issue Type: Improvement

Re: When publish the flink 1.9 Doc

2019-07-04 Thread Tzu-Li (Gordon) Tai
Hi, There is already document available for 1.9-SNAPSHOT [1]. The documentation for the official stable release will not be finalized until 1.9 is actually released. Feature freeze for 1.9.0 is happening this week, so ideally this should be available near end of July. Cheers, Gordon [1] https://

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Kurt Young
+1 and great thanks Chesnay for pushing this. Best, Kurt On Thu, Jul 4, 2019 at 5:44 PM Aljoscha Krettek wrote: > +1 > > Aljoscha > > > On 4. Jul 2019, at 11:09, Stephan Ewen wrote: > > > > +1 to move to a private Travis account. > > > > I can confirm that Ververica will sponsor a Travis CI p

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Chesnay Schepler
Small update with mostly bad news: INFRA doesn't know whether it is possible, and referred my to Travis support. They did point out that it could be problematic in regards to read/write permissions for the repository. From my own findings /so far/ with a test repo/organization, it does not a

[jira] [Created] (FLINK-13100) Fix the unexpected IOException during FileBufferReader#nextBuffer

2019-07-04 Thread zhijiang (JIRA)
zhijiang created FLINK-13100: Summary: Fix the unexpected IOException during FileBufferReader#nextBuffer Key: FLINK-13100 URL: https://issues.apache.org/jira/browse/FLINK-13100 Project: Flink Is

Re: [DISCUSS]Support Upsert mode for Streaming Non-window FlatAggregate

2019-07-04 Thread Kurt Young
Hi Jincheng, Thanks for the clarification. I think you just pointed out my concern by yourself: > When a user uses a User-defined table aggregate function (UDTAGG), he must understand the behavior of the UDTAGG, including the return type and the characteristics of the returned data. such as the k

Re:Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Haibo Sun
+1. Thank Chesnay for pushing this forward. Best, Haibo At 2019-07-04 17:58:28, "Kurt Young" wrote: >+1 and great thanks Chesnay for pushing this. > >Best, >Kurt > > >On Thu, Jul 4, 2019 at 5:44 PM Aljoscha Krettek wrote: > >> +1 >> >> Aljoscha >> >> > On 4. Jul 2019, at 11:09, Stephan Ewen w

Re: Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread zhijiang
+1 and thanks for Chesnay' work on this. Best, Zhijiang -- From:Haibo Sun Send Time:2019年7月4日(星期四) 18:21 To:dev Cc:priv...@flink.apache.org Subject:Re:Re: [VOTE] Migrate to sponsored Travis account +1. Thank Chesnay for pushing

Re: [DISCUSS] Flink framework and user log separation

2019-07-04 Thread Stephan Ewen
Is that something that can just be done by the right logging framework and configuration? Like having a log framework with two targets, one filtered on "org.apache.flink" and the other one filtered on "my.company.project" or so? On Fri, Mar 1, 2019 at 3:44 AM vino yang wrote: > Hi Jamie Grier,

Re: [DISCUSS] Flink framework and user log separation

2019-07-04 Thread Chesnay Schepler
From what I understand this isn't about logging Flink/user messages to different files, but log everything relevant to a specific job to a separate file (including what is being logged in runtime classes, i.e. Tasks, Operators etc.) On 04/07/2019 12:37, Stephan Ewen wrote: Is that something t

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Dian Fu
+1. Thanks Chesnay and Bowen for pushing this forward. Regards, Dian > 在 2019年7月4日,下午6:28,zhijiang 写道: > > +1 and thanks for Chesnay' work on this. > > Best, > Zhijiang > > -- > From:Haibo Sun > Send Time:2019年7月4日(星期四) 18:21 >

Re: When publish the flink 1.9 Doc

2019-07-04 Thread LakeShen
Thank you Tzu-Li (Gordon) Tai 于2019年7月4日周四 下午5:54写道: > Hi, > > There is already document available for 1.9-SNAPSHOT [1]. > The documentation for the official stable release will not be finalized > until 1.9 is actually released. Feature freeze for 1.9.0 is happening this > week, so ideally this

Flink 1.9 blink planner

2019-07-04 Thread kaka chen
Hi All: We found TableEnvironment in Flink 1.9 blink planner didn't support functions such as sqlUpdate() and registerTableSink(), when I used Scala api, it will throw error. *Error:(61, 20) value sqlUpdate is not a member of org.apache.flink.table.api.scala.StreamTableEnvironment.* Is it norma

Re: [DISCUSS] A more restrictive JIRA workflow

2019-07-04 Thread Robert Metzger
This is the Jira ticket I opened https://issues.apache.org/jira/browse/INFRA-18644 a long time ago :) On Thu, Jul 4, 2019 at 10:47 AM Chesnay Schepler wrote: > @Robert what's the state here? > > On 24/06/2019 16:16, Robert Metzger wrote: > > Hey all, > > > > I would like to drive this discussion

[jira] [Created] (FLINK-13101) Introduce "blocking after chaining off" property of StreamGraph

2019-07-04 Thread Biao Liu (JIRA)
Biao Liu created FLINK-13101: Summary: Introduce "blocking after chaining off" property of StreamGraph Key: FLINK-13101 URL: https://issues.apache.org/jira/browse/FLINK-13101 Project: Flink Issu

Re: [DISCUSS] Flink framework and user log separation

2019-07-04 Thread vino yang
Hi Stephan, Thanks for your reply. In some cases, your solution can take effects. However, in some scenarios, it does not meet the requirement: - One program has multiple job instances; - If we make Flink as a platform, we can not know the package of the users' program to config the l

[jira] [Created] (FLINK-13102) Travis build optimization

2019-07-04 Thread Alex (JIRA)
Alex created FLINK-13102: Summary: Travis build optimization Key: FLINK-13102 URL: https://issues.apache.org/jira/browse/FLINK-13102 Project: Flink Issue Type: Improvement Components: Travi

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread vino yang
+1 Dian Fu 于2019年7月4日周四 下午7:09写道: > +1. Thanks Chesnay and Bowen for pushing this forward. > > Regards, > Dian > > > 在 2019年7月4日,下午6:28,zhijiang 写道: > > > > +1 and thanks for Chesnay' work on this. > > > > Best, > > Zhijiang > > > > --

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Xu Forward
+1 vino yang 于2019年7月4日周四 下午7:55写道: > +1 > > Dian Fu 于2019年7月4日周四 下午7:09写道: > > > +1. Thanks Chesnay and Bowen for pushing this forward. > > > > Regards, > > Dian > > > > > 在 2019年7月4日,下午6:28,zhijiang 写道: > > > > > > +1 and thanks for Chesnay' work on this. > > > > > > Best, > > > Zhijiang > >

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Chesnay Schepler
Note that the Flinkbot approach isn't that trivial either; we can't _just_ trigger builds for a branch in the apache repo, but would first have to clone the branch/pr into a separate repository (that is owned by the github account that the travis account would be tied to). One roadblock after

Re: [DISCUSS]Support Upsert mode for Streaming Non-window FlatAggregate

2019-07-04 Thread Jark Wu
Hi jingcheng, I agree with Kurt's point. As you said "the user must know the keys of the output of UDTAGG clearly". If I understand correctly, the key information is strongly relative to the UDTAGG implementation. Users may call `flatAggregate` on a UDTAGG instance with different keys which may re

Re: Flink 1.9 blink planner

2019-07-04 Thread Jark Wu
Hi Kaka, Thanks for trying to use blink planner. We are working on bridging blink planner to the public API (i.e. TableEnvironment) and this is on a good way. Until then, we will remove blink's own TableEnvironment and use API's TableEnvironment and your problem will be fixed. Ideally, we can fin

Re: Flink 1.9 blink planner

2019-07-04 Thread kaka chen
Hi Jark, Got it. Thanks. Thanks, Kaka Jark Wu 于2019年7月4日周四 下午8:30写道: > Hi Kaka, > > Thanks for trying to use blink planner. > > We are working on bridging blink planner to the public API (i.e. > TableEnvironment) and this is on a good way. > Until then, we will remove blink's own TableEnvironm

[jira] [Created] (FLINK-13103) Graceful Shutdown Handling by UDFs

2019-07-04 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-13103: -- Summary: Graceful Shutdown Handling by UDFs Key: FLINK-13103 URL: https://issues.apache.org/jira/browse/FLINK-13103 Project: Flink Issue Type: Improvemen

[DISCUSS] Graceful Shutdown Handling by UDFs.

2019-07-04 Thread Kostas Kloudas
Hi all, In many cases, UDFs (User Defined Functions) need to be able to perform application-specific actions when they stop in an orderly manner. Currently, Flink's UDFs, and more specifically the RichFunction which exposes lifecycle-related hooks, only have a close() method which is called in any

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Hequn Cheng
+1. And thanks a lot to Chesnay for pushing this. Best, Hequn On Thu, Jul 4, 2019 at 8:07 PM Chesnay Schepler wrote: > Note that the Flinkbot approach isn't that trivial either; we can't > _just_ trigger builds for a branch in the apache repo, but would first > have to clone the branch/pr into

Re: [DISCUSS] Make window state queryable

2019-07-04 Thread mayozhang
It’s a good idea to get the process information of large ongoing window. +1 from my side. > 在 2019年7月4日,11:41,vino yang 写道: > > Hi folks, > > Currently, the queryable state is not widely used in production. IMO, there > are two key reasons caused this result. 1) the client of the queryable > st

Re: [DISCUSS]Support Upsert mode for Streaming Non-window FlatAggregate

2019-07-04 Thread Hequn Cheng
Hi Kurt and Jark, Thanks a lot for your great inputs! The keys of the query may not strongly be related to the UDTAGG. It may also be related to the corresponding scenarios that a user wants to achieve. For example, take TopN again as an example. If the TopN table aggregate function outputs thre

[VOTE] How to Deal with Split/Select in DataStream API

2019-07-04 Thread Xingcan Cui
Hi folks, Two weeks ago, I started a thread [1] discussing whether we should discard the split/select methods (which have been marked as deprecation since v1.7) in DataStream API. The fact is, these methods will cause "unexpected" results when using consecutively (e.g., ds.split(a).select(b).spli

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Bowen Li
+1 on approval of the migration to our own Travis account. The foreseeable benefits of the whole community's productivity and iteration speed would be significant! I think using Flinkbot or Travis REST API would be an implementation details. Once we determine the overall direction, details can be

[jira] [Created] (FLINK-13104) Flink Datadog metrics client callback does not check for errors on posting and fails silently

2019-07-04 Thread Mans Singh (JIRA)
Mans Singh created FLINK-13104: -- Summary: Flink Datadog metrics client callback does not check for errors on posting and fails silently Key: FLINK-13104 URL: https://issues.apache.org/jira/browse/FLINK-13104

Re: [VOTE] How to Deal with Split/Select in DataStream API

2019-07-04 Thread Hao Sun
Personally I prefer 3) to keep split/select and correct the behavior. I feel side output is kind of overkill for such a primitive function, and I prefer simple APIs like split/select. Hao Sun On Thu, Jul 4, 2019 at 11:20 AM Xingcan Cui wrote: > Hi folks, > > Two weeks ago, I started a thread [

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Congxian Qiu
+1 for the migration. Best, Congxian Hequn Cheng 于2019年7月4日周四 下午9:42写道: > +1. > > And thanks a lot to Chesnay for pushing this. > > Best, Hequn > > On Thu, Jul 4, 2019 at 8:07 PM Chesnay Schepler > wrote: > > > Note that the Flinkbot approach isn't that trivial either; we can't > > _just_ tri

[jira] [Created] (FLINK-13105) Add documentation for blink planner's built-in functions

2019-07-04 Thread Zhenghua Gao (JIRA)
Zhenghua Gao created FLINK-13105: Summary: Add documentation for blink planner's built-in functions Key: FLINK-13105 URL: https://issues.apache.org/jira/browse/FLINK-13105 Project: Flink Issu

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Jark Wu
+1 for the migration and great thanks to Chesnay and Bowen for pushing this! Cheers, Jark On Fri, 5 Jul 2019 at 09:34, Congxian Qiu wrote: > +1 for the migration. > > Best, > Congxian > > > Hequn Cheng 于2019年7月4日周四 下午9:42写道: > > > +1. > > > > And thanks a lot to Chesnay for pushing this. > > >

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread Yun Tang
I noticed that switching to a separate Travis account to run CI is actually impossible from what https://issues.apache.org/jira/browse/INFRA-18703 said. Hope another option from Chesnay to speed up the CI progress would work soon. Best Yun Tang From: Jark Wu Se

Re: [VOTE] Migrate to sponsored Travis account

2019-07-04 Thread JingsongLee
+1 for the migration Best, JingsongLee -- From:Jark Wu Send Time:2019年7月5日(星期五) 10:35 To:dev Cc:private ; Bowen Li Subject:Re: [VOTE] Migrate to sponsored Travis account +1 for the migration and great thanks to Chesnay and Bowen

Re: [DISCUSS]Support Upsert mode for Streaming Non-window FlatAggregate

2019-07-04 Thread Jark Wu
Hi Hequn, > If the TopN table aggregate function > outputs three columns(rankid, time, value), either rankid or rankid+time could be > used as the key. Which one to be chosen is more likely to be decided by the user > according to his business. In this case, the TopN table aggregate function shoul

[jira] [Created] (FLINK-13106) Translate "parallel" page into Chinese

2019-07-04 Thread yelun (JIRA)
yelun created FLINK-13106: - Summary: Translate "parallel" page into Chinese Key: FLINK-13106 URL: https://issues.apache.org/jira/browse/FLINK-13106 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-13107) Port TableApi IT and UT

2019-07-04 Thread Jing Zhang (JIRA)
Jing Zhang created FLINK-13107: -- Summary: Port TableApi IT and UT Key: FLINK-13107 URL: https://issues.apache.org/jira/browse/FLINK-13107 Project: Flink Issue Type: Task Components: Ta

Re: [DISCUSS] Make window state queryable

2019-07-04 Thread vino yang
Hi all, Thanks to Kostas for reminding me that as early as March 2017, the community had a thread called "Future of Queryable State Feature". [1] It has already discussed the queryable state and how to make the window state queryable. I still think it can offer many advantages, especially for Ad-

Re: [DISCUSS] FLIP-45: Reinforce Job Stop Semantic

2019-07-04 Thread Congxian Qiu
Thanks for the effort, Yu, I've shared the link on the jira side[1] for those who may be interested in this topic. [1] https://issues.apache.org/jira/browse/FLINK-12619 Best, Congxian Yu Li 于2019年7月3日周三 下午10:56写道: > Hi Flink devs, > > Through recent discussion on job stop processing, we found

[jira] [Created] (FLINK-13108) Remove duplicated type cast in generated code

2019-07-04 Thread Liya Fan (JIRA)
Liya Fan created FLINK-13108: Summary: Remove duplicated type cast in generated code Key: FLINK-13108 URL: https://issues.apache.org/jira/browse/FLINK-13108 Project: Flink Issue Type: Bug

flink jira contributor apply

2019-07-04 Thread Nuist_Hook
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is geyx881105