[DISCUSS] Introduce a location-oriented two-stage query mechanism to improve the queryable state.

2019-10-22 Thread vino yang
Hi guys, Currently, queryable state's client is hard to use. Because it requires users to know the address of TaskManager and the port of the proxy. Actually, most users who do not have good knowledge about the Flink's inner and runtime in production. The queryable state clients directly interact

Re: [DISCUSS] FLIP-76: Unaligned checkpoints

2019-10-22 Thread Piotr Nowojski
Hi, I would like to propose a modification to this FLIP. Based on the feedback that we were receiving after publishing this document and during Flink Forward, I was growing more and more anxious about one issue here: having to persist all buffered in-flight data at once. As the volume of this

Re: FLIP-81: Executor-related new ConfigOptions

2019-10-22 Thread Aljoscha Krettek
I think this is good to go to a VOTE. We should, however, make it more prominent that we don’t like the “attached”, “shutdown-on-attached-exit”, and “dynamic-properties” and that we only add them for backwards compatibility. Best, Aljoscha > On 21. Oct 2019, at 17:48, Kostas Kloudas wrote: >

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Zhu Zhu
+1 (non-binding) Thanks, Zhu Zhu Biao Liu 于2019年10月22日周二 上午11:06写道: > +1 (non-binding) > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote: > > > +1 (non-binding) > > > > Best, > > Jark > > > > On Tue, 22 Oct 2019 at 09:38, Hequn Cheng wrote: > > > > > +1 (non-bind

[jira] [Created] (FLINK-14496) Exclude detach flag from ClusterClient

2019-10-22 Thread Zili Chen (Jira)
Zili Chen created FLINK-14496: - Summary: Exclude detach flag from ClusterClient Key: FLINK-14496 URL: https://issues.apache.org/jira/browse/FLINK-14496 Project: Flink Issue Type: Sub-task

Re: [ARM support] Travis ARM CI is now in Alpha Release

2019-10-22 Thread Robert Metzger
Hey Xiyuan, thanks a lot for checking out Travis ARM-based offering. As part of the "Reducing build times" discussion, we have considered moving away from Travis to Azure Pipelines. What I want to say is that Travis might not be important for the Flink community in the long run. I think running th

Re: FLIP-81: Executor-related new ConfigOptions

2019-10-22 Thread Dawid Wysakowicz
Hi, I really like the idea of unifying all the ways to set a configuration option and its keys. I think it nicely aligns with FLIP-59. I have two comments though. 1. I wonder what are you thoughts on reusing the "parallelism.default" (CoreOptions.DEFAULT_PARALLELISM) instead of introducing a new

Re: [DISCUSS] Rename the SQL ANY type to OPAQUE type

2019-10-22 Thread David Anderson
+1 for RAW. I agree that this is clearer than OPAQUE (which I initially proposed). On Mon, Oct 21, 2019 at 10:33 AM Jark Wu wrote: > > +1 to rename ANY. > > I don't have strong opinion on the new name. I think "OPAQUE" is fine, > because it is introduced in IBM Informix and Oracle. > In Informi

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread vino yang
+1 (non-binding) Best, Vino Zhu Zhu 于2019年10月22日周二 下午4:33写道: > +1 (non-binding) > > Thanks, > Zhu Zhu > > Biao Liu 于2019年10月22日周二 上午11:06写道: > > > +1 (non-binding) > > > > Thanks, > > Biao /'bɪ.aʊ/ > > > > > > > > On Tue, 22 Oct 2019 at 10:26, Jark Wu wrote: > > > > > +1 (non-binding) > > > >

Re: [DISUCSS] FLIP-80: Expression String Serializable and Deserializable

2019-10-22 Thread Jark Wu
Hi Timo, I think it's a good idea to use `SqlParser#parseExpression()` to parse literals. That means the string format of literal is SQL compatible. After some discussion with Kurt, we think why not one more step forward, i.e. convert the whole expression to SQL format. For example, the above exp

Re: FLIP-81: Executor-related new ConfigOptions

2019-10-22 Thread Kostas Kloudas
Hi Dawid, For the first comment, I am also up for re-using as many options as possible. My only concern though is that so far the -p and the parallelism.default were considered "different" and I cannot tell the exact reason. In addition, the "parallelism.default" is not the most descriptive name i

Re: FLIP-81: Executor-related new ConfigOptions

2019-10-22 Thread Aljoscha Krettek
Re 1. I think the parallelism setting doesn’t to what was originally planned or expected anymore. As far as I can see it’s only used on the client side. There we only check if the user gave a parallelism using “-p”, if they didn’t we set what is configured under parallelism.default. I’m fine wit

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Zhijiang
+1 (non-binding) Best, Zhijiang -- From:Zhu Zhu Send Time:2019 Oct. 22 (Tue.) 16:33 To:dev Subject:Re: [VOTE] Accept Stateful Functions into Apache Flink +1 (non-binding) Thanks, Zhu Zhu Biao Liu 于2019年10月22日周二 上午11:06写道: > +

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Tzu-Li (Gordon) Tai
+1 (binding) Gordon On Tue, Oct 22, 2019, 10:58 PM Zhijiang wrote: > +1 (non-binding) > > Best, > Zhijiang > > > -- > From:Zhu Zhu > Send Time:2019 Oct. 22 (Tue.) 16:33 > To:dev > Subject:Re: [VOTE] Accept Stateful Functions into

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-22 Thread Becket Qin
+1 (binding) Thanks, Jiangjie (Becket) Qin On Tue, Oct 22, 2019 at 11:44 PM Tzu-Li (Gordon) Tai wrote: > +1 (binding) > > Gordon > > On Tue, Oct 22, 2019, 10:58 PM Zhijiang .invalid> > wrote: > > > +1 (non-binding) > > > > Best, > > Zhijiang > > > > > > ---

Re: [ARM support] Travis ARM CI is now in Alpha Release

2019-10-22 Thread Xiyuan Wang
Hi Robert, Glad to get your response. All the change in my PRs are related to Unit test and e2e test. They won't break any Flink functions. Any review or comment is welcome. The cron job has ran on OpenLab some days[1], Now I need the privilege to send the result to bui...@flink.apache.org. So tha

[jira] [Created] (FLINK-14497) Support primitive data types in Python user-defined functions

2019-10-22 Thread Hequn Cheng (Jira)
Hequn Cheng created FLINK-14497: --- Summary: Support primitive data types in Python user-defined functions Key: FLINK-14497 URL: https://issues.apache.org/jira/browse/FLINK-14497 Project: Flink

[jira] [Created] (FLINK-14498) Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool

2019-10-22 Thread zhijiang (Jira)
zhijiang created FLINK-14498: Summary: Introduce NetworkBufferPool#isAvailable() for interacting with LocalBufferPool Key: FLINK-14498 URL: https://issues.apache.org/jira/browse/FLINK-14498 Project: Flink

[jira] [Created] (FLINK-14499) MetricRegistry#getMetricQueryServiceGatewayRpcAddress is Nonnull

2019-10-22 Thread Zili Chen (Jira)
Zili Chen created FLINK-14499: - Summary: MetricRegistry#getMetricQueryServiceGatewayRpcAddress is Nonnull Key: FLINK-14499 URL: https://issues.apache.org/jira/browse/FLINK-14499 Project: Flink I