Re: [DISCUSS] FLIP-70 - Support Computed Column for Flink SQL

Hi Danny, Thanks for preparing this design document. IMO It's a very useful feature, especially combined with time attribute support to specify watermark in DDL. The design doc looks quite good, but I would suggest to reduce the scope of the first version. Like we don't have to support "STORED" i

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

Hi all, I have updated the backend design in FLIP-75 . Here are some brief introductions: - Add metric for manage memory FLINK-14406 . - E

Re: [DISUCSS] FLIP-80: Expression String Serializable and Deserializable

Thanks Jark for your proposal. If we introduce a new kind of string presentation for expression, we will have 3 string presentation now: 1. Java expression string api. We have PlannerExpressionParser to parse string to Expressions. 2. Sql string presentation, as you said, we can use calcite classe

Re: [Discussion] FLIP-79 Flink Function DDL Support

Hi Peter, Sorry late to reply. Thanks for your efforts on this and I just looked through your design. I left some comments in the doc about alter function section and function catalog interface. IMO, the overall design is ok and we can discuss further more about some details. I also think it’

[jira] [Created] (FLINK-14515) Implement LimitableTableSource for FileSystemTableFactory

Jingsong Lee created FLINK-14515: Summary: Implement LimitableTableSource for FileSystemTableFactory Key: FLINK-14515 URL: https://issues.apache.org/jira/browse/FLINK-14515 Project: Flink Iss

Re: [DISCUSS] Rename the SQL ANY type to OPAQUE type

+1 for RAW type, which is easy to guess its actual meaning, even for a new user. Best, Weike On Tue, Oct 22, 2019 at 5:31 PM David Anderson wrote: > +1 for RAW. > > I agree that this is clearer than OPAQUE (which I initially proposed). > > On Mon, Oct 21, 2019 at 10:33 AM Jark Wu wrote: > > >

Re: [VOTE] Accept Stateful Functions into Apache Flink

+1 (non-biding) Best, Terry Wang > 2019年10月24日 10:31，Jingsong Li 写道： > > +1 (non-binding) > > Best, > Jingsong Lee > > On Wed, Oct 23, 2019 at 9:02 PM Yu Li wrote: > >> +1 (non-binding) >> >> Best Regards, >> Yu >> >> >> On Wed, 23 Oct 2019 at 16:56, Haibo Sun wrote: >> >>> +1 (non-b

Re: [VOTE] FLIP-65: New type inference for Table API UDFs

+1 (non-binding) Best, Jingsong Lee On Mon, Oct 21, 2019 at 11:36 PM Rong Rong wrote: > +1 (binding) > > Thanks Timo for driving this. > > -- > Rong > > On Mon, Oct 21, 2019 at 8:19 AM wrote: > > > +1 (binding) > > > > Best, > > Xingcan > > > > -Original Message- > > From: jincheng sun

[jira] [Created] (FLINK-14514) Improve interface of FunctionContext#getJobParameter

Jark Wu created FLINK-14514: --- Summary: Improve interface of FunctionContext#getJobParameter Key: FLINK-14514 URL: https://issues.apache.org/jira/browse/FLINK-14514 Project: Flink Issue Type: Improv

Re: Re: [VOTE] Accept Stateful Functions into Apache Flink

+1 (non-binding) Best, Jingsong Lee On Wed, Oct 23, 2019 at 9:02 PM Yu Li wrote: > +1 (non-binding) > > Best Regards, > Yu > > > On Wed, 23 Oct 2019 at 16:56, Haibo Sun wrote: > > > +1 (non-binding)Best, > > Haibo > > > > > > At 2019-10-23 09:07:41, "Becket Qin" wrote: > > >+1 (binding) > > >

[jira] [Created] (FLINK-14513) Implement listPartitionsByFilter to HiveCatalog

Jingsong Lee created FLINK-14513: Summary: Implement listPartitionsByFilter to HiveCatalog Key: FLINK-14513 URL: https://issues.apache.org/jira/browse/FLINK-14513 Project: Flink Issue Type: S

[jira] [Created] (FLINK-14512) Introduce listPartitionsByFilter to Catalog

Jingsong Lee created FLINK-14512: Summary: Introduce listPartitionsByFilter to Catalog Key: FLINK-14512 URL: https://issues.apache.org/jira/browse/FLINK-14512 Project: Flink Issue Type: Sub-t

Re: [DISCUSS] Reducing build times

Hi, How is the CI migration going? I notice that Azure pipelines support adding self-hosted pipeline agent.[1] How do you think that OpenLab donate some ARM resources to Flink community as a agent pool? In this way, X86 and ARM can be handled by the same CI config easily. Then we don't need do mor

Re: [DISCUSS] What do we gain by supporting customized High-Availability services

I would be in favour of changing interfaces only between major versions. Otherwise we risk that existing setups break when upgrading to the latest minor version. +1 for the outreach. Cheers, Till On Wed, Oct 23, 2019 at 1:11 PM Zili Chen wrote: > Thanks for your clarification Till. > > For ter

Issue with writeAsText() to S3 bucket

Hello all, I am running into issues at the moment trying to print my DataStreams to an S3 bucket using writeAsText(“s3://bucket/result.json”) in my Flink job. I used print() on the same DataStream and I see the output I am looking for in standard output. I first confirm that my datastream has d

[jira] [Created] (FLINK-14511) Checking YARN queues should add "root" prefix

Zhanchun Zhang created FLINK-14511: -- Summary: Checking YARN queues should add "root" prefix Key: FLINK-14511 URL: https://issues.apache.org/jira/browse/FLINK-14511 Project: Flink Issue Type:

Re: [VOTE] FLIP-81: Executor-related new ConfigOptions

We could benefit a lot from unifying the cli options and config options. +1(non-binding) Best, Yang Aljoscha Krettek 于2019年10月23日周三 下午5:24写道： > +1 (binding) > > Aljoscha > > > On 23. Oct 2019, at 10:41, Zili Chen wrote: > > > > Thanks for starting this voting process. I have looked at the FLI

Re: Re: [VOTE] Accept Stateful Functions into Apache Flink

+1 (non-binding) Best Regards, Yu On Wed, 23 Oct 2019 at 16:56, Haibo Sun wrote: > +1 (non-binding)Best, > Haibo > > > At 2019-10-23 09:07:41, "Becket Qin" wrote: > >+1 (binding) > > > >Thanks, > > > >Jiangjie (Becket) Qin > > > >On Tue, Oct 22, 2019 at 11:44 PM Tzu-Li (Gordon) Tai > > >wrot

Re: [DISCUSS] What do we gain by supporting customized High-Availability services

Thanks for your clarification Till. For terminology pluggable and customizable, I am mainly concerning about interface audience issue. Pluggable means we have multiple high-availability implementation but closed to extend in user scope; customizable means high-availability interface are stable and

[jira] [Created] (FLINK-14510) Remove the lazy vertex attaching mechanism from ExecutionGraph

Zhu Zhu created FLINK-14510: --- Summary: Remove the lazy vertex attaching mechanism from ExecutionGraph Key: FLINK-14510 URL: https://issues.apache.org/jira/browse/FLINK-14510 Project: Flink Issue T

Re: [VOTE] FLIP-81: Executor-related new ConfigOptions

+1 (binding) Aljoscha > On 23. Oct 2019, at 10:41, Zili Chen wrote: > > Thanks for starting this voting process. I have looked at the FLIP and the > discussion > thread. These options added make sense to me. > > +1 from my side. > > Best, > tison. > > > Kostas Kloudas 于2019年10月23日周三 下午4:12

[jira] [Created] (FLINK-14509) Improve the README.md in pyflink to prepare for PyPI release

Dian Fu created FLINK-14509: --- Summary: Improve the README.md in pyflink to prepare for PyPI release Key: FLINK-14509 URL: https://issues.apache.org/jira/browse/FLINK-14509 Project: Flink Issue Typ

Re: [SURVEY] Dropping non Credit-based Flow Control

+1 I have not heard of a real-world use-case that suffered more than it gained and also think it is time to remove the old paths. There are, however, still improvements to be made in credit-based flow control (like [1]) but that should not stop us from removing the old paths if no-one is really u

[jira] [Created] (FLINK-14508) google protobuf is not shaded

YING HOU created FLINK-14508: Summary: google protobuf is not shaded Key: FLINK-14508 URL: https://issues.apache.org/jira/browse/FLINK-14508 Project: Flink Issue Type: Bug Components:

[jira] [Created] (FLINK-14507) JoinITCase consistently crashes the JVM

Chesnay Schepler created FLINK-14507: Summary: JoinITCase consistently crashes the JVM Key: FLINK-14507 URL: https://issues.apache.org/jira/browse/FLINK-14507 Project: Flink Issue Type: S

Re:Re: [VOTE] Accept Stateful Functions into Apache Flink

+1 (non-binding)Best, Haibo At 2019-10-23 09:07:41, "Becket Qin" wrote: >+1 (binding) > >Thanks, > >Jiangjie (Becket) Qin > >On Tue, Oct 22, 2019 at 11:44 PM Tzu-Li (Gordon) Tai >wrote: > >> +1 (binding) >> >> Gordon >> >> On Tue, Oct 22, 2019, 10:58 PM Zhijiang > .invalid> >> wrote: >> >> > +1

[jira] [Created] (FLINK-14506) Improve the release script for Python API release package

Dian Fu created FLINK-14506: --- Summary: Improve the release script for Python API release package Key: FLINK-14506 URL: https://issues.apache.org/jira/browse/FLINK-14506 Project: Flink Issue Type: S

Re: [VOTE] FLIP-81: Executor-related new ConfigOptions

Thanks for starting this voting process. I have looked at the FLIP and the discussion thread. These options added make sense to me. +1 from my side. Best, tison. Kostas Kloudas 于2019年10月23日周三 下午4:12写道： > Hi all, > > This is the voting thread for FLIP-81, as the title says. > > The FLIP can be

[jira] [Created] (FLINK-14505) SQL Client end-to-end test for Kafka 0.10 nightly end-to-end test failed on travis

Yu Li created FLINK-14505: - Summary: SQL Client end-to-end test for Kafka 0.10 nightly end-to-end test failed on travis Key: FLINK-14505 URL: https://issues.apache.org/jira/browse/FLINK-14505 Project: Flink

[VOTE] FLIP-81: Executor-related new ConfigOptions

Hi all, This is the voting thread for FLIP-81, as the title says. The FLIP can be found in [1] and the discussion thread in [2]. As per the bylaws, the vote will stay open until Friday 26-10 (3 days) or until it gets 3 votes. Thank you, Kostas [1] https://cwiki.apache.org/confluence/pages/view

[jira] [Created] (FLINK-14504) Add partition management REST API endpoints

Chesnay Schepler created FLINK-14504: Summary: Add partition management REST API endpoints Key: FLINK-14504 URL: https://issues.apache.org/jira/browse/FLINK-14504 Project: Flink Issue Typ

[jira] [Created] (FLINK-14503) Send PartitionReport to ResourceManager via heartbeats

Chesnay Schepler created FLINK-14503: Summary: Send PartitionReport to ResourceManager via heartbeats Key: FLINK-14503 URL: https://issues.apache.org/jira/browse/FLINK-14503 Project: Flink

Re: FLIP-81: Executor-related new ConfigOptions

Hi all, Thanks for the discussion! I will update the FLIP to reflect: 1) I will reuse the core option parallelism.default for the parallelism, and 2) I will remove the dynamic properties from the options. And I will open a voting thread. Cheers, Kostas On Tue, Oct 22, 2019 at 3:12 PM Aljoscha

[jira] [Created] (FLINK-14502) Make ClusterDescriptor/ClusterSpecification creation configuration-based.

Kostas Kloudas created FLINK-14502: -- Summary: Make ClusterDescriptor/ClusterSpecification creation configuration-based. Key: FLINK-14502 URL: https://issues.apache.org/jira/browse/FLINK-14502 Project

[jira] [Created] (FLINK-14501) Move ClusteDescriptor/ClusterSpecification creation from the CustomCommandLine to a ClusterClientFactory

Kostas Kloudas created FLINK-14501: -- Summary: Move ClusteDescriptor/ClusterSpecification creation from the CustomCommandLine to a ClusterClientFactory Key: FLINK-14501 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-14500) Support Flink Python User-Defined Stateless Function for Table(Phase 2)

Dian Fu created FLINK-14500: --- Summary: Support Flink Python User-Defined Stateless Function for Table(Phase 2) Key: FLINK-14500 URL: https://issues.apache.org/jira/browse/FLINK-14500 Project: Flink