Re: [DISCUSS] FLIP-115: Filesystem connector in Table

2020-03-15 Thread Jingsong Li
Thanks Jinhai for involving. > we need add 'connector.sink.username' for UserGroupInformation when data is written to HDFS Yes, I am not an expert of HDFS, but it seems we need do this "doAs" in the code for access external HDFS. I will update document. Best, Jingsong Lee On Mon, Mar 16, 2020 a

Re: FLIP-117: HBase catalog

2020-03-15 Thread Jingsong Li
Thanks Flavio for driving. Personally I am +1 for integrating HBase tables. I start a new topic for discussion. It is related but not the core of this FLIP. In the FLIP, I can see: - Does HBase support the concept of partitions..? I don't think so.. - Does HBase support functions? I don't think so

[jira] [Created] (FLINK-16609) Promotes the column name representation of SQL-CLI

2020-03-15 Thread Danny Chen (Jira)
Danny Chen created FLINK-16609: -- Summary: Promotes the column name representation of SQL-CLI Key: FLINK-16609 URL: https://issues.apache.org/jira/browse/FLINK-16609 Project: Flink Issue Type: Im

Re: [DISCUSS] FLIP-115: Filesystem connector in Table

2020-03-15 Thread Jingsong Li
Thanks Piotr and Yun for involving. Hi Piotr and Yun, for implementation, FLINK-14254 [1] introduce batch sink table world, it deals with partitions thing, metastore thing and etc.. And it just reuse Dataset/Datastream FileInputFormat and FileOutputFormat. Filesystem can not do without FileInputF

Re: [DISCUSS] FLIP-108: Add GPU support in Flink

2020-03-15 Thread Xintong Song
@Yangze, I think what Stephan means (@Stephan, please correct me if I'm wrong) is that, we might not need to hold and maintain the GPUManager as a service in TaskManagerServices or RuntimeContext. An alternative is to create / retrieve the GPUManager only in the operators that need it, e.g., with a

[jira] [Created] (FLINK-16608) Support primitive data types for vectorized Python UDF

2020-03-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-16608: --- Summary: Support primitive data types for vectorized Python UDF Key: FLINK-16608 URL: https://issues.apache.org/jira/browse/FLINK-16608 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-16607) Update flink-fn-execution.proto adding more schema information

2020-03-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-16607: --- Summary: Update flink-fn-execution.proto adding more schema information Key: FLINK-16607 URL: https://issues.apache.org/jira/browse/FLINK-16607 Project: Flink Issue T

[jira] [Created] (FLINK-16606) Throw exceptions for the data types which are not currently supported

2020-03-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-16606: --- Summary: Throw exceptions for the data types which are not currently supported Key: FLINK-16606 URL: https://issues.apache.org/jira/browse/FLINK-16606 Project: Flink

[jira] [Created] (FLINK-16605) Add max limitation to the total number of slots

2020-03-15 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-16605: -- Summary: Add max limitation to the total number of slots Key: FLINK-16605 URL: https://issues.apache.org/jira/browse/FLINK-16605 Project: Flink Issue Type: Impro

[VOTE] FLIP-112: Support User-Defined Metrics for Python UDF

2020-03-15 Thread Hequn Cheng
Hi everyone, I'd like to start the vote of FLIP-112[1] which is discussed and reached consensus in the discussion thread[2]. The vote will be open for at least 72 hours. Unless there is an objection, I will try to close it by March 19, 2020 03:00 UTC if we have received sufficient votes. Thanks,

Re: How to change the flink web-ui jobServer?

2020-03-15 Thread Yang Wang
For K8s deployment(including standalone session/perjob, native integration), Flink could not support port range for rest options. You need to set the `rest.bind-port` exactly same with `rest.port`. Hi LakeShen I am trying to understand your problem and do not think it is about the port configurati

[ANNOUNCE] Weekly Community Update 2020/11

2020-03-15 Thread Konstantin Knauf
Dear community, happy to share this week's community digest with an outlook on Apache Flink 1.11 & 1.10.1, an update on the recent development around Apache Flink Stateful Functions, a couple of SQL FLIPs (planner hints, Hbase catalog) and a bit more. Flink Development == * [release

[jira] [Created] (FLINK-16604) Column key in JM configuration is too narrow

2020-03-15 Thread Jeff Zhang (Jira)
Jeff Zhang created FLINK-16604: -- Summary: Column key in JM configuration is too narrow Key: FLINK-16604 URL: https://issues.apache.org/jira/browse/FLINK-16604 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-16603) statefun-quickstart generates invalid pom.xml

2020-03-15 Thread Igal Shilman (Jira)
Igal Shilman created FLINK-16603: Summary: statefun-quickstart generates invalid pom.xml Key: FLINK-16603 URL: https://issues.apache.org/jira/browse/FLINK-16603 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-16602) Rework the Service design for Kubernetes deployment

2020-03-15 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-16602: Summary: Rework the Service design for Kubernetes deployment Key: FLINK-16602 URL: https://issues.apache.org/jira/browse/FLINK-16602 Project: Flink Issue Typ