[jira] [Created] (FLINK-15356) Add applicationId to existing flink metrics running on yarn

2019-12-20 Thread Forward Xu (Jira)
Forward Xu created FLINK-15356: -- Summary: Add applicationId to existing flink metrics running on yarn Key: FLINK-15356 URL: https://issues.apache.org/jira/browse/FLINK-15356 Project: Flink Issu

[jira] [Created] (FLINK-15355) Nightly streaming file sink fails with unshaded hadoop

2019-12-20 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-15355: --- Summary: Nightly streaming file sink fails with unshaded hadoop Key: FLINK-15355 URL: https://issues.apache.org/jira/browse/FLINK-15355 Project: Flink Issue Ty

[jira] [Created] (FLINK-15354) Start and stop minikube only in kubernetes related e2e tests

2019-12-20 Thread Yang Wang (Jira)
Yang Wang created FLINK-15354: - Summary: Start and stop minikube only in kubernetes related e2e tests Key: FLINK-15354 URL: https://issues.apache.org/jira/browse/FLINK-15354 Project: Flink Issue

Re: Re: [DISCUSS] Support JSON functions in Flink SQL

2019-12-20 Thread Forward Xu
Hi Jark, Thanks for your help. I convert it into FLIP wiki already. Best, Forward Jark Wu 于2019年12月20日周五 下午11:09写道: > Hi Forward, > > Thanks for updating the documentation. I think the design doc looks good to > me now. I think you can convert it into FLIP wiki and start a vote then. > > Best,

[DISCUSS] FLIP-90: Support SQL 2016-2017 JSON functions in Flink SQL

2019-12-20 Thread Forward Xu
Hi everybody, I'd like to kick off a discussion on FLIP-90: Support SQL 2016-2017 JSON functions in Flink SQL. Implement Support SQL 2016-2017 JSON functions in Flink SQL[1]. Would love to hear your thoughts. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-90%3A+Support+SQL+2016

[DISCUSS] FLIP-90: Support SQL 2016-2017 JSON functions in Flink SQL

2019-12-20 Thread Forward Xu
Hi everybody, I'd like to kick off a discussion on FLIP-90: Support SQL 2016-2017 JSON functions in Flink SQL. Implement Support SQL 2016-2017 JSON functions in Flink SQL[1]. Would love to hear your thoughts. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-90%3A+Support+SQL+2016

[jira] [Created] (FLINK-15351) develop PostgresJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15351: Summary: develop PostgresJDBCCatalog Key: FLINK-15351 URL: https://issues.apache.org/jira/browse/FLINK-15351 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-15353) develop AbstractJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15353: Summary: develop AbstractJDBCCatalog Key: FLINK-15353 URL: https://issues.apache.org/jira/browse/FLINK-15353 Project: Flink Issue Type: Sub-task Components

[jira] [Created] (FLINK-15352) develop MySQLJDBCCatalog

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15352: Summary: develop MySQLJDBCCatalog Key: FLINK-15352 URL: https://issues.apache.org/jira/browse/FLINK-15352 Project: Flink Issue Type: Sub-task Components: C

[jira] [Created] (FLINK-15350) develop JDBCCatalog to connect to relational databases

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15350: Summary: develop JDBCCatalog to connect to relational databases Key: FLINK-15350 URL: https://issues.apache.org/jira/browse/FLINK-15350 Project: Flink Issue Type: Ne

[jira] [Created] (FLINK-15349) add Catalog DDL support in FLIP-69

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15349: Summary: add Catalog DDL support in FLIP-69 Key: FLINK-15349 URL: https://issues.apache.org/jira/browse/FLINK-15349 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-15348) Fix orc optimization for version less than 2.3 by introducing orc shim

2019-12-20 Thread Bowen Li (Jira)
Bowen Li created FLINK-15348: Summary: Fix orc optimization for version less than 2.3 by introducing orc shim Key: FLINK-15348 URL: https://issues.apache.org/jira/browse/FLINK-15348 Project: Flink

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

2019-12-20 Thread Till Rohrmann
Thanks for the feedback and good discussion everyone. I left some comments inline. On Fri, Dec 20, 2019 at 1:59 PM Stephan Ewen wrote: > +1 to not have more options for off-heap memory, that would get confusing > fast. We can keep the name "off-heap" for both task and framework, as long > as the

[jira] [Created] (FLINK-15347) ZooKeeperDefaultDispatcherRunnerTest.testResourceCleanupUnderLeadershipChange failed on Travis

2019-12-20 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15347: - Summary: ZooKeeperDefaultDispatcherRunnerTest.testResourceCleanupUnderLeadershipChange failed on Travis Key: FLINK-15347 URL: https://issues.apache.org/jira/browse/FLINK-15347

Re: Re: [DISCUSS] Support JSON functions in Flink SQL

2019-12-20 Thread Jark Wu
Hi Forward, Thanks for updating the documentation. I think the design doc looks good to me now. I think you can convert it into FLIP wiki and start a vote then. Best,Jark Jark Wu 于2019年12月20日 周五23:07写道: > Hi Forward, > > Thanks for updating the documentation. I think it is > > On Mon, 2 Dec 201

Re: Re: [DISCUSS] Support JSON functions in Flink SQL

2019-12-20 Thread Jark Wu
Hi Forward, Thanks for updating the documentation. I think it is On Mon, 2 Dec 2019 at 14:21, Forward Xu wrote: > Hi Jark, > Thank you very much,I will improve this document as soon as possible. > My confluence username is ForwardXu. > > Best, > Forward > > Jark Wu 于2019年12月2日周一 上午11:56写道: > >

Re: [DISCUSS] Flink docs vendor table

2019-12-20 Thread Seth Wiesman
Thanks Robert. Bowen, in the spirit of remaining neutral, I decided to put them in alphabetical order. Seth > On Dec 20, 2019, at 3:34 AM, Robert Metzger wrote: > > I've assigned you to the ticket. > You've convinced me that the "Deployment Model" thing was not a good idea. > >> On Fri, De

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

2019-12-20 Thread Stephan Ewen
+1 to not have more options for off-heap memory, that would get confusing fast. We can keep the name "off-heap" for both task and framework, as long as they mean the same thing: native plus direct, and fully counted into MaxDirectMemory. I would suggest to update the config descriptions then to ref

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

2019-12-20 Thread Xintong Song
Regarding the framework/task direct/native memory options, I tend to think it differently. I'm in favor of keep the "*.off-heap.size" for the config option keys. - It's not necessary IMO to expose the difference concepts of direct / native memory to the users. - I would avoid introducing

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

2019-12-20 Thread Andrey Zagrebin
Hi Stephan and Xintong, Thanks for the further FLIP-49 feedbacks. > - "taskmanager.memory.size" (old main config option) is replaced by > "taskmanager.memory.total-process.size" which has a different meaning in > standalone setups. The old option did not subtract metaspace and other > overhe

Re: [DISCUSS] FLIP-85: Delayed Job Graph Generation

2019-12-20 Thread Yang Wang
Hi tison, I think we have the same direction that running user program on jobmanager side. Maybe i could called it cluster deploy-mode for per-job. The separation of deployment and submission is exactly what we need to do. After separation, we could choose where to run the user program. For examp

Re: [DISCUSS] Drop vendor specific repositories from pom.xml

2019-12-20 Thread Robert Metzger
Okay, I understand. I'm okay with removing the profile. On Thu, Dec 19, 2019 at 11:34 AM Till Rohrmann wrote: > The profiles make bumping ZooKeeper's version a bit more cumbersome. I > would be interested for this reason to get rid of them, too. > > Cheers, > Till > > On Wed, Dec 18, 2019 at 5:3

Re: [DISCUSS] Flink docs vendor table

2019-12-20 Thread Robert Metzger
I've assigned you to the ticket. You've convinced me that the "Deployment Model" thing was not a good idea. On Fri, Dec 20, 2019 at 5:35 AM Bowen Li wrote: > Really cool. I especially like the list of tags on "Ververica Platform"! > > BTW, why is "Ververica Platform" placed at the last? I won't

Re: [DISCUSS] Integrate Flink Docker image publication into Flink release process

2019-12-20 Thread Yang Wang
Big +1 for this effort. It is really exciting we have started this great work. More and more companies start to use Flink in container environment(docker, Kubernetes, Mesos, even Yarn-3.x). So it is very important that we could have unified official image building and releasing process. The ima

Re: [DISCUSS] Some feedback after trying out the new FLIP-49 memory configurations

2019-12-20 Thread Stephan Ewen
Hi Xintong! Please find my answers inline: > - "taskmanager.memory.size" (old main config option) is replaced by >> "taskmanager.memory.total-process.size" which has a different meaning in >> standalone setups. The old option did not subtract metaspace and other >> overhead, while the new optio

[jira] [Created] (FLINK-15346) OldCsvValidator has no property of "emptyColumnAsNull".

2019-12-20 Thread xiaojin.wy (Jira)
xiaojin.wy created FLINK-15346: -- Summary: OldCsvValidator has no property of "emptyColumnAsNull". Key: FLINK-15346 URL: https://issues.apache.org/jira/browse/FLINK-15346 Project: Flink Issue Typ

[jira] [Created] (FLINK-15345) CurrentExecution and priorExecutions are inconsistent in the test case

2019-12-20 Thread lining (Jira)
lining created FLINK-15345: -- Summary: CurrentExecution and priorExecutions are inconsistent in the test case Key: FLINK-15345 URL: https://issues.apache.org/jira/browse/FLINK-15345 Project: Flink I

[jira] [Created] (FLINK-15344) Update limitations in hive udf document

2019-12-20 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-15344: Summary: Update limitations in hive udf document Key: FLINK-15344 URL: https://issues.apache.org/jira/browse/FLINK-15344 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-15343) Add Watermarks options for TwoInputStreamOperator

2019-12-20 Thread jocean.shi (Jira)
jocean.shi created FLINK-15343: -- Summary: Add Watermarks options for TwoInputStreamOperator Key: FLINK-15343 URL: https://issues.apache.org/jira/browse/FLINK-15343 Project: Flink Issue Type: New