Re: [DISCUSS] Enhance convenience of TableEnvironment in TableAPI/SQL

2018-12-10 Thread jincheng sun
Hi Xuefu, Thanks for your feedback, and mention the compatibility issues. You are right the change will result version incompatibility. And we my plan it's will be released in the version of 1.8.x. To be frank, we have considered the compatibility approach, which is to retain the current TableEnv

Re: [DISCUSS] Enhance convenience of TableEnvironment in TableAPI/SQL

2018-12-10 Thread Timo Walther
Hi Jincheng, thanks for the proposal. I totally agree with the problem of having 3 StreamTableEnvironments and 3 BatchTableEnvironments. We also identified this problem when doing Flink trainings and introductions to the Table & SQL API. Actually, @Dawid and I were already discussing to remo

[jira] [Created] (FLINK-11126) Filter out AMRMToken in the TaskManager credentials

2018-12-10 Thread Paul Lin (JIRA)
Paul Lin created FLINK-11126: Summary: Filter out AMRMToken in the TaskManager credentials Key: FLINK-11126 URL: https://issues.apache.org/jira/browse/FLINK-11126 Project: Flink Issue Type: Impro

Re: [DISCUSS] Enhance convenience of TableEnvironment in TableAPI/SQL

2018-12-10 Thread Zhang, Xuefu
Hi Jincheng, Thanks for bringing this up. It seems making good sense to me. However, one concern I have is about backward compatibility. Could you clarify whether existing user program will break with the proposed changes? The answer to the question would largely determine when this can be intr

Re: [DISCUSS] Support Interactive Programming in Flink Table API

2018-12-10 Thread Becket Qin
Another potential concern for semantic 3 is that. In the future, we may add automatic caching to Flink. e.g. cache the intermediate results at the shuffle boundary. If our semantic is that reference to the original table means skipping cache, those users may not be able to benefit from the implicit

[jira] [Created] (FLINK-11125) Remove useless import

2018-12-10 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11125: --- Summary: Remove useless import Key: FLINK-11125 URL: https://issues.apache.org/jira/browse/FLINK-11125 Project: Flink Issue Type: Improvement Compon

Re: [DISCUSS] Support Interactive Programming in Flink Table API

2018-12-10 Thread Becket Qin
Hi Piotrek, Thanks for the reply. Thought about it again, I might have misunderstood your proposal in earlier emails. Returning a CachedTable might not be a bad idea. I was more concerned about the semantic and its intuitiveness when a CachedTable is returned. i..e, if cache() returns CachedTable

[jira] [Created] (FLINK-11124) Add private[flink] to TemporalTableFunction.create()

2018-12-10 Thread Hequn Cheng (JIRA)
Hequn Cheng created FLINK-11124: --- Summary: Add private[flink] to TemporalTableFunction.create() Key: FLINK-11124 URL: https://issues.apache.org/jira/browse/FLINK-11124 Project: Flink Issue Type

[jira] [Created] (FLINK-11123) Improve ml quick start doc

2018-12-10 Thread sunjincheng (JIRA)
sunjincheng created FLINK-11123: --- Summary: Improve ml quick start doc Key: FLINK-11123 URL: https://issues.apache.org/jira/browse/FLINK-11123 Project: Flink Issue Type: Improvement Co

Re: [DISCUSS] Creating last bug fix release for 1.5 branch

2018-12-10 Thread Thomas Weise
Thanks Till and my belated +1 for a final patch release :) On Mon, Dec 10, 2018 at 5:47 AM Till Rohrmann wrote: > Thanks for the feedback! I conclude that the community is in favour of a > last 1.5.6 release. I'll try to make the arrangements in the next two > weeks. > > Cheers, > Till > > On Mo

[jira] [Created] (FLINK-11122) SafetyNetCloseableRegistryTest fails with ClassCastException

2018-12-10 Thread Gary Yao (JIRA)
Gary Yao created FLINK-11122: Summary: SafetyNetCloseableRegistryTest fails with ClassCastException Key: FLINK-11122 URL: https://issues.apache.org/jira/browse/FLINK-11122 Project: Flink Issue T

[ANNOUNCE] Weekly community update #50

2018-12-10 Thread Till Rohrmann
Dear community, this is the weekly community update thread #50. Please post any news and updates you want to share with the community to this thread. # Unified core API for streaming and batch The community started to discuss how to bring streaming and batch closer together by implementing a com

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-10 Thread Till Rohrmann
Hi Xianda, thanks for sharing this detailed feedback. Do I understand you correctly that flink-python and flink-streaming-python are not usable for the use cases at Alibaba atm? Could you share a bit more details about the Python UDFs for SQL? How do you execute the Python code? Will it work with

Re: [DISCUSS] Creating last bug fix release for 1.5 branch

2018-12-10 Thread Till Rohrmann
Thanks for the feedback! I conclude that the community is in favour of a last 1.5.6 release. I'll try to make the arrangements in the next two weeks. Cheers, Till On Mon, Dec 10, 2018 at 2:40 AM jincheng sun wrote: > +1. There are incompatible improvements between 1.5.x and 1.6/1.7, so many > 1

[jira] [Created] (FLINK-11121) Check and update licensing notes for Aliyun FS [FLINK-10865]

2018-12-10 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-11121: -- Summary: Check and update licensing notes for Aliyun FS [FLINK-10865] Key: FLINK-11121 URL: https://issues.apache.org/jira/browse/FLINK-11121 Project: Flink

Re: [DISCUSS] Support Interactive Programming in Flink Table API

2018-12-10 Thread Piotr Nowojski
Hi Becket, Sorry for not responding long time. Regarding case1. There wouldn’t be no “a.unCache()” method, but I would expect only `cachedTableA1.dropCache()`. Dropping `cachedTableA1` wouldn’t affect `cachedTableA2`. Just as in any other database dropping modifying one independent table/mate

[jira] [Created] (FLINK-11120) The bug of timestampadd handles time

2018-12-10 Thread xuqianjin (JIRA)
xuqianjin created FLINK-11120: - Summary: The bug of timestampadd handles time Key: FLINK-11120 URL: https://issues.apache.org/jira/browse/FLINK-11120 Project: Flink Issue Type: Sub-task

[DISCUSS] Enhance convenience of TableEnvironment in TableAPI/SQL

2018-12-10 Thread jincheng sun
Hi All, According to the feedback from users, the design of TableEnvironment is very inconvenient for users, and often mistakenly imported by IDE, especially for Java users, such as: ExecutionEnvironment env = ... BatchTableEnvironment tEnv = TableEnvironment.getTableEnvironment(env); The user

[jira] [Created] (FLINK-11119) Incorrect Scala example for Table Function

2018-12-10 Thread Denys Fakhritdinov (JIRA)
Denys Fakhritdinov created FLINK-9: -- Summary: Incorrect Scala example for Table Function Key: FLINK-9 URL: https://issues.apache.org/jira/browse/FLINK-9 Project: Flink Issue

[jira] [Created] (FLINK-11118) Refactor and unify rowtime timestamp extractor interface

2018-12-10 Thread vinoyang (JIRA)
vinoyang created FLINK-8: Summary: Refactor and unify rowtime timestamp extractor interface Key: FLINK-8 URL: https://issues.apache.org/jira/browse/FLINK-8 Project: Flink Issue Type:

[jira] [Created] (FLINK-11117) Migrate connector classes to flink-table-spi

2018-12-10 Thread vinoyang (JIRA)
vinoyang created FLINK-7: Summary: Migrate connector classes to flink-table-spi Key: FLINK-7 URL: https://issues.apache.org/jira/browse/FLINK-7 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-11116) Clean-up temporary files that upon recovery, they belong to no checkpoint.

2018-12-10 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-6: -- Summary: Clean-up temporary files that upon recovery, they belong to no checkpoint. Key: FLINK-6 URL: https://issues.apache.org/jira/browse/FLINK-6 Projec