Re: [ANNOUNCE] Apache Flink 1.10.3 released

2021-01-28 Thread Yu Li
Thanks Xintong for being our release manager and everyone else who made the release possible! Best Regards, Yu On Fri, 29 Jan 2021 at 15:05, Xintong Song wrote: > The Apache Flink community is very happy to announce the release of Apache > Flink 1.10.3, which is the third bugfix release for th

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-28 Thread Rui Li
Thanks Shengkai for bringing up this discussion. I think it covers a lot of useful features which will dramatically improve the usability of our SQL Client. I have two questions regarding the FLIP. 1. Do you think we can let users set arbitrary configurations via the SET command? A connector may h

[ANNOUNCE] Apache Flink 1.10.3 released

2021-01-28 Thread Xintong Song
The Apache Flink community is very happy to announce the release of Apache Flink 1.10.3, which is the third bugfix release for the Apache Flink 1.10 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming a

[jira] [Created] (FLINK-21199) Introduce InternalTimerService In PyFlink

2021-01-28 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-21199: Summary: Introduce InternalTimerService In PyFlink Key: FLINK-21199 URL: https://issues.apache.org/jira/browse/FLINK-21199 Project: Flink Issue Type: Sub-tas

Fwd: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-28 Thread Shengkai Fang
-- Forwarded message - 发件人: Shengkai Fang Date: 2021年1月29日周五 下午2:46 Subject: Re: [DISCUSS]FLIP-163: SQL Client Improvements To: Sebastian Liu Hi Sebastian, Thanks for your suggestions. For the suggestion 1, 2: Yes. That's what we want. By the way, Godfrey has already the PR ab

[jira] [Created] (FLINK-21198) Add show create table command support for flink sql client

2021-01-28 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-21198: - Summary: Add show create table command support for flink sql client Key: FLINK-21198 URL: https://issues.apache.org/jira/browse/FLINK-21198 Project: Flink Issue Ty

[jira] [Created] (FLINK-21197) DESC command in sql-client should show the column comment

2021-01-28 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-21197: - Summary: DESC command in sql-client should show the column comment Key: FLINK-21197 URL: https://issues.apache.org/jira/browse/FLINK-21197 Project: Flink Issue Typ

[jira] [Created] (FLINK-21196) Sensitive information(password) is not masked in configuration file

2021-01-28 Thread Suchithra V N (Jira)
Suchithra V N created FLINK-21196: - Summary: Sensitive information(password) is not masked in configuration file Key: FLINK-21196 URL: https://issues.apache.org/jira/browse/FLINK-21196 Project: Flink

[jira] [Created] (FLINK-21195) LimitableBulkFormat is invalid when format is orc

2021-01-28 Thread sujun (Jira)
sujun created FLINK-21195: - Summary: LimitableBulkFormat is invalid when format is orc Key: FLINK-21195 URL: https://issues.apache.org/jira/browse/FLINK-21195 Project: Flink Issue Type: Bug

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-01-28 Thread Sebastian Liu
Hi Shengkai, Glad to see this improvement. And I have some additional suggestions: #1. Unify the TableEnvironment in ExecutionContext to StreamTableEnvironment for both streaming and batch sql. #2. Improve the way of results retrieval: sql client collect the results locally all at once using accu

[jira] [Created] (FLINK-21194) TaskExecutorITCase.testJobRecoveryWithFailingTaskExecutor Fail

2021-01-28 Thread Guowei Ma (Jira)
Guowei Ma created FLINK-21194: - Summary: TaskExecutorITCase.testJobRecoveryWithFailingTaskExecutor Fail Key: FLINK-21194 URL: https://issues.apache.org/jira/browse/FLINK-21194 Project: Flink Iss

Re: [DISCUSS] FLIP-158: Generalized incremental checkpoints

2021-01-28 Thread Khachatryan Roman
Thanks a lot for your replies! Yes, feedback is very much appreciated! Especially regarding the approach in general. I think that's a good idea to discuss some details in the follow-up docs or tickets (but I'd be happy to discuss it here as well). As for the PoC, I hope we'll publish it soon (lo

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Leonard Xu
Hi, Timo > I'm sorry that I need to open another discussion thread befoe voting but I > think we should also discuss this in this FLIP before it pops up at a later > stage. > > How do we want our time functions to behave in long running queries? It’s okay to open this thread. Although I don’t

[Announce] Documentation Freeze Feb 2nd

2021-01-28 Thread Seth Wiesman
Hi Everyone, As part of migrating the flink documentation to Hugo, I need to ask the community for a short documentation freeze. This will keep us from losing any contributions during the migration. I am proposing the freeze begin next week February 2nd with the goal to get the change merged in t

[jira] [Created] (FLINK-21193) Migrate Flink Docs to Hugo

2021-01-28 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-21193: Summary: Migrate Flink Docs to Hugo Key: FLINK-21193 URL: https://issues.apache.org/jira/browse/FLINK-21193 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-158: Generalized incremental checkpoints

2021-01-28 Thread Yuan Mei
Big +1 onto this FLIP! Great to see it is stepping forward since this idea is discussed for quite a while. :-) 1. I totally agree that the critical part is the overhead added during normal state updates (forward additional state updates to log as well as state updates itself). Once we have this p

[jira] [Created] (FLINK-21192) Support setting namespace in RemoteKeyedStateBackend

2021-01-28 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-21192: Summary: Support setting namespace in RemoteKeyedStateBackend Key: FLINK-21192 URL: https://issues.apache.org/jira/browse/FLINK-21192 Project: Flink Issue Ty

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Timo Walther
I'm sorry that I need to open another discussion thread befoe voting but I think we should also discuss this in this FLIP before it pops up at a later stage. How do we want our time functions to behave in long running queries? See also: https://stackoverflow.com/questions/5522656/sql-now-in-lo

[DISCUSS]FLIP-163: SQL Client Improvements

2021-01-28 Thread Shengkai Fang
Hi devs, Jark and I want to start a discussion about FLIP-163:SQL Client Improvements. Many users have complained about the problems of the sql client. For example, users can not register the table proposed by FLIP-95. The main changes in this FLIP: - use -i parameter to specify the sql file to

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Leonard Xu
Hi, Jark > I have a minor suggestion: > I think we will still suggest users use TIMESTAMP even if we have > TIMESTAMP_NTZ. Then it seems > introducing TIMESTAMP_NTZ doesn't help much for users, but introduces more > learning costs. I think your suggestion makes sense, we should suggest users u

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Jark Wu
I have a minor suggestion: I think we may not need to introduce TIMESTAMP_NTZ, we already have the shortcut type TIMESTAMP for TIMESTAMP WITHOUT TIME ZONE. I think we will still suggest users use TIMESTAMP even if we have TIMESTAMP_NTZ. Then it seems introducing TIMESTAMP_NTZ doesn't help much fo

Re: [DISCUSS] FLIP-158: Generalized incremental checkpoints

2021-01-28 Thread Stephan Ewen
+1 to this FLIP in general. I like the general idea very much (full disclosure, have been involved in the discussions and drafting of the design for a while, so I am not a new/neutral reviewer here). One thing I would like to see us do here, is reaching out to users early with this, and validatin

[jira] [Created] (FLINK-21191) Support reducing buffer for upsert-kafka sink

2021-01-28 Thread Jark Wu (Jira)
Jark Wu created FLINK-21191: --- Summary: Support reducing buffer for upsert-kafka sink Key: FLINK-21191 URL: https://issues.apache.org/jira/browse/FLINK-21191 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Leonard Xu
Thanks all for sharing your opinions. Looks like we’ve reached a consensus about the topic. @Timo: > 1) Are we on the same page that LOCALTIMESTAMP returns TIMESTAMP and not > TIMESTAMP_LTZ? Maybe we should quickly list also LOCALTIME/LOCALDATE and > LOCALTIMESTAMP for completeness. Yes, LOC

[jira] [Created] (FLINK-21190) Expose extended exception history through REST handler and adapt UI accordingly

2021-01-28 Thread Matthias (Jira)
Matthias created FLINK-21190: Summary: Expose extended exception history through REST handler and adapt UI accordingly Key: FLINK-21190 URL: https://issues.apache.org/jira/browse/FLINK-21190 Project: Flin

[jira] [Created] (FLINK-21189) Extend exception history to collect concurrent task failure that have a common root cause

2021-01-28 Thread Matthias (Jira)
Matthias created FLINK-21189: Summary: Extend exception history to collect concurrent task failure that have a common root cause Key: FLINK-21189 URL: https://issues.apache.org/jira/browse/FLINK-21189 Pro

[jira] [Created] (FLINK-21188) Introduce wrapper class to hold information besides ArchivedExecutionGraph

2021-01-28 Thread Matthias (Jira)
Matthias created FLINK-21188: Summary: Introduce wrapper class to hold information besides ArchivedExecutionGraph Key: FLINK-21188 URL: https://issues.apache.org/jira/browse/FLINK-21188 Project: Flink

Re: [VOTE] FLIP-159: Reactive Mode

2021-01-28 Thread Yang Wang
Thanks Robert for your great work on this FLIP. This is really a big step to make Flink auto scalable. +1 (non-binding) Best, Yang Robert Metzger 于2021年1月28日周四 下午4:32写道: > @Yangze: That's something I overlooked. I should have waited. If FLIP-160 > is rejected or undergoes fundamental changes,

[jira] [Created] (FLINK-21187) RootException history implementation in DefaultScheduler

2021-01-28 Thread Matthias (Jira)
Matthias created FLINK-21187: Summary: RootException history implementation in DefaultScheduler Key: FLINK-21187 URL: https://issues.apache.org/jira/browse/FLINK-21187 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Jark Wu
+1 to have shortcut types TIMESTAMP_LTZ, TIMESTAMP_TZ. Best, Jark On Thu, 28 Jan 2021 at 17:32, Timo Walther wrote: > Hi Leonard, > > thanks for the great summary and the updated FLIP. I think using > TIMESTAMP_LTZ for CURRENT_TIMESTAMP/PROCTIME/ROWTIME is a good long-term > solution. I also d

Re: [DISCUSS] FLIP-158: Generalized incremental checkpoints

2021-01-28 Thread Piotr Nowojski
Hi Roman, +1 from my side on this proposal. Also big +1 for the recent changes in this FLIP in the motivation and high level overview sections. For me there are quite a bit of unanswered things around how to actually implement the proposed changes and especially how to integrate it with the state

Re: [DISCUSS] FLINK-21109: Introduce "retractAccumulators" interface for AggregateFunction in Table/SQL API

2021-01-28 Thread DONG, Weike
Hi Jark, +1 for this proposal. Glad to see more details : ) Sincerely, Weike On Mon, Jan 25, 2021 at 2:03 PM Jark Wu wrote: > Hi all, > > I would like to propose introducing a new method "retractAccumulators()" to > the `AggregateFunction` in Table/SQL. > > *Motivation* > > The motivation is t

[jira] [Created] (FLINK-21186) RecordWriterOutput swallows interrupt state when interrupted.

2021-01-28 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-21186: --- Summary: RecordWriterOutput swallows interrupt state when interrupted. Key: FLINK-21186 URL: https://issues.apache.org/jira/browse/FLINK-21186 Project: Flink

Re: [DISCUSS] FLIP-162: Consistent Flink SQL time function behavior

2021-01-28 Thread Timo Walther
Hi Leonard, thanks for the great summary and the updated FLIP. I think using TIMESTAMP_LTZ for CURRENT_TIMESTAMP/PROCTIME/ROWTIME is a good long-term solution. I also discussed this with people of different backgrounds internally and everybody seems to agree to the proposed design. I hope we

[RESULT] [VOTE] Release 1.10.3, release candidate #1

2021-01-28 Thread Xintong Song
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Matthias Pohl (non-binding) * Leonard Xu (non-binding) * Yang Wang (non-binding) * Robert Metzger (binding) * Zhu Zhu (binding) * Xingbo Huang (non-binding) * Dian Fu (bind

Re: [VOTE] Release 1.10.3, release candidate #1

2021-01-28 Thread Xintong Song
Thanks all for the voting. We have collected 3 binding votes. I'm closing this vote in a separate thread. Thank you~ Xintong Song On Thu, Jan 28, 2021 at 4:38 PM Dian Fu wrote: > +1 (binding) > > - checked the changes since 1.10.2 and it looks good to me as there are no > dependency changes

[jira] [Created] (FLINK-21185) Introduce a new interface for catalog to listen on temporary object operations

2021-01-28 Thread Rui Li (Jira)
Rui Li created FLINK-21185: -- Summary: Introduce a new interface for catalog to listen on temporary object operations Key: FLINK-21185 URL: https://issues.apache.org/jira/browse/FLINK-21185 Project: Flink

[jira] [Created] (FLINK-21184) Support temporary table/function for hive connector

2021-01-28 Thread Rui Li (Jira)
Rui Li created FLINK-21184: -- Summary: Support temporary table/function for hive connector Key: FLINK-21184 URL: https://issues.apache.org/jira/browse/FLINK-21184 Project: Flink Issue Type: New Featu

[jira] [Created] (FLINK-21183) Support watermark for Hive streaming source

2021-01-28 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-21183: -- Summary: Support watermark for Hive streaming source Key: FLINK-21183 URL: https://issues.apache.org/jira/browse/FLINK-21183 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-21182) Make HeapPriorityQueueStateSnapshot iterable

2021-01-28 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21182: Summary: Make HeapPriorityQueueStateSnapshot iterable Key: FLINK-21182 URL: https://issues.apache.org/jira/browse/FLINK-21182 Project: Flink Issue Ty

[jira] [Created] (FLINK-21181) Buffer pool is destroyed error when outputting data over a timer after cancellation.

2021-01-28 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-21181: --- Summary: Buffer pool is destroyed error when outputting data over a timer after cancellation. Key: FLINK-21181 URL: https://issues.apache.org/jira/browse/FLINK-21181 Pr

Re: [VOTE] Release 1.10.3, release candidate #1

2021-01-28 Thread Dian Fu
+1 (binding) - checked the changes since 1.10.2 and it looks good to me as there are no dependency changes - checked the website PR, have left a minor comment - verified the signatures and checksums Thanks, Dian > 在 2021年1月28日,下午2:39,Xingbo Huang 写道: > > +1 (non-binding) > > - verified signa

Re: [VOTE] FLIP-159: Reactive Mode

2021-01-28 Thread Robert Metzger
@Yangze: That's something I overlooked. I should have waited. If FLIP-160 is rejected or undergoes fundamental changes, I'll cancel this vote and rewrite FLIP-159. But I have the impression that there were no major concerns regarding FLIP-160 so far. On Thu, Jan 28, 2021 at 8:46 AM Yangze Guo wro