Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-12 Thread Piotr Nowojski
Hey, I would like to raise a concern about implementation of the final checkpoints taking into account operators/functions that are implementing two phase commit (2pc) protocol for exactly-once processing with some external state (kept outside of the Flink). Primarily exactly-once sinks. First of

[jira] [Created] (FLINK-21367) Support objectReuse in JDBC sink

2021-02-12 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21367: - Summary: Support objectReuse in JDBC sink Key: FLINK-21367 URL: https://issues.apache.org/jira/browse/FLINK-21367 Project: Flink Issue Type: Improv

Re: [DISCUSS] FLIP-164: Improve Schema Handling in Catalogs

2021-02-12 Thread Timo Walther
Thanks for the feedback everyone. If there are no objections, I would like to continue with the voting now. We can still discuss class names or package locations during the implementation. But as far as I can see everyone agrees about the general proposition of this FLIP to improve the schema d

[jira] [Created] (FLINK-21368) Consider removing RpcService#getExecutor

2021-02-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21368: Summary: Consider removing RpcService#getExecutor Key: FLINK-21368 URL: https://issues.apache.org/jira/browse/FLINK-21368 Project: Flink Issue Type:

[VOTE] FLIP-164: Improve Schema Handling in Catalogs

2021-02-12 Thread Timo Walther
Hi everyone, I'd like to start a vote on FLIP-164 [1] which was discussed in [2]. The vote will be open for at least 72 hours. Unless there are any objections, I'll close it by February 17th, 2021 (due to weekend) if we have received sufficient votes. [1] https://cwiki.apache.org/confluence/

Re: [VOTE] FLIP-164: Improve Schema Handling in Catalogs

2021-02-12 Thread Dawid Wysakowicz
+1 (binding) Best, Dawid On 12/02/2021 13:33, Timo Walther wrote: > Hi everyone, > > I'd like to start a vote on FLIP-164 [1] which was discussed in [2]. > > The vote will be open for at least 72 hours. Unless there are any > objections, I'll close it by February 17th, 2021 (due to weekend) if >

Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

2021-02-12 Thread Arvid Heise
Hi Piotr, Thank you for raising your concern. Unfortunately, I do not have a better idea than doing closing of operators intermittently with checkpoints (= multiple last checkpoints). However, two ideas on how to improve the overall user experience: 1. If an operator is not relying on notifyCheck

Re: [VOTE] FLIP-164: Improve Schema Handling in Catalogs

2021-02-12 Thread Jark Wu
+1 (binding) Best, Jark > 2021年2月12日 20:37，Dawid Wysakowicz 写道： > > +1 (binding) > > Best, > > Dawid > > On 12/02/2021 13:33, Timo Walther wrote: >> Hi everyone, >> >> I'd like to start a vote on FLIP-164 [1] which was discussed in [2]. >> >> The vote will be open for at least 72 hours. Un

Re: [DISCUSS]FLIP-163: SQL Client Improvements

2021-02-12 Thread Timo Walther
Hi Shengkai, thanks for updating the FLIP. I have one last comment for the option `table.execution.mode`. Should we already use the global Flink option `execution.runtime-mode` instead? We are using Flink's options where possible (e.g. `pipeline.name` and `parallism.default`) why not also fo

[jira] [Created] (FLINK-21369) Document Checkpoint Storage

2021-02-12 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-21369: Summary: Document Checkpoint Storage Key: FLINK-21369 URL: https://issues.apache.org/jira/browse/FLINK-21369 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-21370) flink-1.12.1 - JDBCExecutionOptions defaults config JDBCDynamicTableFactory default config is not consistent

2021-02-12 Thread Jira
谢波 created FLINK-21370: -- Summary: flink-1.12.1 - JDBCExecutionOptions defaults config JDBCDynamicTableFactory default config is not consistent Key: FLINK-21370 URL: https://issues.apache.org/jira/browse/FLINK-21370