[jira] [Created] (FLINK-28471) Translate hive_read_write.md into Chinese

2022-07-08 Thread eyys (Jira)
eyys created FLINK-28471: Summary: Translate hive_read_write.md into Chinese Key: FLINK-28471 URL: https://issues.apache.org/jira/browse/FLINK-28471 Project: Flink Issue Type: Improvement C

[jira] [Created] (FLINK-28470) Show source watermarks on dashboard

2022-07-08 Thread James (Jira)
James created FLINK-28470: - Summary: Show source watermarks on dashboard Key: FLINK-28470 URL: https://issues.apache.org/jira/browse/FLINK-28470 Project: Flink Issue Type: Improvement Compo

[jira] [Created] (FLINK-28469) Setting a timer within broadcast applyToKeyedState()

2022-07-08 Thread James (Jira)
James created FLINK-28469: - Summary: Setting a timer within broadcast applyToKeyedState() Key: FLINK-28469 URL: https://issues.apache.org/jira/browse/FLINK-28469 Project: Flink Issue Type: Improvemen

[VOTE] Creating benchmark channel in Apache Flink slack

2022-07-08 Thread Anton Kalashnikov
Hi everyone, I would like to start a vote for creating the new channel in Apache Flink slack for sending benchamrk's result to it. This should help the community to notice the performance degradation on time. The discussion of this idea can be found here[1]. The ticket for this is here[2].

[jira] [Created] (FLINK-28468) Creating benchmark channel in Apache Flink slack

2022-07-08 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-28468: - Summary: Creating benchmark channel in Apache Flink slack Key: FLINK-28468 URL: https://issues.apache.org/jira/browse/FLINK-28468 Project: Flink Is

Re: [DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-08 Thread Anton Kalashnikov
Thanks, everybody for your feedback. It seems no objections to this proposal. So I will create the ticket with a description and start the formal voting for this proposal. -- Best regards, Anton Kalashnikov 08.07.2022 04:21, Qingsheng Ren пишет: +1 for this channel in Slack. Only few people

[DISCUSS] FLIP-248: Introduce dynamic partition pruning

2022-07-08 Thread godfrey he
Hi all, I would like to open a discussion on FLIP-248: Introduce dynamic partition pruning. Currently, Flink supports static partition pruning: the conditions in the WHERE clause are analyzed to determine in advance which partitions can be safely skipped in the optimization phase. Another common

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-08 Thread Zhu Zhu
I agree that it can be more useful to show the number of slots that are free but blocked. Currently users infer the slots in use by subtracting available slots from the total slots. With blocked slots introduced, this can be achieved by subtracting available slots and blocked free slots from the to

[jira] [Created] (FLINK-28467) AVRO Table API fails during schema evolution

2022-07-08 Thread Jaya Ananthram (Jira)
Jaya Ananthram created FLINK-28467: -- Summary: AVRO Table API fails during schema evolution Key: FLINK-28467 URL: https://issues.apache.org/jira/browse/FLINK-28467 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-251: Support collecting arbitrary number of streams

2022-07-08 Thread David Anderson
I've found that with our current tooling it's frustrating to try to write good end-to-end tests for real-world jobs with multiple sinks. DataStream#executeAndCollect() is okay for simple pipelines with one sink, but in my opinion we do need something like FLIP-251. The proposed interface looks goo

[jira] [Created] (FLINK-28466) Update assertj to 3.23.1

2022-07-08 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-28466: --- Summary: Update assertj to 3.23.1 Key: FLINK-28466 URL: https://issues.apache.org/jira/browse/FLINK-28466 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-28465) commit.force-compact should always be true under batch mode

2022-07-08 Thread Jane Chan (Jira)
Jane Chan created FLINK-28465: - Summary: commit.force-compact should always be true under batch mode Key: FLINK-28465 URL: https://issues.apache.org/jira/browse/FLINK-28465 Project: Flink Issue

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-08 Thread Lijie Wang
Hi Gen & Zhu, -> 1. Can we also show "Blocked Slots" in the resource card, so that users can easily figure out how many slots are available/blocked/in-use? I think we should describe the "available" and "blocked" more clearly. In my opinion, I think users should be interested in the number of slo

[DISCUSS] FLIP-247 Bulk fetch of table and column statistics for given partitions

2022-07-08 Thread Jing Ge
Hi devs, After having multiple discussions with Jark and Goldfrey, I'd like to start a discussion on the mailing list w.r.t. FLIP-247[1], which will significantly improve the performance by providing the bulk fetch capability for table and column statistics. Currently the statistics information a

[jira] [Created] (FLINK-28464) Support CsvReaderFormat in PyFlink

2022-07-08 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28464: - Summary: Support CsvReaderFormat in PyFlink Key: FLINK-28464 URL: https://issues.apache.org/jira/browse/FLINK-28464 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-28463) Flink SQL syntax support CREATE TABLE AS SELECT(CTAS)

2022-07-08 Thread tartarus (Jira)
tartarus created FLINK-28463: Summary: Flink SQL syntax support CREATE TABLE AS SELECT(CTAS) Key: FLINK-28463 URL: https://issues.apache.org/jira/browse/FLINK-28463 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-28462) Table API support CREATE TABLE AS SELECT(CTAS)

2022-07-08 Thread tartarus (Jira)
tartarus created FLINK-28462: Summary: Table API support CREATE TABLE AS SELECT(CTAS) Key: FLINK-28462 URL: https://issues.apache.org/jira/browse/FLINK-28462 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28461) PyFlink Table should add get_resolved_schema method

2022-07-08 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-28461: -- Summary: PyFlink Table should add get_resolved_schema method Key: FLINK-28461 URL: https://issues.apache.org/jira/browse/FLINK-28461 Project: Flink Issue Type: I

[jira] [Created] (FLINK-28460) Flink SQL supports atomic CREATE TABLE AS SELECT(CTAS)

2022-07-08 Thread tartarus (Jira)
tartarus created FLINK-28460: Summary: Flink SQL supports atomic CREATE TABLE AS SELECT(CTAS) Key: FLINK-28460 URL: https://issues.apache.org/jira/browse/FLINK-28460 Project: Flink Issue Type: Su

[jira] [Created] (FLINK-28459) Flink SQL supports non-atomic CREATE TABLE AS SELECT(CTAS)

2022-07-08 Thread tartarus (Jira)
tartarus created FLINK-28459: Summary: Flink SQL supports non-atomic CREATE TABLE AS SELECT(CTAS) Key: FLINK-28459 URL: https://issues.apache.org/jira/browse/FLINK-28459 Project: Flink Issue Type

[jira] [Created] (FLINK-28458) Document append-only mode

2022-07-08 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28458: Summary: Document append-only mode Key: FLINK-28458 URL: https://issues.apache.org/jira/browse/FLINK-28458 Project: Flink Issue Type: Sub-task Comp

[jira] [Created] (FLINK-28457) Flink add JobStatusHook support

2022-07-08 Thread tartarus (Jira)
tartarus created FLINK-28457: Summary: Flink add JobStatusHook support Key: FLINK-28457 URL: https://issues.apache.org/jira/browse/FLINK-28457 Project: Flink Issue Type: Sub-task Repo

[RESULT][VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-08 Thread Jing Zhang
Hi everyone, I’m happy to announce that FLIP-245[1] has been accepted, with 5 approving votes, 3 of which are binding[2]: - Mang Zhang - Jiangang Liu - Guowei Ma (binding) - Zhu Zhu (binding) - Jing Zhang (binding) There is no disapproving vote. [1] https://cwiki.apache.org/confluence/display/FLI

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-08 Thread Gen Luo
Hi Zhu, Thanks for the feedback! 1.Good idea. Users should be more familiar with the slots as the resource units. 2.You remind me that the "speculative attempts" are execution attempts started by the SpeculativeScheduler when slot tasks are detected, while the current execution attempts other tha

[RESULT][VOTE] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-07-08 Thread Mang Zhang
Hi, everyone. FLIP-218: Support SELECT clause in CREATE TABLE(CTAS) [1] has been accepted. There are 3 binding votes, 4 non-binding votes [2][3]. - Jark Wu(binding) - godfrey he(binding) - Jing Zhang(binding) - Rui Fan(non-binding) - Jiangang Liu(non-binding) - Jing Ge(non-binding) - yuxia(non-

[jira] [Created] (FLINK-28456) Document streaming query page

2022-07-08 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28456: Summary: Document streaming query page Key: FLINK-28456 URL: https://issues.apache.org/jira/browse/FLINK-28456 Project: Flink Issue Type: Improvement