[jira] [Created] (FLINK-23367) testKeyGroupedInternalPriorityQueue does not dispose rocksdb properly, and fails the test

2021-07-12 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-23367: Summary: testKeyGroupedInternalPriorityQueue does not dispose rocksdb properly, and fails the test Key: FLINK-23367 URL: https://issues.apache.org/jira/browse/FLINK-23367 Pro

Re: [DISCUSS]FLIP-170 Adding Checkpoint Rejection Mechanism

2021-07-12 Thread Senhong Liu
Hi Stephan, Thank you so much for replying and suggesting! Follow by your question, I would give some explanation and new thoughts. (1) More detailed info about CDC use case. In the previous design of FLINK-CDC, they would start a full-table scanning at the beginning by holding a read-write lock

[jira] [Created] (FLINK-23366) AkkaRpcActorTest. testOnStopFutureCompletionDirectlyTerminatesAkkaRpcActor fails on azure

2021-07-12 Thread Yun Gao (Jira)
Yun Gao created FLINK-23366: --- Summary: AkkaRpcActorTest. testOnStopFutureCompletionDirectlyTerminatesAkkaRpcActor fails on azure Key: FLINK-23366 URL: https://issues.apache.org/jira/browse/FLINK-23366 Proje

[jira] [Created] (FLINK-23365) flink-azure-fs-hadoop compile error because of json-smart

2021-07-12 Thread kevinsun (Jira)
kevinsun created FLINK-23365: Summary: flink-azure-fs-hadoop compile error because of json-smart Key: FLINK-23365 URL: https://issues.apache.org/jira/browse/FLINK-23365 Project: Flink Issue T

[jira] [Created] (FLINK-23364) Check all GeneratedClass to make sure they can be split by JavaCodeSplitter

2021-07-12 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-23364: Summary: Check all GeneratedClass to make sure they can be split by JavaCodeSplitter Key: FLINK-23364 URL: https://issues.apache.org/jira/browse/FLINK-23364 Project:

[jira] [Created] (FLINK-23363) JavaCodeSplitter can not split the code from ProjectionCodeGenerator

2021-07-12 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-23363: Summary: JavaCodeSplitter can not split the code from ProjectionCodeGenerator Key: FLINK-23363 URL: https://issues.apache.org/jira/browse/FLINK-23363 Project: Flink

[jira] [Created] (FLINK-23362) ClientTest.testSimpleRequests fails due to timeout on azure

2021-07-12 Thread Xintong Song (Jira)
Xintong Song created FLINK-23362: Summary: ClientTest.testSimpleRequests fails due to timeout on azure Key: FLINK-23362 URL: https://issues.apache.org/jira/browse/FLINK-23362 Project: Flink

Re: [DISCUSS]FLIP-170 Adding Checkpoint Rejection Mechanism

2021-07-12 Thread Stephan Ewen
Hi! Thanks for writing this FLIP, and interesting idea. I would like to understand a bit better why exactly we need this, and what our alternative options are. My main concerns are the following: *(1) Can we achieve this without changing the checkpointing mechanism?* The checkpoint mechanism is

Re: [DISCUSS] FLIP-182: Watermark alignment

2021-07-12 Thread Eron Wright
The notion of per-split watermarks seems quite interesting. I think the idleness feature could benefit from a per-split approach too, because idleness is typically related to whether any splits are assigned to a given operator instance. On Mon, Jul 12, 2021 at 3:06 AM 刘建刚 wrote: > +1 for the s

[DISCUSS] FLIP-183: Dynamic buffer size adjustment

2021-07-12 Thread Anton,Kalashnikov
Hey! There is a wish to decrease amount of in-flight data which can improve aligned checkpoint time(fewer in-flight data to process before checkpoint can complete) and improve the behaviour and performance of unaligned checkpoints (fewer in-flight data that needs to be persisted in every unal

[DISCUSS] Release flink-shaded 14

2021-07-12 Thread Chesnay Schepler
Hello, I recently bumped various dependencies in flink-shaded (jackson, guava, netty, zookeeper) and so would like to create a new flink-shaded release, ideally asap so we can observe the impact for longer. Are there any concerns, or ideas for what else we should change in flink-shaded befor

[jira] [Created] (FLINK-23361) After ZooKeeper sets authority, HA does not work

2021-07-12 Thread shouzuo meng (Jira)
shouzuo meng created FLINK-23361: Summary: After ZooKeeper sets authority, HA does not work Key: FLINK-23361 URL: https://issues.apache.org/jira/browse/FLINK-23361 Project: Flink Issue Type:

Re: [ANNOUNCE] New Apache Flink Committer - Yuan Mei

2021-07-12 Thread Yuan Mei
Thanks, everyone! ☺ Best Regards, Yuan On Fri, Jul 9, 2021 at 7:30 PM Benchao Li wrote: > Congratulations Yuan~ > > Jun Qin 于2021年7月9日周五 下午4:27写道: > > > Congratulations, Yuan! > > > > > On Jul 8, 2021, at 11:49 AM, Jingsong Li > wrote: > > > > > > Congratulations Yuan! > > > > > > Best, > >

[jira] [Created] (FLINK-23360) Facing broker disconnected issue while establishing Kafka with Azure Event hubs in Spring boot application #543

2021-07-12 Thread Rajiya Mulani (Jira)
Rajiya Mulani created FLINK-23360: - Summary: Facing broker disconnected issue while establishing Kafka with Azure Event hubs in Spring boot application #543 Key: FLINK-23360 URL: https://issues.apache.org/jira/bro

Re: Job Recovery Time on TM Lost

2021-07-12 Thread 刘建刚
Yes, time is main when detecting the TM's liveness. The count method will check by certain intervals. Gen Luo 于2021年7月9日周五 上午10:37写道: > @刘建刚 > Welcome to join the discuss and thanks for sharing your experience. > > I have a minor question. In my experience, network failures in a certain > cluste

Re: [DISCUSS] FLIP-182: Watermark alignment

2021-07-12 Thread 刘建刚
+1 for the source watermark alignment. In the previous flink version, the source connectors are different in implementation and it is hard to make this feature. When the consumed data is not aligned or consuming history data, it is very easy to cause the unalignment. Source alignment can resolve ma

[jira] [Created] (FLINK-23359) Fix the number of available slots in testResourceCanBeAllocatedForDifferentJobAfterFree

2021-07-12 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-23359: -- Summary: Fix the number of available slots in testResourceCanBeAllocatedForDifferentJobAfterFree Key: FLINK-23359 URL: https://issues.apache.org/jira/browse/FLINK-23359 P

[jira] [Created] (FLINK-23357) jobmanager metaspace oom

2021-07-12 Thread Borland Won (Jira)
Borland Won created FLINK-23357: --- Summary: jobmanager metaspace oom Key: FLINK-23357 URL: https://issues.apache.org/jira/browse/FLINK-23357 Project: Flink Issue Type: Bug Affects Versions:

[jira] [Created] (FLINK-23358) Refactor CoreOptions parent-first patterns to List options

2021-07-12 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-23358: Summary: Refactor CoreOptions parent-first patterns to List options Key: FLINK-23358 URL: https://issues.apache.org/jira/browse/FLINK-23358 Project: Flink

Re: [VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-12 Thread Till Rohrmann
Thanks for starting the vote Marton. I have two comments: * I would suggest that the interfaces return Optional or at least have a @Nullable annotation in order to make the contract explicit. * The test plan should contain tests for the general infrastructure which should live in Flink. We should

Re: [VOTE] FLIP-181: Custom netty HTTP request inbound/outbound handlers

2021-07-12 Thread Konstantin Knauf
+1 (binding) Assuming that we continue to vote in this thread for now. Thank you for your patience! On Mon, Jul 12, 2021 at 8:56 AM Chesnay Schepler wrote: > The vote has not reached the required number of votes to be considered > successful. > > As outlined in the bylaws > < > https://cwiki.a

[jira] [Created] (FLINK-23356) HBase delegation token expired after 7 days

2021-07-12 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-23356: - Summary: HBase delegation token expired after 7 days Key: FLINK-23356 URL: https://issues.apache.org/jira/browse/FLINK-23356 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-23355) Use Flink SQL ,How to implement insert into seq to multi sinks?

2021-07-12 Thread Bo Wang (Jira)
Bo Wang created FLINK-23355: --- Summary: Use Flink SQL ,How to implement insert into seq to multi sinks? Key: FLINK-23355 URL: https://issues.apache.org/jira/browse/FLINK-23355 Project: Flink Issue

[jira] [Created] (FLINK-23354) Limit the size of blob cache on TaskExecutor

2021-07-12 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-23354: Summary: Limit the size of blob cache on TaskExecutor Key: FLINK-23354 URL: https://issues.apache.org/jira/browse/FLINK-23354 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-23353) UDTAGG can't execute in Batch mode

2021-07-12 Thread hayden zhou (Jira)
hayden zhou created FLINK-23353: --- Summary: UDTAGG can't execute in Batch mode Key: FLINK-23353 URL: https://issues.apache.org/jira/browse/FLINK-23353 Project: Flink Issue Type: Bug Co

Re: Sideoutput in Flink Web Dashboard

2021-07-12 Thread Chesnay Schepler
This is currently not possible. It would indeed be a useful thing to have, but there are considerable technical hurdles to realize that. On 11/07/2021 06:29, Dipanjan Mazumder wrote: Hi,    I am using side output to actually create named substreams from main source streams. While it works fin