+1 (binding)
Thanks for this FLIP Panos, LGTM.
--
Best regards,
Anton Kalashnikov
On 20.04.23 13:44, Roman Khachatryan wrote:
+1 (binding)
The FLIP LGTM, thanks Panos!
Regards,
Roman
On Thu, Apr 20, 2023 at 1:33 PM Hong Teoh wrote:
+1 (non-binding)
Thank you for driving this effort
Anton Kalashnikov created FLINK-31610:
-
Summary: Refactoring of LocalBufferPool
Key: FLINK-31610
URL: https://issues.apache.org/jira/browse/FLINK-31610
Project: Flink
Issue Type
Congrats Rui!
--
Best regards,
Anton Kalashnikov
On 20.02.23 17:53, Matthias Pohl wrote:
Congratulations, Rui :)
On Mon, Feb 20, 2023 at 5:10 PM Jing Ge wrote:
Congrats Rui!
On Mon, Feb 20, 2023 at 3:19 PM Piotr Nowojski
wrote:
Hi, everyone
On behalf of the PMC, I'm very hap
Congrats Jing!
--
Best regards,
Anton Kalashnikov
On 16.02.23 14:38, Austin Cawley-Edwards wrote:
Congrats Jing!
On Thu, Feb 16, 2023 at 01:37 Feng Jin wrote:
Congratulations, Jing!
Best,
Feng
On Thu, Feb 16, 2023 at 2:24 PM Weihua Hu wrote:
Congratulations, Jing!
Best,
Weihua
On
Anton Kalashnikov created FLINK-30278:
-
Summary: Unexpected config mutation in
SinkTransformationTranslator
Key: FLINK-30278
URL: https://issues.apache.org/jira/browse/FLINK-30278
Project: Flink
g (binding)
There is no disapproving vote.
Thanks everyone for votes.
Márton, I think I will reach you later for handling admin steps.
--
Best regards,
Anton Kalashnikov
ere[2].
[1] https://www.mail-archive.com/dev@flink.apache.org/msg58666.html
[2] https://issues.apache.org/jira/browse/FLINK-28468
--
Best regards,
Anton Kalashnikov
Anton Kalashnikov created FLINK-28468:
-
Summary: Creating benchmark channel in Apache Flink slack
Key: FLINK-28468
URL: https://issues.apache.org/jira/browse/FLINK-28468
Project: Flink
Thanks, everybody for your feedback. It seems no objections to this
proposal. So I will create the ticket with a description and start the
formal voting for this proposal.
--
Best regards,
Anton Kalashnikov
08.07.2022 04:21, Qingsheng Ren пишет:
+1 for this channel in Slack. Only few people
-app
[4] https://issues.apache.org/jira/browse/FLINK-28407
--
Best regards,
Anton Kalashnikov
Anton Kalashnikov created FLINK-28407:
-
Summary: Make Jenkins benchmark script more autonomous
Key: FLINK-28407
URL: https://issues.apache.org/jira/browse/FLINK-28407
Project: Flink
Anton Kalashnikov created FLINK-28243:
-
Summary: Considering only time of targeted operation for
calculation benchmarks performance
Key: FLINK-28243
URL: https://issues.apache.org/jira/browse/FLINK-28243
Anton Kalashnikov created FLINK-28241:
-
Summary: Massive regression on 20.06.2021
Key: FLINK-28241
URL: https://issues.apache.org/jira/browse/FLINK-28241
Project: Flink
Issue Type: Bug
Hi.
Thanks Fanrui for this FLIP. I think it will be useful thing for us.
+1(non-binding)
--
Best regards,
Anton Kalashnikov
26.05.2022 06:00, rui fan пишет:
Hi, everyone,
Thanks for your feedback for FLIP-227: Support overdraft buffer[1] on
the discussion thread[2].
I'd like to st
ually know what
type of invokable we have in case of the chain. But roughly, the idea is
to create LocalBufferPool with/without overdraft based on knowledge of
operator type.
--
Best regards,
Anton Kalashnikov
05.05.2022 11:49, rui fan пишет:
Hi,
Thanks a lot for your discussion.
After seve
Congrats Yang!
--
Best regards,
Anton Kalashnikov
05.05.2022 13:53, rui fan пишет:
Congratulations Yang!
Best
fanrui
On Thu, May 5, 2022 at 19:47 Martijn Visser wrote:
Congratulations Yang Wang!
On Thu, 5 May 2022 at 13:23, Lijie Wang wrote:
Congratulations Yang!
Best,
Lijie
s for both implementations a little more.
--
Best regards,
Anton Kalashnikov
04.05.2022 11:28, Dawid Wysakowicz пишет:
Hey all,
I have not replied in the thread yet, but I was following the discussion.
Personally, I like Fanrui's and Anton's idea. As far as I understand
it the idea to
regards,
Martijn Visser
https://twitter.com/MartijnVisser82
https://github.com/MartijnVisser
On Tue, 3 May 2022 at 07:50, rui fan <1996fan...@gmail.com> wrote:
Hi Piotrek
Do you mean to ignore it while processing records, but keep using
`maxBuffersPerChannel` when calculating the availabi
- Do you think it's ok?
- Actually, we added the checkAvailable logic for LegacySource in our
internal version. It works well.
5. For the benchmark, do you have any suggestions? I submitted the PR
[1].
[1] https://github.com/apache/flink-benchmarks/pull/54
Thanks
fanrui
still need to think about that.
29.04.2022 11:11, rui fan пишет:
Hi Anton Kalashnikov,
I think you agree with we should limit the maximum number of overdraft
segments that each LocalBufferPool can apply for, right?
I prefer to hard code the maxOverdraftBuffers due to don't add the new
con
.
28.04.2022 06:39, rui fan пишет:
Hi Anton Kalashnikov,
Thanks for your very clear reply, I think you are totally right.
The 'maxBuffersNumber - buffersInUseNumber' can be used as the
overdraft buffer, it won't need the new buffer configuration.Flink users
can turn up the maxBuffersNumber
is not clear how to correctly configure
network buffers with existing configuration and I don't want to
complicate it, especially if it will be possible to resolve the problem
automatically(as described above).
So is my understanding about network memory/buffers correct?
--
Best regards,
Congratulations, David!
--
Best regards,
Anton Kalashnikov
14.03.2022 09:18, Matthias Pohl пишет:
Congratulations, David!
Congrats, Martijn!
--
Best regards,
Anton Kalashnikov
13.03.2022 01:57, Guowei Ma пишет:
Congrats Martijn!
Best,
Guowei
On Fri, Mar 11, 2022 at 10:36 PM Marios Trivyzas wrote:
Congrats Martijn!!
Best,
Marios
On Thu, Mar 10, 2022 at 4:50 PM yu'an huang wrote:
Congrats, Ma
Congratulations, Yuan!
--
Best regards,
Anton Kalashnikov
14.03.2022 09:13, Leonard Xu пишет:
Congratulations Yuan!
Best,
Leonard
2022年3月14日 下午4:09，Yangze Guo 写道：
Congratulations!
Best,
Yangze Guo
On Mon, Mar 14, 2022 at 4:08 PM Martijn Visser wrote:
Congratulations Yuan!
On Mon, 14
Anton Kalashnikov created FLINK-26326:
-
Summary: FLIP-203: Support native and incremental savepoints 1.1
Key: FLINK-26326
URL: https://issues.apache.org/jira/browse/FLINK-26326
Project: Flink
Anton Kalashnikov created FLINK-26325:
-
Summary: Add test coverage for native format State Processor API
Key: FLINK-26325
URL: https://issues.apache.org/jira/browse/FLINK-26325
Project: Flink
+1 (non-binding)
- signatures OK
- checksums OK
- tag OK
- all artifacts OK
- PR OK
run examples
--
Best regards,
Anton Kalashnikov
15.02.2022 09:30, Dawid Wysakowicz пишет:
+1 (binding)
- signatures OK
- checksums OK
- tag OK
- PR looks good
- built from sources
- run example
Anton Kalashnikov created FLINK-26134:
-
Summary: Document checkpoint/savepoint guarantees
Key: FLINK-26134
URL: https://issues.apache.org/jira/browse/FLINK-26134
Project: Flink
Issue
Anton Kalashnikov created FLINK-26130:
-
Summary: Document why and when user would like to increase network
buffer size
Key: FLINK-26130
URL: https://issues.apache.org/jira/browse/FLINK-26130
Anton Kalashnikov created FLINK-26002:
-
Summary: Add test coverage for native format job upgrades
Key: FLINK-26002
URL: https://issues.apache.org/jira/browse/FLINK-26002
Project: Flink
Anton Kalashnikov created FLINK-25891:
-
Summary: NoClassDefFoundError AsyncSSLPrivateKeyMethod in benchmark
Key: FLINK-25891
URL: https://issues.apache.org/jira/browse/FLINK-25891
Project: Flink
+1 (non-binding)
Thanks Piotr.
--
Best regards,
Anton Kalashnikov
26.01.2022 11:21, David Anderson пишет:
+1 (non-binding)
I'm pleased to see this significant improvement coming along, as well as
the effort made in the FLIP to document what is and isn't supported (and
where ??? re
Anton Kalashnikov created FLINK-25650:
-
Summary: Document unaligned checkpoints performance limitations
(larger records/flat map/timers/...)
Key: FLINK-25650
URL: https://issues.apache.org/jira/browse/FLINK
Anton Kalashnikov created FLINK-25646:
-
Summary: Document buffer debloating issues with high parallelism
Key: FLINK-25646
URL: https://issues.apache.org/jira/browse/FLINK-25646
Project: Flink
Anton Kalashnikov created FLINK-25590:
-
Summary: Logging warning of insufficient memory for all configured
buffers
Key: FLINK-25590
URL: https://issues.apache.org/jira/browse/FLINK-25590
Project
Anton Kalashnikov created FLINK-25556:
-
Summary: Extra waiting of final checkpoint in benchmarks
Key: FLINK-25556
URL: https://issues.apache.org/jira/browse/FLINK-25556
Project: Flink
Anton Kalashnikov created FLINK-25454:
-
Summary: Negative time in throughput calculator
Key: FLINK-25454
URL: https://issues.apache.org/jira/browse/FLINK-25454
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-24738:
-
Summary: Fail during announcing buffer size to released local
channel
Key: FLINK-24738
URL: https://issues.apache.org/jira/browse/FLINK-24738
Project
Anton Kalashnikov created FLINK-24734:
-
Summary: testSecretOption fails due to missing required options
Key: FLINK-24734
URL: https://issues.apache.org/jira/browse/FLINK-24734
Project: Flink
Anton Kalashnikov created FLINK-24690:
-
Summary: Clarification of buffer size threshold calculation in
BufferDebloater
Key: FLINK-24690
URL: https://issues.apache.org/jira/browse/FLINK-24690
Anton Kalashnikov created FLINK-24671:
-
Summary: Possible NPE in LocalInputChannel#getBuffersInUseCount
before initialization of subpartitionView
Key: FLINK-24671
URL: https://issues.apache.org/jira/browse
Anton Kalashnikov created FLINK-24659:
-
Summary: Two active miniCluster in RemoteBenchmarkBase
Key: FLINK-24659
URL: https://issues.apache.org/jira/browse/FLINK-24659
Project: Flink
Anton Kalashnikov created FLINK-24658:
-
Summary: Debug logs for buffer size calculation
Key: FLINK-24658
URL: https://issues.apache.org/jira/browse/FLINK-24658
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-24657:
-
Summary: Add metric of the total real size of input/output buffers
queue
Key: FLINK-24657
URL: https://issues.apache.org/jira/browse/FLINK-24657
Project
Anton Kalashnikov created FLINK-24589:
-
Summary: FLIP-183: Buffer debloating 1.2
Key: FLINK-24589
URL: https://issues.apache.org/jira/browse/FLINK-24589
Project: Flink
Issue Type: New
Anton Kalashnikov created FLINK-24578:
-
Summary: Unexpected erratic load shape for channel skew load
profile
Key: FLINK-24578
URL: https://issues.apache.org/jira/browse/FLINK-24578
Project: Flink
Anton Kalashnikov created FLINK-24553:
-
Summary: Change buffer debloating default configuration values
Key: FLINK-24553
URL: https://issues.apache.org/jira/browse/FLINK-24553
Project: Flink
Anton Kalashnikov created FLINK-24551:
-
Summary: BUFFER_DEBLOAT_SAMPLES property is taken from the wrong
configuration
Key: FLINK-24551
URL: https://issues.apache.org/jira/browse/FLINK-24551
Anton Kalashnikov created FLINK-24481:
-
Summary: Translit buffer debloater documenation to chinese
Key: FLINK-24481
URL: https://issues.apache.org/jira/browse/FLINK-24481
Project: Flink
Anton Kalashnikov created FLINK-24470:
-
Summary: EMA for buffer debloat level
Key: FLINK-24470
URL: https://issues.apache.org/jira/browse/FLINK-24470
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-24469:
-
Summary: Incorrect calcualtion of the buffer size in case of
channel data skew
Key: FLINK-24469
URL: https://issues.apache.org/jira/browse/FLINK-24469
Anton Kalashnikov created FLINK-24468:
-
Summary: NPE when notifyNewBufferSize
Key: FLINK-24468
URL: https://issues.apache.org/jira/browse/FLINK-24468
Project: Flink
Issue Type: Bug
Anton Kalashnikov created FLINK-24467:
-
Summary: Set min and max buffer size even if the difference less
than threshold
Key: FLINK-24467
URL: https://issues.apache.org/jira/browse/FLINK-24467
Anton Kalashnikov created FLINK-24294:
-
Summary: Resources leak in the StreamTask constructor
Key: FLINK-24294
URL: https://issues.apache.org/jira/browse/FLINK-24294
Project: Flink
Issue
Anton Kalashnikov created FLINK-24233:
-
Summary: Receiving new buffer size before network reader configured
Key: FLINK-24233
URL: https://issues.apache.org/jira/browse/FLINK-24233
Project: Flink
Anton Kalashnikov created FLINK-24231:
-
Summary: Buffer debloating microbenchmark for multiply gate
Key: FLINK-24231
URL: https://issues.apache.org/jira/browse/FLINK-24231
Project: Flink
Anton Kalashnikov created FLINK-24230:
-
Summary: Buffer debloating microbenchmark for single gate
Key: FLINK-24230
URL: https://issues.apache.org/jira/browse/FLINK-24230
Project: Flink
Anton Kalashnikov created FLINK-24191:
-
Summary: Adjusting number of buffers besides buffer size
Key: FLINK-24191
URL: https://issues.apache.org/jira/browse/FLINK-24191
Project: Flink
Anton Kalashnikov created FLINK-24190:
-
Summary: Handling large record with buffer debloat
Key: FLINK-24190
URL: https://issues.apache.org/jira/browse/FLINK-24190
Project: Flink
Issue
Anton Kalashnikov created FLINK-24189:
-
Summary: Debloating buffer for multiply gates
Key: FLINK-24189
URL: https://issues.apache.org/jira/browse/FLINK-24189
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-23975:
-
Summary: High checkpoint time for unaligned checkpoint when
throthling in source
Key: FLINK-23975
URL: https://issues.apache.org/jira/browse/FLINK-23975
Anton Kalashnikov created FLINK-23974:
-
Summary: Low throughput for buffer debloat in case of different
load profile
Key: FLINK-23974
URL: https://issues.apache.org/jira/browse/FLINK-23974
Anton Kalashnikov created FLINK-23973:
-
Summary: FLIP-183: Buffer debloat 1.1
Key: FLINK-23973
URL: https://issues.apache.org/jira/browse/FLINK-23973
Project: Flink
Issue Type: New
Anton Kalashnikov created FLINK-23928:
-
Summary: Test the buffer debloating
Key: FLINK-23928
URL: https://issues.apache.org/jira/browse/FLINK-23928
Project: Flink
Issue Type: Sub-task
Anton Kalashnikov created FLINK-23870:
-
Summary: Test the ability for ignoring in-flight data on recovery
Key: FLINK-23870
URL: https://issues.apache.org/jira/browse/FLINK-23870
Project: Flink
Anton Kalashnikov created FLINK-23726:
-
Summary: Buffer debloat configuration is taken from the wrong
configuration
Key: FLINK-23726
URL: https://issues.apache.org/jira/browse/FLINK-23726
Project
Hi everyone,
I am happy to finish voting for FLIP-183 [1] with approving. The vote [2] is
now closed.
There was no veto and three +1 votes all of which were binding:
- Piotr Nowojski (binding)
- Yuan Mei (binding)
- Till Rohrmann (binding)
Thank everyone for participating!
[1]https://cwiki
Anton Kalashnikov created FLINK-23459:
-
Summary: New metrics for dynamic buffer size
Key: FLINK-23459
URL: https://issues.apache.org/jira/browse/FLINK-23459
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-23458:
-
Summary: Document required number of buffers in the network stack
Key: FLINK-23458
URL: https://issues.apache.org/jira/browse/FLINK-23458
Project: Flink
Anton Kalashnikov created FLINK-23457:
-
Summary: Sending the buffer of the right size for broadcast
Key: FLINK-23457
URL: https://issues.apache.org/jira/browse/FLINK-23457
Project: Flink
Anton Kalashnikov created FLINK-23456:
-
Summary: Manually test on cluster
Key: FLINK-23456
URL: https://issues.apache.org/jira/browse/FLINK-23456
Project: Flink
Issue Type: Sub-task
Anton Kalashnikov created FLINK-23454:
-
Summary: Sending the buffer of the right size for unicast
Key: FLINK-23454
URL: https://issues.apache.org/jira/browse/FLINK-23454
Project: Flink
Anton Kalashnikov created FLINK-23453:
-
Summary: Dynamic calculation of the buffer size
Key: FLINK-23453
URL: https://issues.apache.org/jira/browse/FLINK-23453
Project: Flink
Issue Type
Anton Kalashnikov created FLINK-23452:
-
Summary: Measuring subtask throughput
Key: FLINK-23452
URL: https://issues.apache.org/jira/browse/FLINK-23452
Project: Flink
Issue Type: Sub-task
Anton Kalashnikov created FLINK-23451:
-
Summary: FLIP-183: Dynamic buffer size adjustment
Key: FLINK-23451
URL: https://issues.apache.org/jira/browse/FLINK-23451
Project: Flink
Issue
[2]
https://lists.apache.org/thread.html/r0d06131b35fe641df787c16e8bcd3784161f901062c25778ed92871b%40%3Cdev.flink.apache.org%3E
--
Best regards,
Anton Kalashnikov
Thanks everyone for sharing your opinion. I updated the FLIP according
to discussion and I'm going to start the vote on this FLIP
--
Best regards,
Anton Kalashnikov
16.07.2021 09:23, Till Rohrmann пишет:
I think this is a good idea. +1 for this approach. Are you gonna update the
throughput and following changes the buffer
size based on the this throughput. More details about the proposal you
can find here [1].
What are you thoughts about it?
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-183%3A+Dynamic+buffer+size+adjustment
--
Best regards,
Anton
throughput and following changes the buffer
size based on the this throughput. More details about the proposal you
can find here [1].
What are you thoughts about it?
[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-183%3A+Dynamic+buffer+size+adjustment
--
Best regards,
Anton
Anton Kalashnikov created FLINK-23041:
-
Summary: Change local alignment timeout back to the global time out
Key: FLINK-23041
URL: https://issues.apache.org/jira/browse/FLINK-23041
Project: Flink
Anton Kalashnikov created FLINK-23034:
-
Summary: NPE in JobDetailsDeserializer during the reading old
version of ExecutionState
Key: FLINK-23034
URL: https://issues.apache.org/jira/browse/FLINK-23034
Anton Kalashnikov created FLINK-22961:
-
Summary: Incorrect calculation of alignment timeout for
LocalInputChannel
Key: FLINK-22961
URL: https://issues.apache.org/jira/browse/FLINK-22961
Project
Anton Kalashnikov created FLINK-22684:
-
Summary: Add the ability to ignore in-flight data on recovery
Key: FLINK-22684
URL: https://issues.apache.org/jira/browse/FLINK-22684
Project: Flink
Anton Kalashnikov created FLINK-22379:
-
Summary: Introduce a new JobStatus to avoid premature checkpoint
triggering
Key: FLINK-22379
URL: https://issues.apache.org/jira/browse/FLINK-22379
Project
Anton Kalashnikov created FLINK-22215:
-
Summary: Rename RECOVERING state to RESTORING
Key: FLINK-22215
URL: https://issues.apache.org/jira/browse/FLINK-22215
Project: Flink
Issue Type
86 matches
Mail list logo
