Re: [DISCUSS] Minimum constraint for segment.ms

hey guys, Regarding to num.recovery.threads.per.data.dir: I agree, in our company we use the number of vCPUs to do so as this is not competing with ready cluster traffic. On Wed, 13 Mar 2024 at 09:29, Luke Chen wrote: > Hi Divij, > > Thanks for raising this. > The valid minimum value 1 for `se

[jira] [Created] (KAFKA-16015) kafka-leader-election timeout values always overwritten b default values

Sergio Troiano created KAFKA-16015: -- Summary: kafka-leader-election timeout values always overwritten b default values Key: KAFKA-16015 URL: https://issues.apache.org/jira/browse/KAFKA-16015

Re: [DISCUSS] KIP-964: Have visibility when produce requests become "async".

ite in the OS (sync vs async) Thanks in advance!!! On Mon, 7 Aug 2023 at 14:43, Sergio Daniel Troiano < sergio.troi...@adevinta.com> wrote: > Hi everyone! > > I would like to start a discuss thread for this KIP > <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263426647> > > > Thanks >

[DISCUSS] KIP-964: Have visibility when produce requests become "async".

Hi everyone! I would like to start a discuss thread for this KIP Thanks

new KIP doubt

I can recover them? Thanks in advance. Sergio Troiano

Bug wile create users

Hi everyone! We think we found a bug, we dug deep and found the solution. Please take a look at the bug reported, I am happy to deliver the patch https://issues.apache.org/jira/browse/KAFKA-15243 Thanks!

[jira] [Created] (KAFKA-15243) User creation mismatch

Sergio Troiano created KAFKA-15243: -- Summary: User creation mismatch Key: KAFKA-15243 URL: https://issues.apache.org/jira/browse/KAFKA-15243 Project: Kafka Issue Type: Bug Affects

log-cleaner priority while accessing block device (sharing idea)

*Hi everyone!* *In our company we use Kafka in hundreds of clusters in PRO. When the log cleaner triggers it “could” create some resource issues (disk I/O).* *For example when we are running a deployment it is possible one or several of the brokers run a log cleaner. As we know there is a thro

Message conversion and TLS

ink it is a good idea maybe we could include the count on the ProduceMessageConversionsPerSec when the TLS is enabled, what do you think? Thanks in advance. Sergio Troiano

RE: [DISCUSS] KIP-731: Record Rate Limiting for Kafka Connect

Bump! On 2021/04/09 18:41:17 Ryanne Dolan wrote: > Hey y'all, I'd like to draw you attention to a new KIP: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-731%3A+Record+Rate+Limiting+for+Kafka+Connect > > Lemme know what you think. Thanks! > > Ryanne >

[Doubt] about breaking zero copy

his I want to write a public document about performance based on batch conversions. Thanks in advance Best regards. Sergio Troiano - recordsIterator.forEachRemaining { record => val expected

Re: [DISCUSS] KIP-838 Simulate batching and compression

I’ll start with the code if you consider this feature could be useful, what do you think ? Regarding to the code I’ll use the same classes dump-logs uses for reading records and add the logic on top of it. Best regards Sergio Troiano Sent from my iPhone > On 16 May 2022, at 20:48, Ser

Re: [DISCUSS] KIP-838 Simulate batching and compression

s in the producer" I hope this help, please feel free to add more feedback Best regards. Sergio Troiano On Mon, 16 May 2022 at 10:35, Divij Vaidya wrote: > Thank you for the KIP Sergio. > > High level thoughts: > 1\ I understand that the idea here is to provide b

[DISCUSS] KIP-838 Simulate batching and compression

Hey guys! I would like to start an early discussion on this: https://cwiki.apache.org/confluence/display/KAFKA/KIP-838+Simulate+batching+and+compression Thanks!

Re: [VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

Thanks Mickael, the steps were in the wiki page, sorry for that!! I have just updated the wiki page, so the voting was finished and this KIP is adopted Best regards. On Tue, 29 Mar 2022 at 12:32, Mickael Maison wrote: > Hi Sergio, > > You've obtained 3 binding votes and over

Re: [VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

hi guys again, How does it work now? After voting, should I update/modify the KIP? So basically is there any action I should do from my side? Thanks! On Sat, 26 Mar 2022 at 14:58, John Roesler wrote: > Thanks for the KIP, Sergio! > > I’m +1 (binding) > > Thanks, > John

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

Hi David, I apologize. I missed your suggestion. By the way I like it and I have applied your suggestion. About the rejected alternatives I have updated the KIP as well Best regards Sergio Troiano On Fri, 25 Mar 2022 at 06:50, David Jacot wrote: > Hi Sergio, > > I made a suggest

[VOTE] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

did (maybe I will start another KIP later) we started saving plenty of money. Best regards. Sergio Troiano

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

Hey guys, What is the next step? Who decides when it is time for voting? Thanks! Sent from my iPhone > On 8 Mar 2022, at 19:57, Sergio Daniel Troiano > wrote: > >  > Hi Michael, > > Yes, it's a good idea and I considered it, the main problem is the > File

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

change is quite small, it uses the current classes and has a big benefit. Maybe in the future we could consider the FileRecords class to support getting the amount of batches as parameters and we encapsulate this logic in the proper class (FileRecords) What do you think? Thanks Sergio Thanks Sergio

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

Hi Luke, Make sense, done! Thank you. Sergio Troiano On Tue, 8 Mar 2022 at 03:02, Luke Chen wrote: > Hi Sergio, > > > I don't want this to minimize the main feature I want to deploy as I > think the > message size limit is not as important as the limiting the amount

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

s not as important as the limiting the amount of batches. It is up to you, if you guys consider we must add this in this KIP then I will be happy to do it. 😀 Best regards. Sergio Troiano On Mon, 7 Mar 2022 at 02:01, Luke Chen wrote: > Hi Sergio, > > Thanks for your explanation. >

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

rds. On Sat, 5 Mar 2022 at 10:36, Luke Chen wrote: > Hi Sergio, > > Thanks for the explanation! Very clear! > I think we should put this example and explanation into KIP. > > Other comments: > 1. If the *max-batches-size* is too small that results in no records > output, wi

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

ents.scala#L428> 3. I have just added the unit test 😀 On Fri, 4 Mar 2022 at 20:21, Kirk True wrote: > Hi Sergio, > > Thanks for the KIP. I don't know anything about the log segment internals, > but the logic and implementation seem sound. > > Three questions: > 1.

Re: [DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

file Also if all of them are smaller than 1000 bytes it will end up printing out all the batches. The idea of my change is to limit the *amount* of batches no matter their size. I hope this reply helps. Best regards. On Sat, 5 Mar 2022 at 08:00, Luke Chen wrote: > Hi Sergio, > > Thank

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output

[DISCUSS] KIP-824 Allowing dumping segmentlogs limiting the batches in the output

https://cwiki.apache.org/confluence/display/KAFKA/KIP-824%3A+Allowing+dumping+segmentlogs+limiting+the+batches+in+the+output

[jira] [Created] (KAFKA-13687) Limit number of batches when using kafka-dump-log.sh

Sergio Troiano created KAFKA-13687: -- Summary: Limit number of batches when using kafka-dump-log.sh Key: KAFKA-13687 URL: https://issues.apache.org/jira/browse/KAFKA-13687 Project: Kafka

[jira] [Created] (KAFKA-13386) Foreign Key Join filtering valid records after a code change / schema evolved

Sergio Duran Vegas created KAFKA-13386: -- Summary: Foreign Key Join filtering valid records after a code change / schema evolved Key: KAFKA-13386 URL: https://issues.apache.org/jira/browse/KAFKA-13386

Requesting to be added as a contributor

Hi All, I would like to be added as a Kafka contributor and get permissions for JIRA and Confluence. My username is: spena Thanks, - Sergio