Re: Kafka consumer

Thanks Chris But it won't work,I tried that also. I found solution That @KafkaListener default behavior it self is to take one by one data only.. On Thu, May 7, 2020, 11:28 Chris Toomey wrote: > You can set the max.poll.records config. setting to 1 in order to pull down > and process 1 r

Re: Kafka consumer

You can set the max.poll.records config. setting to 1 in order to pull down and process 1 record at a time. See https://kafka.apache.org/documentation/#consumerconfigs . On Mon, May 4, 2020 at 1:04 AM vishnu murali wrote: > Hey Guys, > > I am having a topic and in that topic I am having 3000 me

JDBC Sink Connector

Hey Guys, i am working on JDBC Sink Conneector to take data from kafka topic to mysql. i am having 2 questions. i am using normal Apache Kafka 2.5 not a confluent version. 1)For inserting data every time we need to add the schema data also with every data,How can i overcome this situation?i wan

Consumer call retries

We're using Kafka 2.4.0 and trying to understand the Java consumer behavior w.r.t. transient network problems, such as getting temporarily disconnected from a broker due to temporary broker or network issue. The following consumer config. settings imply that in the above scenario, all consumer cli

Kafka long running job consumer config best practices and what to do to avoid stuck consumer

Hi, With the emerge of using Apache Kafka for event-driven architecture, one thing that has become important is how to tune apache Kafka consumer to manage long-running jobs. The main issue raises when we set a relatively large value for "max.poll.interval.ms". Setting this value will, of course,

Re: Separate Kafka partitioning from key compaction

Could you deploy a Kafka Streams app that implemented your desired partitioning? Obviously this would require a duplication in topics between those produced to initially, and those partitioned the way you'd like, but it would solve the issue you're having. On Wed, 6 May 2020, 10:25 pm Young, Ben

Re: [EXTERNAL] Re: Master-Slave being DB locked both

@Jean We are not defining neither those sizes nor sync mode, so I guess default values and synchronous? Thanks Jose Manuel Vega Monroy Java Developer / Software Developer Engineer in Test Direct: +0035 0 2008038 (Ext. 8038) Ema

Separate Kafka partitioning from key compaction

Hi, We have a use case where we'd like the partition a key is hashed to, to be a subset of the keys that are used for compaction. It would be really cool if there was a built in hashing strategy that could help us as we're potentially using Kafka from multiple languages and it could be hard to