Request for joining the contributor list

2020-09-14 Thread Shaohan Yin
Hi, I am interested in participating in the project. It would be appreciated if you could add me to the contributors list. Cheers

Re: Request for joining the contributor list

2020-09-15 Thread Shaohan Yin
Sorry that I forgot to attach my Jira id. My ID is Shawn Yin Cheers On Tue, 15 Sep 2020 at 22:20, Bill Bejeck wrote: > Hi, > > Can you share your Jira user-id so we can sign you up? > > Thanks, > Bill > > On Tue, Sep 15, 2020 at 1:55 AM Shaohan Yin wrote: > > &g

Re: Kafka TImeout & Network Exception (Urgent)

2020-09-15 Thread Shaohan Yin
You could check if there are any performance issues on the broker. Broker metrics such as kafka_network_requestmetrics_totaltimems and kafka_network_requestmetrics_requestqueuetimems might do you a favor. And your acks config would also affect the e2e latency On Wed, 16 Sep 2020 at 05:08, Navnee

Re: Compression.type=GZIP without actual compression

2020-09-17 Thread Shaohan Yin
Hi, Could you specify your version and the protocol of your broker? >From the client of 2.5.1 I didn't see any changes that could be made to the client compression. Maybe you could check if the compression.type is set on the topic level or the broker side? Cheers On Thu, 17 Sep 2020 at 20:19, M

Re: Compression.type=GZIP without actual compression

2020-09-17 Thread Shaohan Yin
pressed data. > > That's all I could say. > > Regards, > > > > > On Thu, 17 Sep 2020 at 15:01, Shaohan Yin wrote: > > > Hi, > > > > Could you specify your version and the protocol of your broker? > > > > From the client of 2.5.1 I didn&#

Re: Poll Records Return Zero Records

2020-09-17 Thread Shaohan Yin
Hi Gowtham, You could check if there are any throttles on the broker. The metric kafka_server_quota_throttle_time might do you a favor. Cheers On Fri, 18 Sep 2020 at 07:20, Liam Clarke-Hutchinson < liam.cla...@adscale.co.nz> wrote: > Hi, what is the output of kafka-consumer-groups.sh --describe

Re: Kafka rebalancing - assignement of Kafka consumers to partitions

2020-10-12 Thread Shaohan Yin
Hi, If you are using the official Java clients: (1) Partition assignments are performed on the client side. You could check the interface named ConsumerPartitionAssignor or PartitionAssignor ( deprecated in 2.4 ) for customized partition assignments. (2) You could implement the ConsumerPartitionA

Re: log compaction across partitions

2021-01-05 Thread Shaohan Yin
Hi, Normally the same keys will lead to the same partition. And log compaction works on a single topic-partition. Cheers On Wed, 6 Jan 2021 at 07:40, Jacob Botuck wrote: > If I somehow have 2 records with the same key in different partitions in a > topic with log compaction enabled, will log c