Re: Compression - producer vs topic?

on > wrote: > > > Sounds like a goer then :) Those strings in the protobuf always get ya, > > can't use clever encodings for them like you can with numbers. > > > > On Wed, 16 Mar 2022 at 11:29, Dan Hill wrote: > > > >> We're using protos but

Re: Compression - producer vs topic?

ucer metrics > (available via JMX if you're using the Java clients) for avg-batch-size and > compression-ratio. > > You may just wish to start with no compression, and then consider moving to > it if/when network bandwidth becomes a bottleneck. > > Regards, > > Li

Re: Compression - producer vs topic?

iny batches. > > If you're sending a large amount of data, do tune your batching and use > compression to reduce data being sent over the wire. > > If you can tell us more about what your problem domain, there might be more > advice that's applicable :) > > Cheers, >

Compression - producer vs topic?

Hi. I looked around for advice about Kafka compression. I've seen mixed and conflicting advice. Is there any sorta "if X, do Y" type of documentation around Kafka compression? Any advice? Any good posts to read that talk about this trade off? *Detailed comments* I tried looking for producer v

Re: I'm trying to connect to a kafka broker running in AWS EKS (from outside the EKS cluster).

e to get to a working configuration. On Thu, Mar 19, 2020 at 4:55 PM Dan Hill wrote: > I'll prefix this with I'm new to AWS. I'm used to Google's stack. I also > noticed the helm instructions > <https://github.com/helm/charts/tree/master/incubator/kafka#connecting-t

Re: I'm trying to connect to a kafka broker running in AWS EKS (from outside the EKS cluster).

ou've configured your listeners & advertised > listeners correctly. This should help: > https://rmoff.net/2018/08/02/kafka-listeners-explained/ > > > -- > > Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff > > > On Thu, 19 Mar 2020 at 01

I'm trying to connect to a kafka broker running in AWS EKS (from outside the EKS cluster).

Problem: I'm hitting an error: "no such host" for " kafka-0.cluster.local:19092". Has anyone done this before? Any help would be appreciated. Thanks! - Dan My long-term goal is to get an AWS Lambda to send events to a Kafka running in AWS EKS. I used the following instructions