Larger socket buffer size configuration for kafka brokers on high bandwidth and high delay network

Hi, We have a 1 Gbits per sec bandwidth network with 200ms latency between producer and kafka brokers. Currently, the throughput of producer (synchronous) is very low (1 message in 1.3 sec, in single message we send 100 lines). We tried tweaking the tcp window sizes ( receive and send window incre

Multiple streaming jobs on the same topic

Hi, We have a kafka cluster running in production and there are two spark streaming job (J1 and J2) that fetches the data from the same topic. We noticed that if one of the two jobs (say J1) starts reading data from old offset (that job failed for 2 hours and when we started the job after fixing