Re: Spark Kafka API tries connecting to dead node for every batch, which increases the processing time

gt; Have you tried adjusting the timeout? > > On Mon, Oct 16, 2017 at 8:08 AM, Suprith T Jain > wrote: > > Hi guys, > > > > I have a 3 node cluster and i am running a spark streaming job. consider > the > > below example

Spark Kafka API tries connecting to dead node for every batch, which increases the processing time

Hi guys, I have a 3 node cluster and i am running a spark streaming job. consider the below example /*spark-submit* --master yarn-cluster --class com.huawei.bigdata.spark.examples.FemaleInfoCollectionPrint --jars /opt/client/Spark/spark/lib/streamingClient/kafka-clients-0.8.2.1.jar,/opt/client/Sp