Re: [Spark Structured Streaming] Not working while worker node is on different machine

2020-12-23 Thread lec ssmi
Any more detail about it ? bannya 于2020年12月18日周五 上午11:25写道: > Hi, > > I have a spark structured streaming application that is reading data from a > Kafka topic (16 partitions). I am using standalone mode. I have two workers > node, one node is on the same machine with masters and another one is

[Spark Structured Streaming] Not working while worker node is on different machine

2020-12-17 Thread bannya
Hi, I have a spark structured streaming application that is reading data from a Kafka topic (16 partitions). I am using standalone mode. I have two workers node, one node is on the same machine with masters and another one is on a different machine. Both of the worker nodes has 8 cores and 16G RAM