Hi, I am experimenting Spark Streaming and Kafka Integration, To read messages from Kafka in parallel, basically there are two ways 1. Create many Receivers like (1 to 6).map(_ => KakfaUtils.createStream). 2. Specifiy many threads when calling KakfaUtils.createStream like val topicMap("myTopic"=>6), this will create one receiver with 6 reading threads.
My question is which option is better, sounds option 2 is better is to me because it saves a lot of cores(one Receiver one core), but I learned from somewhere else that choice 1 is better, so I would ask and see how you guys elaborate on this. Thank bit1...@163.com