Hi,
I have two different topics and two Kafka receivers, one for each topic.
Regards,Laeeq
On Monday, April 20, 2015 4:28 PM, Evo Eftimov <[email protected]>
wrote:
#yiv4992037734 #yiv4992037734 -- _filtered #yiv4992037734 {panose-1:2 4 5 3 5
4 6 3 2 4;} _filtered #yiv4992037734 {font-family:Calibri;panose-1:2 15 5 2 2 2
4 3 2 4;} _filtered #yiv4992037734 {font-family:Tahoma;panose-1:2 11 6 4 3 5 4
4 2 4;}#yiv4992037734 #yiv4992037734 p.yiv4992037734MsoNormal, #yiv4992037734
li.yiv4992037734MsoNormal, #yiv4992037734 div.yiv4992037734MsoNormal
{margin:0in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv4992037734 a:link,
#yiv4992037734 span.yiv4992037734MsoHyperlink
{color:blue;text-decoration:underline;}#yiv4992037734 a:visited, #yiv4992037734
span.yiv4992037734MsoHyperlinkFollowed
{color:purple;text-decoration:underline;}#yiv4992037734
p.yiv4992037734MsoListParagraph, #yiv4992037734
li.yiv4992037734MsoListParagraph, #yiv4992037734
div.yiv4992037734MsoListParagraph
{margin-top:0in;margin-right:0in;margin-bottom:0in;margin-left:.5in;margin-bottom:.0001pt;font-size:12.0pt;}#yiv4992037734
span.yiv4992037734EmailStyle17 {color:#1F497D;}#yiv4992037734
.yiv4992037734MsoChpDefault {font-size:10.0pt;} _filtered #yiv4992037734
{margin:1.0in 1.0in 1.0in 1.0in;}#yiv4992037734 div.yiv4992037734WordSection1
{}#yiv4992037734 _filtered #yiv4992037734 {} _filtered #yiv4992037734
{}#yiv4992037734 ol {margin-bottom:0in;}#yiv4992037734 ul
{margin-bottom:0in;}#yiv4992037734 What is meant by “streams” here: 1.
Two different DSTream Receivers producing two different DSTreams consuming from
two different kafka topics, each with different message rate 2. One kafka
topic (hence only one message rate to consider) but with two different DStream
receivers (ie running in parallel) giving a start of two different DSTreams
From: Laeeq Ahmed [mailto:[email protected]]
Sent: Monday, April 20, 2015 3:15 PM
To: [email protected]
Subject: Equal number of RDD Blocks Hi, I have two streams of data from
kafka. How can I make approx. equal number of RDD blocks of on two
executors.Please see the attachement, one worker has 1785 RDD blocks and the
other has 26. Regards,Laeeq
