Hi TD. Do you have any suggestion? Thanks /Du
Sent from Yahoo Mail for iPhone
Begin Forwarded Message
From: Shao, Saisai<'saisai.s...@intel.com'>
Date: Mar 4, 2015, 10:35:44 PM
To: Du Li<'l...@yahoo-inc.com'>, User<'user@spark.apache.org'>
assigned its hostname to each receiver.
Thanks
Jerry
From: Du Li [mailto:l...@yahoo-inc.com]
Sent: Thursday, March 5, 2015 2:29 PM
To: Shao, Saisai; User
Subject: Re: distribution of receivers in spark streaming
Hi Jerry,
Thanks for your response.
Is there a way to get the list of currently
ibution of receivers in spark streaming Figured it out: I
need to override method preferredLocation() in MyReceiver class. On
Wednesday, March 4, 2015 3:35 PM, Du Li wrote:
Hi, I have a set of machines (say 5) and want to evenly launch a number (say
8) of kafka receivers on those machi
-inc.com.INVALID]
Sent: Thursday, March 5, 2015 1:50 PM
To: User
Subject: Re: distribution of receivers in spark streaming
Figured it out: I need to override method preferredLocation() in MyReceiver
class.
On Wednesday, March 4, 2015 3:35 PM, Du Li
mailto:l...@yahoo-inc.com.INVALID>> wrote:
Hi,
I
Figured it out: I need to override method preferredLocation() in MyReceiver
class.
On Wednesday, March 4, 2015 3:35 PM, Du Li
wrote:
Hi,
I have a set of machines (say 5) and want to evenly launch a number (say 8) of
kafka receivers on those machines. In my code I did something like
Hi,
I have a set of machines (say 5) and want to evenly launch a number (say 8) of
kafka receivers on those machines. In my code I did something like the
following, as suggested in the spark docs: val streams = (1 to
numReceivers).map(_ => ssc.receiverStream(new MyKafkaReceiver()))
