One output is sort of a subset of the other so it didn¹t make much sense
to spin up another Spark app for the same source.
On 9/18/14, 11:19 AM, "Tim Smith" wrote:
>Curious, if you have 1:1 mapping between Stream1:topic1 and
>Stream2:topic2 then why not run different instances of the app for
>ea
Curious, if you have 1:1 mapping between Stream1:topic1 and
Stream2:topic2 then why not run different instances of the app for
each and pass as arguments to each instance the input source and
output topic?
On Thu, Sep 18, 2014 at 8:07 AM, Padmanabhan, Mahesh (contractor)
wrote:
> Hi all,
>
> I am
Hi all,
I am using Spark 1.0 streaming to ingest a a high volume stream of data
(approx. 1mm lines every few seconds) transform it into two outputs and send
those outputs to two separate Apache Kafka topics. I have two blocks of output
code like this:
Stream1 =
….
Stream2 =
…
Stream1.foreac
