Hi Samaza Gurus,

 

I want to send output of one task to input of another task for further
processing.  For example In task one I want read data from kafka que and
emit messages with group by key  , in second task I want to read the
messages emitted from first task and further process them. Essentially I
have to link Task one output to  Task two , which should read output from
task one and do further processing. Any pointers for this is highly
appreciated.

 

This is very similar to spark and storm where output of one task can be feed
as input to another task,  Please kindly provide your inputs if tasks can be
chained or linked in samza. An example from storm is provided below for
better understanding problem 

 

Please see following snippet from storm processing, how stepOne output is
linked to StepTwo.

 

builder.setBolt("StepOne", new
StepIdentificationRichBolt(),1).setNumTasks(1)

 
.globalGrouping("KafkaSpout");

 

builder.setBolt("StepTwo", new
ProcessIdentificationRichBolt_With_TrimSequence(),4).setNumTasks(4)

                                          .fieldsGrouping("StepOne", new
Fields("UserName"));               

 

Output of stepOne send as input to steptwo in above line of code in storm.


     

 

 

Thanks regards,

 

Annadath rao

Reply via email to