Re: force the kafka consumer process to different machines

2015-05-13 Thread Du Li
发件人:Cody Koeninger 时间:周三 5月13日 23:52 收件人:hotdog 抄送:user@spark.apache.org 主题:Re: force the kafka consumer process to different machines >I assume you're using the receiver based approach?  Have you tried the >createDirectStream api? > >https://spark.apache.org/docs/1.3.

Re: force the kafka consumer process to different machines

2015-05-13 Thread Dibyendu Bhattacharya
> 收件人:hotdog > 抄送:user@spark.apache.org > 主题:Re: force the kafka consumer process to different machines > > >I assume you're using the receiver based approach? Have you tried the > >createDirectStream api? > > > >https://spark.apache.org/docs/1.3.0/streaming-k

Re: force the kafka consumer process to different machines

2015-05-13 Thread Akhil Das
b is running, the kafka consumer processes are only deploy > to 2 machines, the bandwidth of the 2 machines will be very very high. > > I wonder is there any way to control the kafka consumer's dispatch? > > > > -- > View this message in context: > http://apache-spark-u

Re: force the kafka consumer process to different machines

2015-05-13 Thread 李森栋
thank you very much 来自 魅族 MX4 Pro 原始邮件 发件人:Cody Koeninger 时间:周三 5月13日 23:52 收件人:hotdog 抄送:user@spark.apache.org 主题:Re: force the kafka consumer process to different machines >I assume you're using the receiver based approach? Have you tried the >createDirec

Re: force the kafka consumer process to different machines

2015-05-13 Thread Cody Koeninger
his message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/force-the-kafka-consumer-process-to-different-machines-tp22872.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > -

force the kafka consumer process to different machines

2015-05-13 Thread hotdog
there any way to control the kafka consumer's dispatch? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/force-the-kafka-consumer-process-to-different-machines-tp22872.html Sent from the Apache Spark User List mailing list archive at