how to understand the flink flow control

2015-08-06 Thread wangzhijiang999
As said in apache page, Flink's streaming runtime has natural flow control:  Slow downstream operators backpressure faster upstream operators.How to understand the flink natural flow control? As i know, heron has the backpressure mechanism, if some tasks process slowly, it will stop reading from

Discussion: two different computation approaches for flink and spark(Operator-centric, intermediate data-centric)

2015-08-06 Thread Chenliang (Liang, DataSight)
Hi Flink and Spark take different approaches to do computation, each of which has its pros and cons. Who can elaborate the pros and cons for "Operator-centric, intermediate data-centric"? Any help would be very appreciated. First of all, share my understanding: Operator-centric: Could have more

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Matthias J. Sax
Never mind. Just saw that this in not the problem... Sounds weird to me. Maybe you can try to name the class. Anonymous classes should not be a problem, but it should be worth a try. -Matthias On 08/06/2015 01:51 PM, Matthias J. Sax wrote: > If I see it correctly your jar contains > >> com/da

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Matthias J. Sax
If I see it correctly your jar contains > com/davengo/rfidcloud/flink/DaoJoin$1.class But your error message says > ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 Both are different packages. Your jar seems not be correctly packaged. -Matthias On 08/06/2015 12:46 PM, Michael Huelfenha

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Michael Huelfenhaus
I am back at work next Tuesday, any further ideas would be great until then, for now I am continuing inside ecplise. Am 06.08.2015 um 11:27 schrieb Michael Huelfenhaus mailto:m.huelfenh...@davengo.com>>: hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked wheth

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Till Rohrmann
Hi Michael, in the flink-test-0.1.jar the class DaoJoin$1.class is located at com/davengo/rfidcloud/flink but Flink tries to load com.otter.ist.flink.DaoJoin$1. This might be the problem. This is somehow odd because in the source code you’ve specified the correct package com.otter.ist.flink. Chee

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Michael Huelfenhaus
hi, how did you build the jar file? mvn clean install -Pbuild-jar Have you checked whether your classes are in the jar file? yes, this seems alright for me > jar tf target/flink-test-0.1.jar META-INF/MANIFEST.MF META-INF/ com/ com/davengo/ com/davengo/rfidcloud/ com/davengo/rfidcloud/flink/ co

Re: java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Robert Metzger
Hi, how did you build the jar file? Have you checked whether your classes are in the jar file? On Thu, Aug 6, 2015 at 11:08 AM, Michael Huelfenhaus < m.huelfenh...@davengo.com> wrote: > Hello everybody > > I am truing to build a very simple streaming application with the nightly > build of flink

java.lang.ClassNotFoundException when deploying streaming jar locally

2015-08-06 Thread Michael Huelfenhaus
Hello everybody I am truing to build a very simple streaming application with the nightly build of flink 0.10, my code runs fine in eclipse. But when I build and deploy the jar locally I always get java.lang.ClassNotFoundException: com.otter.ist.flink.DaoJoin$1 There is also no plan visible in