Re: Error trying to access JM through proxy

2015-10-03 Thread Henry Saputra
Hi Emmanuel, Could you tell a bit how the proxy being setup? - Henry On Fri, Oct 2, 2015 at 1:55 PM, Emmanuel wrote: > When trying to access the JM through a proxy I get: > > > 19:26:23,113 ERROR akka.remote.EndpointWriter > - dropping message [class akka.actor.ActorSelectionMessage] for non-lo

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Suneel, Flink comes with a built-in AvroOutputFormat. Is that good enough for you? On Sun, Oct 4, 2015 at 6:01 AM, Suneel Marthi wrote: > While on that Marton, would it make sense to have a > dataStream.writeAsJson() method? > > On Sat, Oct 3, 2015 at 11:54 PM, Márton Balassi > wrote: > >> Hi

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Suneel Marthi
While on that Marton, would it make sense to have a dataStream.writeAsJson() method? On Sat, Oct 3, 2015 at 11:54 PM, Márton Balassi wrote: > Hi Jay, > > As for the NPE: the file monitoring function throws it when the location > is empty. Try running the datagenerator first! :) This behaviour i

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Hi Jay, As for the NPE: the file monitoring function throws it when the location is empty. Try running the datagenerator first! :) This behaviour is unwanted though, I am adding a JIRA ticket for it. Best, Marton On Sun, Oct 4, 2015 at 5:28 AM, Márton Balassi wrote: > Hi Jay, > > Creating a b

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Hi Jay, Creating a batch and a streaming environment in a single Java source file is fine, they just run separately. (If you run it from an IDE locally they might conflict as the second one would try to launch a local executor on a port that is most likely already taken by the first one.) I would

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread jay vyas
Here is a distilled example of the issue, should be easier to debug for folks interested... :) public static void main(String[] args) { ExecutionEnvironment.getExecutionEnvironment().registerTypeWithKryoSerializer(com.github.rnowling.bps.datagenerator.datamodels.Product.class, new FlinkBPSG

setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread jay vyas
Hi flink ! Looks like "setSlotSharing" is throwing an NPE when I try to start a Thread which runs a streaming job. I'm trying to do this by creating a dataStream from env.readFileStream, and then later starting a job which writes files out ... However, I get Exception in thread "main" java.lan

Flink program compiled with Janino fails

2015-10-03 Thread Giacomo Licari
Hi guys, I'm developing a dynamic Flink program composer, which receive a dataflow from a client and convert it into Flink code. I have tried to compile a test Flink program with Janino, but it fails, the error I receive is: org.codehaus.commons.compiler.CompileException: Line 66, Column 0: Non-ab