Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Suneel, Flink comes with a built-in AvroOutputFormat. Is that good enough for you? On Sun, Oct 4, 2015 at 6:01 AM, Suneel Marthi wrote: > While on that Marton, would it make sense to have a > dataStream.writeAsJson() method? > > On Sat, Oct 3, 2015 at 11:54 PM, Márton Balassi > wrote: > >> Hi

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Suneel Marthi
While on that Marton, would it make sense to have a dataStream.writeAsJson() method? On Sat, Oct 3, 2015 at 11:54 PM, Márton Balassi wrote: > Hi Jay, > > As for the NPE: the file monitoring function throws it when the location > is empty. Try running the datagenerator first! :) This behaviour i

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Hi Jay, As for the NPE: the file monitoring function throws it when the location is empty. Try running the datagenerator first! :) This behaviour is unwanted though, I am adding a JIRA ticket for it. Best, Marton On Sun, Oct 4, 2015 at 5:28 AM, Márton Balassi wrote: > Hi Jay, > > Creating a b

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread Márton Balassi
Hi Jay, Creating a batch and a streaming environment in a single Java source file is fine, they just run separately. (If you run it from an IDE locally they might conflict as the second one would try to launch a local executor on a port that is most likely already taken by the first one.) I would

Re: setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread jay vyas
Here is a distilled example of the issue, should be easier to debug for folks interested... :) public static void main(String[] args) { ExecutionEnvironment.getExecutionEnvironment().registerTypeWithKryoSerializer(com.github.rnowling.bps.datagenerator.datamodels.Product.class, new FlinkBPSG

setSlotSharing NPE: Starting a stream consumer in a thread

2015-10-03 Thread jay vyas
Hi flink ! Looks like "setSlotSharing" is throwing an NPE when I try to start a Thread which runs a streaming job. I'm trying to do this by creating a dataStream from env.readFileStream, and then later starting a job which writes files out ... However, I get Exception in thread "main" java.lan