Re: JSON data source for Flink Job

2015-05-28 Thread Tamara Mendt
Ok great, thanks a lot =) On Thu, May 28, 2015 at 12:39 PM, Stephan Ewen wrote: > Hi! > > This depends a bit how the JSON is formatted. > > If you want the source to be parallelizable, you need to have a way of > splitting the file at object boundaries. Is there a character on which you > can

Re: JSON data source for Flink Job

2015-05-28 Thread Stephan Ewen
Hi! This depends a bit how the JSON is formatted. If you want the source to be parallelizable, you need to have a way of splitting the file at object boundaries. Is there a character on which you can split? If yes, you can use theTextInputFormat (with a custom line break character), take the stri

JSON data source for Flink Job

2015-05-28 Thread Tamara Mendt
Hello, I have a JSON file containing multiple JSON objects and wish to use this as a data source for a Flink Job. What is the best way to do this? Cheers, Tamara