IT's with POJO's

2015-11-04 Thread Nick Dimiduk
Heya, I'm writing my first flink streaming application and have a flow that passes type checking and complies. I've written a simple end-to-end test with junit, using StreamExecutionEnvironment#fromElements() to provide a stream if valid and invalid test objects; the objects are POJOs. It seems I

Re: [IE] Re: passing environment variables to flink program

2015-11-04 Thread Jian Jiang
I have to continue the evaluation so I managed to patch a fix to my local build. In case someone cannot wait here is what I did: 1. In the flink-core's ConfigConstants.java add public static final String FLINK_JVM_OPTIONS = "env.java.opts"; <-- existing public static final String FLINK_CUSTOM_EN

Re: Zeppelin Integration

2015-11-04 Thread Vasiliki Kalavri
Great tutorial! Thanks a lot ^^ On 4 November 2015 at 17:12, Leonard Wolters wrote: > Indeed very nice! Thanks > On Nov 4, 2015 5:04 PM, "Till Rohrmann" wrote: > >> Really cool tutorial Trevor :-) >> >> On Wed, Nov 4, 2015 at 3:26 PM, Robert Metzger >> wrote: >> >>> For those interested, Trevo

Re: Zeppelin Integration

2015-11-04 Thread Leonard Wolters
Indeed very nice! Thanks On Nov 4, 2015 5:04 PM, "Till Rohrmann" wrote: > Really cool tutorial Trevor :-) > > On Wed, Nov 4, 2015 at 3:26 PM, Robert Metzger > wrote: > >> For those interested, Trevor wrote a blog post describing how to setup >> Spark, Flink and Zeppelin, both locally and on clus

Re: Zeppelin Integration

2015-11-04 Thread Till Rohrmann
Really cool tutorial Trevor :-) On Wed, Nov 4, 2015 at 3:26 PM, Robert Metzger wrote: > For those interested, Trevor wrote a blog post describing how to setup > Spark, Flink and Zeppelin, both locally and on clusters: > http://trevorgrant.org/2015/11/03/apache-casserole-a-delicious-big-data-reci

Re: Zeppelin Integration

2015-11-04 Thread Robert Metzger
For those interested, Trevor wrote a blog post describing how to setup Spark, Flink and Zeppelin, both locally and on clusters: http://trevorgrant.org/2015/11/03/apache-casserole-a-delicious-big-data-recipe-for-the-whole-family/ Thanks Trevor for the great tutorial! On Thu, Oct 22, 2015 at 4:23 PM

Re: Could not load the task's invokable class.

2015-11-04 Thread Robert Metzger
It seems that Eclipse's export jar functionality is broken. But since maven is working properly, I assume the issue is resolved. For the other error, can you post the source code of the main() method somewhere? There are some hints how to resolve the issue in the exceptions (use of .returns() anno

Re: Hi, question about orderBy two columns more

2015-11-04 Thread Maximilian Michels
Hi Philip, The issue has been fixed in rc5 which you can get here: https://people.apache.org/~mxm/flink-0.10.0-rc5/ Note that these files will be removed once 0.10.0 is out. Kind regards, Max On Mon, Nov 2, 2015 at 6:38 PM, Philip Lee wrote: > You are welcome. > > I am wondering if there is a

Re: How to preserve KeyedDataStream

2015-11-04 Thread Aljoscha Krettek
Hi, I’m afraid there is no other solution besides calling keyBy() again if you require a keyed data stream. This has to do with the data model of Flink, where the key is part of the regular data element. This is different from systems that have a (Key, Value) data model. Those systems can provid