Re: Dependency Injection and Microservice development with Spark

2016-12-28 Thread Miguel Morales
Hi Not sure about Spring boot but trying to use DI libraries you'll run into serialization issues.I've had luck using an old version of Scaldi. Recently though I've been passing the class types as arguments with default values. Then in the spark code it gets instantiated. So you're basic

Re: Flink event session window in Spark

2016-12-02 Thread Miguel Morales
Although this may not be natively supported, you can mimic this behavior. By having a micro batch time of 1 minute. Then on your updateStateByKey check how long the session has been running. If it's longer than 10 minutes, return an empty key so that it's removed from the stream. On Fri, Dec 2,