Re: XGBoost on DataFlow and Flink

2016-05-21 Thread Henry Saputra
Hi Tianqi, I am also impressed with XGBoost and looking forward to having integration with Apache Flink. As for resource requirements, Apache Flink is using abstraction of slots to express parallel execution in the TaskManager [1] I suppose you were looking for some DSL or specification configur

Re: Develop/Test within IDE

2016-05-21 Thread Márton Balassi
Hey Vijay, Depending on the local dependencies is one way to do this. IMHO the more straight-forward way is to simply place your tests within your version of Flink in the same project. That way the IDE will use the right version of the artifact when executing the test. Best, Marton On Sat, May

Re: Blogpost on Flink's SQL support

2016-05-21 Thread Henry Saputra
I agree with Ufuk, that this is more internal posts which perfect for blog. For high level and use cases I think would be better to be added to Apache Flink release docs bc that is where most users will try to find info on how to use it. - Henry On Saturday, May 21, 2016, Ufuk Celebi wrote: >

Develop/Test within IDE

2016-05-21 Thread Vijay Srinivasaraghavan
Folks, I am making some code changes to "flink-runtime" module. I am able to test/debug my changes from IDE (IntelliJ) using remote debug option (test Job Manager/Task Manager runtime/startup). Steps followed...1) git clone flink... 2) Import Flink maven project from IntelliJ3) Made some code ch

Re: Blogpost on Flink's SQL support

2016-05-21 Thread Ufuk Celebi
Hey Fabian, thank you for this blog post. I added some minor comments in the document. Great read and great work by you and the others who have contributed to SQL! :-) In general, I think that the post is very much an "Internals" post like the "bits and bytes" one. This is definitely nice, but I

Re: Blogpost on Flink's SQL support

2016-05-21 Thread Aljoscha Krettek
A great post! I had some small comments on the doc. On Sat, 21 May 2016 at 16:52 Robert Metzger wrote: > Thanks a lot for the great blog post! > > +1 for publishing it on the Flink blog. > > On Fri, May 20, 2016 at 5:12 PM, Fabian Hueske wrote: > > > Hi everybody, > > > > I wrote a blog post a

Re: Blogpost on Flink's SQL support

2016-05-21 Thread Robert Metzger
Thanks a lot for the great blog post! +1 for publishing it on the Flink blog. On Fri, May 20, 2016 at 5:12 PM, Fabian Hueske wrote: > Hi everybody, > > I wrote a blog post about the SQL efforts of the Flink community and would > like to get your feedback. > > You can read and comment the Google