Anton, The implementation is correct and was reviewed by Val long time ago. The only issue that is left is the compilation in *TeamCity* only. You fixed it for one scala version and now should simply do the same for other scala version by adding a new suite to TeamCity and adjusting the pom.
— Denis > On Feb 15, 2017, at 1:20 AM, Anton Vinogradov <avinogra...@gridgain.com> > wrote: > > Denis, > > I don't know what is the plan for this issue. > You asked me to fix compilation and thats what I done :) , but I'm not sure > that issue implemented in proper way. I don't like changes I've done, they > looks redundant although it works. > Do we have somebody more familiar with spark inside the community? > We have to review what we already done and figure out what's left. > > On Wed, Feb 15, 2017 at 5:01 AM, Denis Magda <dma...@apache.org> wrote: > >> Continuing Spark related topic... >> >> This ticket definitely must be included in 1.9: >> https://issues.apache.org/jira/browse/IGNITE-3710 < >> https://issues.apache.org/jira/browse/IGNITE-3710> >> >> We can’t longer afford torture Ignite Shared RDD users who have to use an >> outdated Spark version. >> >> Anton, could you finalize it this week? As far as I remember, the only >> thing that is left is to add a missing test suite to Team City. >> >> — >> Denis >> >>> On Feb 14, 2017, at 5:00 PM, Denis Magda <dma...@apache.org> wrote: >>> >>> Reviewed and merged the first (!) Ignite Shared RDD examples contributed >> by Manish: >>> >>> https://issues.apache.org/jira/browse/IGNITE-4526 >>> >>> Java: >>> https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e2 >> 53dcf26202/examples/src/main/java8/org/apache/ignite/examples/java8/spark/ >> SharedRDDExample.java >>> >>> Scala: >>> https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e2 >> 53dcf26202/examples/src/main/scala/org/apache/ignite/ >> scalar/examples/spark/ScalarSharedRDDExample.scala >>> >>> Manish, thanks for making the life of Apache Ignite users easier. No >> they can refer to your examples while learning Ignite Shared RDD API. >>> >>> — >>> Denis >>> >>>> On Feb 14, 2017, at 1:21 AM, Anton Vinogradov <avinogra...@gridgain.com> >> wrote: >>>> >>>>> >>>>> Can we push to 1.9 and then merge/rebase to master? >>>> >>>> >>>> Yes, that's *correct *too, but only *megre *should be used. >>>> >>>> On Tue, Feb 14, 2017 at 12:19 PM, Vladimir Ozerov <voze...@gridgain.com >>> >>>> wrote: >>>> >>>>> Can we push to 1.9 and then merge/rebase to master? It should be more >>>>> reliable than cherry-picking. >>>>> >>>>> On Tue, Feb 14, 2017 at 12:15 PM, Anton Vinogradov < >>>>> avinogra...@gridgain.com >>>>>> wrote: >>>>> >>>>>> Denis, >>>>>> >>>>>> Merge to the master first and then cherry-pick to 1.9 from there is a >>>>>> *correct >>>>>> *case. >>>>>> >>>>>> On Tue, Feb 14, 2017 at 5:24 AM, Dmitriy Setrakyan < >>>>> dsetrak...@apache.org> >>>>>> wrote: >>>>>> >>>>>>> Thanks, Denis! >>>>>>> >>>>>>> On Mon, Feb 13, 2017 at 5:49 PM, Denis Magda <dma...@apache.org> >>>>> wrote: >>>>>>> >>>>>>>> Well, merged Kubernetes integration to the master and cherry-picked >>>>> to >>>>>>>> 1.9. The docs and getting started for readme.io to be done soon. >>>>>>>> >>>>>>>> — >>>>>>>> Denis >>>>>>>> >>>>>>>>> On Feb 13, 2017, at 9:10 AM, Denis Magda <dma...@apache.org> >>>>> wrote: >>>>>>>>> >>>>>>>>> Do I merge to the master first and then cherry-pick to 1.9 from >>>>>> there? >>>>>>>>> >>>>>>>>> — >>>>>>>>> Denis >>>>>>>>> >>>>>>>>>> On Feb 13, 2017, at 8:21 AM, Anton Vinogradov < >>>>>>> avinogra...@gridgain.com> >>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>> Igniters, >>>>>>>>>> >>>>>>>>>> We're starting release stabilization process. >>>>>>>>>> Branch 1.9 created and equals to master branch right now. >>>>>>>>>> >>>>>>>>>> Please make sure that your changes will be merged to both >>>>> branches: >>>>>>>>>> *ignite-1.9* and *master*. >>>>>>>>>> >>>>>>>>>> On Fri, Feb 10, 2017 at 4:53 PM, Sergey Kalashnikov < >>>>>>>> zkilling...@gmail.com> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Anton, >>>>>>>>>>> >>>>>>>>>>> Here is the status for IGNITE-4523. >>>>>>>>>>> The work is completed, tests are OK. >>>>>>>>>>> Most of the changes were made by Alexey and were reviewed. >>>>>>>>>>> I only authored few last commits for which I would appreciate a >>>>>>> review. >>>>>>>>>>> The PR is https://github.com/apache/ignite/pull/1508 >>>>>>>>>>> >>>>>>>>>>> Thank you >>>>>>>>>>> -- >>>>>>>>>>> Sergey >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> 2017-02-09 23:58 GMT+03:00 Denis Magda <dma...@apache.org>: >>>>>>>>>>> >>>>>>>>>>>> Anton, >>>>>>>>>>>> >>>>>>>>>>>> You can expect Kubernetes support from me in time. >>>>>>>>>>>> >>>>>>>>>>>> — >>>>>>>>>>>> Denis >>>>>>>>>>>> >>>>>>>>>>>>> On Feb 9, 2017, at 1:52 AM, Anton Vinogradov <a...@apache.org> >>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> Igniters, >>>>>>>>>>>>> >>>>>>>>>>>>> We're on a half way to Ignite 1.9. >>>>>>>>>>>>> Development phase will be finished 17th of February. >>>>>>>>>>>>> >>>>>>>>>>>>> Here <https://cwiki.apache.org/confluence/display/IGNITE/ >>>>>>>>>>>> Apache+Ignite+1.9> is >>>>>>>>>>>>> a status page for upcoming release. >>>>>>>>>>>>> >>>>>>>>>>>>> According to this page we have some Issues we *especially >>>>> *expect >>>>>>> in >>>>>>>>>>> 1.9: >>>>>>>>>>>>> >>>>>>>>>>>>> IGNITE-4106 SQL: parallelize sql queries over cache local >>>>>>> partitions >>>>>>>>>>>> Andrew >>>>>>>>>>>>> Mashenkov >>>>>>>>>>>>> IGNITE-3860 Improve distributed SQL support. Sergi Vladykin >>>>>>>>>>>>> IGNITE-4539 RocketMQ data streamer Roman Shtykh >>>>>>>>>>>>> IGNITE-4212 Ignite Benchmarking Simplification and Automation >>>>>> Oleg >>>>>>>>>>>> Ostanin >>>>>>>>>>>>> IGNITE-4523 Allow distributed SQL query execution over explicit >>>>>> set >>>>>>>> of >>>>>>>>>>>>> partitions Alexei Scherbakov >>>>>>>>>>>>> IGNITE-3013 Support sorted merge index for SQL Sergi Vladykin >>>>>>>>>>>>> IGNITE-4169 Data streamer mode for DML Alexander Paschenko >>>>>>>>>>>>> IGNITE-4670 CPP: Implement LoadCache method Unassigned (Igor >>>>>>> Sapego, >>>>>>>>>>>> seems >>>>>>>>>>>>> you're the best person) >>>>>>>>>>>>> IGNITE-4159 Cloud Native Deployment of Apache Ignite using >>>>>>> Kubernetes >>>>>>>>>>>> Denis >>>>>>>>>>>>> Magda >>>>>>>>>>>>> IGNITE-4526 Add Spark Shared RDD examples Manish Mishra >>>>>>>>>>>>> IGNITE-4674 Ignite Web Console: Support DML queries Alexey >>>>>>> Kuznetsov >>>>>>>>>>>>> IGNITE-1794 Ignite should support Hibernate 5 Mykola Pereyma >>>>>>>>>>>>> >>>>>>>>>>>>> Guys, please confirm that you will be able to complete listed >>>>>> tasks >>>>>>>> by >>>>>>>>>>>> 17th >>>>>>>>>>>>> of February. >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Fri, Feb 3, 2017 at 5:32 AM, Denis Magda <dma...@apache.org >>>>>> >>>>>>>> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Excellent news Roman! Please keep us posted. >>>>>>>>>>>>>> >>>>>>>>>>>>>> — >>>>>>>>>>>>>> Denis >>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Feb 2, 2017, at 6:26 PM, Roman Shtykh >>>>>>> <rsht...@yahoo.com.INVALID >>>>>>>>> >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Denis, >>>>>>>>>>>>>>> RocketMQ data streamer implementation is almost ready. But >>>>>> there >>>>>>>> are >>>>>>>>>>> no >>>>>>>>>>>>>> binaries in maven repositories now (it will be their 1st >>>>> release >>>>>>>> under >>>>>>>>>>>>>> Apache license). The release is very close to starting voting >>>>>> for, >>>>>>>> so >>>>>>>>>>>>>> hopefully it can be done in the middle of February. >>>>>>>>>>>>>>> Roman >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Wednesday, February 1, 2017 4:13 AM, Denis Magda < >>>>>>>>>>>>>> dma...@apache.org> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Igniters, >>>>>>>>>>>>>>> Looks like 2.0 will be slightly delayed since the community >>>>>>>> requires >>>>>>>>>>>>>> more time to make the new page memory architecture faster. At >>>>>> the >>>>>>>> same >>>>>>>>>>>> time >>>>>>>>>>>>>> we have a plenty of bug fixes and performance improvements >>>>> that >>>>>>> were >>>>>>>>>>>> merged >>>>>>>>>>>>>> or close to be merged into the master and ready to be >>>>> released. >>>>>>>>>>>>>>> I propose to release all the changes we have in 1.9 close to >>>>>> the >>>>>>>> end >>>>>>>>>>> of >>>>>>>>>>>>>> February. >>>>>>>>>>>>>>> According to the dev list discussions, we will be ready to >>>>>>> release >>>>>>>>>>>>>> performance optimizations done by Yakov and Sam close to the >>>>> end >>>>>>> of >>>>>>>>>>> 2016 >>>>>>>>>>>>>> and many SQL improvements driven by multiple folks. >>>>>>>>>>>>>>> In addition, this is what we might expect in 1.9:- SQL >>>>>> execution >>>>>>>> over >>>>>>>>>>>>>> specific partitions (https://issues.apache.org/ >>>>>>>>>>> jira/browse/IGNITE-4523 >>>>>>>>>>>> ). >>>>>>>>>>>>>> Alexey Scherbakov.- Spark version upgrade ( >>>>>>>> https://issues.apache.org/ >>>>>>>>>>>>>> jira/browse/IGNITE-3710). Anton V.- Spark RDD Examples ( >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4526). Manish >>>>>>> Mishra.- >>>>>>>>>>>>>> Rocket MQ data streamer (https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-4539). >>>>>>>>>>>>>> Roman Shtykh.- Hibernate 5 support ( >>>>> https://issues.apache.org/ >>>>>>>>>>>>>> jira/browse/IGNITE-1794). Mykola Pereyma.- .NET DML ( >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4045). Pavel >>>>>>>> Tupitsyn.- >>>>>>>>>>>> .NET >>>>>>>>>>>>>> Transaction Scope API (https://issues.apache.org/ >>>>>>>>>>>> jira/browse/IGNITE-3430). >>>>>>>>>>>>>> Pavel Tupitsyn.- C++ Continuous queries ( >>>>>>> https://issues.apache.org/ >>>>>>>>>>>>>> jira/browse/IGNITE-1443). Igor Sapego.- Kubernetes Support ( >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4159). Denis >>>>>> Magda.- >>>>>>>>>>> JDBC >>>>>>>>>>>>>> batch mode for DML (https://issues.apache.org/ >>>>>>>> jira/browse/IGNITE-4269 >>>>>>>>>>> ). >>>>>>>>>>>>>> Alexander Paschenko.- Benchmarks automation ( >>>>>>>>>>> https://issues.apache.org/ >>>>>>>>>>>>>> jira/browse/IGNITE-4212). Oleg Ostanin. >>>>>>>>>>>>>>> Guys, please confirm that you will be able to complete listed >>>>>>> tasks >>>>>>>>>>> by >>>>>>>>>>>>>> the middle or by 20th of February. Anything else that is not >>>>> in >>>>>>> the >>>>>>>>>>>> list? >>>>>>>>>>>>>>> BTW, is there anyone who can take a role of the release >>>>> manager >>>>>>> for >>>>>>>>>>>> 1.9? >>>>>>>>>>>>>>> —Denis >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>> >> >>
