Hi, There are some questions regarding IGNITE-4169 - probably some design approval will be required from Dmitry S. However, chances are good that we'll make it in time.
- Alex 2017-02-16 14:48 GMT+03:00 Anton Vinogradov <avinogra...@gridgain.com>: > Igniters, > > We're planning to have a code freeze tomorrow, Feb 17 19.00 MSK. > Here's the list of issues we especially expect to be done in 1.9: > > IGNITE-4106 SQL: parallelize sql queries over cache local partitions Andrew > Mashenkov > IGNITE-4670 CPP: Implement LoadCache method Task Igor Sapego > IGNITE-3860 Improve distributed SQL support. Sergi Vladykin > IGNITE-3013 Support sorted merge index for SQL Sergi Vladykin > IGNITE-4212 Ignite Benchmarking Simplification and Automation Oleg Ostanin > IGNITE-4169 Data streamer mode for DML Alexander Paschenko > IGNITE-3710 Upgrade ignite-spark module to Spark 2.0 Evgenii Zhuravlev > IGNITE-1794 Ignite should support Hibernate 5 Mykola Pereyma > IGNITE-4523 Allow distributed SQL query execution over explicit set of > partitions Alexei Scherbakov > > Guys, please confirm that you will be able to complete listed tasks till > Feb 17 19.00 MSK. > > On Thu, Feb 16, 2017 at 2:31 PM, Anton Vinogradov <avinogra...@gridgain.com> > wrote: > >> Denis, >> >> Evgenii Zhuravlev going to fix this issue. I'll provide him help if >> necessarry. >> >> On Wed, Feb 15, 2017 at 8:03 PM, Denis Magda <dma...@apache.org> wrote: >> >>> Anton, >>> >>> The implementation is correct and was reviewed by Val long time ago. The >>> only issue that is left is the compilation in *TeamCity* only. >>> You fixed it for one scala version and now should simply do the same for >>> other scala version by adding a new suite to TeamCity and adjusting the pom. >>> >>> — >>> Denis >>> >>> > On Feb 15, 2017, at 1:20 AM, Anton Vinogradov <avinogra...@gridgain.com> >>> wrote: >>> > >>> > Denis, >>> > >>> > I don't know what is the plan for this issue. >>> > You asked me to fix compilation and thats what I done :) , but I'm not >>> sure >>> > that issue implemented in proper way. I don't like changes I've done, >>> they >>> > looks redundant although it works. >>> > Do we have somebody more familiar with spark inside the community? >>> > We have to review what we already done and figure out what's left. >>> > >>> > On Wed, Feb 15, 2017 at 5:01 AM, Denis Magda <dma...@apache.org> wrote: >>> > >>> >> Continuing Spark related topic... >>> >> >>> >> This ticket definitely must be included in 1.9: >>> >> https://issues.apache.org/jira/browse/IGNITE-3710 < >>> >> https://issues.apache.org/jira/browse/IGNITE-3710> >>> >> >>> >> We can’t longer afford torture Ignite Shared RDD users who have to use >>> an >>> >> outdated Spark version. >>> >> >>> >> Anton, could you finalize it this week? As far as I remember, the only >>> >> thing that is left is to add a missing test suite to Team City. >>> >> >>> >> — >>> >> Denis >>> >> >>> >>> On Feb 14, 2017, at 5:00 PM, Denis Magda <dma...@apache.org> wrote: >>> >>> >>> >>> Reviewed and merged the first (!) Ignite Shared RDD examples >>> contributed >>> >> by Manish: >>> >>> >>> >>> https://issues.apache.org/jira/browse/IGNITE-4526 >>> >>> >>> >>> Java: >>> >>> https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e2 >>> >> 53dcf26202/examples/src/main/java8/org/apache/ignite/example >>> s/java8/spark/ >>> >> SharedRDDExample.java >>> >>> >>> >>> Scala: >>> >>> https://github.com/apache/ignite/blob/b461cb47882861356ede58775bd9e2 >>> >> 53dcf26202/examples/src/main/scala/org/apache/ignite/ >>> >> scalar/examples/spark/ScalarSharedRDDExample.scala >>> >>> >>> >>> Manish, thanks for making the life of Apache Ignite users easier. No >>> >> they can refer to your examples while learning Ignite Shared RDD API. >>> >>> >>> >>> — >>> >>> Denis >>> >>> >>> >>>> On Feb 14, 2017, at 1:21 AM, Anton Vinogradov < >>> avinogra...@gridgain.com> >>> >> wrote: >>> >>>> >>> >>>>> >>> >>>>> Can we push to 1.9 and then merge/rebase to master? >>> >>>> >>> >>>> >>> >>>> Yes, that's *correct *too, but only *megre *should be used. >>> >>>> >>> >>>> On Tue, Feb 14, 2017 at 12:19 PM, Vladimir Ozerov < >>> voze...@gridgain.com >>> >>> >>> >>>> wrote: >>> >>>> >>> >>>>> Can we push to 1.9 and then merge/rebase to master? It should be >>> more >>> >>>>> reliable than cherry-picking. >>> >>>>> >>> >>>>> On Tue, Feb 14, 2017 at 12:15 PM, Anton Vinogradov < >>> >>>>> avinogra...@gridgain.com >>> >>>>>> wrote: >>> >>>>> >>> >>>>>> Denis, >>> >>>>>> >>> >>>>>> Merge to the master first and then cherry-pick to 1.9 from there >>> is a >>> >>>>>> *correct >>> >>>>>> *case. >>> >>>>>> >>> >>>>>> On Tue, Feb 14, 2017 at 5:24 AM, Dmitriy Setrakyan < >>> >>>>> dsetrak...@apache.org> >>> >>>>>> wrote: >>> >>>>>> >>> >>>>>>> Thanks, Denis! >>> >>>>>>> >>> >>>>>>> On Mon, Feb 13, 2017 at 5:49 PM, Denis Magda <dma...@apache.org> >>> >>>>> wrote: >>> >>>>>>> >>> >>>>>>>> Well, merged Kubernetes integration to the master and >>> cherry-picked >>> >>>>> to >>> >>>>>>>> 1.9. The docs and getting started for readme.io to be done soon. >>> >>>>>>>> >>> >>>>>>>> — >>> >>>>>>>> Denis >>> >>>>>>>> >>> >>>>>>>>> On Feb 13, 2017, at 9:10 AM, Denis Magda <dma...@apache.org> >>> >>>>> wrote: >>> >>>>>>>>> >>> >>>>>>>>> Do I merge to the master first and then cherry-pick to 1.9 from >>> >>>>>> there? >>> >>>>>>>>> >>> >>>>>>>>> — >>> >>>>>>>>> Denis >>> >>>>>>>>> >>> >>>>>>>>>> On Feb 13, 2017, at 8:21 AM, Anton Vinogradov < >>> >>>>>>> avinogra...@gridgain.com> >>> >>>>>>>> wrote: >>> >>>>>>>>>> >>> >>>>>>>>>> Igniters, >>> >>>>>>>>>> >>> >>>>>>>>>> We're starting release stabilization process. >>> >>>>>>>>>> Branch 1.9 created and equals to master branch right now. >>> >>>>>>>>>> >>> >>>>>>>>>> Please make sure that your changes will be merged to both >>> >>>>> branches: >>> >>>>>>>>>> *ignite-1.9* and *master*. >>> >>>>>>>>>> >>> >>>>>>>>>> On Fri, Feb 10, 2017 at 4:53 PM, Sergey Kalashnikov < >>> >>>>>>>> zkilling...@gmail.com> >>> >>>>>>>>>> wrote: >>> >>>>>>>>>> >>> >>>>>>>>>>> Anton, >>> >>>>>>>>>>> >>> >>>>>>>>>>> Here is the status for IGNITE-4523. >>> >>>>>>>>>>> The work is completed, tests are OK. >>> >>>>>>>>>>> Most of the changes were made by Alexey and were reviewed. >>> >>>>>>>>>>> I only authored few last commits for which I would appreciate >>> a >>> >>>>>>> review. >>> >>>>>>>>>>> The PR is https://github.com/apache/ignite/pull/1508 >>> >>>>>>>>>>> >>> >>>>>>>>>>> Thank you >>> >>>>>>>>>>> -- >>> >>>>>>>>>>> Sergey >>> >>>>>>>>>>> >>> >>>>>>>>>>> >>> >>>>>>>>>>> >>> >>>>>>>>>>> 2017-02-09 23:58 GMT+03:00 Denis Magda <dma...@apache.org>: >>> >>>>>>>>>>> >>> >>>>>>>>>>>> Anton, >>> >>>>>>>>>>>> >>> >>>>>>>>>>>> You can expect Kubernetes support from me in time. >>> >>>>>>>>>>>> >>> >>>>>>>>>>>> — >>> >>>>>>>>>>>> Denis >>> >>>>>>>>>>>> >>> >>>>>>>>>>>>> On Feb 9, 2017, at 1:52 AM, Anton Vinogradov <a...@apache.org >>> > >>> >>>>>>> wrote: >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> Igniters, >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> We're on a half way to Ignite 1.9. >>> >>>>>>>>>>>>> Development phase will be finished 17th of February. >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> Here <https://cwiki.apache.org/confluence/display/IGNITE/ >>> >>>>>>>>>>>> Apache+Ignite+1.9> is >>> >>>>>>>>>>>>> a status page for upcoming release. >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> According to this page we have some Issues we *especially >>> >>>>> *expect >>> >>>>>>> in >>> >>>>>>>>>>> 1.9: >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> IGNITE-4106 SQL: parallelize sql queries over cache local >>> >>>>>>> partitions >>> >>>>>>>>>>>> Andrew >>> >>>>>>>>>>>>> Mashenkov >>> >>>>>>>>>>>>> IGNITE-3860 Improve distributed SQL support. Sergi Vladykin >>> >>>>>>>>>>>>> IGNITE-4539 RocketMQ data streamer Roman Shtykh >>> >>>>>>>>>>>>> IGNITE-4212 Ignite Benchmarking Simplification and >>> Automation >>> >>>>>> Oleg >>> >>>>>>>>>>>> Ostanin >>> >>>>>>>>>>>>> IGNITE-4523 Allow distributed SQL query execution over >>> explicit >>> >>>>>> set >>> >>>>>>>> of >>> >>>>>>>>>>>>> partitions Alexei Scherbakov >>> >>>>>>>>>>>>> IGNITE-3013 Support sorted merge index for SQL Sergi >>> Vladykin >>> >>>>>>>>>>>>> IGNITE-4169 Data streamer mode for DML Alexander Paschenko >>> >>>>>>>>>>>>> IGNITE-4670 CPP: Implement LoadCache method Unassigned (Igor >>> >>>>>>> Sapego, >>> >>>>>>>>>>>> seems >>> >>>>>>>>>>>>> you're the best person) >>> >>>>>>>>>>>>> IGNITE-4159 Cloud Native Deployment of Apache Ignite using >>> >>>>>>> Kubernetes >>> >>>>>>>>>>>> Denis >>> >>>>>>>>>>>>> Magda >>> >>>>>>>>>>>>> IGNITE-4526 Add Spark Shared RDD examples Manish Mishra >>> >>>>>>>>>>>>> IGNITE-4674 Ignite Web Console: Support DML queries Alexey >>> >>>>>>> Kuznetsov >>> >>>>>>>>>>>>> IGNITE-1794 Ignite should support Hibernate 5 Mykola Pereyma >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> Guys, please confirm that you will be able to complete >>> listed >>> >>>>>> tasks >>> >>>>>>>> by >>> >>>>>>>>>>>> 17th >>> >>>>>>>>>>>>> of February. >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>> On Fri, Feb 3, 2017 at 5:32 AM, Denis Magda < >>> dma...@apache.org >>> >>>>>> >>> >>>>>>>> wrote: >>> >>>>>>>>>>>>> >>> >>>>>>>>>>>>>> Excellent news Roman! Please keep us posted. >>> >>>>>>>>>>>>>> >>> >>>>>>>>>>>>>> — >>> >>>>>>>>>>>>>> Denis >>> >>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> On Feb 2, 2017, at 6:26 PM, Roman Shtykh >>> >>>>>>> <rsht...@yahoo.com.INVALID >>> >>>>>>>>> >>> >>>>>>>>>>>>>> wrote: >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> Denis, >>> >>>>>>>>>>>>>>> RocketMQ data streamer implementation is almost ready. But >>> >>>>>> there >>> >>>>>>>> are >>> >>>>>>>>>>> no >>> >>>>>>>>>>>>>> binaries in maven repositories now (it will be their 1st >>> >>>>> release >>> >>>>>>>> under >>> >>>>>>>>>>>>>> Apache license). The release is very close to starting >>> voting >>> >>>>>> for, >>> >>>>>>>> so >>> >>>>>>>>>>>>>> hopefully it can be done in the middle of February. >>> >>>>>>>>>>>>>>> Roman >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> On Wednesday, February 1, 2017 4:13 AM, Denis Magda < >>> >>>>>>>>>>>>>> dma...@apache.org> wrote: >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>>> Igniters, >>> >>>>>>>>>>>>>>> Looks like 2.0 will be slightly delayed since the >>> community >>> >>>>>>>> requires >>> >>>>>>>>>>>>>> more time to make the new page memory architecture faster. >>> At >>> >>>>>> the >>> >>>>>>>> same >>> >>>>>>>>>>>> time >>> >>>>>>>>>>>>>> we have a plenty of bug fixes and performance improvements >>> >>>>> that >>> >>>>>>> were >>> >>>>>>>>>>>> merged >>> >>>>>>>>>>>>>> or close to be merged into the master and ready to be >>> >>>>> released. >>> >>>>>>>>>>>>>>> I propose to release all the changes we have in 1.9 close >>> to >>> >>>>>> the >>> >>>>>>>> end >>> >>>>>>>>>>> of >>> >>>>>>>>>>>>>> February. >>> >>>>>>>>>>>>>>> According to the dev list discussions, we will be ready to >>> >>>>>>> release >>> >>>>>>>>>>>>>> performance optimizations done by Yakov and Sam close to >>> the >>> >>>>> end >>> >>>>>>> of >>> >>>>>>>>>>> 2016 >>> >>>>>>>>>>>>>> and many SQL improvements driven by multiple folks. >>> >>>>>>>>>>>>>>> In addition, this is what we might expect in 1.9:- SQL >>> >>>>>> execution >>> >>>>>>>> over >>> >>>>>>>>>>>>>> specific partitions (https://issues.apache.org/ >>> >>>>>>>>>>> jira/browse/IGNITE-4523 >>> >>>>>>>>>>>> ). >>> >>>>>>>>>>>>>> Alexey Scherbakov.- Spark version upgrade ( >>> >>>>>>>> https://issues.apache.org/ >>> >>>>>>>>>>>>>> jira/browse/IGNITE-3710). Anton V.- Spark RDD Examples ( >>> >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4526). Manish >>> >>>>>>> Mishra.- >>> >>>>>>>>>>>>>> Rocket MQ data streamer (https://issues.apache.org/ >>> >>>>>>>>>>>> jira/browse/IGNITE-4539). >>> >>>>>>>>>>>>>> Roman Shtykh.- Hibernate 5 support ( >>> >>>>> https://issues.apache.org/ >>> >>>>>>>>>>>>>> jira/browse/IGNITE-1794). Mykola Pereyma.- .NET DML ( >>> >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4045). Pavel >>> >>>>>>>> Tupitsyn.- >>> >>>>>>>>>>>> .NET >>> >>>>>>>>>>>>>> Transaction Scope API (https://issues.apache.org/ >>> >>>>>>>>>>>> jira/browse/IGNITE-3430). >>> >>>>>>>>>>>>>> Pavel Tupitsyn.- C++ Continuous queries ( >>> >>>>>>> https://issues.apache.org/ >>> >>>>>>>>>>>>>> jira/browse/IGNITE-1443). Igor Sapego.- Kubernetes Support >>> ( >>> >>>>>>>>>>>>>> https://issues.apache.org/jira/browse/IGNITE-4159). Denis >>> >>>>>> Magda.- >>> >>>>>>>>>>> JDBC >>> >>>>>>>>>>>>>> batch mode for DML (https://issues.apache.org/ >>> >>>>>>>> jira/browse/IGNITE-4269 >>> >>>>>>>>>>> ). >>> >>>>>>>>>>>>>> Alexander Paschenko.- Benchmarks automation ( >>> >>>>>>>>>>> https://issues.apache.org/ >>> >>>>>>>>>>>>>> jira/browse/IGNITE-4212). Oleg Ostanin. >>> >>>>>>>>>>>>>>> Guys, please confirm that you will be able to complete >>> listed >>> >>>>>>> tasks >>> >>>>>>>>>>> by >>> >>>>>>>>>>>>>> the middle or by 20th of February. Anything else that is >>> not >>> >>>>> in >>> >>>>>>> the >>> >>>>>>>>>>>> list? >>> >>>>>>>>>>>>>>> BTW, is there anyone who can take a role of the release >>> >>>>> manager >>> >>>>>>> for >>> >>>>>>>>>>>> 1.9? >>> >>>>>>>>>>>>>>> —Denis >>> >>>>>>>>>>>>>>> >>> >>>>>>>>>>>>>> >>> >>>>>>>>>>>>>> >>> >>>>>>>>>>>> >>> >>>>>>>>>>>> >>> >>>>>>>>>>> >>> >>>>>>>>> >>> >>>>>>>> >>> >>>>>>>> >>> >>>>>>> >>> >>>>>> >>> >>>>> >>> >>> >>> >> >>> >> >>> >>> >>