Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-30 Thread Николай Ижиков
Valentin, Now it's run OK. Thank you. 30.11.2017 23:41, Valentin Kulichenko пишет: Nikolay, Please try once again. -Val On Thu, Nov 30, 2017 at 11:43 AM, Николай Ижиков mailto:nizhikov@gmail.com>> wrote: Valentin, Thank you, but your changes does not enough I ran a build

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-30 Thread Valentin Kulichenko
Nikolay, Please try once again. -Val On Thu, Nov 30, 2017 at 11:43 AM, Николай Ижиков wrote: > Valentin, > > Thank you, but your changes does not enough > > I ran a build for my branch and still has "Unsupport major.minor version > 52.0" issue [1] > > Build log: > > `Starting: /usr/lib/jvm/jav

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-30 Thread Николай Ижиков
Valentin, Thank you, but your changes does not enough I ran a build for my branch and still has "Unsupport major.minor version 52.0" issue [1] Build log: `Starting: /usr/lib/jvm/java-7-oracle/bin/java -DJAVA_HOME=/usr/lib/jvm/java-8-oracle` I look to build settings and found some variables

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-30 Thread Valentin Kulichenko
Nikolay, Java 7 support will be dropped by Ignite soon, so let's do the upgrade now. I changed both 'Ignite RDD' and 'Ignite RDD spark 2_10' configuration on TC to use JDK 8. Can you try it out and let me know if it works? -Val On Wed, Nov 29, 2017 at 11:28 PM, Николай Ижиков wrote: > Valentin

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-29 Thread Николай Ижиков
Valentin, > Oh, so this is because of upgrade to 2.2.0? Yes, we should upgrade spark module to jdk1.8 because switching to spark 2.2.0. > least we should consider not dropping previous version yet. Please, note, we can have IgniteRDD and Ignite Data Frame for a spark 2.1. The only thing we ca

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-29 Thread Valentin Kulichenko
Nikolay, Oh, so this is because of upgrade to 2.2.0? Then I'm not sure we should upgrade in the first place, or at least we should consider not dropping previous version yet. I sent a message to the original thread about upgrade, let's decide there and then come back to this issue. -Val On Tue,

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-28 Thread Николай Ижиков
Valentin, For now `Ignite RDD` build runs on jdk1.7. We need to update it to jdk1.8. I wrote the whole versions numbers to be clear: 1. Current master - Spark version is 2.1.0. So both `Ignite RDD` and `Ignite RDD 2.10` runs OK on jdk1.7. 2. My branch - `Ignite RDD 2.10` - spar

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-28 Thread Valentin Kulichenko
Nikolay, If Spark requires Java 8, then I guess we have no choice. How TC is configured at the moment? My understanding is that Spark related suites are successfully executed there, so is there an issue? -Val On Tue, Nov 28, 2017 at 2:42 AM, Николай Ижиков wrote: > Hello, Valentin. > > Added '

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-28 Thread Николай Ижиков
Hello, Valentin. Added '-Dscala-2.10' to the build config. Let me know if it helps. Yes, it helps. Thank you! Now, 'Ignite RDD spark 2_10' succeed for my branch. Do you mean that IgniteRDD does not compile on JDK7? If yes, do we know the reason? I don't think switching it to JDK8 is a solu

Re: TC issues. IGNITE-3084. Spark Data Frame API

2017-11-27 Thread Valentin Kulichenko
Hi Nikolay, Please see my responses inline. -Val On Fri, Nov 24, 2017 at 2:55 AM, Николай Ижиков wrote: > Hello, guys. > > I have some issues on TC with my PR [1] for IGNITE-3084(Spark Data Frame > API). > Can you, please, help me: > > > 1. `Ignite RDD spark 2_10` - > > Currently this build ru