Re: Support for Apache Spark 3.1.2

2021-09-24 Thread Denis Magda
mar, Abhinav : RFT COO (PUN) > Sent: Wednesday, September 22, 2021 12:02 AM > To: dev@ignite.apache.org > Subject: Support for Apache Spark 3.1.2 > > Hello team, > > We have recently upgraded to use Spark 3.1.2 to utilize Kubernetes support > and ability to use spot instances.

RE: Support for Apache Spark 3.1.2

2021-09-24 Thread abhinav.kumar2
Hello team, Any update or suggestion on this one? We are currently not able to use Ingite in our current Spark 3.1.2 set up. Regards, Abhinav From: Kumar, Abhinav : RFT COO (PUN) Sent: Wednesday, September 22, 2021 12:02 AM To: dev@ignite.apache.org Subject: Support for Apache Spark 3.1.2

Re: Support for Apache Spark 3.1.2

2021-09-23 Thread Valentin Kulichenko
Hello Abhinav, Spark 3 support definitely becomes higher priority for Ignite as more people transition to it from Spark 2. I'm sure someone in the community will pick this up soon. In the meantime, could you please give a little more detail on how you use Ignite with Spark? Are you using the data

Support for Apache Spark 3.1.2

2021-09-21 Thread abhinav.kumar2
Hello team, We have recently upgraded to use Spark 3.1.2 to utilize Kubernetes support and ability to use spot instances. However, we are not able to integrate Ignite with this version. I understand that a lot of people of raise interest in the same. In general, loosely couple these two project