Hello Abhinav, Spark 3 support definitely becomes higher priority for Ignite as more people transition to it from Spark 2. I'm sure someone in the community will pick this up soon.
In the meantime, could you please give a little more detail on how you use Ignite with Spark? Are you using the dataframes integration [1] or something else? [1] https://ignite.apache.org/docs/latest/extensions-and-integrations/ignite-for-spark/ignite-dataframe -Val On Tue, Sep 21, 2021 at 11:09 PM <abhinav.kum...@barclays.com.invalid> wrote: > Hello team, > > We have recently upgraded to use Spark 3.1.2 to utilize Kubernetes support > and ability to use spot instances. However, we are not able to integrate > Ignite with this version. I understand that a lot of people of raise > interest in the same. In general, loosely couple these two projects so > benefits of both can be achieved? Considering that Spark releases do not > necessary align to Ignite and vice versa, would it make sense? > > Please suggest. > > Regards, > Abhinav > > > _________________________________________________________________________________________________________________________________________________________________________________________________________________________________ > “This message is for information purposes only, it is not a > recommendation, advice, offer or solicitation to buy or sell a product or > service nor an official confirmation of any transaction. It is directed at > persons who are professionals and is not intended for retail customer use. > Intended for recipient only. This message is subject to the terms at: > www.barclays.com/emaildisclaimer. > > For important disclosures, please see: > www.barclays.com/salesandtradingdisclaimer regarding market commentary > from Barclays Sales and/or Trading, who are active market participants; > https://www.investmentbank.barclays.com/disclosures/barclays-global-markets-disclosures.html > regarding our standard terms for the Investment Bank of Barclays where we > trade with you in principal-to-principal wholesale markets transactions; > and in respect of Barclays Research, including disclosures relating to > specific issuers, please see http://publicresearch.barclays.com.” > > _________________________________________________________________________________________________________________________________________________________________________________________________________________________________ > If you are incorporated or operating in Australia, please see > https://www.home.barclays/disclosures/importantapacdisclosures.html for > important disclosure. > > _________________________________________________________________________________________________________________________________________________________________________________________________________________________________ > How we use personal information see our privacy notice > https://www.investmentbank.barclays.com/disclosures/personalinformationuse.html > > _________________________________________________________________________________________________________________________________________________________________________________________________________________________________ >
