can I run ignite and spark on cluster mode ? in the github example what I
see is just local mode, if I use grid cloud ignite cluster how would I
install spark distributed mode is it comes with the ignite cluster ?
https://github.com/apache/ignite/blob/1f8cf042f67f523e23f795571f609a9c81726258/examp
As I say, there’s nothing "out of the box” — you’d have to write it yourself.
Exactly how you architect it would depend on what you’re trying to do.
Regards,
Stephen
> On 12 Aug 2019, at 19:59, sri hari kali charan Tummala
> wrote:
>
> Thanks Stephen , last question so I have to keep looping
Thanks Stephen , last question so I have to keep looping to find new data
files in S3 and write to cache real time or is it already built in ?
On Mon, Aug 12, 2019 at 5:43 AM Stephen Darlington <
stephen.darling...@gridgain.com> wrote:
> I don’t think there’s anything “out of the box,” but you co
I don’t think there’s anything “out of the box,” but you could write a custom
CacheStore to do that.
See here for more details:
https://apacheignite.readme.io/docs/3rd-party-store#section-custom-cachestore
Regards,
Stephen
> On 9 Aug 2019, at 21:50, sri hari kali charan Tummala
> wrote:
>
>
one last question, is there an S3 connector for Ignite which can load s3
objects in realtime to ignite cache and data updates directly back to S3? I
can use spark as one alternative but is there another approach of doing?
Let's say I want to build in-memory near real-time data lake files which
get
Thank you, I got it now I have to change the id values to see the same data
as extra results (this is just for testing) amazing.
val df = spark.sql(SELECT monolitically_id() as id, name, department FROM
json_person)
df.write(append)... to ignite
Thanks
Sri
On Fri, Aug 9, 2019 at 6:08 AM Andrei
Hi,
Spark contains several *SaveModes *that will be applied if the table
that you are going to use exists:
* *Overwrite *- with this option you *will try to re-create* existed
table or create new and load data there using IgniteDataStreamer
implementation
* *Append *- with this option you *w
Hi All,
I am new to Apache Ignite community I am testing out ignite for knowledge
sake in the below example the code reads a json file and writes to ingite
in-memory table is it overwriting can I do append mode I did try spark
append mode .mode(org.apache.spark.sql.SaveMode.Append)
without stoppin
