Re: Re-partitioning when partition key changes

Ok. That clears my understanding on how partitioning would work. Thanks -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-partitioning-when-partition-key-changes-tp10031p10071.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

What is the main use case for ignite Jobs and what they are not suitable for?

What is the main use case for ignite Jobs (https://apacheignite.readme.io/docs/job-scheduling) and what they are not suitable for? It looks like Ignite has many concepts dedicated to the queueing/messaging: - https://apacheignite.readme.io/docs/job-scheduling - https://apacheignite.readme.io/docs/

Re: Convert stream data

ok :) thanks!! -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Convert-stream-data-key-value-tp10033p10069.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: How to remove large amount of data from cache

I have considered expiration, but my removing logic also include other conditions beside date. BTW, when using OffHeap with ExpirePolicy, it seems have bugs about utilization too many memory. https://issues.apache.org/jira/browse/IGNITE-3840 and https://issues.apache.org/jira/browse/IGNITE-3948. I

Re: Re-partitioning when partition key changes

Affinity key is part of the configuration and can't be change in runtime. The only way to do this is to create another cache with new config and migrate the data. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Re-partitioning-when-partition-key-changes-tp1

RE: Questions on Client Reconnect and Client Cache

Hi Mani, Cache configuration will indeed be broadcasted - that's how cache start procedure currently works, it doesn't depend on cache mode. However, if cache mode is LOCAL, the data will be stored only the node where you created it. -Val -- View this message in context: http://apache-ignite-

Re: IgniteRDD doesn't return rows in the dataframe

Answered on SO: http://stackoverflow.com/questions/41612845/igniterdd-doesnt-return-rows-in-the-dataframe -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IgniteRDD-doesn-t-return-rows-in-the-dataframe-tp10058p10065.html Sent from the Apache Ignite Users mai

Re: Convert stream data

Well, you should've mentioned that you're using KafkaStreamer :) If so, then this was indeed fixed in IGNITE-4140, but as it's backward incompatible change, it will be available only in 2.0/ -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Convert-stream-dat

Re: How to remove large amount of data from cache

Yes, by batching I mean removeAll or IgniteDataStreamer. However, I would consider using expiration, I think it can really help you. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-remove-large-amount-of-data-from-cache-tp10024p10063.html Sent from t

Re: Amazon AWS EC2 settings

First of all, I would check that there are no memory issue under load. This (as message states) is likely to happen when one or more nodes suffer from long GC pauses. If this is not the case, I would set failure detection timeout to several seconds and then try several values to check which one wor

Q: Getting started with Spark under CDH integrated with Yarn

Hello, I have been trying to run a simple Spark app under CDH with Yarn, I set IGNITE_HOME path on all nodes, built app with jars needed and nodes seem to discover each other but when using shared RDDs in shared deployment I can't seem to retrieve all partitions. And most likely those are the part

Amazon AWS EC2 settings

We are running ignite on AWS EC2 instance. We are not using S3 based discovery but using zookeeper based discovery and it seems to work fine. While reading some of ignite documentation I came across this that suggests using "significantly greater than the default" value for socket timeout for EC2

Re: How to remove large amount of data from cache

Hi, It looks like you try to remove entries from single node. At first you collect SQL query result from all nodes and then perform delete operations. Also, you can try to run a job on grid that would remove local entries on each node. SqlFieldsQuery.setLocal(true) can be used to make query run

IgniteRDD doesn't return rows in the dataframe

I am performing an sql query on IgniteRDD. It is running ok for RDD transformation and actions but when I am Invoking an sql on the IgniteRDD, It won't return anything as result. Please refer to this stackOverflow post: stackoverflow

Re: Convert stream data

You can just wrap your IgniteDataStreamer instance, override addData() method and pass this wrapper instance to your streamer (I suspect it is KafkaStreamer). All conversions you can execute in overriden addData() method. On Thu, Jan 12, 2017 at 7:40 AM, rishi007bansod wrote: > So, you are sugges