Re: Data lose in query

2017-12-11 Thread Vladislav Pyatkov
Hi, When you use JOIN, you should to enable DistributedJoins flag[1], or tack care about collocated of each joined entry[2]. [1]: org.apache.ignite.cache.query.SqlFieldsQuery#setDistributedJoins [2]: https://apacheignite.readme.io/docs On Mon, Dec 11, 2017 at 11:36 AM, Ahmad Al-Masry wrote: >

Access Cache Deployed from a server node where Cache is not deployed

2017-12-11 Thread Harshil garg
I am trying to access a cache from server Node A where cache is not deployed. My Ignite cache is deployed in another server Node B. While doing so ,* I am getting an illegalStateException when I am trying to access a cache deployed in server node B from server Node A.* Is it an ignite bug ?? I e

Access Cache Deployed from a server node where Cache is not deployed !!

2017-12-11 Thread harshilbits
I am trying to access a cache from server Node A where cache is not deployed. My Ignite cache is deployed in another server Node B. While doing so , I am getting an illegalStateException when I am trying to access a cache deployed in server node B from server Node A. Is it an ignite bug ?? I exp

Re: IgniteDataStreamer

2017-12-11 Thread Alexey Kukushkin
You can access a cache created with DDL (CREATE TABLE) from Java API including IgniteDataStreamer API by prepending "SQL_PUBLIC_" to the capitalised table name. For example, if you created a table as "create table person ... " then you can access if from Java API as ignite.dataStreamer("SQL_PUBLIC_

Re: Access Cache Deployed from a server node where Cache is not deployed !!

2017-12-11 Thread Alexey Kukushkin
Can you please provide more info: - Full error info copied from the log including stack trace - What do you mean by "access a cache" - can you share your code and specify which line throws the exception?

Re: "HandshakeException: Remote node ID is not as expected" occurs when tested with 1000 clients

2017-12-11 Thread yonggu.lee
After applying related pull request (https://github.com/apache/ignite/pull/1814), the exception disappeared. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: "HandshakeException: Remote node ID is not as expected" occurs when tested with 1000 clients

2017-12-11 Thread Evgenii Zhuravlev
It's not the best solution for this problem, that's why this PR was not merged yet. Evgenii 2017-12-11 12:33 GMT+03:00 yonggu.lee : > After applying related pull request > (https://github.com/apache/ignite/pull/1814), the exception disappeared. > > > > -- > Sent from: http://apache-ignite-users.

Re: Ignite behaving strange with Spark SharedRDD in AWS EMR Yarn Client Mode

2017-12-11 Thread Nikolai Tikhonov
Hi @raksja! Was your problem resolved? Otherwise can you provide detailed steps for reproducing this behaviour? On Thu, Nov 30, 2017 at 4:17 AM, vkulichenko wrote: > I don't think raksja had an issue with only one record in the RDD. > IgniteRDD#count redirects directly to IgniteCache#size, so

Re: Data lose in query

2017-12-11 Thread Ahmad Al-Masry
Hi; When I enabled the distributed JOIN, get the following Exception: java.sql.SQLException: javax.cache.CacheException: Failed to prepare distributed join query: join condition does not use index [joinedCache=PositionTypeCache Should I remove the indexes before doing distributed joins? BR > O

Re: Data lose in query

2017-12-11 Thread Nikolai Tikhonov
Hi, Strongly recommend to care about collocation of your data (as above suggested by Vlad) instead of enable DistributedJoins flag. The performance of this type of joins is worse then the performance of the affinity collocation based joins due to the fact that there will be much more network round

Memory foot print of the ignite node

2017-12-11 Thread Naveen
Hi Am using 2.3 Formed a cluster with 3 nodes I have loaded 2 caches,named - Customer and Account with 10 millions rows. One of the node logs, I could see the below lines [17:42:14,092][INFO][grid-timeout-worker-#23%IgnitePOC%][IgniteKernal%IgnitePOC] Metrics for local node (to disable set 'm

Count mismatch for a cache between ignitevisor & Sqlline

2017-12-11 Thread Naveen
Hi AM using 2.3 Loaded 2 caches - Customer & Account with 10 million rows. You can see the same from the below snippet, 2.5M avg * 4 -> 10M visor> cache -e Time of the snapshot: 12/11/17, 17:57:11 +=

Re: Affinity - Join query on the collocated data taking 90 seconds

2017-12-11 Thread Naveen
Hi Attached the java code I am using. IgnitePOC-project.zip Here the data load class - DataLoadAffinity. Config XML is - IgnitePOC-client.xml Please let me know if you need anything further Thanks Naveen

Re: Data lose in query

2017-12-11 Thread Ahmad Al-Masry
How can I enable this on the server configuration XML? BR > On Dec 11, 2017, at 2:31 PM, Nikolai Tikhonov wrote: > > Hi, > > Strongly recommend to care about collocation of your data (as above suggested > by Vlad) instead of enable DistributedJoins flag. The performance of this > type of join

Re: Data lose in query

2017-12-11 Thread Nikolai Tikhonov
It depends from your data model and can't be enabled via one property. Please, look at the following documentation pages: https://apacheignite.readme.io/docs/affinity-collocation https://apacheignite-sql.readme.io/docs/distributed-joins#collocated-joins On Mon, Dec 11, 2017 at 4:02 PM, Ahmad Al-M

Re: What happens if there is no disk space for Ignite persistent store

2017-12-11 Thread ilya.kasnacheev
Hello! When out of disk space, node should stop. Thus it would not be able to process any data or handle any requests. You should be able to bring this node back online if you increase available disk space and activate the cluster properly. So it's the former but more severe - it will throw excep

Re: Redis problem with values > 8kb

2017-12-11 Thread Alexey Popov
Thanks, Wolfram. Good to know you have not blocked by this issue. Anyway, the issue is identified and will be fixed in the next release. Thanks, Alexey -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite use case

2017-12-11 Thread Steven van der Merwe
Hi All I am new to Ignite and I am trying to understand if Ignite will fit my use case (I hope so). It seems to have all of the aspects I am looking for. I am trying to do the following: - I am building up a realtime analytics / business dashboard based on a whole lot of metrics and messag

Re: Access Cache Deployed from a server node where Cache is not deployed

2017-12-11 Thread Andrey Mashenkov
Hi Harshil, What do you mean cache is deployed in another node? Would you please attach log with full stacktrace and an example code if possible? On Mon, Dec 11, 2017 at 11:46 AM, Harshil garg wrote: > I am trying to access a cache from server Node A where cache is not > deployed. > My Ignite c

Ignite Cache Data Not Available in Other Server Nodes

2017-12-11 Thread Harshil garg
I am trying to access ignite cache data from other nodes , I am able to access the ignite cache but cache is completely empty and hence throwing nullpointerException when I am trying to do cache.get(key). I have tried using both REPLICATED and PARTITONED MODE for workflowRunState Cache. Here is t

Re: Query Execution Error when changing the cache from PARTITIONED to REPLICATED

2017-12-11 Thread Nikolai Tikhonov
Hello, I see in attached files the following "Caused by: java.lang.OutOfMemoryError: Java heap space" error. It means that one node can't handle whole resultset of this query. You need to increase JVM heap size (via -Xmx/-Xms vm properties) or add node in cluster. Look at the following doc pages:

Re: Ignite Cache Data Not Available in Other Server Nodes

2017-12-11 Thread Nikolai Tikhonov
Hello! It looks weird for me. You should see the same data set from all nodes of cluster. I think you or remove data from other nodes or performe an operations under another cache. Can you share simple maven project which reproduces the problem? On Mon, Dec 11, 2017 at 5:22 PM, Harshil garg wrot

Cache store class not found exception

2017-12-11 Thread Mikael
Hi! I have a cache in a server node that is using a custom cache store for a JDBC database, when I connect a client node (running inside a Payara/Glassfish web application) to that server node I get a: class org.apache.ignite.IgniteCheckedException: Failed to find class with given class load

Re: Cache store class not found exception

2017-12-11 Thread Naveen Kumar
Please make sure class is on the server Ignite's CLASSPATH. OR You can just deploy the JAR to $IGNITE_HOME/libs/user direcgtory This should resolve On Mon, Dec 11, 2017 at 8:52 PM, Mikael wrote: > Hi! > > I have a cache in a server node that is using a custom cache store for a > JDBC database,

Re: Cache store class not found exception

2017-12-11 Thread Nikolai Tikhonov
Hello! Apache Ignite requires that CacheStore classes should be in classpath on client nodes. Look at thread with the same question: http://apache-ignite-users.70518.x6.nabble.com/Cache-store-class-not-found-exception-td18842.html On Mon, Dec 11, 2017 at 6:28 PM, Naveen Kumar wrote: > Please

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-11 Thread svonn
Hi, Thanks alot for the insight! I got a few questions left: 1. Currently I'm developing in my local IDEA IDE, starting ignite in client mode - How would is deployment supposed to work for live environment? Do you still start a client node with 'instructions' for the cluster? 2. I've been readi

Re: How to do 'stream processing' and more questions of a Ignite newbie

2017-12-11 Thread svonn
Hi, Thanks a lot for the insight! I got a few questions left: 1. Currently, I'm developing in my local IDEA IDE, starting ignite in client mode - How would is deployment supposed to work for live environment? Do you still start a client node with 'instructions' for the cluster? 2. I've been rea

Re: IgniteDataStreamer

2017-12-11 Thread Denis Magda
Just in case you can set a meaningful cache name using CACHE_NAME property of CREATE TABLE command: https://apacheignite-sql.readme.io/docs/create-table — Denis > On Dec 11, 2017, at 1:12 AM, Alexey Kukushkin > wrote: > > You can access

Re: Memory foot print of the ignite node

2017-12-11 Thread Denis Magda
Hi, Java heap is used for operational needs to store temporary objects generated by both Ignite and your application in runtime. 8GB off-heap is a maximum size. Ignite doesn’t allocate the whole region entirely and rather allocates it by chunks whenever more space is needed. Once this ticket i

Re: Ignite use case

2017-12-11 Thread Denis Magda
Hello Steve, Your use case perfectly well fits Ignite’s capabilities. Please see inline for the rest. > On Dec 11, 2017, at 6:00 AM, Steven van der Merwe > wrote: > > Hi All > > I am new to Ignite and I am trying to understand if Ignite will fit my use > case (I hope so). It seems to have a

Re: Ignite use case

2017-12-11 Thread Steven van der Merwe
Brilliant - Thanks for the pointers Dennis Regards Steve On 11 December 2017 at 19:43:37, Denis Magda (dma...@apache.org) wrote: Hello Steve, Your use case perfectly well fits Ignite’s capabilities. Please see inline for the rest. On Dec 11, 2017, at 6:00 AM, Steven van der Merwe < stevevan

Re:Re: Re: Re: Re: Re: Re: Re: Re:Poor performance select query with jdbc thin mode

2017-12-11 Thread Lucky
Denis, Thanks very much! All data are related ,and there are about 60G data in the heap. And if I add other business module ,the data also are related.We can not split them. So If data is collocated, then a single node is enough. But it's not high availability.

Can Ignite me used for everyday processes, storage, reading, writing, etc. together with SQL

2017-12-11 Thread Rick Alexander
Can Ignite me used for everyday processes, storage, reading, writing, etc. together with SQL? We're having a situation where the queries on Ignite are much, much slower than on SQL. Has anyone gone from an SQL environment to Ignite before? Our goals are to speed up and scale our current and futu

Re: Can Ignite me used for everyday processes, storage, reading, writing, etc. together with SQL

2017-12-11 Thread Alexey Kuznetsov
Hi, Rick Could you describe how many are you running Ignite cluster? How many nodes? On how many hosts? Some virtual OS or bare metal? On Tue, Dec 12, 2017 at 12:46 PM, Rick Alexander wrote: > Can Ignite me used for everyday processes, storage, reading, writing, etc. > together with SQL? > > W

Re: Can Ignite me used for everyday processes, storage, reading, writing, etc. together with SQL

2017-12-11 Thread Rick Alexander
No clusters setup yet, 1 node, 1 host, running on a VM. On Tue, Dec 12, 2017 at 2:09 AM, Alexey Kuznetsov wrote: > Hi, Rick > > Could you describe how many are you running Ignite cluster? > How many nodes? On how many hosts? Some virtual OS or bare metal? > > > On Tue, Dec 12, 2017 at 12:46 PM