Re: OutOfMemoryError while streaming

2018-07-02 Thread Denis Mekhanikov
How many entries did you put into a cache? How do you check, that nodes have entries? Did you configure a node filter for the cache? Rendezvous affinity function may give unfair distribution on small datasets, but it gets better, when number of entries grows. So, if you've only put 5-10 entries, t

Re: OutOfMemoryError while streaming

2018-07-01 Thread breischl
The keys are hashed so in theory they should be distributed relatively evenly. I traced the logic to do the hashing once and it seemed ok, but it's pretty complicated so I won't claim to know it that well. We use UUIDs and it does seem to distribute pretty much evenly. Are you sure all the nodes

Re: OutOfMemoryError while streaming

2018-06-29 Thread smovva
Thanks again. I have one more question. After pushing some data, I see only two nodes having entries out of 8. All the others have 0 entries. My keys are 9 char long strings with a common prefix (all have the same first 3 chars). Wondering why the keys are not evenly distributed. -- Sent fro

Re: OutOfMemoryError while streaming

2018-06-29 Thread breischl
Non-heap memory is different than off-heap memory. Non-heap is (roughly speaking) memory that the JVM itself uses. Off-heap is what Ignite is using for storage off the heap. So you're probably not looking at what you think you're looking at. -- Sent from: http://apache-ignite-users.70518.x6.nab

Re: OutOfMemoryError while streaming

2018-06-29 Thread smovva
breischl, Thanks for the quick response. I'm not sure why the node stats show Non-heap memory maximum | 744mb Each server node has 32GB and I've assigned 3g for heap. Shouldn't this be 16GB since that's what I set the data region size to? -

Re: OutOfMemoryError while streaming

2018-06-29 Thread breischl
You're probably just running out of memory, though if you examine the stacktrace it may tell you if you're running out of heap or off-heap memory. If there's a call to Unsafe.something() in there, it's probably off-heap. Otherwise it's probably on-heap. You do seem to be configuring only a 3 GB h

OutOfMemoryError while streaming

2018-06-29 Thread smovva
I'm seeing OutOfMemoryError when I have multiple data streamers pushing data into the cluster. My cluster consists of 8 servers running one node each. Each server has 32GB RAM and 4 Cores. All the nodes are started like this = bin/ignite.sh -J-Xmx3g config/dev-cluster-config.xml ===