Re: Failed to accept TCP connection. java.net.SocketException: Too many open files

Hi, I am running 2 ignite nodes, each one having on different machine but Ignite might need some more file handles for the .wal files etc hence you see more number of file handles required. I am repeating my original questions , 1.In my case it creates so many bin files of ~1MB. If it i

Re: Initial query resent the data when client got reconnect

Voted. Appreciated and looking for it. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ComputeTask is including Nodes for ComputeJobs prematurely

Hi Denis, You are correct. Thank you! Affinity is not affected by IgniteCompute. My mistake. I get a hold of an IgniteCompute _before_ the Affinity is applied. So. It seems that a “dynamic cluster group based on a predicate” will work beautifully!! I can simply add my gating function there. I kn

Re: Cache size changes unexpectedly

Hi Denis, We are using CacheMetrics.getKeySize api to get size of a cache. Does this api give cache size of entire cache or just the size of the partitions local to the node? -Biren From: Denis Mekhanikov Reply-To: "user@ignite.apache.org" Date: Wednesday, November 22, 2017 at 8:13 AM To: "u

Re: Getting "BinaryObjectException: Failed to deserialize object" while trying to execute the application using multi node

Try to replace lambda with a static class. Most likely it currently serializes objects that you do not expect to be serialized, like KafkaFileConsumer and its fields. With a static class you will be able to make sure that only required data is included. -Val -- Sent from: http://apache-ignite-u

Re: Unable to query system cache through Visor console

Krzystof, It will be more correct to add missing metrics that will provide this information. Feel free to propose the new metrics in this discussion: http://apache-ignite-developers.2346864.n4.nabble.com/Ignite-Enhancement-Proposal-6-Metrics-td24192.html

Re: Unable to query system cache through Visor console

Thanks for your response Denis. My uses case would be to list all Ignite semaphores and Ignite atomic references used in my Ignite grid. As fare as I know, those are stored in system caches. Thanks Krzysztof -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to accept TCP connection. java.net.SocketException: Too many open files

Hello, As I mentioned above, Ignite Native Persistence creates a dedicated file on the file system for every partition that this node is either a primary or backup. Well, I guess that you are running two Ignite nodes on the same physical machine. The replicated cache has 512 partitions by default

Getting "BinaryObjectException: Failed to deserialize object" while trying to execute the application using multi node

Hi, I am getting an exception while we are trying to check how it working on ignite remote node (same physical server). This application is working fine when we are running it on local node. tried all possible way to fix it still not getting why we are getting this exception. Please help me to f

Re: Register Contentious query quit slow

Re: Initial query resent the data when client got reconnect

There's a ticket for this feature: https://issues.apache.org/jira/browse/IGNITE-5625 please vote for it and at some point, it will be implemented. 2017-11-21 13:52 GMT+03:00 gunman524 : > Mike, double checked Mongodb way, their ObjectID only provide a unique ID, > sorry for my info. But there i

Re: IgniteInterruptedException: Node is stopping

Hi Hyma, Could you please show a code snippet where it is hanged? Thanks, Mike. 2017-11-22 12:48 GMT+03:00 Hyma : > Thanks Mikhail. > > I suspected to increase the spark heartbeat/network timeout. But my > question > here is if an executor is lost, corresponding ignite node also gets out of > c

Re: Logging query on server node sent from client node

Hi, I don't think that you run ignite with proper configuration, because the snippet that you sent won't work. EventType.EVTS_CACHE_QUERY is array and you should have the folllowin exception on logs: Caused by: org.springframework.beans.TypeMismatchException: Failed to convert property value of ty

Re: Cache size changes unexpectedly

Hi Brien! I tried to run a cluster with a cache configured like you described, but everything works fine. Could you provide more information about this issue? A project with a reproducer will be ideal. Are you sure that you measure size correctly? Denis ср, 22 нояб. 2017 г. в 1:28, Biren Shah :

Re: Unable to query system cache through Visor console

Hi Krzysztof! It's even problematic to get an instance of system cache over Java API, not even from Visor CLI. Internal system information is stored there, so it's hidden from users. And Visor cannot access it as well, because it uses public API. Why would you want to do something like that? Coul

Re: ComputeTask is including Nodes for ComputeJobs prematurely

> Would you stop Ignite & start it again?? Yes, I meant that. You can't tell Ignite not to take compute tasks, you can only configure compute tasks not to be executed on certain nodes. So, the first run will be to read configuration, the second one - to execute tasks and do everything else. To avoi

Re: Register Contentious query quit slow

> I wondered why connecting so many port, as my configuration is like You see remote ports, that are opened on remote nodes to establish a client connection. They are chosen by the OS arbitrary and may differ from the ones you specified in config. > Does the "Class locally deployed" means load cla

Re: ComputeTask is including Nodes for ComputeJobs prematurely

Hi Denis, Thank you very much for responding. I’m unclear what you meant by “start Ignite twice”?? I don’t really understand how that scenario would work. Would you stop Ignite & start it again?? And, if so, wouldn’t that cause a whole new “rebalancing” to occur?? Is there a “soft restart” that I

Unable to query system cache through Visor console

Hi, is there a way to query system caches like *ignite-sys-atomic-cache* via Visor console? If I'm trying to execute Visor command "cache -scan -c=@c2" where @2 is a cache's id, I'm receiving this error: *(wrn) : Failed to get cache because it is a system cache: ignite-sys-atomic-cache@default-ds-

Re: WAL size control

Hi David! WAL is a ring buffer on the filesystem. Each file in it is called a "segment". By default each segment occupies 64 MB on disk (*walSegmentSize* property), and there are 10 such files in the buffer (*walSegments* property). So, WAL for

RE: Node unable to join cluster

Hi Denis, After adding the localAddress in TcpDiscoverySpi, the node is still not starting. It fails with the below log messages 2017-11-22 11:25:36 [localhost-startStop-1] DEBUG TcpDiscoverySpi:452 - Handshake response from local node: TcpDiscoveryHandshakeResponse [order=0, super=TcpDiscove

Re: IgniteInterruptedException: Node is stopping

Thanks Mikhail. I suspected to increase the spark heartbeat/network timeout. But my question here is if an executor is lost, corresponding ignite node also gets out of cluster. In that case, ignite takes care of re balancing between the other active nodes right. My spark job was not killed and it

Re: Register Contentious query quit slow

2 After I copied jar file to Ignite libs and start my app, the log on server side shows: [2017-11-22T08:14:17,585][INFO ][tcp-disco-msg-worker-#3][GridDeploymentLocalStore] Class locally deployed: class org.apache.ignite.configuration.CacheConfiguration$IgniteAllNodesPredicate [2017-11-22T08:14:17

Re: Only one node has a high number of SystemExecutor CompletedTask

Hi as you already noted, ignite cluster has a special node - coordinator, the oldest node in a cluster is coordinator node: ignite.cluster().forServers().forOldest().node() In case of creation/destroying a cache, coordinator needs to coordinate this process and notify each node about cache crea

Re: Unable to read all the entries in present single cache using Streamer

As Alexey said, DataStreamer is for loading data *to* Ignite. So, If you want to get data *from *Ignite, you may choose to use IgniteCache#iterator() method. But note, that this method is not transactional, so

Re: Transport compression (not store compression)

Forwarding to DEV list: Ignite developers, could you please share your thoughts on how hard it is to extend Ignite to compress data on the network. On Wed, Nov 22, 2017 at 10:04 AM, Gordon Reid (Nine Mile) < gordon.r...@ninemilefinancial.com> wrote: > Hi Igniters, > > > > I see there is a lot of

Re: Unable to read all the entries in present single cache using Streamer

Hi, You must use IgniteDataStreamer#addData(key, value) to stream data into Ignite. What you did when you attached a receiver would make the data streamer execute the receiver on the nodes in co-located mode (that is the receiver logic will be called on the node where the receiver's input data is

Re: Failed to accept TCP connection. java.net.SocketException: Too many open files

Hi, I am still getting "Too many open files" issue even after increasing the limit to ~32K. Following is my ignite configuration: I am running 2 nodes in cluster configured with REPLICATION mode and FULL_SYNC. I have populated ingnite with around ~30 different caches (Requirement to have close to