Re: How to add a new node to an existing cluster which Ignite native persistence is enabled?

You can change the baseline topology ( https://apacheignite.readme.io/docs/baseline-topology) either via control.sh or GridGain web console. For example, you will see something like this after running "control.sh --baseline": Cluster state: active Current topology version: 5 Baseline nodes: Co

Re: deep learning over apache ignite

I have another question? As you know dl4j execute over spark. When we want to integrate dl4j with ignite is it meaningful? For acceleration execution we can do below idea 1. We can using ignite as cache storage and preparing data for processing on dl4j. 2. Job on spark can spawn hirarchy job for ac

How to add a new node to an existing cluster which Ignite native persistence is enabled?

Hi Team, I am testing Ignite on version 2.7.0. I used Ignite native persistence and cache mode is PARTITIONED. I found there’s no data was stored in the node which joined the cluster after the cluster is already active，even though I deactivate the cluster and activate it again. I have to delete th

Re: Ignite startu is very slow

Hi Evgenii, Thank you very much for your help. it is reduced to 5 mins now. I believe, we should have some documentation on partition count as per the data size. Currently Ignite is showing my native persistence size around 800 MB, so can I still decrease the partition count to improve the startu

Failed to map keys for cache (all partition nodes left the grid)

Hi Team, I have 3 node server mode cluster setup with Cache mode Partitioned with 1 backup. We are receiving above error as soon as 2 nodes left from cluster. All 3 nodes are on baselinetopology. Collection baselineNodes = ignite.cluster().currentBaselineTopology(); if(!Collectio

Re: Question about cpu usage and disk read speed on activation stage.

Hello. Please see the logs and the configuration.Thanks. example-default.xml ignite-b3234010.rar aealexsandrov wrote > Hi, > >

Ignite in container enviroments?

Hi, from what I have tried and read it seems that you need host network for docker to run Ignite and overlay networks cause issues... I'm using DC/OS and I can technically maybe try the mesos deployment, but not sure how new or old that framework is. #1 the docs indicate to use: libs\optional\ign

Re: Optimizing Collocated Join

I haven't increased parallelism yet, but that's not a solution to my problem. I was able to speed up the query by running a ComputeTask that distributes work to the nodes in my cluster based on affinity key parentS2CellId, and the runs this local query for each matching parentS2CellId, s2CellId:

Re: Dealing with changing class definitions in Ignite

Hello! I have found that you can avoid compute job type incompatibility problem (please see history below) by setting .setMarshaller(new OptimizedMarshaller()) in your Ignite configuration on all nodes. However, it is not clear at all why this is needed. Anybody can help? Why co

RE: I encountered a problem when restarting ignite

Hi, Sending a SIGQUIT signal forces VM to print a thread dump to its stdout: kill -3 Stan From: Justin Ji Sent: 13 декабря 2018 г. 5:20 To: user@ignite.apache.org Subject: Re: I encountered a problem when restarting ignite Akurbanov - Thank for your reply! I have tried to dump the thread

RE: Effective way to pre-load data around 10 TB

The problem might be in HDD not performing fast enough, and also suffering from random reads (IgniteCache::preloadPartition at least tries to read sequentially). Also, do you have enough RAM to store all data? If not, you shouldn’t preload all the data, just the amount that fits into RAM. Anywa

Re: Optimizing Collocated Join

Hello! The main document for query optimization is https://apacheignite-sql.readme.io/docs/performance-and-debugging For example, have you tried increasing queryParallelism on your caches? Regards, -- Ilya Kasnacheev вт, 18 дек. 2018 г. в 20:53, kellan : > Hi, I'm not sure how I could make t

RE: Question about add new nodes to ignite cluster.

Well, in short - it does, don’t worry about it :) Unfortunately I’m not aware of a proper design document explaining the process in detail. But simply put, Ignite will wait for the new node to obtain all of the data it needs to store. While that’s happening, the node doesn’t serve any requests.

RE: Failed to read data from remote connection

“OOME: Direct buffer memory” means that MaxDirectMemorySize is too small. Set a larger MaxDirectMemorySize value. Stan From: wangsan Sent: 18 декабря 2018 г. 5:08 To: user@ignite.apache.org Subject: Re: Failed to read data from remote connection Now the cluster have 100+ nodes, when 'Start check

RE: Did anyone write custom Affinity function?

You could write a custom affinity function, and some people do, but as far as I can see you don’t need it. You just chose a poor affinity key. You need to have MANY affinity keys, much more than there are partitions, and have MANY partitions, much more than nodes. That will make sure that the de

How Ignite transfer cached data between nodes in the cluster

I am trying to understand the logic and find the source code on how Ignite retrieves cached data if the data is cached on different node in the cluster. As an example, say the cluster has 3 node which are A, B & C. Data retrieval request sent from node A, and data is cached on node C. I found that

Re: Register listeners before joining the cluster

Hi, Yes, I understand. You also can contribute this new event to Ignite: 1)Create the Jira issue - https://issues.apache.org/jira 2)Prepare the patch in a separate branch named ignite-X (where X is a number of JIRA ticket) 3)Create the pull request in GitHub to master branch - https://git

Re: Scoped vs Singleton ignite client node in .net web api

Replied on StackOverflow https://stackoverflow.com/questions/53842387/scoped-vs-singleton-ignite-client-node-in-net-web-api/ In short, use Singleton, because "Thick" client is heavy and thread-safe. On Wed, Dec 19, 2018 at 5:28 PM aealexsandrov wrote: > Hi, > > Generally, you should have a work

Re: Register listeners before joining the cluster

Hi, the suggestion to use BEFORE_NODE_START doesn't work, I'm getting org.apache.ignite.IgniteCheckedException: Grid is in invalid state to perform this operation. It either not started yet or has already being or have stopped [igniteInstanceName=Ignite IDKit Server, state=STARTING] I got it worki

Re: Scoped vs Singleton ignite client node in .net web api

Hi, Generally, you should have a working Ignite cluster somewhere that will store and process your requests. I am not sure that you really require the client node in your case. It will use additional memory and CPU. You can use several ways to work with Ignite cluster without fat client node: 1

Re: IgniteCheckedException when write and read made by different clients

Hi, I don't think so. However, you can try to use Integer instead of Enum values and proceeds it accordingly (It will require the changes in configuration) What is the reason why you can't move the class to correct package? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.c

Re: Question about cpu usage and disk read speed on activation stage.

Hi, Could you share you Ignite node configuration and logs from startup? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Register listeners before joining the cluster

Hi, Depends on what you are going to archive: In case if you are going to just collect some information then you can use: https://apacheignite.readme.io/docs/ignite-life-cycle BEFORE_NODE_START Invoked before Ignite node startup routine is initiated. In case if you are going to make some des

Register listeners before joining the cluster

Hi, is there a way to register local listeners before a node joins the cluster? The documentation says to register local listeners through "ignite.events().localListen(...)", however that can only be done once e.g. "ignite = Ignition.start(cfg)" has been called. At that point the node might have a

Re: Can i use SQL query and Cache Operations in same transaction (JTA)

Hi Hyungbai, Please be aware that MVCC is included into Ignite release as kind of experimental feature as stated in release notes [1]. I do not know plans for providing releases with MVCC fixes. But perhaps you can try nightly builds [2] once the related ticket [3] is resolved. And I believe that

Re: Copying My Service classes to the lib folder of already started nodes (not via visor)

Thank you very much for the replies. Regards Zaheer -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Copying My Service classes to the lib folder of already started nodes (not via visor)

Thank you very much for the replies Denis and Ilya Regards Zaheer -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to benchmark IgniteDataStreamer?

Hello! You will need to benchmark batches, of course. IgniteDataStreamer has flush() which is synchronous. Regards, -- Ilya Kasnacheev ср, 19 дек. 2018 г. в 09:33, ashishb008 : > Hello, > > IgniteDataStreamer is async, so how will you find the exact time? > > > > > -- > Sent from: http://apac

Re: Ignite native persistence and replicated caches - should it even be possible?

Ilya, thank you very much for your response! Kamil Mišúth On 2018-12-17 15:13, Ilya Kasnacheev wrote: Hello! I'm not completely sure but persistent REPLICATED cache is the same as PARTITIONED with MAXINT backups. It means that every node will have a copy of data, but it has to be in BLT to be

Re: deep learning over apache ignite

Yes, in TensorFlow on Apache Ignite we support distributed learning as you described it (please see details in this documentation ). Speaking about performance, TensorFlow supports distributed learning itself (please see details here