Re: YCSB Benchmark

Thanks for your reply. I was comparing to the results published here: https://www.gridgain.com/resources/blog/apacher-ignitetm-and-apacher-cassandratm-benchmarks-power-in-memory-computing I run the benchmark on very powered machine with 72 cpu and 500G RAM. I used 32 threads. On Tue, Sep 18, 2

Re: YCSB Benchmark

Hi! What results are you using for comparison? Please provide URL. There are plenty of factors which affects performance. Hardware, number of server and client nodes, Ignite memory mode, replication factor (number of backups), number of benchmarking threads, data amount (record count) -- just to m

Re: Performance of SQL query by partial primary key

To answer my own question here, basically the index created on PK now is useless according to this ticket. https://issues.apache.org/jira/browse/IGNITE-8386 Ignite will perform a whole table scan when trying to execute the SQL query I posted above unless an index identical to PK is created manuall

RE: Failed to get page IO instance (page content is corrupted) after onenode failed when trying to reboot.

Hi Stan, Thanks for the reply. 10.29.42.49 is a client node trying to connect to cluster to write data. Don't know why the log shows it's not a client node. Anyway, can you help take a look why restart 2-4 didn't work? In restart 2-4 theres no server trying to join cluster as server nodes. Than

How to start an Ignite cluster with fixed number of servers?

Let's say I want to start an Ignite cluster of three server nodes with fixed IP address and prevent other servers joining cluster as Ignite server nodes, how can I do that? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Error while loading data to cache

Hi, The error is clear, you try to cast BinaryObject to Customer type. It can happen if you use CacheJdbcPojoStoreFactory for example. In this case, you can use BinaryObject.field: int id = ((BinaryObject)value).field("id"); return id == 11; According to your filter, cachestore will fetc

Re: Do I need CacheStoreFactory class and hibernate configuration on Remote Node?

Hello, > Do I need CacheStoreFactory class and hibernate configuration on Remote Node? Yes, CacheStore classes must be in the classpath on all nodes (including the client nodes) For example, you can put them to '$IGNITE_HOME/libs' folder (a subfolder can be created for convenience as well). > Not

Do I need CacheStoreFactory class and hibernate configuration on Remote Node?

Simply hibernate example: One node contains HibernateCacheStore and other configuration (hibernate.cfg.xml vs...) I have created that node and read database and write to cache (It works as it is) (cache name is "hibernateCache") Now I have created another node which has default configuration. The

Re: WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read(most probably....)

I think you are right, when I killed some jar process on the systems, then it does not give errors -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Ignite Cluster: Cache Misses happening for existing keys

With your idea of that race condition, we decided to lock the get, and put for a given key on app level, and keep using the JCache API. So far for 250 tps with 3 nodes, everything looks good. Thank you very much! From: Вячеслав Коптилин [mailto:slava.kopti...@gmail.com] Sent: Thursday, Septembe

Error while loading data to cache

I am trying to load data to cache using below code and seeing an error. ignite.cache("CustomerCache").loadCache(new IgniteBiPredicate() { @Override public boolean apply(Object key, Object value) { if(((Cus

Re: Unreasonable segmentation in Kubernetes on one node reboot

Hi, Can you share the full logs from all nodes? Looks like everything should work just fine. Maxim. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Failed to get page IO instance (page content is corrupted) after onenode failed when trying to reboot.

I see a node in the topology flacking up and down every minute in the restart1.log: TcpDiscoveryNode [id=d6e52510-3380-4258-8a8e-798640b1786c, addrs=[10.29.42.49, 127.0.0.1], sockAddrs=[/10.29.42.49:47500, /127.0.0.1:47500], discPort=47500, order=596, intOrder=302, lastExchangeTime=153715439345

Re: Message grid failure due to userVersion setting

I probably did not explain this clearly. When sending a message from server to client using the message grid, from a context unrelated to any client call, the server, as you would expect uses its installed libraries, and userVersion 0.For some reason, when the client receives this message, it

Re: Loading Cache

Tried below code, but code is not complaining in IDE..Keep seeing error message asking to change the method loadcache() to method localloadCache(). When changed to method localloadcache(), asking to change method to loadCache(). ignite.cache("CustomerCache").loadCache(new IgniteBiPred

Re: WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read(most probably....)

It's possible that you have some application that listens to 47504 port and doesn't read anything from the socket. I'd recommend checking which application bound to this port. Evgenii пн, 17 сент. 2018 г. в 17:02, monstereo : > Most the time, it happens when starting the first ignite node > > I

Re: Using compute().call from a Service has P2P class loading feature?

Hi, Are you sure that you use proper service? I mean from the client node. I've just checked this case and everything works fine. Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL query and Indexes architecture

Hello! I recommend starting with H2TreeIndex class. Maybe dropping mails on developer list with precise questions. Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 16:25, eugene miretsky : > Thanks! > > I am curious about the process of loading data from Ignite to H2 on the > fly, as H2 cre

Re: Message grid failure due to userVersion setting

Hello! I think that Ignite cannot unload old version of code, unless it is loaded with something like URI deployment module. Version checking is there but server can't get rid of old code if it's on classpath. Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 16:47, Dave Harvey : > We have a

RE: IGNITE-8386 question (composite pKeys)

Hi, The thing is that the PK index is currently created roughly as CREATE INDEX T(_key) and not CREATE INDEX T(customer_id, date). You can’t use the _key column in the WHERE clause directly, so the query optimizer can’t use the index. After the IGNITE-8386 is fixed the index will be cre

Re: WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read(most probably....)

Most the time, it happens when starting the first ignite node I can not share logs at this time. But simply it prints that warning forever. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Message grid failure due to userVersion setting

We have a client that uses the compute grid and message grid, as well as the discovery API. It communicates with a server plugin. The cluster is configured for CONTINUOUS peer class loading. In order to force the proper code to be loaded for the compute tasks, we change the user version, e.g.,

YCSB Benchmark

Hi, I have followed the instructions written in the README page here: https://github.com/brianfra... I used the following configuration: IgniteClient (

Re: Handling split brain with Zookeeper and persistence

Hello Eugene, 1) Split brain resolver takes into account only server nodes (not client). No difference between in-memory only or with persistence. 2) It's no necessary to immediately remove a node from baseline topology after split-brain. If you lost backup factor for some partitions (All partitio

Re: SQL query and Indexes architecture

Thanks! I am curious about the process of loading data from Ignite to H2 on the fly, as H2 creating indexes but storing them in Ignite. Can you point me to some JIRAs that discuss it, or which part of the code is responsible for that? On Mon, Sep 17, 2018 at 9:18 AM Ilya Kasnacheev wrote: > Hel

Re: SQL query and Indexes architecture

Hello! 1. 1. H2 executes the query, during which it has to load rows from tables, and Ignite does the row loading part. Then Ignite will collect query results on all nodes and aggregate them on a single node. 1. 2. Index is created by H2, but it is stored in Ignite pages (?). 2. Maybe you're right

Re: Query 3x slower with index

Hello! Why don't you diff the results of those two queries, tell us what the difference is? Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 16:08, eugene miretsky : > Hello, > > Just wanted to see if anybody had time to look into this. > > Cheers, > Eugene > > On Wed, Sep 12, 2018 at 6:29

Re: Backup failover with persistence

Hello! 1. A thing called "late affinity assignment" will happen. 2. Before "late affinity assignment" happens Node A is not primary. Once it happens, Node A is primary. Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 16:07, eugene miretsky : > Thanks Ilya, > > >1. "So all nodes will kn

Re: Query 3x slower with index

Hello, Just wanted to see if anybody had time to look into this. Cheers, Eugene On Wed, Sep 12, 2018 at 6:29 PM eugene miretsky wrote: > Thanks! > > Tried joining with an inlined table instead of IN as per the second > suggestion, and it didn't quite work. > > Query1: > >- Select COUNT(*)

Re: Backup failover with persistence

Thanks Ilya, 1. "So all nodes will know when node A begins hosting that partition as primary" - how is that consensus achieved? Will it result in partition map exchange and new topology version? 2. What I actually meant is that it is impossible to know when Node A is fully caught u

Re: SQL query and Indexes architecture

Thanks! 1. 1. "Ignite feeds H2 rows that it asks for, and H2 creates indexes on them and executes queries on them." - what exactly do you mean by that? Do you mean that all parts of a query that use indexes are executed by H2, then the actual data is retrieved from Ignite

Re: Backup failover with persistence

Hello! Apache Ignite is NOT "eventually consistent" if you ask that. Apache Ignite is strongly consistent. It has discovery ring (or discovery star with Zk) which allows messages to be sent and acknowledged by all nodes. So all nodes will know when node A begins hosting that partition as primary.

Re: Huge Query order by PK causes OOMKilled

Hello! Have you tried setting lazy=true for this query? Ignite has couple of ways to do SQL, but each of those allows you to set lazy=true. If this does not help, please try to add explicit SQL index on the field that you're doing ORDER BY on. Regards, -- Ilya Kasnacheev пт, 14 сент. 2018 г.

Re: Backup failover with persistence

How is "finish syncing" defined? Since it is a distributed system that is no way to guarantee that node A is 100% caught up to node B. In Kafka there is a replica.lag.time.max.ms settings, is there something similar in Ignite? On Mon, Sep 17, 2018 at 8:37 AM Ilya Kasnacheev wrote: > Hello! > >

Re: rmdbs integration readthrough - Ownership flag not set for binary property. Have you set 'keyFields' property of QueryEntity in programmatic or XML configuration?

Hello! You have "fields" list in your QueryEntity, but not "keyFields". I suggest you add them. Regards, -- Ilya Kasnacheev сб, 15 сент. 2018 г. в 18:50, wt : > i have setup rmdbs integration with read-through > > if i query an empty cache it should read-through from the underlying system > b

Re: Java maven Application

Hello! You need to add ignite-core-VERSION.jar to classpath to be able to use Ignite JDBC driver. If it's not enough, provide driver class as `org.apache.ignite.IgniteJdbcThinDriver' Regards, -- Ilya Kasnacheev пн, 17 сент. 2018 г. в 10:17, Malashree : > how to connect to the ignite database

Re: Backup failover with persistence

Hello! Node A will have two choices: either drop partition completely and re-download it from B, or replicate recent changes on it. Either one will be choosed internally. Node A will only become primary again when it finishes syncing that partition. Regards, -- Ilya Kasnacheev пт, 14 сент. 201

Re: SQL query and Indexes architecture

Hello! 1. H2 does not store data but, as far as my understanding goes, it created SQL indexes from data. Ignite feeds H2 rows that it asks for, and H2 creates indexes on them and executes queries on them. 2. Ignite always has special index on your key (since it's a key-value storage it can always

Re: WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read(most probably....)

Hi, Do you have connectivity between nodes? Have you checked that all nodes are reachable and there are no long GC pauses? Can you share the full logs from all nodes? Evgenii -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: multiple tables in same cache - is it possible

Hello! Yes, this is possible, for example, by specifying multiple key-value type pairs in setIndexedTypes(). For every pair, a table of VALUETYPECLASSNAME will be created. The requirements will be that key and value types should not intersect between those tables. Regards, -- Ilya Kasnacheev

Re: .NET java thread count keeps growing

Hello! You seem to have 3000 threads of form "Thread-", which is not what Ignite usually uses, and they're all empty. This is mysterious so I urge you to share the sample reproducer (or, barring that, code snippet) that leads to such behavior. By the way, do you observe any errors in the log?

Failed to get page IO instance (page content is corrupted) after one node failed when trying to reboot.

I have a three nodes Ignite 2.6.0 cluster with native persistence enabled. Here's the config http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.

WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read(most probably....)

2018-09-17 10:51:00 WARN TcpDiscoverySpi:135 - Timed out waiting for message to be read (most probably, the reason is long GC pauses on remote node) [curTimeout=1, rmtAddr=/127.0.0.1:47504, rmtPort=47504] this warning is printing out on the screen, and my ignite node can not start. How do i s

Re: ignite - what ports should be open on a linux machine

Hi, In default configuration Ignite will use next ports: Major: TCP 47500 - 47600 discovery TCP 47100 - 47200 communication Optional: TCP 11211 connect by internal http protocol TCP 49128 jmx connection TCP 48100 - 48200 if using shared memory TCP 10800 - 10900 connection ports (odbc/jdbc) UDP

Java maven Application

how to connect to the ignite database using java maven web application using jdbc driver. For this i am getting error that No suitable driver found for jdbc:ignite:thin://127.0.0.1/ Please help me resolving these issues. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to write Trigger Script

Hi, There are continuous queries in Ignite fir such purpose: https://apacheignite.readme.io/docs/continuous-queries Evgenii пн, 17 сент. 2018 г. в 9:22, Malashree : > How to write Trigger Script for Apache Ignite which is similar to MYSQL > Trigger Script. > > > > -- > Sent from: http://apache-

Re: How to connect to the Rest API

Hi, Here is a doc: https://apacheignite.readme.io/docs/rest-api#section-getting-started Evgenii пн, 17 сент. 2018 г. в 10:04, Malashree : > How to connect to the Rest API using Ignite Database. > > http://localhost:8080/ignite?cmd=version > This command is not working,i am getting error like >

How to connect to the Rest API

How to connect to the Rest API using Ignite Database. http://localhost:8080/ignite?cmd=version This command is not working,i am getting error like HTTP Status 404-/ignite -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/