Re: HashMap warning when using PutAll()

2020-06-12 Thread Evgenii Zhuravlev
Raymond, Collections used in putAll should be sorted, because otherwise if they have the same entries but in a different order, it can lead to the classic deadlock. It is expected behavior. Best Regards, Evgenii чт, 11 июн. 2020 г. в 21:38, Raymond Wilson : > We are using Ignite v2.8.0 and the

Re: HashMap warning when using PutAll()

2020-06-12 Thread Evgenii Zhuravlev
The same works for other operations too(like removeAll). Evgenii пт, 12 июн. 2020 г. в 07:22, Evgenii Zhuravlev : > Raymond, > > Collections used in putAll should be sorted, because otherwise if they > have the same entries but in a different order, it can lead to the classic >

Re: Using native persistence to "extend" memory

2020-06-16 Thread Evgenii Zhuravlev
Steve, Actually, disabling WAL is a good option for your use case. Checkpoint mechanism is the same with disabled WAL, the only difference is that node is not writing WAL to the disk on each operation. Usually, it might make sense to disable WAL for initial loading - when you can lose the data in

Re: Ignite persistence and activation

2020-06-16 Thread Evgenii Zhuravlev
Hi, All caches, including caches for atomic structures and in-memory caches, are not available before activation. I believe it makes sense to move your code for running after the activation event: https://apacheignite.readme.io/docs/baseline-topology#cluster-activationdeactivation-events . Evgeni

Re: How to fix Ignite node segmentation without restart

2020-06-17 Thread Evgenii Zhuravlev
>I do not want to restart it and I cannot do a failover because a network issue just happened and the stand-by may be invalid. The fix is to always restart the slave. You can enable CacheWriteSynchronizationMode.FULL_SYNC and there will be no differences between primary and backup partitions. In th

Re: What does all partition owners have left the grid on the client side mean?

2020-06-24 Thread Evgenii Zhuravlev
Hi, It means that there are no nodes in the cluster that holds certain partitions. So, probably you have a wrong configuration or some of the nodes left the cluster and you don't have backups in the cluster for these partitions. I believe more can be found from logs. Evgenii ср, 24 июн. 2020 г.

Re: What does all partition owners have left the grid on the client side mean?

2020-06-24 Thread Evgenii Zhuravlev
text.java:269) > at io.vertx.ext.web.client.impl.HttpContext.fire(HttpContext.java:279) > at > io.vertx.ext.web.client.impl.HttpContext.dispatchResponse(HttpContext.java:240) > at > io.vertx.ext.web.client.impl.HttpContext.lambda$null$2(HttpContext.java:370) > ... 7 common frames

Re: What does all partition owners have left the grid on the client side mean?

2020-06-24 Thread Evgenii Zhuravlev
John, right, didn't notice them before. Can you share the full log for the client node with an issue? Evgenii ср, 24 июн. 2020 г. в 12:29, John Smith : > I thought I did! The link doesn't have them? > > On Wed., Jun. 24, 2020, 2:43 p.m. Evgenii Zhuravlev, < > e.zhur

Re: What does all partition owners have left the grid on the client side mean?

2020-06-24 Thread Evgenii Zhuravlev
No, it's not. It's not clear when it happened and what was with the cluster and the client node itself at this moment. Evgenii ср, 24 июн. 2020 г. в 18:16, John Smith : > Ok I'll try... The stack trace isn't enough? > > On Wed., Jun. 24, 2020, 4:30 p.m. Evgen

Re: What does all partition owners have left the grid on the client side mean?

2020-06-25 Thread Evgenii Zhuravlev
Evgenii чт, 25 июн. 2020 г. в 07:36, John Smith : > Hi Evgenii, same folder shared stdout.copy > > Just in case: > https://www.dropbox.com/sh/ejcddp2gcml8qz2/AAD_VfUecE0hSNZX7wGbfDh3a?dl=0 > > On Wed, 24 Jun 2020 at 21:23, Evgenii Zhuravlev > wrote: > >> No, it

Re: What does all partition owners have left the grid on the client side mean?

2020-07-07 Thread Evgenii Zhuravlev
gt;>> Because in between it's all the business logs. Let me make sure I didn't >>> filter anything relevant. So maybe in those 13 hours nothing happened? >>> >>> >>> On Thu, 25 Jun 2020 at 10:53, Evgenii Zhuravlev < >>> e.zhuravlev...@gma

Re: How to do cache.get() on SQL table by primary key with multiple columns?

2020-07-14 Thread Evgenii Zhuravlev
Hi John, To do this, you need to create a key object with the same type as you have for the table. If you don't specify KEY_TYPE in the create table script, it will be generated automatically. I would recommend to specify it for the command(just type name, if you don't have a class) and, when you

Re: Ignite Native Persistence With write behind additional store

2020-07-14 Thread Evgenii Zhuravlev
Hi, There is no guarantee of data consistency between Ignite persistence and 3rd party DB in this case. Storages will be synchronized in case of one of the node failure. You can try to run some explicit checking for data consistency, but I believe it won't be easy with the load. Evgenii вт, 14 и

Re: How to do cache.get() on SQL table by primary key with multiple columns?

2020-07-14 Thread Evgenii Zhuravlev
hat class need to exist in the > class path of the server nodes? > > Like if I have > > class MyKeyClass { >Integer col1; >Integer col2; > } > > Does this class need to be loaded in all nodes or ignite can figure it out > and marshal it? > >

Re: Ignite Native Persistence With write behind additional store

2020-07-15 Thread Evgenii Zhuravlev
There is a typo in my previous message, I meant "Storages will be synchronized in case of one of the node failure." There is no reference for this type of configuration since there is no guarantee for the consistency. If you still want to use it, you can just combine configuration for persistence

Re: How to do cache.get() on SQL table by primary key with multiple columns?

2020-07-15 Thread Evgenii Zhuravlev
to > be in the classpath on all nodes? > > On Wed, 15 Jul 2020 at 10:43, John Smith wrote: > >> Ok I will try it... >> >> On Tue, 14 Jul 2020 at 22:34, Evgenii Zhuravlev >> wrote: >> >>> John, >>> >>> It's not necessary to

Re: How to do cache.get() on SQL table by primary key with multiple columns?

2020-07-15 Thread Evgenii Zhuravlev
, the 3rd event will wait until one of the event loops > can process the next event... > > > > On Wed., Jul. 15, 2020, 3:43 p.m. Evgenii Zhuravlev, < > e.zhuravlev...@gmail.com> wrote: > >> 1. This builder can be used for making one object, do you want to >> con

Re: Apache Ignite CacheRebalanceMode Is Not Respected By Nodes

2020-07-21 Thread Evgenii Zhuravlev
Hi, CacheRebalanceMode is responsible for a different thing - it starts to work when data need to be rebalanced due to topology(or baseline topology change). It's not responsible for data distribution between nodes for put operations. So, when you insert data, part of this data belongs to the part

Re: Ignite DefaultDataRegion config

2020-07-22 Thread Evgenii Zhuravlev
Hi, If you don't plan to use it at all, then yes, 40mb should be fine. Evgenii вт, 21 июл. 2020 г. в 22:17, kay : > Hello! > > What size should I give you for DefaultDataRegion? > Every cache has a specific Region(I'm not going to use defaultDataRegion) > > 40MB is enough? If will not use defaul

Re: java.lang.StackOverflowError when put a value on Ignite cache 2.7.6

2020-07-23 Thread Evgenii Zhuravlev
Hi, Did you find the object which caused this error? Can you share the reproducer with us? Thank you, Evgenii вт, 21 июл. 2020 г. в 23:15, abraham : > I am using Ignite 2.7.6 in a cluster of 2 servers with persistence > enabled. > > > > It is working fine but suddenly a java.lang.StackOverflow

Re: Checking dataregion limits

2020-07-23 Thread Evgenii Zhuravlev
Hi, >What is the best way to check for data region limits. *How about DataRegionMetricsMXBeanImpl.getMaxSize ?* 1. Why does max size not show what i exactly set. E.g. if i set the size as 20 mb (i.e. 20 * 1024 * 1024 = 20971520), but the value for OffHeapSize is 19922944. So why not exact? *I t

Re: custom ignite-log4j.xml when using stock docker ignite image

2020-07-23 Thread Evgenii Zhuravlev
Hi Maxim, Do you plan to use persistence or attach any disk for the work directory? If so, you can just put a configuration file there, and just use inside the ignite XML configuration file. Evgenii ср, 22 июл. 2020 г. в 08:13, Maxim Volkomorov <2201...@gmail.com>: > Hi! > > Is there a simple w

Re: Odd behavior/bug with DataRegion

2020-07-24 Thread Evgenii Zhuravlev
Hi, There is a couple of known issues related to the small data region. I saw this behavior before and you shouldn't see this issue for regions with bigger sizes. Also, if you have really big objects, you might need to change the emptyPagesPoolSize, to make sure that there are no objects bigger th

Re: Are CPU Metrics logged by Ignite correct?

2020-07-24 Thread Evgenii Zhuravlev
Hi, What OS and java version do you use? Evgenii пт, 24 июл. 2020 г. в 12:32, Mat : > Ignite is logging "strange" CPU metrics for me: > > Metrics for local node (to disable set 'metricsLogFrequency' to 0) > ^-- Node [id=c2a76580, name=embedded, uptime=00:01:00.153] > ^-- H/N/C [hosts=1,

Re: Are CPU Metrics logged by Ignite correct?

2020-07-28 Thread Evgenii Zhuravlev
Hi, It's a known issue related to the java11: https://issues.apache.org/jira/browse/IGNITE-13306 Evgenii пн, 27 июл. 2020 г. в 03:17, Mat : > Tested with Windows and Linux K8 containers all on Java 11. > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: Log file not found with Ignite 2.8.1

2020-07-31 Thread Evgenii Zhuravlev
Are you sure that this configuration file was applied? On the node start, it prints info about log to the System.out, so, I would recommend checking the console. Best Regards, Evgenii чт, 30 июл. 2020 г. в 05:51, manueltg89 : > Hi all! > > I have a Ignite app with version 2.8.1, I've followed th

Re: Question in Continuous Query Remote Filter

2020-07-31 Thread Evgenii Zhuravlev
Hi, You can just stop the CQ and then register it again if you don't want to get notifications for some period of time. Evgenii пт, 31 июл. 2020 г. в 01:51, Devakumar J : > Hi All, > > We have a setup of 2 servers and 1 client Node. Client node registers CQ on > set of caches. > > I just want t

Re: Question in Continuous Query Remote Filter

2020-08-03 Thread Evgenii Zhuravlev
I believe Java doc should be enough for that: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/cache/query/ContinuousQuery.html It says: To stop receiving updates call QueryCursor.close()

Re: ignite metrics - cache vs cachelocal

2020-08-03 Thread Evgenii Zhuravlev
Hi, Cache metrics contain information from all nodes in the cluster, while cache local metrics are related to the one(local) node only. Evgenii пн, 3 авг. 2020 г. в 15:43, scottmf : > hi, > In JMX with Ignite I see cache and cachelocal metrics. What's the > difference? Many of the metrics see

Re: Best first steps for performance tuning

2020-08-06 Thread Evgenii Zhuravlev
Hi Devin, Yes, you're right, the first step could be increasing the amount of offheap memory used for data(data region size). By default, Ignite uses 20% of available RAM. After that, I would recommend finding where the bottleneck is for your system - you can check CPU, disk and network to find i

Re: Is there a way for client to lazy join the cluster?

2020-08-06 Thread Evgenii Zhuravlev
It should be handled on your application side. For example, you can make initialization of Ignite instance in a separate thread and add a check on other API invocations that instance was initialized. Evgenii чт, 6 авг. 2020 г. в 09:03, John Smith : > I'm testing failover scenarios and currently

Re: build failure for module hibernate 5.3

2020-08-11 Thread Evgenii Zhuravlev
Hi, You can use it from this repository: https://gridgainsystems.com/nexus/content/repositories/external/org/gridgain/ignite-hibernate_5.3/ I believe there are no changes between these versions. Best Regards, Evgenii вт, 11 авг. 2020 г. в 10:53, Tathagata Roy : > I am trying to do a poc on usin

Re: I have an exception while trying to send the "evt=NODE_JOINED" message

2020-08-11 Thread Evgenii Zhuravlev
Hi, It looks like the node can't establish a connection using the Communication channel to the remote node. I would recommend checking that all ports are opened and there is no firewall. Also, you can check that connection can be established using telnet or any other tool. If you're sure, that con

Re: How can I find out if indexes are used in a query?

2020-08-11 Thread Evgenii Zhuravlev
Hi, EXPLAIN should show all the indexes. Are you sure that these indexes can be used for your query? You also can use USE INDEX hint to force the use of the index. Best Regards, Evgenii вт, 11 авг. 2020 г. в 16:22, Axel Luft : > EXPLIN PLAN doesn't show any indexes used although I created them.

Re: How can I find out if indexes are used in a query?

2020-08-12 Thread Evgenii Zhuravlev
Well, it uses index now: /* PUBLIC.IDX_CELL_ENODEB_ID: PERIOD_START_TIME < TIMESTAMP '2020-08-04 00:00:00'\nAND REGION_ID = 'NORTHEAST'\nAND PERIOD_START_TIME >= TIMESTAMP '2020-08-03 00:00:00'\n */ Is it better now, after using the hint for index? How much time was it taking

Re: I have an exception while trying to send the "evt=NODE_JOINED" message

2020-08-14 Thread Evgenii Zhuravlev
cfg.setPeerClassLoadingEnabled(true); >>> >>> cfg.setWorkDirectory("/tmp/"); >>> >>> TcpDiscoveryVmIpFinder ipFinder = new TcpDiscoveryVmIpFinder(); >>> >>> ipFinder.setAddresses(Arrays.asList("51.15.203.4

Re: Cache configuration

2020-08-17 Thread Evgenii Zhuravlev
Hi, You can add cache configuration to the xml file with the *(for example, cache-*) at the end. After this, caches with names that fit this template(cache-1 for template cache-*) will use it's cache configuration. Evgenii вс, 16 авг. 2020 г. в 07:03, C Ravikiran : > As for the below, I have t

Re: Cache Expiry policy not working..

2020-08-25 Thread Evgenii Zhuravlev
Well, in the code you've shared you're not waiting between puts and checks after that. I used this expiry policy for cache: FactoryBuilder.factoryOf(new CreatedExpiryPolicy(new Duration(SECONDS, 1 and added Thread.sleep(2000) before puts and gets in your code and ExpiryPolicy world for me witho

Re: Lag before records are visible after transaction commit

2020-08-25 Thread Evgenii Zhuravlev
Hi, It looks like you need to use https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/cache/CacheWriteSynchronizationMode.html, just set it to FULL_SYNC for the cache using CacheConfiguration. setWriteSynchronizationMode. Evgenii вт, 25 авг. 2020 г. в 02:27, ssansoy : > Hi, I am

Re: Cache Expiry policy not working..

2020-08-26 Thread Evgenii Zhuravlev
Hi, It looks like a little bit different problem then. As far as I see, the only issue here is related to the cache size, no to the get operations. It is a known issue: https://issues.apache.org/jira/browse/IGNITE-9474 Best Regards, Evgenii вт, 25 авг. 2020 г. в 21:22, kay : > Hello, There is a

Re: Hibernate 2nd Level query cache with Ignite

2020-08-26 Thread Evgenii Zhuravlev
Hi, Can you please share full logs from client and server nodes? Thanks, Evgenii ср, 26 авг. 2020 г. в 14:26, Tathagata Roy : > Hi, > > > > I am trying to do a POC on hibernate 2nd level cache with Apache Ignite. > With this configuration I was able to make it work > > > > *spring.jpa.propertie

Re: Cache Expiry policy not working..

2020-08-27 Thread Evgenii Zhuravlev
Hi, Please share the full maven project with a reproducer then. I wan't able to reproduce the same behaviour with a code you shared before. Evgenii чт, 27 авг. 2020 г. в 01:40, kay : > Hi I didn't notice a Cache Name > > cache name is NC_INITPGECONTRACT_CACHE > > Thank you. > > > > -- > Sent fro

Re: Ignite test takes several days

2020-08-27 Thread Evgenii Zhuravlev
Hi, No, it's not normal. Do you really want to run all the tests locally, or you just want to build the project? If you want just to build it, I suggest skipping tests by using -Dmaven.*test*.*skip*=true flag. Evgenii чт, 27 авг. 2020 г. в 06:33, Cong Guo : > Hi, > > I try to build the ignite-c

Re: Item not found, B+Tree is corrupted and critical error detected after add nodes to baseline topology

2020-08-27 Thread Evgenii Zhuravlev
Hi, Can you attach logs in normal format? It's really hard to read it. Also, please attach full logs from nodes, not only the stacktrace. Thanks, Evgenii вт, 25 авг. 2020 г. в 19:27, Steven Zheng : > Hi community, > Currently I have 25 nodes in my ignite cluster and all of them were added > int

Re: Hibernate 2nd Level query cache with Ignite

2020-08-28 Thread Evgenii Zhuravlev
uery cache with Ignite > > > > Thanks for responding @Evgenii > > > > Attaching the logs for both. There is no signification info in the ignite > server. In application logs all logs after line 6629 is when application > was able to reconnect with server after the server

Re: Item not found, B+Tree is corrupted and critical error detected after add nodes to baseline topology

2020-08-31 Thread Evgenii Zhuravlev
ogs. > Best Regards, > - > Steven Zheng > E-mail: closee...@gmail.com > > > Evgenii Zhuravlev 于2020年8月28日周五 上午6:45写道: > >> Hi, >> >> Can you attach logs in normal format? It's really hard to read it.

Re: Lag before records are visible after transaction commit

2020-09-01 Thread Evgenii Zhuravlev
Hi, Checked this reproducer. Continuous Query itself is not transactional and it looks like it can't be used for this at the moment. So, it gets notification before other entries were committed. Best Regards, Evgenii вт, 1 сент. 2020 г. в 00:34, ssansoy : > Hi is anyone able to help look into/r

Re: Lag before records are visible after transaction commit

2020-09-02 Thread Evgenii Zhuravlev
Hi, To make this work, you can change the transaction type - from READ_COMMITED to SERIALIZABLE and replace scanQuery with getAll. In this case, getAll operation will be waiting for locked keys. Note that running cache operations in CQ listener thread may cause deadlock and it's better to use anot

Re: Lag before records are visible after transaction commit

2020-09-03 Thread Evgenii Zhuravlev
Yes, it is expected that ScanQuery and ContinuousQuery are not transactional. >Getting all the records will pull everything back onto the and we would have to filter locally if I am understanding correctly? There is no need to get all entries from the cache, you can get entries with certain keys.

Re: Ignite test takes several days

2020-09-03 Thread Evgenii Zhuravlev
nfiguration issue. Do I need any special > configuration for the ignite core test? Thank you. > > > On Thu, Aug 27, 2020 at 9:53 AM Evgenii Zhuravlev < > e.zhuravlev...@gmail.com> wrote: > >> Hi, >> >> No, it's not normal. Do you really want to run all th

Re: Lag before records are visible after transaction commit

2020-09-04 Thread Evgenii Zhuravlev
You can put the number of entries in B cache related to this object A right in the object A. After that, you can use this number to make keys of all objects from cache B, as you already know q and r. But it depends on use case. Evgenii пт, 4 сент. 2020 г. в 03:21, ssansoy : > Thanks Evgenii, > >

Re: Lag before records are visible after transaction commit

2020-09-09 Thread Evgenii Zhuravlev
Yes, but if you know the number of entries B for this object A, then you can get all objects using s, which will be 0..n Evgenii пн, 7 сент. 2020 г. в 06:38, ssansoy : > Thanks Evgenii, > > Sorry to keep revisiting this - maybe I am misunderstanding, but don't we > also need 's' to be able to qu

Re: Lag before records are visible after transaction commit

2020-09-14 Thread Evgenii Zhuravlev
No, I don't see other ways to do this transactionally, as CQ itself is not transactional. Evgenii чт, 10 сент. 2020 г. в 00:52, ssansoy : > unfortunately the 's' on B here can't be derived from a number 0..n - e.g. > it > isn't a numeric id. > > E.g. in practice lets say: > > A is a "Location" >

Re: Lag before records are visible after transaction commit

2020-09-15 Thread Evgenii Zhuravlev
ards, > -- > Ilya Kasnacheev > > > пн, 14 сент. 2020 г. в 21:15, Evgenii Zhuravlev >: > >> No, I don't see other ways to do this transactionally, as CQ itself is >> not transactional. >> >> Evgenii >> >> чт, 10 сент. 2020 г. в 00:52, ssansoy

Re: Apache ignite statefulsets pods abruptly restarts

2020-09-21 Thread Evgenii Zhuravlev
There is no such thing as "on heap cache only.". It's possible to enable an additional cache level in heap, but it still will be storing all data in the off heap. So, right now you need at least 10.25+8gb+ Checkpoint buffer size for your Ignite node. Evgenii пн, 21 сент. 2020 г. в 09:29, Sanjaya

Re: Ignite communicating with non ignite servers

2020-09-21 Thread Evgenii Zhuravlev
Hi, What security scan tool do you use? Evgenii пн, 21 сент. 2020 г. в 09:03, ignite_user2016 : > Recently, we migrated ignite to JDK11, all works well except when we run > our > security scan, ignite node tries to connect on that servers and result in > out of memory and heap dump errors. > >

Re: Eviction policy enablement leads to ignite cluster blocking, it does not use pages from freelist

2020-10-05 Thread Evgenii Zhuravlev
Hi Prasad, What operations do you run on the cluster? What is the size of objects? Is it possible to share full logs from nodes? Do you have some kind of small reproducer for this issue? It would be really helpful. Thanks, Evgenii пн, 5 окт. 2020 г. в 07:53, Prasad Pillala : > Hi, > > > > evict

Re: L2-cache slow/not working as intended

2020-11-06 Thread Evgenii Zhuravlev
Hi, How many nodes do you have? Can you check the same scenario with one node only? How do you run queries? Is client on the same machine as a server node? I would recommend enabling DEBUG logs for org.apache.ignite.cache.hibernate package. DEBUG logs can show all get and put operations for hiber

Re: Ignite 2.8.1: Database Closed error

2020-11-19 Thread Evgenii Zhuravlev
Hi, I don't think it's related to the discovery. In the log, before OOM you can see the long JVM pause: Possible too long JVM pause: 2323 milliseconds. So, probably you used more heap memory than you had. What version do you use? How much heap memory do you have? What do you do with a cluster(S

Re: Ignite communicating with non ignite servers

2020-11-23 Thread Evgenii Zhuravlev
Hi, Can you please tell what scan were you running? I want to reproduce this issue using tenable.sc. Thank you, Evgenii вт, 22 сент. 2020 г. в 06:55, Ilya Kasnacheev : > Hello! > > I don't think it should cause heap dumps. Here you are showing just a > warning. This warning may be ignored. > >

Re: Query on Ignite Visor usage

2020-12-08 Thread Evgenii Zhuravlev
Hi, I don't think that it's related to the commands that you run from Visor, it's more about the way Visor connects to the cluster. Internally, it starts a daemon node, which basically has the same discovery and communication mechanisms as other nodes. So, other nodes will try to communicate with

Re: SQLLine: Insert into for complex object not working

2019-04-02 Thread Evgenii Zhuravlev
Hi, Looks like you're trying to insert the entry with the same key as before. SQL INSERT command doesn't allow to do that(in all DBs). Looks like you need to use UPDATE or UPSERT commands Evgenii вт, 2 апр. 2019 г. в 10:43, ashishb888 : > I have a cache, with complex key (3 fields). I am able g

Re: write behind not working for RDBMS

2019-04-02 Thread Evgenii Zhuravlev
Hi, writeThrough property enables cache store integration overall, while writeBehindEnabled property controls whether store updates are async or not. So this is correct behavior. Evgenii вт, 2 апр. 2019 г. в 00:24, himanshu : > Hi, > > I am using ignite 2.7.0, when I am trying to test write thr

Re: critical thread has been detected

2019-04-25 Thread Evgenii Zhuravlev
Could you share logs from client nodes? I believe we can find more useful information there. Also, could you share a full log file, not a console output? Or, alternatively, you can run Ignite with -DIGNITE_QUIET=false to enable INFO logging for console output. Evgenii чт, 25 апр. 2019 г. в 00:19,

Re: Failover in thin client mode

2019-04-25 Thread Evgenii Zhuravlev
Hi, I believe that this paragraph describes what you want to see: Updating partition mapping It is important for client to keep partition mapping updated. To ensure this, the following changes are proposed: 1. Changes in Standard Message Response header. It is proposed to add flag to every

Re: Older client connections to Ignite blocking new clients

2019-04-26 Thread Evgenii Zhuravlev
Hi, Could you provide logs from all the nodes, including servers and clients? Evgenii пт, 26 апр. 2019 г. в 11:04, mahesh76private : > Hi, > > We are experiencing a strange issue on ignite 2.7 for a few months now. > > we have 4 ignite clients (say GROUP1) connected to a ignite cluster > native

Re: Ignite DataStreamer Memory Problems

2019-04-30 Thread Evgenii Zhuravlev
Hi, Lucene indexes are stored in the heap, while I see that in reproducer you've limited heap size to 1gb. Are you sure that you used these JVM opts? Can you please share logs from your run, so I can check the heap usage? Best Regards, Evgenii вт, 30 апр. 2019 г. в 00:23, kellan : > The issue s

Re: Issues with Clients joining cluster on Kubernetes (EKS)

2019-05-01 Thread Evgenii Zhuravlev
Hi, I see this warning in the logs: Local node's value of 'java.net.preferIPv4Stack' system property differs from remote node's (all nodes in topology should have identical value) [locPreferIpV4=true, rmtPreferIpV4=null, locId8=20c2dc57, rmtId8=699d2d8c, rmtAddrs=[ignite-jwp-0.ignite.ignite-jwp.s

Re: sizing

2019-05-01 Thread Evgenii Zhuravlev
Hi, What do you mean here? Do you mean binary fields VS varchars? Could you please give an example of the object? Thank you, Evgenii вт, 30 апр. 2019 г. в 12:27, Clay Teahouse : > Hi All > If I choose binary data type for my objects, as opposed to varchar, will > it result in any saving, and ye

Re: Transactions from Python

2019-05-02 Thread Evgenii Zhuravlev
Hi Stéphane Community is working on this functionality at the moment, here you can find design document and discussion regarding this feature: https://cwiki.apache.org/confluence/display/IGNITE/IEP-34+Thin+client%3A+transactions+support Alternatively, you can start to use ODBC from python, now SQ

Re: How data region is propagated to other nodes

2019-05-02 Thread Evgenii Zhuravlev
Hi, No, Data region configuration won't be propagated to other nodes in the cluster. DataRegion is only a local configuration, so, you have to configure it on each node. Moreover, these the same data region on different nodes can have different maxSize, which could be useful in case of using NodeF

Re: How data region is propagated to other nodes

2019-05-03 Thread Evgenii Zhuravlev
Then you can simply create 2 different data regions for all server nodes in the cluster - one with persistence and one without. After that, you can decide, how you want to store your key - with persistence or without. Evgenii пт, 3 мая 2019 г. в 08:27, dhiman_nikhil : > As per documentation, I c

Re: Creating off-heap REPLICATED cache with Eviction policies borks the cluster.

2019-05-03 Thread Evgenii Zhuravlev
Hi I believe that you can just remove folder related to the newly created cache, have you tried to do this? Evgenii чт, 2 мая 2019 г. в 23:15, John Smith : > Hi running 2.7.0, > > I have a 4 node cluster running with off-heap persistence works great! > > I then by mistake tried to create a REPL

Re: How data region is propagated to other nodes

2019-05-03 Thread Evgenii Zhuravlev
Data regions can't be created dynamically, because it's needed to preallocate memory. I believe that in your use case you can just create it statically on cluster start, is there a problem with that? Evgenii пт, 3 мая 2019 г. в 12:54, dhiman_nikhil : > Can I create data regions on All Servers dy

Re: Creating off-heap REPLICATED cache with Eviction policies borks the cluster.

2019-05-03 Thread Evgenii Zhuravlev
Yes, I tried to do this and it works. Just delete folder work/db/node-NODEID/CACHE_NAME. Also, I created a ticket for adding validation for this situation: https://issues.apache.org/jira/browse/IGNITE-11832 Evgenii пт, 3 мая 2019 г. в 13:39, Evgenii Zhuravlev : > Hi > > I believe tha

Re: Issues with Clients joining cluster on Kubernetes (EKS)

2019-05-03 Thread Evgenii Zhuravlev
Why there is no lines in the server log between these two: [17:10:48,827][INFO][sys-#149][GridCachePartitionExchangeManager] Sending Full Message for AffinityTopologyVersion [topVer=10, minorTopVer=1] performed in 1 ms. [19:39:58,910][INFO][disco-event-worker-#62][GridDiscoveryManager] Added new n

Re: Failed to archive WAL segment

2019-05-03 Thread Evgenii Zhuravlev
Hi, How many folders you have in /opt/ignite/wal/ ? Is there a chance that you have there 2 folders with different node IDs? Can you share your configuration? Thanks, Evgenii пн, 29 апр. 2019 г. в 11:17, shivakumar : > HI all, > > I have 7 node ignite cluster running on kubernetes platform, eac

Re: Issues with Clients joining cluster on Kubernetes (EKS)

2019-05-03 Thread Evgenii Zhuravlev
Yes, I know that users have deployments in kubernetes and they don't have any issues with that. Did you follow this instruction: https://apacheignite.readme.io/docs/kubernetes-deployment ? Please make sure that ports for Discovery and Communication are open in this environment. Evgenii пт, 3 мая

Re: [data-streamer-stripe-2-#35][] Critical system error detected.

2019-05-07 Thread Evgenii Zhuravlev
Hi, Here is the documentation regarding this message: https://apacheignite.readme.io/v2.7/docs/jvm-and-system-tuning#section-file-descriptors Evgenii вт, 7 мая 2019 г. в 12:09, yangjiajun <1371549...@qq.com>: > thread_dump.rar >

Re: cache.destroy() vs cache.close()

2019-06-10 Thread Evgenii Zhuravlev
Hi, Cache.destroy() completely removes caches from all the nodes in the cluster, while Cache.close() just closes the local proxy for the cache. So, yes, data will be lost in case of invoking destroy from the client node. Evgenii пн, 10 июн. 2019 г. в 19:23, foobar2 : > Hello. I am using Ignite

Re: Ignite Nodes Go Down - org.apache.spark.rpc.RpcTimeoutException: Futures timed out after [10 seconds]. This timeout is controlled by spark.executor.heartbeatInterval

2019-06-13 Thread Evgenii Zhuravlev
Hi, > we have noticed that Ignite nodes are not responding in the heart beat interval time and hence the re-balancing of data is happening and followed by query cancellation. It looks like a long GC pauses for me. Can you share full logs from all the nodes? As the fast workaround, I can suggest i

Re: Ignite Rest API is not working

2019-06-14 Thread Evgenii Zhuravlev
There is a chance that port 8080 was busy and it was bound to the next port. I'd recommend checking Ignite logs to make sure that rest was started and check the port. Evgenii пт, 14 июн. 2019 г. в 19:47, Kishan : > I want to use REST API provided by ignite. > > I have downloaded the ignite binar

Re: too many dirty pages

2019-06-24 Thread Evgenii Zhuravlev
Hi, It's not a warning, it's just an INFO message about writing checkpoint to the disk. The reason for this checkpoint was that there were "too many dirty pages". Here is how Ignite persistence works: https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Persistent+Store+-+under+the+hood Best

Re: Server Nodes Stopped Unexpectedly

2019-07-23 Thread Evgenii Zhuravlev
Hi, Can you please share full logs from the node start from all nodes in the cluster? Thanks, Evgenii вт, 23 июл. 2019 г. в 16:51, Akash Shinde : > I am using Ignite 2.6 version. I have created a cluster of 7 server nodes > and three client nodes. Out of seven nodes five nodes stopped unexpect

Re: Server Nodes Stopped Unexpectedly

2019-07-26 Thread Evgenii Zhuravlev
t; > On Wed, Jul 24, 2019 at 12:04 PM Akash Shinde > wrote: > >> Hi, >> Please find attached logs from all server and client nodes.Also attached >> gc logs for each node. >> >> Thanks, >> Akash >> >> >> On Tue, Jul 23, 2019 at 8:59 PM Evge

Re: Server Nodes Stopped Unexpectedly

2019-07-29 Thread Evgenii Zhuravlev
ssue happens. > But in this case multiple JVMs were terminated.Can it be a bug in Ignite > 2.6 version? > > Thanks, > Akash > > On Fri, Jul 26, 2019 at 4:00 PM Evgenii Zhuravlev < > e.zhuravlev...@gmail.com> wrote: > >> I don't see any specific error

Re: exceptions in Ignite node when a thin client process ends

2019-08-01 Thread Evgenii Zhuravlev
Hi, This message is absolutely unharmful, however, I agree that server node shouldn't print this exception since nothing wrong happened there. I've created a ticket in Jira for fixing this behavior: https://issues.apache.org/jira/browse/IGNITE-12032 Evgenii чт, 1 авг. 2019 г. в 09:33, Matan Lev

Re: Rebalancing only to backups

2019-08-15 Thread Evgenii Zhuravlev
Hi Abhishek, That's how it works now if you have enabled Persistence. Actually, that's the main reason why BaselineTopology was introduced - we don't want to move a lot of data between nodes if we know that node will return soon after a failure: https://apacheignite.readme.io/docs/baseline-topolog

Re: Server Nodes Stopped Unexpectedly

2019-08-29 Thread Evgenii Zhuravlev
est any tool? > > 4) I understand that node gets segmented because of long GC pause or > network connectivity. Is my understanding correct? > > 5) What is the purpose of networkTimeout configuration? In my case it is > set to 1 . > > Regards, > Akash > > On Mon, Jul 29,

Re: distributed sql join not working as mentioned in documentation

2019-09-23 Thread Evgenii Zhuravlev
Hi, To make work this query, you can add one where clause or join condition in the query, for example: where c.id = city_id;. I don't really understand why do you want to run a fully distributed cross join on these tables - it doesn't make sense, moreover, it will lead to the a lot of data movemen

Re: Ignite bulk data load issue

2019-09-24 Thread Evgenii Zhuravlev
Hi, Looks like you can have really slow disks. What kind of disk do you have there? I see throttling in logs, Because the write operation is really slow. Evgenii пн, 23 сент. 2019 г. в 13:07, Muhammed Favas < favas.muham...@expeedsoftware.com>: > Hi, > > > > I need help to figure out the issues

Re: Huge number of .classname files

2019-09-24 Thread Evgenii Zhuravlev
Hi, These files are mainly used for reconnection purposes, so after it client node have everything needed. You can clear it if you want, it shouldn't affect the node. Evgenii вт, 24 сент. 2019 г. в 14:53, BOUCHRIT Abderrahmane : > Hi All, > I have an Ignite 2.6.0 cluster and my application is

Re: Ignite bulk data load issue

2019-09-25 Thread Evgenii Zhuravlev
each node > > > > > > *Regards,* > > *Favas * > > > > *From:* Evgenii Zhuravlev > *Sent:* Tuesday, September 24, 2019 12:44 PM > *To:* user@ignite.apache.org > *Subject:* Re: Ignite bulk data load issue > > > > Hi, > > > > Looks

Re: Map Reduce over cache items, where values are sequences

2019-10-01 Thread Evgenii Zhuravlev
Hi, To parallelise everything properly, I would recommend starting an affinityCallable per partition(1024 by default). Inside this compute job, you can collect information for the certain partition only using ScanQuery(or SQLQuery) пт, 27 сент. 2019 г. в 18:09, Stas Girkin : > Hello everyone, >

Re: Map Reduce over cache items, where values are sequences

2019-10-01 Thread Evgenii Zhuravlev
For example, query with partition will look like : QueryCursor> qry = cache.query(new ScanQuery().setPartition(part)); вт, 1 окт. 2019 г. в 15:25, Evgenii Zhuravlev : > Hi, > > To parallelise everything properly, I would recommend starting an > affinityCallable per pa

Re: ClassCastException retrieving cached object

2019-10-07 Thread Evgenii Zhuravlev
Hi, Peer class loading doesn't work with model classes, more information regarding use cases for peerClassLoading can be found here: https://www.gridgain.com/docs/latest/developers-guide/peer-class-loading Evgenii вс, 6 окт. 2019 г. в 04:09, niamin : > Working with Ignite 2.7.6 using spring co

Re: Query Parallelism through SQL

2019-10-17 Thread Evgenii Zhuravlev
Hi, When you create table using DDL, you can choose template with a cache configuration(CREATE TABLE WITH TEMPLATE): https://www.gridgain.com/docs/latest/sql-reference/ddl#create-table Inside template you can define query parallelism Evgenii чт, 17 окт. 2019 г. в 09:11, Kurt Semba : >

Re: Ignite singel instance

2019-11-02 Thread Evgenii Zhuravlev
Hi, Do you use only one ODBC client? Can you start one more ODBC client and check the performance? Thanks, Evgenii сб, 2 нояб. 2019 г. в 16:47, Siew Wai Yow : > Hi, > > We are doing POC on ignite performance using ODBC driver but the > performance is always capped at around 1700 TPS which is to

Re: Improving Get operation performance

2019-11-27 Thread Evgenii Zhuravlev
Hi Viktor, It looks like you're running 3 server nodes on the same physical machine, right? How do you run Cassandra benchmarks? Do you use the same 2 machines? How many Cassandra instances do you have? Also, how much memory do you have on this machine? Best Regards, Evgenii ср, 27 нояб. 2019 г

Re: Improving Get operation performance

2019-11-27 Thread Evgenii Zhuravlev
Victor, Then, I would recommend to check if you have a swapping enabled in OS. If you have only 75gb on the machine and you started 3 nodes with 14 gb off heap and something like a 16gb heap each, probably OS started a swapping process, which will affect a performance. Additionally, there is no n

  1   2   3   4   5   6   >