Re: ignite web agent issue

2020-06-12 Thread Denis Magda
Hello, The community made a decision to stop supporting Ignite Web Console and will deprecate it eventually. It’s better to look for alternatives such as GridGain Web Console or GridGain Control Center. Denis On Thursday, June 11, 2020, itsmeravikiran.c wrote: > Could you please let me know, w

Re: Ignite concepts

2020-06-12 Thread Denis Magda
by not using the try and > autoclose with the igniteClient I can control when the igniteClient > object is closed and therefore use it for all 3 Cache checks. > > Regards Eugene > > On Thu, Jun 11, 2020 at 10:57 PM Denis Magda wrote: > >> Eugene, >> >> In

Re: [CVE-2020-1963] Apache Ignite access to file system disclosure vulnerability

2020-06-15 Thread Denis Magda
This is an official update to the "Credit" section of the vulnerability announcement. Credit: The vulnerability was initially discovered by Jinny Ramsmark of Defensify and further reported to the Ignite community by Sriveena Mattaparth of Ekaplus" Denis Magda, On behalf of Apache

Re: Apache Ignite with Spring framework

2020-06-16 Thread Denis Magda
It depends on what you assume under a spring bean. If that's an entity of a Spring framework such as Controller, Repository or Entity, then you don't need to register anything with Ignite. Use those Spring annotations throughout your application and have your Controllers & Repositories access an I

Re: IgniteSpringBean IgniteCheckedException

2020-06-16 Thread Denis Magda
It looks like you copied this configuration template from this documentation file: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/IgniteSpringBean.html It assumes that an Ignite instance will be started separately and then passed into this configuration file via "mySpringBean"

Re: Using native persistence to "extend" memory

2020-06-16 Thread Denis Magda
Hi Steve, I think that you can get a performance hit for your write operations by disabling the WAL. It serves two purposes in Ignite. The first is the recovery while the second is fast disk writes. The WAL is an append-only structure and Ignite can persist changes to disk really quick. If the WAL

Re: Using native persistence to "extend" memory

2020-06-16 Thread Denis Magda
Steve, Please check these generic recommendations if you haven't done so already: https://apacheignite.readme.io/docs/durable-memory-tuning#native-persistence-related-tuning Otherwise, send us a note if you come across any bottlenecks or issues so that we can give you more specific recommendation

Re: Using native persistence to "extend" memory

2020-06-16 Thread Denis Magda
can just disable it: > https://www.gridgain.com/docs/latest/developers-guide/persistence/native-persistence#disabling-wal > > Best Regards, > Evgenii > > > > вт, 16 июн. 2020 г. в 17:02, Denis Magda : > >> Steve, >> >> Please check these generic recommendations

Re: sqlline

2020-06-17 Thread Denis Magda
Hi, You need to pass the required parameters to the JDBC driver's connection URL: https://apacheignite-sql.readme.io/docs/jdbc-driver#parameters However, I'm not quite sure what you mean under the "collocation" in the following context. All your data needs to be co-located beforehand (ensure you

Re: sqlline

2020-06-17 Thread Denis Magda
r query the data > via SQL line. > > thanks > > On Wed, Jun 17, 2020 at 11:39 AM Denis Magda wrote: > >> Hi, >> >> You need to pass the required parameters to the JDBC driver's connection >> URL: >> https://apacheignite-sql.readme.io/docs/jdbc-d

Re: sqlline

2020-06-17 Thread Denis Magda
e for JDBC url > is for? > Should I assume that if the table is defined with affinity set, then > compute collocation, including sql execution will happen automatically? > I am sorry if this is just a basic question. > > On Wed, Jun 17, 2020 at 12:57 PM Denis Magda wrote: > >>

Re: sqlline

2020-06-17 Thread Denis Magda
gnite know which node to run the SQL query on? I assume > the SQL is parsed on the server nodes, and I will still need to direct the > SQL to be executed on the right server node (assuming that all the data is > collocated on a single node). Am I right? > > On Wed, Jun 17, 2020

Re: sqlline

2020-06-17 Thread Denis Magda
the sql as part of >> the logic)? >> >> On Wed, Jun 17, 2020 at 7:02 PM Denis Magda wrote: >> >>> Narges, >>> >>> INSERTS/UPDATES/DELETES will be forwarded to primary nodes based on the >>> value of primary keys you pass into quer

Re: Best practices for WalArchive when using EFS

2020-06-17 Thread Denis Magda
Raymond, I agree with you that the existence of the WAL should be more than enough to ensure data consistency. The documentation suggests that the archives help to speed up the rebalancing procedures (refer to the Pros and Cons of WAL Archiving callout): https://apacheignite.readme.io/docs/write-

Re: Atomic Sequence/Auto Increment via IgniteClient - Thin Client - Ignite 2.8.1

2020-06-17 Thread Denis Magda
Hi Manesh, Thin clients don't support this API yet. As a workaround, see if you can implement a custom SQL function [1] and call it from an INSERT statement issued by the thin client - "INSERT INTO table(id, name, age) VALUES (generateIdFunction(), 'Mark', 40)". I haven't tried this approach and

Re: sqlline

2020-06-18 Thread Denis Magda
Yes, that’s right. On Thursday, June 18, 2020, narges saleh wrote: > Hi Denis > But if all the involved tables/caches have the same affinity key, > shouldn't they be collocated on the same node, if the data fits on that > node? > thanks. > > On Wed, Jun 17, 2020 at 1

Tech Talk: Explaining Ignite Through Coding

2020-06-18 Thread Denis Magda
Igniters, I'm doing an online tech talk on June 24th in the format of a coding session. We're going to learn key Ignite capabilities by building an application that uses SQL, compute, continuous queries, and

Re: Tech Talk: Explaining Ignite Through Coding

2020-06-18 Thread Denis Magda
Yes, it will be recorded and uploaded to YouTube. If you register for the event, you'll get a follow-up email once the recording is published. Or ping me later here. - Denis On Thu, Jun 18, 2020 at 2:14 PM aveiros wrote: > Denis, > > Will this session be recorded and posted on a video content

Re: read-though tutorial for a big table

2020-06-23 Thread Denis Magda
is possible, my writing activities should be continued. The only >> question is to get my local project to production, there is no sense in >> writing another model example. So I hope there will be a progress in the >> nearest future >> >> Vladimir >> >>

Re: Amazon AMI not available in a specific region

2020-06-24 Thread Denis Magda
Ignite dev community, Could you remind me if we still updating the AWS images for our releases? If yes, how about expanding a list of supported regions? - Denis On Wed, Jun 24, 2020 at 6:10 AM Gandhi, Karthik wrote: > Hi - AWS Apache images are limited to 2 regions (US East 1 and US West > 1

Re: GridIoManager compile error(2.8.0)

2020-06-24 Thread Denis Magda
This should be a problem of your toolchain. If there were compilations issues we would not release those versions. The first thing to check is that you use JDK 8 to build the binary. The produced binary can work on other versions of JDK 9+. - Denis On Sun, Jun 21, 2020 at 6:21 PM 38797715 <3879

Re: Setting Cache Size using Max Records

2020-06-24 Thread Denis Magda
Hi Vic, That’s unsupported for the off-heap memory. You can only limit memory usage based on the size in bytes. Please share more details of why this type of records eviction is needed. We might suggest an alternate solution. Denis On Wednesday, June 24, 2020, Victor wrote: > Hi, > > I am loo

Re: Setting Cache Size using Max Records

2020-06-25 Thread Denis Magda
Victor, Is it correct to assume that the users define this configuration first and only then you span up an Ignite cluster for them? If it's so, then you can translate a user-defined number of records to final data region size. The formula might be as follows - "data_region_size = provided_number_

Re: Use Kryo serializer end to end

2020-06-25 Thread Denis Magda
Hi Vicky, Yes, technically that's doable and requires you to create a marshaller implementation that uses Kryo: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/marshaller/Marshaller.html However, I would switch from the default serialization format (binary format and BinaryMar

Re: Regarding SQL injection in Ignite H2 database

2020-06-26 Thread Denis Magda
The discussion is moved to the security channel. Please don’t respond here. Denis On Friday, June 26, 2020, Jinny Ramsmark wrote: > Hello! > > I have a client who has designed an application where the user can input > SQL directly in the browser and send it to the application. > The application

Re: Do server nodes attempt to connect to client nodes?

2020-06-26 Thread Denis Magda
John, Stephen, Just for your reference, soon we'll introduce a configuration option that will prevent servers from initiating a connection with thick clients. The clients will be required to open the connection: http://apache-ignite-developers.2346864.n4.nabble.com/DISCUSSION-New-Ignite-settings-f

Re: Do server nodes attempt to connect to client nodes?

2020-06-26 Thread Denis Magda
ent for any reason would it > take itself offline somehow? > > On Fri, 26 Jun 2020 at 12:46, Denis Magda wrote: > >> John, Stephen, >> >> Just for your reference, soon we'll introduce a configuration option that >> will prevent servers from initiating a connec

Re: Question on Key choice for an Ignite cache

2020-06-30 Thread Denis Magda
He Eugene, To elaborate on Ilya's answer, you can define a POJO for your key like as follows: public class AccountKey { String email; String phoneNumber; //don't forget to implement equals() and hashCode() so // that Ignite partitions and locates your records properly } and then

Re: How to do address resolution?

2020-07-01 Thread Denis Magda
Hi John, As Stephen mentioned, Visor connects to the cluster in a way similar to server nodes and thick clients. It's connected as a daemon node that is filtered out from metrics and other public APIs. That's why you don't see Visor being reported in the cluster topology metrics along with servers

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-01 Thread Denis Magda
Hi Rafael, Lamdas and anonymous classes capture and serialize their Inner/OuterClass with all the fields, and classes of the fields of those fields, etc. In your case, ScanQueryClass was captured during the lamda serialization and that class was not found during deserialization on the other side:

Re: Setting Cache Size using Max Records

2020-07-01 Thread Denis Magda
1. There is no any public API for that but you can follow a workaround suggested here . If you have a POJO class of your domain object, then create an instance, convert it to BinaryObjectImpl and get the array size (as s

Re: How to do address resolution?

2020-07-01 Thread Denis Magda
a > container. > > Anyways thanks for creating an issue and as well just wondering if any > docs should be updated for containers because I found the > BasicAddresResolver java doc by chance. > > On Wed., Jul. 1, 2020, 12:51 p.m. Denis Magda, wrote: > >> Hi John, >>

Re: How to do address resolution?

2020-07-01 Thread Denis Magda
g/releases/latest/javadoc/org/apache/ignite/configuration/ >> BasicAddressResolver.html >> >> And nothing is mentioned elsewhere in the official docs. >> >> On Wed., Jul. 1, 2020, 2:22 p.m. Denis Magda, wrote: >> >>> But you guys also mentioned in my other t

Re: ScanQuery Transform: fail to deserialze! ignite 2.8.0, java 11

2020-07-02 Thread Denis Magda
ignite.internal.binary.BinaryMarshaller. >> unmarshal0(BinaryMarshaller.java:101) >> at org.apache.ignite.marshaller.AbstractNodeNameAwareMarshalle >> r.unmarshal(AbstractNodeNameAwareMarshaller.java:81) >> at org.apache.ignite.internal.util.IgniteUtils.unmarshal( >>

Re: Hot service upgrade without downtime

2020-07-15 Thread Denis Magda
Hi Sergey, Starting Ignite 2.8 you can update services without brining down cluster nodes: https://apacheignite.readme.io/docs/service-grid#service-updates-redeployment Even though you still need to shut down for a short period of time, the cluster itself stays up-and-running. - Denis On Thu,

Re: Load balanced CQ listener/Catch up missed events

2020-07-17 Thread Denis Magda
Hi Devakumar, I think it's feasible to implement such logic with custom remote filters: https://apacheignite.readme.io/docs/continuous-queries#remote-filter Also, an alternate option might be a partitioned message bus like Kafka. Servers can send changes to a Kafka topic and the clients can consu

Re: Local CQ disconnected when other node re-join the cluster

2020-07-20 Thread Denis Magda
Hi Rick, Please share the logs from both server nodes that capture the moment when the first node is being restarted and the second goes down. Btw, who starts the continuous query - an application code or one of the servers? - Denis On Sat, Jul 18, 2020 at 11:48 AM crypto_ricklee wrote: > De

Re: Load balanced CQ listener/Catch up missed events

2020-07-21 Thread Denis Magda
The queue can be a good alternative [1] but the application has to care about faults handling. For example, if a client reads a message from the queue, starts doing some job as the message prescribes and then fails in the middle, then the job is incomplete and nobody else can pick it up. So, you wo

Re: ContinuousQueryWithTransformer with custom return type

2020-07-21 Thread Denis Magda
Both the local listener and remote filter will return BinaryObjects as long as the continuous query was registered with the "cache.withKeepBinary()" option set. However, there is a trick you can use in the implementation of the local listener. Just call "deserialize()" method on the instance of a

Re: 3rd party persistence: Mapping with RDBMS tables that don't have primary keys

2020-07-21 Thread Denis Magda
Hi Alex, How will you access such records in Ignite? SQL lookups? If primary key-based searches are irrelevant in Ignite as well then think about the following: - Obviously, Ignite still requires a primary key and that can be an integer number incremented by your application: https://apa

Re: A question regarding cluster groups

2020-07-22 Thread Denis Magda
Hi, A single scattered cluster across two distant data centers is a tricky thing that leads to higher latencies and corner cases you're asking about. As a general recommendation, each data center needs to have its own cluster. The nodes of those two different clusters (belonging to the different

Re: Apache Ignite CacheRebalanceMode Is Not Respected By Nodes

2020-07-22 Thread Denis Magda
Here is a detailed instruction for managing data distribution across server nodes: https://www.gridgain.com/docs/latest/developers-guide/configuring-caches/managing-data-distribution - Denis On Tue, Jul 21, 2020 at 6:19 PM Evgenii Zhuravlev wrote: > Hi, > > CacheRebalanceMode is responsible fo

Re: Load balanced CQ listener/Catch up missed events

2020-07-23 Thread Denis Magda
1. It depends on your application needs. Most likely a single distributed queue will work if it needs to be accessed by any remote producer or consumer. 2. Yes, refer to the documentation from my previous email. 3. What do you mean under "storing a part of the client node"? - Denis On Wed, Jul

Re: Apache Ignite with istio/envoy mTLS

2020-07-23 Thread Denis Magda
To support this deployment model you would need to have a Kubernetes Service per Ignite server node so that remote thick clients can connect to any server from outside. Also, you would need to enable the following setting on the clients side (the setting will be released in Ignite 2.9): https://www

Re: 3rd party persistence: Mapping with RDBMS tables that don't have primary keys

2020-07-24 Thread Denis Magda
Hi Alex, > I'm not going to write any new records or update existing ones for such > tables through Ignite. So I can skip the overrides in CacheStore > implementation, right? (I'm using default implementation at the moment) That's right. https://apacheignite.readme.io/docs/id-generator > Thi m

Re: Load balanced CQ listener/Catch up missed events

2020-07-27 Thread Denis Magda
The client can create a queue, and the servers will keep items of that queue. Those items will be stored in memory and disk tiers of the servers. And, yes, physically the records will be persisted in the database folder (that is under the work folder by default). Hope this helps. - Denis On Fri,

Re: Kubernetes : Connection timed out (Connection timed out)

2020-07-28 Thread Denis Magda
Steve, Jose, Try to follow this instruction created specifically for Azure Kubernetes Service (AKS): https://www.gridgain.com/docs/latest/installation-guide/kubernetes/azure-deployment Not, if the cluster (server nodes) are planned to be deployed as virtual machines (on-premises) while the thick

Fwd: The Apache(R) Software Foundation Announces Annual Report for 2020 Fiscal Year

2020-07-29 Thread Denis Magda
Igniters, The board of directors published the annual report and even though Ignite is not mentioned in the press release, you can find encouraging datapoints by looking into the full report: https://www.apache.org/foundation/docs/FY2020AnnualReport.pdf Remember that Ignite is compared to other 3

Re: Kubernetes : Connection timed out (Connection timed out)

2020-07-29 Thread Denis Magda
Steve, Excellent, glad the problem is gone. The community is working on the new documentation and, as far as I know, the Kubernetes instructions will be brought up-to-date. Thanks for pointing that out. - Denis On Wed, Jul 29, 2020 at 2:53 AM steve.hostettler wrote: > Hello Dennis, > > so it

Re: [MEETUP] Apache Ignite Best Practices for Native Persistence and Data Recovery

2020-07-29 Thread Denis Magda
Vasiliy, You can find a link to the recording in the comments section here: https://www.meetup.com/ru-RU/Apache-Ignite-Virtual-Meetup/events/271602652/ - Denis On Wed, Jul 29, 2020 at 2:36 AM Vasily Laktionov wrote:

Re: Work Directory Usage with Persistence Disabled

2020-07-30 Thread Denis Magda
Hello Mitchell, Ignite saves there classes of objects which your application puts in caches or executes as compute tasks. For instance, if you put a MyObject instance in a cache, then Ignite will persist the info about MyObject in the marshaller directory and then will be able to deserialize this

Re: Effective Monitoring of Rebalancing

2020-07-31 Thread Denis Magda
John, If it's still relevant for you, now you can monitor rebalancing progress with a special widget of Control Center: https://www.gridgain.com/docs/control-center/latest/monitoring/configuring-widgets#rebalance-widget - Denis On Fri, Jan 17, 2020 at 12:33 AM John Gardner wrote: > I've found

Re: Ignite Web Console sign up. Not found.

2020-08-03 Thread Denis Magda
The Ignite community stopped supporting Ignite Web Console some time ago and recently made a decision to discontinue the tool officially: https://issues.apache.org/jira/browse/IGNITE-13038 Please select an alternate tool. We've put together a list of potential candidates: https://ignite.apache.org

Re: Serialize a char array member as part of class serialization into cache - C++ API

2020-08-03 Thread Denis Magda
Igor, Would you please join the discussion and help Data tackle the issue? - Denis On Thu, Jul 30, 2020 at 1:03 AM Dana Milan wrote: > Hi, > > I couldn't find an answer anywhere else, hopefully you can help me. > > I have the following class: > > class Pair { > friend struct ignite::binary::B

Re: Call for presentations for ApacheCon North America 2020 now open

2020-08-04 Thread Denis Magda
e and Apache Flink. > > > > I would also like to co-present on Ignite internals and usecases deep > dive. > > > > Regards, > > Saikat > > > > On Wed, Jan 22, 2020 at 6:22 PM Denis Magda wrote: > > > >> Igniters, > >> > >> I

Re: Call for presentations for ApacheCon North America 2020 now open

2020-08-06 Thread Denis Magda
Wesley, Definitely follow the advice of Saikat and submit the talk to the IMC Summit. Also, we’ll be happy to host you for Ignite virtual meetup. Many community folks will be glad to learn how you use Ignite ML in production. Are you ready? https://www.meetup.com/Apache-Ignite-Virtual-Meetup/ De

Re: run ignitevisorcmd in k8s and docker?

2020-08-06 Thread Denis Magda
Hi there, Visor CMD uses a legacy connection mode (daemon node) that might be tricky to deal with in K8S environments. Try to start it inside the same K8S network with your cluster and use a configuration with KubernetesIPFinder you used for the server nodes. Alternatively, go for an alternate mo

Re: run ignitevisorcmd in k8s and docker?

2020-08-07 Thread Denis Magda
in the same container with > Ignite server, and using the same configuration file with > KubernetesIPFinder that ignite server use. Should this mode be supported? > And for the link provided, does it mean that web console can also be used? > Thanks! - Bright > > - 原始邮件 -

Re: read-though tutorial for a big table

2020-08-07 Thread Denis Magda
Alex, Please share a bit more details on what you’re struggling with. It sounds like you are looking for a specific piece of advice rather than generic performance suggestions. Denis On Thursday, August 6, 2020, Alex Panchenko wrote: > Hello Vladimir, > > are there some key things you can shar

Re: Best first steps for performance tuning

2020-08-07 Thread Denis Magda
Devin, Please consider watching this talk by Ivan Rakov, one of main contributors to the native persistence. Rewind to 28 minutes 14 seconds for performance consideration: https://www.youtube.com/watch?v=f2ArcJPH4iU Let us know if any piece of advice was helpful and we’ll put the knowledge on pap

Re: Enabling swapPath causes invoking shutdown hook

2020-08-07 Thread Denis Magda
Agree with Ilya that the performance should be comparable if you disable the WAL of the Ignite persistence. Anyway, the swapping and Ignite persistence pursue different goals. The swapping is one of the out-of-memory protection techniques - if you run out of DRAM, then the OS will start swapping i

Re: Operation block on Cluster recovery/rebalance.

2020-08-07 Thread Denis Magda
If I'm not mistaken, key-value operations (cache.get/put) and compute calls fail with an exception if the cluster is deactivated. Do those fail on your end? As for the async and SQL operations, let's see what other community members say. - Denis On Fri, Aug 7, 2020 at 1:06 PM John Smith wrote:

Re: What does all partition owners have left the grid, partition data has been lost mean?

2020-08-07 Thread Denis Magda
John, This page covers all the aspects of backups in Ignite (what are those, how to configure, etc.): https://www.gridgain.com/docs/latest/developers-guide/configuring-caches/configuring-backups As for the 5 nodes cluster with the persistence, yes, all those have to be added to be in the same bas

Re: [BLOG] Apache Ignite Extensions

2020-08-10 Thread Denis Magda
Hi Saikat, The weekly routines of an Apache Ignite committer :) I believe that Ignite application developers would love to learn insights from this article and eventually get modular-based Ignite integrations. So, with(out) your permission sharing the article via @user list. Excellent article and

Re: Operation block on Cluster recovery/rebalance.

2020-08-11 Thread Denis Magda
block. >> >> Basically the client application is an HTTP Server on each HTTP request >> does cache exception. >> >> >> >> >> >> >> On Fri, 7 Aug 2020 at 19:46, John Smith wrote: >> >>> No, everything blocks... Also using 2.7.0 just in case.

Re: Operation block on Cluster recovery/rebalance.

2020-08-12 Thread Denis Magda
is the query that >> blocks. >> >> My application first first runs a select on the cache and then does a put >> to cache. >> >> On Tue, 11 Aug 2020 at 19:22, Denis Magda wrote: >> >>> John, >>> >>> It sounds like a deadlock caus

Re: Operation block on Cluster recovery/rebalance.

2020-08-13 Thread Denis Magda
gt; The Client disconnected exception only happens when all server nodes in > the cluster are down. The blockage only happens when the cluster is trying > to establish baseline topology. > > On Wed., Aug. 12, 2020, 6:28 p.m. Denis Magda, wrote: > >> John, >> >> I don

Re: Enabling swapPath causes invoking shutdown hook

2020-08-13 Thread Denis Magda
Ignite swapping is based on the swapping mechanism of the OS. So, you shouldn’t see any difference if enable the OS one directly some way. Generally, you should not use swapping of any form as a permanent persistence layer due to the performance penalty. Once the swapping kicks in, you should scal

Re: Enabling swapPath causes invoking shutdown hook

2020-08-13 Thread Denis Magda
orm. At this time, it may be a good > practice to make full use of the swap mechanism of the OS, which takes up > more disk space but achieves better performance. > 在 2020/8/14 上午8:22, Denis Magda 写道: > > Ignite swapping is based on the swapping mechanism of the OS. So, you > should

Re: 2.8.1 - Loading Plugin Provider - Conflicting documentation

2020-08-13 Thread Denis Magda
Veena, thanks for the ticket! We’ll take care of it. On Thursday, August 13, 2020, VeenaMithare wrote: > HI , > > Raised a Documentation Improvement jira : > IGNITE-13356 > Documentation Change needed: PluginProvider loading changed from 2.8.1 > regards, > Veena. > > > > -- > Sent from: http://

Re: How to use Ignite Spring Data to query selected fields from Ignite ?

2020-08-14 Thread Denis Magda
Hi, Check this section of the Ignite + Spring Data tutorial: https://www.gridgain.com/docs/tutorials/spring/spring_ignite_tutorial#create-spring-data-repositories - Denis On Wed, Aug 12, 2020 at 6:52 PM 1478814670 <1478814...@qq.com> wrote: > Hi, > Use Ignite Spring Data module to query so

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
e.tryComplete(result.result()); > } else { > promise.tryFail(result.cause()); > } > }); > > return promise.future(); > } > > public T cache() { > return (T) cache; > } > } > &g

Re: Change Data Capture Feature

2020-08-14 Thread Denis Magda
Hello Pavel, GridGain supports a Kafka Connect integration that supports all sophisticated CDC scenarios: https://www.gridgain.com/docs/latest/integrations/kafka/cert-kafka-connect Debezium is another option. This article covers how to capture changes with GridGain Kafka Connect

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
t; > On Fri., Aug. 14, 2020, 12:53 p.m. Denis Magda, wrote: > >> John, >> >> Ok, we nailed it. That's the current expected behavior. Generally, I >> agree with you that the platform should support an option when operations >> fail if the cluster is deactivate

Re: Operation block on Cluster recovery/rebalance.

2020-08-14 Thread Denis Magda
y are back > > 2- Implement some kind of logic on the client side not to block the HTTP > part... > > Can IgniteCache instance be notified of disconnected events so I can maybe > tell the repository class I have to set a flag to skip the operation? > > > On Fri., Aug. 1

Re: Operation block on Cluster recovery/rebalance.

2020-08-17 Thread Denis Magda
instance? > > On Fri, 14 Aug 2020 at 18:22, Denis Magda wrote: > >> @Evgenii Zhuravlev , @Ilya Kasnacheev >> , any thoughts on this? >> >> As a dirty workaround, you can update your cache references on client >> reconnect events. You will be getting an except

Re: Ignite Queue (Documentation or Code defect)?

2020-08-19 Thread Denis Magda
Could you please file a ticket in Ignite JIRA for 2.10 release? That's definitely an overlook in the current implementation. - Denis On Tue, Aug 18, 2020 at 9:57 AM Humphrey wrote: > Hope someone pics this up. That the code is not behaving as the > documentation > is saying. > (Not throwing ex

Re: Lost node again.

2020-08-19 Thread Denis Magda
John, I would try to get to the bottom of the issue, especially, if the case is reproducible. If that's not GC then check if that's the I/O (your logs show that the checkpointing rate is high): - You can monitor checkpointing duration with a JMX tool

Re: Lost node again.

2020-08-20 Thread Denis Magda
to happen on "off" hours. > > Dennis, wouldn't 15 seconds faillureDetectionTimeout cause even more > shutdowns? > We also considered more tuning stuff in the docs, we' ll see I guess... > As for now we don't have separate disks for now. > > > > On W

Re: Issue with using Ignite with Spring Data

2020-08-21 Thread Denis Magda
Hi Srikanta, You forgot to share the configuration. Anyway, I think it's clear what you are looking for. Check this example showing how to configure CacheJdbcPojoStoreFactory programmatically (click on the "Java" tab, by default the example shows the XML version): https://www.gridgain.com/docs/la

Re: Issue with using Ignite with Spring Data

2020-08-21 Thread Denis Magda
dd the entries into the cache for the ones which are > missing ? > > If my above understanding is correct then that explains why I was getting > null results from the queries executed once the Spring boot is instantiated > as the cache load on startup was not complete yet. > > >

Re: ignite partition mode

2020-08-21 Thread Denis Magda
How do you check that the second node doesn't keep any records? What your verification method? - Denis On Tue, Aug 18, 2020 at 3:17 AM itsmeravikiran.c wrote: > Our application running with 2 ignite node,. > But data is available in one node, and not available in the second node. > Our cache c

Re: Failed to map SQL query

2020-08-25 Thread Denis Magda
If it's expected that the SQL query will produce a large data set then consider using the memory quotas feature with the offloading to disk option . It's not available in Ignite though. GridGain releases it in

Re: Select clause is quite more slow than same Select on MySQL

2020-08-27 Thread Denis Magda
This resource tries to explain your issue in a bit more detail. In short, there are scenarios when an RDBMS can easily show much better performance numbers. - Denis On Thu, Aug 27,

Re: How to stop a node from dying when memory is full?

2020-08-27 Thread Denis Magda
Folks, this article should be relevant to you. It covers all techniques to avoid the OOM except for swapping: https://www.gridgain.com/resources/blog/out-of-memory-apache-ignite-cluster-handling-techniques You can use swapping as a part of your toolbox to survive the time when a node is running ou

Re: Executing select query in Partition mode (cluster with two nodes) taking more than 10 minutes.

2020-08-27 Thread Denis Magda
Hi Bhavesh, Follow these basic performance tuning recommendations for SQL to understand how to optimize the query. Take the execution plan first. Most likely, you need to set secondary indexes. If that's not the case, the

Re: ignite partition mode

2020-08-27 Thread Denis Magda
Explain the steps in detail - Denis On Wed, Aug 26, 2020 at 5:13 AM itsmeravikiran.c wrote: > By using ignite web console > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: [External]Re: unable to start node

2020-09-02 Thread Denis Magda
@Taras Ledkov , @Igor Seliverstov , @Yuriy Gerzhedovich , did you guys see this issue before? It looks like a bug in the SQL engine. Kamlesh, in the meantime, try to follow the procedure described in this JIRA ticket (you need to clean the index that we'll be rebuild on the startup): https://issue

Re: Regarding TRANSACTIONAL_SNAPSHOT

2020-09-04 Thread Denis Magda
Hi Dana, Here you can find a list of known high-level limitations: https://apacheignite.readme.io/docs/multiversion-concurrency-control#limitations Also, the performance might not be satisfactory and not all the cluster failure scenarios might be covered. Generally, as of know, I would advise yo

Re: InvalidClassException local class incompatible for custom cache store factory

2020-09-08 Thread Denis Magda
Hi Xinmin, Are you getting this error for your custom objects? If yes, did you change a type of a field in those objects? Probably, you're hitting this problem: https://www.gridgain.com/docs/latest/perf-troubleshooting-guide/troubleshooting#cluster-doesnt-start-after-field-type-changes - Denis

Re: Ignite Segmentation Behaviour

2020-09-11 Thread Denis Magda
Hi Samuel, With the current behavior, the segments will not rejoin automatically. Once the network is recovered from a network partitioning event, you need to restart all the nodes of one of the segments. Those nodes will join the other nodes and the cluster will become fully operational. Let me

Re: Map 10 caches to 10 different ignite nodes

2020-09-11 Thread Denis Magda
Take a look at this documentation page that share a bit more detail on how to use the node filters. - Denis On Fri, Sep 11, 2020 at 5:19 AM abhi2703 wrote: > Thanks a lot Vladimir, that's exac

Tech talk: thoughts and suggestions on how to use Ignite with serverless functions

2020-09-15 Thread Denis Magda
Igniters, The serverless architecture is getting more traction these days since it helps us to reduce the costs of our cloud-based applications. Several months ago I decided to research if Ignite is 100% ready for serverless dep

Re: Tech talk: thoughts and suggestions on how to use Ignite with serverless functions

2020-09-15 Thread Denis Magda
x27;s website > > On Tue, Sep 15, 2020 at 7:43 PM Denis Magda wrote: > >> Igniters, >> >> The serverless architecture >> <https://martinfowler.com/articles/serverless.html#WhatIsServerless> is >> getting more traction these days since it helps us to r

[DISCUSSION] Renaming Ignite's product category

2020-09-16 Thread Denis Magda
Igniters, Throughout the history of our project, we could see how the addition of certain features required us to reassess the project's name and category. Before Ignite joined the ASF, it supported only compute APIs resembling the MapReduce engine of Hadoop. Those days, it was fair to define Ign

Re: [DISCUSSION] Renaming Ignite's product category

2020-09-23 Thread Denis Magda
ributed memory-first database". It clearly > states > > that Ignite is a database (which is true at this point), while still > > emphasizing the in-memory computing power endorsed by the platform. > > > > The "in-memory computing platform" is

Re: [DISCUSSION] Renaming Ignite's product category

2020-09-24 Thread Denis Magda
what you are > trying to achieve. > > Regards > > > > Adam Carbone | Director of Innovation – Intelligent Platform Team | > Bottomline Technologies > Office: 603-501-6446 | Mobile: 603-570-8418 > www.bottomline.com > > > > > > > > *From:

Re: Fast Load Large Datasets

2020-09-25 Thread Denis Magda
he Ignite has finally > arrived [1]. Many thanks to @Denis Magda and @Ksenia Romanova for their > valuable help. > > [1] > https://www.gridgain.com/resources/blog/how-fast-load-large-datasets-apache-ignite-using-key-value-api > > Vladimir >

Re: Question about Ignite persistence disk space used after clearing cache

2020-09-25 Thread Denis Magda
Hi Scott, The disk space is not compacted even after you clear the entire cache. The compaction feature will be introduced to Ignite soon. So, the metric shows the allocated size. This doc section suggests an approach for the actual size calculation: https://www.gridgain.com/docs/latest/administra

Re: Continuous Query

2020-10-02 Thread Denis Magda
Hi Narges, Use continuous queries if you need to be notified in real-time, i.e. 1) a record is inserted, 2) the continuous filter confirms the record's time satisfies your condition, 3) the continuous queries notifies your application that does require processing. The jobs are better for a batchi

  1   2   3   4   5   6   7   8   9   10   >