Re: ComputeTask with JSON POST data

2019-04-02 Thread ilya.kasnacheev
Hello! Can you share a sample reproducer project? I guess I could try to make it work. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: infinite localhost to localhost connections

2019-04-02 Thread ilya.kasnacheev
Hello! Does this manifest in any way other than logging? I guess if some other program would connect to Ignite's communication port you will see such messages. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Can't add new key/value pair to existing cache via sql command

2019-04-02 Thread ilya.kasnacheev
Hello! Why adding a new cache an issue for you? You can add new caches dynamically in runtime, you know. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite graceful shutdown

2019-04-02 Thread ilya.kasnacheev
Hello! Unfortunately there is no graceful shutdown. Maybe consider asking this question on developers list? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite for a temporal (Open Source) NoSQL storage system

2019-04-02 Thread ilya.kasnacheev
Hello! I think that Apache Ignite can handle most if not all of what you have listed. So you can give it a try. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ClassNotFoundException when using IgniteHadoopIgfsSecondaryFileSystem

2019-04-02 Thread ilya.kasnacheev
Hello! Looks like there is some dependency problem in hadoop modules. Do you have steps to reproduce? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Re-post: java.io.IOException: Too many open files

2018-07-03 Thread ilya.kasnacheev
Hello! I have tried to reproduce your case, but I don't observe any growth of number of open file descriptors on Ignite side. I think the problem here is on Go side. Please make sure to always close connection if you open it. If your program is terminated, this is not so strict, but if you create

Re: Classloading error during startup with OSGi in 2.5

2018-07-05 Thread ilya.kasnacheev
Hello! Can you create a small reproducer project for this problem, post it to e.g. Github? I would take a look definitely if you do. Otherwise it's hard to say, I don't know anything about your environment. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Install As Service error

2018-07-11 Thread ilya.kasnacheev
Hello! What version of package are you using? Since 2.4 there should be a minus sign before mkdir, which will make it non-essential. Also, I don't understand why chown is ran before mkdir. Petr, can you chime in by chance? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Possible starvation in striped pool

2018-07-17 Thread ilya.kasnacheev
Hello! I have noticed that you are using putAll in your code. Apache Ignite is susceptible to deadlocks in the same fashion as regular multi-threaded code: i.e., if you take multiple locks (as putAll does, on partitions for its keys), you can get deadlock unless you maintain sequence of locks, i.

Re: spark ignite - how to set ignite client jvm memory options?

2018-07-17 Thread ilya.kasnacheev
Hello! Can you please copy the message that gives you worries? Also please share spark's config. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Spring application context resource is not injected

2018-07-17 Thread ilya.kasnacheev
Hello! Can you please upload the project to github so that we could take a look? Please include relevant Spark configs. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Port Assigned? Work on specific Node?

2018-07-17 Thread ilya.kasnacheev
Hello! I still don't understand /why/ you want to implement the scenario that you have described. Can you please describe which real-life problem you are solving? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: OptimizedMarshaller instead of BinaryMarshaller is usedforScanQuery

2018-07-23 Thread ilya.kasnacheev
Hello! I have filed a ticket against Apache Ignite JIRA: https://issues.apache.org/jira/browse/IGNITE-9054 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite.NET 2.2 crashes on startup without any information

2018-07-31 Thread ilya.kasnacheev
Hello! I have just witnessed this problem and was able to fix it by installing MFC Redistributable 2010. Apparently jvm.dll depends on msvcr100.dll and it can get misplaced even on modern Windows as to require reinstall of this component. Regards, -- Sent from: http://apache-ignite-users.7051

Re: Errors with TCPCommunicationSpi when using zookeeper discovery

2018-08-06 Thread ilya.kasnacheev
Hello! I can imagine circumstances where clients will open connections to other clients, such as starting caches on clients or deploying services on clients. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to do rolling updates with embedded Ignite and changing models

2018-08-07 Thread ilya.kasnacheev
Hello! My expectation that you can also use Binarylizable classes with some forward compatibility and avoid this problem. You could also focus on using SQL/binary objects. It should be working, but if it doesn't, please supply code snippets & exception traces. Regards, -- Sent from: http://ap

Re: Help needed with BinaryObjectException

2018-08-07 Thread ilya.kasnacheev
Hello! You mentioned that you have client nodes in test setup. This means that data has to be serialized to be sent from client to server. If you only use server nodes, you can configure them in such fashion that they never form a cluster but only function individually, and thus you should avoid

Re: OOME causing caches to be removed

2018-08-07 Thread ilya.kasnacheev
Hello! My recommendation here is breaking this query down into ranges (by using LIMIT or better yet, range WHERE condition), processing every range separately. Otherwise I can see how Ignite will try to keep all data on heap at some point. Regards, -- Sent from: http://apache-ignite-users.7051

Re: SqlFieldsQuery Cannot create inner bean 'org.apache.ignite.cache.query.SqlFieldsQuery

2018-08-07 Thread ilya.kasnacheev
Hello! I'm not aware of any other settings to avoid OOME for SQL queries. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Using more memory than is physically available

2018-08-10 Thread ilya.kasnacheev
Hello! If you want to store more data on node than available Data Regions memory, your course of action should be Ignite Native Persistence. You can also use Expiry if the data is not crucial and you want to put limit on amount of data. Regards, -- Sent from: http://apache-ignite-users.70518.x

Re: Ignite.NET tasks cancellation

2018-08-10 Thread ilya.kasnacheev
Hello! I try running this code, and I observe "System.Threading.Tasks.TaskCanceledException: A task was canceled." in Run() method. This is not quite what you are expecting, as you seem to expect jobs to be cancelled and not task, but from the code it's logical that it will happen. As for code h

Re: Is Cache reads take long time with cache size increase?

2018-08-10 Thread ilya.kasnacheev
Hello! The expectation is that increase should be logarithmic. In your case you should not expect 10 times increase, but 2-3x. However, if the operations take very short time their latency becomes irrelevant, you should really be looking at throughput. If for some requests latency starts to spike

Re: Any mbean call to get all deployed services in a grid

2018-08-13 Thread ilya.kasnacheev
Hello! I went through MBeans and MXBeans in Apache Ignite code base, found no such calls. Please feel free to contribute. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Perfromance Issues when Grid size is more (.Net)

2018-08-13 Thread ilya.kasnacheev
Hello! I suggest you continue discussion in http://apache-ignite-users.70518.x6.nabble.com/Is-Cache-reads-take-long-time-with-cache-size-increase-td23326.html instead of starting new threads. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Failed to create index on cache

2018-08-13 Thread ilya.kasnacheev
Hello! I suggest specifying shorter index name manually, since it looks like automatically generated index name was too long (longer than 255 bytes). It has no relation to number of fields, just to its name which can be any compliant string. Regards, -- Sent from: http://apache-ignite-users.7

Re: No response from ignite job tracker

2018-08-13 Thread ilya.kasnacheev
Hello! You should not use curl to test 11211 port since it's not an HTTP port. I don't think that Ignite binary client protocol supports whatever mapreduce.jobtracker.address expects. Have you tried "local"? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: Incorrect syntax near ','

2018-08-20 Thread ilya.kasnacheev
Hello! Unfortunately I still do not understand what kind of problem you are having. Can you please make screenshot where the problem is apparent? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite and Persistent Collections

2018-08-21 Thread ilya.kasnacheev
Hello! My recommendation is to re-send this question to developer list, since it concerns design considerations and not already shipped features. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite Indexes

2018-08-21 Thread ilya.kasnacheev
Hello! Regarding index order: Index order basically means that records in the data_idx1 index will be sorted by field1; if two records have the same field1 value, field3 will be used as sorting tier, and if both field1 and field3 are same, field2 will be used as sorting tier. Index is basically a

Re: Query execution too slow

2018-08-21 Thread ilya.kasnacheev
Hello! Can you please show the original query that you are running? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Unix timestamp conversion problem

2018-08-24 Thread ilya.kasnacheev
Hello! Can you share a reproducer for this problem? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Difference between replicated and local cache mode regarding time execution of query

2018-08-28 Thread ilya.kasnacheev
Hello! Can you try setting replicatedOnly(true) hint on SqlFieldsQuery, or ;replicatedOnly=true parameter for Ignite Thin JDBC Driver? This will prevent query to be distributed between nodes. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: C++ affinity key set up

2018-08-28 Thread ilya.kasnacheev
Hello! I have just ran your code with two nodes, and I could not observe any case where two Key()s will be on different nodes with same id but different flag. They're always on the same node Can you please elaborate how you got that result? Regards, -- Sent from: http://apache-ignite-users.705

Re: Difference between replicated and local cache mode regarding time execution of query

2018-09-05 Thread ilya.kasnacheev
Hello! Unfortunately I'm not aware why you see such a big difference in this case. It should be comparable. Maybe SQL people will chime in? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite RPM Installation As Service ignitevisorcmd usage

2018-09-13 Thread ilya.kasnacheev
Hello! Our current package build includes this script but it does not work out of FHS yet. This is left as an exercise for future releases. So if you need to use it, please download binary Apache Ignite release tarball and use this script from it. Thanks for telling us that you're using our packa

Re: Map C# class to Cassandra persistence settings

2018-09-25 Thread ilya.kasnacheev
Hello! Be the first to try! Note that you should probably a) enable simple binary name mapping[1] (i.e. use class="Person"), b) use Java types for primitives[2] (or their Java wrapper classes). 1. https://apacheignite-net.readme.io/docs/platform-interoperability#section-default-behavior 2. https

Re: kafka.common.KafkaException: Failed to parse the broker info from zookeeper

2018-09-25 Thread ilya.kasnacheev
Hello! >From the thread dumps looks like it's more of a Kafka issue than Apache Ignite. Have you tried newer releases BTW? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Data modeling for segmenting a huge data set: precomputing vs real time computations

2018-09-27 Thread ilya.kasnacheev
Hello! It's hard to say for sure which way to go since Apache Ignite offers a very diverse range of tools. Note that you can persist arbitrary data structures into Apache Ignite. You are not in any sense limited to SQL. You can turn sparse row into a tiny object. While keeping some SQL indexes. Y

Re: ignite .net index group definition

2018-09-27 Thread ilya.kasnacheev
Hello! Unfortunately this looks like a genuine limitation of .Net's QuerySqlField. You can try specifying those indexes with QueryEntities or CREATE INDEX instead to have more control. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Java 11 and the future of Apache Ignite

2018-09-27 Thread ilya.kasnacheev
Hello! This might be more suited to developers list. I will answers from user perspective: 1) I guess that all LTS releases will be supported (which are every 6th release?). Intermediate releases will receive some testing in releases that they are released, but will not be a primary target. 2) M

Re: .NET ContinuousQuery lose cache entries

2018-09-27 Thread ilya.kasnacheev
Hello! Do you have some kind of reproducer project? It's hard to say otherwise what is happening in your case. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Issues running Ignite with Cassandra and spark.

2018-09-27 Thread ilya.kasnacheev
Hello! 1) There is no generic way of pulling updates from 3rd party database and there is no API support for it usually, so it's not obvious how we could implement that even if we wanted. 2) By default cache store will process data in parallel on all nodes. However if will not align data distribu

Re: Ignite getAll does not return values randomly

2018-09-27 Thread ilya.kasnacheev
Hello! It's hard to say. Do you really have CacheRebalance.NONE? What would you expect with that? What happens if you take it off your configuration? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ignite .net programatically access cluster config (not working)

2018-09-28 Thread ilya.kasnacheev
Hello! You can send compute tasks to other nodes to determine their data regions using code. You can also just take a look at Web Console to see if it suits your needs: https://apacheignite-tools.readme.io/docs/ignite-web-console Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabb

Re: Problems are enabling Ignite Persistence

2018-09-28 Thread ilya.kasnacheev
Hello! Seems to be working for me after two changes. First, I had to change h2 version dependency from 1.4.197 to 1.4.195 - maybe this is because I have later snapshot of Apache Ignite compiled. Second, I had to activate the cluster! You have to activate persistent cluster after you bring all no

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

2018-09-28 Thread ilya.kasnacheev
Hello! I have indeed try a use case like yours: 0: jdbc:ignite:thin://127.0.0.1/> create index on b(x,y); No rows affected (9,729 seconds) 0: jdbc:ignite:thin://127.0.0.1/> select count(*) from a; COUNT(*) 1 1 row selected (0,017 seconds) 0: jdbc:ignite:thin://127.0.0.1/> select count(*) from

Re: Off heap constantly grow on use BinaryObject as field of cached data

2018-09-28 Thread ilya.kasnacheev
Hello! It is still a problem for you? I can see slight decrease of fill factor on your chart coupled with slight increase of data region usage. With regards to fragmentation it is to be expected. I have tried your test: 15:04:54,356 INFO [grid-timeout-worker-#23] Metrics for local node (to disa

Re: Reading from the SQLServer persistence store with write-behind setting

2018-09-28 Thread ilya.kasnacheev
Hello! In order to use loadCaches you will have to define types in jdbc cache store, since it obviously needs to know structure of your data. You can find example of that in Ignite documentation: https://apacheignite.readme.io/docs/3rd-party-store#section-manual Regards, -- Sent from: http://

Re: GridMergeTable

2018-10-23 Thread ilya.kasnacheev
Hello! GridMergeTable is H2 table which is stored on Java heap. This means you have to plan carefully and make sure that you always have enough heap for merge/sort/group. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Total Size seems to keep growing

2018-10-25 Thread ilya.kasnacheev
Hello! After more experiments with your reproducer, I have filed an issue: https://issues.apache.org/jira/browse/IGNITE-10011 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: CPU Count Drop On ECS

2018-10-30 Thread ilya.kasnacheev
Hello! I remember the discussion where Java 8 did not support detecting change of # available CPUs. Then it improved in some of builds. Anyway, I think it's out of our control since we rely on Runtime.availableProcessors(), unless this issue becomes very widespread and we have to fix it on out sid

Re: What is update check & how to disable it?

2018-11-14 Thread ilya.kasnacheev
Hello! This notifier checks if there is newer Ignite version available for upgrade and prints message. You can disable it with -DIGNITE_UPDATE_NOTIFIER=false. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Snapshotting and Restore in Ignite

2018-11-14 Thread ilya.kasnacheev
Hello! Currently there is no snapshotting in Apache Ignite. You could restore a different cluster from shutdown nodes' persistence directories but not from live nodes'. There are third party commercial implementations of snapshotting for Ignite. Regards, -- Sent from: http://apache-ignite-use

Re: Dependency resource injection with OpenWebBeans CDI instead of Spring

2018-11-14 Thread ilya.kasnacheev
Hello! Judging from the .internal. designation of this interface, it doesn't look like you can meaningfully extend it in your code. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 1 server - many Clients scenario failing

2018-11-14 Thread ilya.kasnacheev
Hello! You should avoid usage of IPs not visible to some nodes, for example by setting localAddress setting. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Unable to load more than 5g data through sqlline

2018-11-14 Thread ilya.kasnacheev
Hello! Looks like you have allowed more heap/offheap memory for Ignite than your operating system can allocate. Are you sure you're not starting multiple nodes on same box? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Very slow to execute batch merge into statement .

2018-11-14 Thread ilya.kasnacheev
Hello! My recommendation will be using Cache API's replace() or invoke() calls. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Quering with PHP PDO returns null for all column values except the 1st one

2018-11-14 Thread ilya.kasnacheev
Hello! Looks like it's getting fixed in JIRA as we speak. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: ComplexObjects via REST API?

2018-11-14 Thread ilya.kasnacheev
Hello! We have it kinda documented via https://apacheignite.readme.io/docs/rest-api#section-general-configuration Also I can see that the following ticket now exists: https://issues.apache.org/jira/browse/IGNITE-9758 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: how to do i hibernate configuration for Apache ignite database

2018-11-19 Thread ilya.kasnacheev
Hello! Have you tried H2Dialect? Ignite's SQL is based on H2 so it should be a good fit. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Re: Partition-exchanger blocked after upgrade to 2.7

2018-12-20 Thread ilya.kasnacheev
Hello! Do you have any non-standard settings for failureDetectionTimeout or networkTimeout? Do you have any observable issues besides occasional extra logging? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: After upgrading 2.7 getting Unexpected error occurred during unmarshalling

2019-01-11 Thread ilya.kasnacheev
Hello! I think the problem was introduced by https://issues.apache.org/jira/browse/IGNITE-6846 which does look very suspicious, however it is strange that it does not reproduce right away. I could try and devise a fix but I could not reproduce this behavior in any of tests. If you could do a repr

Re: Error with Spark + IGFS (HDFS cache) through Hive

2019-01-14 Thread ilya.kasnacheev
Hello! If you can write a test which demonstrates problematic behavior, and a fix on top of that, and fill a ticket against IGNITE project in Apache JIRA, I think we could merge it all right. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: UPDATE query with JOIN

2019-01-14 Thread ilya.kasnacheev
Hello! Unfortunately you can't do this right now. Your best bet is 4) as you have figured. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cache access blocked on destroy

2019-01-14 Thread ilya.kasnacheev
Hello! Unfortunately your e-mail contained neither attachment nor links to it. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Local node SEGMENTED error causing node goes down for no obvious reason

2019-01-14 Thread ilya.kasnacheev
Hello! I can see that at 2018-11-07T07:54:47 five new clients will suddently arrive and then five server nodes will drop (not being able to acknowledge addition of new nodes perhaps?). Either there is communication problems between new clients and old servers, or some bug manifested by rapid incl

Re: JDBC thin: support connection pooling in 2.7?

2019-01-14 Thread ilya.kasnacheev
Hello! > When we use connection pool,we randomly get a connection from the > pool.This cause strange issues.For example,when we do create index > operation after create a table we get an exception "cache doesn't exists". It is a known issue, which you can mitigate by not putting connection to cli

Re: SQL Support for IN predicate

2019-01-14 Thread ilya.kasnacheev
Hello! I believe you can still get IN to ignore indexes for more complex queries, so watch out even if they work for simpler ones. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite benchmarking with YCSB

2019-01-14 Thread ilya.kasnacheev
Hello! Unfortunately there's not enoug info to be able to debug this further. I don't think you can get Ignite to use both IPs to connect client to server, unless you start two differing server nodes with different own IP. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Able to access one cache not able to access another from cluster

2019-01-14 Thread ilya.kasnacheev
Hello! What happens when you try to access the one cache that you can't? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Does ignite keep loading result when the jdbc thin connection is dead?

2019-01-14 Thread ilya.kasnacheev
Hello! I guess it is true. But, you can sometimes work around it by setting 'lazy=true' connection flag. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to Write and Read a Nested JSON Into and From Apache Ignite Table

2019-01-14 Thread ilya.kasnacheev
Hello! You can nest BinaryObjects as deep as you need. I know that there are users who routinely serialize JSON to BinaryObject. However, you will not be actually refer to nested data in SQL queries, only to top-level values. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.c

Re: Cache updates slow on Linux Vs Windows

2019-01-14 Thread ilya.kasnacheev
Hello! Did you figure out anything? I went through your log but did not have any exact ideas. Is it possible that Windows node is slowed down by very active I/O? Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite ML withKeepBinary cache

2019-01-14 Thread ilya.kasnacheev
Hello! I can see there is a ticket in JIRA: https://issues.apache.org/jira/browse/IGNITE-10700 If anything is not there please update it. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Abnormal termination of nodes with native persistence enabled

2019-01-14 Thread ilya.kasnacheev
Hello! Please see http://apache-ignite-users.70518.x6.nabble.com/Native-persistence-ignite-server-failed-to-join-when-client-has-been-started-td26248.html#a26250 with regards to visor node. > Node with BaselineTopology cannot join mixed cluster running in > compatibility mode This is the key. U

Re: Data streamer has been closed.

2019-01-20 Thread ilya.kasnacheev
Hello! I have filed an issue https://issues.apache.org/jira/browse/IGNITE-10991 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: failure due to IGNITE_BPLUS_TREE_LOCK_RETRIES

2019-01-31 Thread ilya.kasnacheev
Hello! I have filed an usability ticket https://issues.apache.org/jira/browse/IGNITE-11162 Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Performance degradation in case of high volumes

2019-02-28 Thread ilya.kasnacheev
Hello! I'm afraid you will have to increase IGNITE_MAX_INDEX_PAYLOAD_SIZE until you no longer see "Indexed columns of a row cannot be fully inlined" warning. Can you try? Alternatively you can try specifying it with cacheCfg.setSqlIndexMaxInlineSize(). Regards, -- Sent from: http://apache-ign

Re: Backup make DataStreamer performance decreased a lot.

2019-03-04 Thread ilya.kasnacheev
Hello! Actually, now I understand I only had one node so backups were not applicable. I will re-run it, but as you can see, since adding more data slows down superlinearly, you can expect that adding back-up also decrease performance superlinearly. Regards, -- Sent from: http://apache-ignite-

Re: User authentication and persistence

2019-03-04 Thread ilya.kasnacheev
Hello! You need at least one persistent region AFAIK, and it may be quite small just for authentication needs. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [Cache in Java] Missing AutomicConfiguration enum in lib

2019-03-04 Thread ilya.kasnacheev
Hello! I don't see any contradiction, unless you are confusing type names with property names. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Cpu usage cannot be improved

2019-03-04 Thread ilya.kasnacheev
Hello! You did not attach any files and I doubt stack traces will help much here. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Geospatial module's JTS dependency license change

2019-03-04 Thread ilya.kasnacheev
Hello! https://ignite.apache.org/community/contribute.html - however, I think maybe this issue was already addressed in master. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Access a cache loaded by DataStreamer with SQL

2019-03-15 Thread ilya.kasnacheev
Hello! Definitely works for me in DBeaver with this exact code: Some of DBeaver's introspection does not work but statements are solid. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Client Mode and client to client communication

2017-09-21 Thread ilya.kasnacheev
Hello John! Why don't you promote your clients to servers? In Ignite, it is possible that only your dedicated servers will contain caches data, while other servers will participate in cluster without storing data. You can set up custom Cluster Groups / server roles for that. For every cache you c

Re: Data (that is inserted via JDBC) is not persisted after cluster restart

2017-10-10 Thread ilya.kasnacheev
Hello blackfield! I have tried to reproduce your scenario, but to no avail. So I started AI with your config: ~/Downloads/apache-ignite-fabric-2.2.0-bin% bin/ignite.sh -v config/IgniteConfig.xml [15:13:29,179][INFO][main][GridDiscoveryManager] Topology snapshot [ver=1, servers=1, clients=0, CPUs

Re: Inserting data into Ignite got stuck when memory is full with persistent store enabled.

2017-10-11 Thread ilya.kasnacheev
Hello Ray, Can you please share your Ignite configuration? That including persistence settings and cache configuration and memory policy. Does it get stuck for good, or does it get un-stuck periodically to do some loading? This might be related to checkpointing. Try setting PersistentStoreConfig

Re: Inserting data into Ignite got stuck when memory is full with persistent store enabled.

2017-10-12 Thread ilya.kasnacheev
Hello Ray! Can you please share cache configuration also? There's nothing in your configuation which stands out so maybe I'll try to reproduce it on hardware. Did checkpointing tuning produce any measurable difference? Do you spot anything in Ignite logs when nodes get stuck that you may share?

Re: Ignite YARN deployment mode issues

2017-10-24 Thread ilya.kasnacheev
Hello Ray, Yes, please try it and tell if it helps. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: deadlock

2017-10-31 Thread ilya.kasnacheev
Hello! Can you please attach full thread dump from the node once it stops responding? You can collect thread dump by using jstack JVM utility. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Out of memory streaming to Ignite Apache 2.0

2017-11-01 Thread ilya.kasnacheev
You may be hitting this scenario from my experience: As you have three nodes you begin to get deadlocks between load tasks. These deadlocks cause tasks to be postponed, but real troubles happen when they survive past 30 seconds and are dumped to logs. There's massive amount of data in your tasks

Re: Out of memory in client node freezes complete cluster

2017-11-09 Thread ilya.kasnacheev
Hello! I would recommend using 2.2 or 2.3 and not 2.0. Having said that, it makes sense to avoid OOM because in many places behavior is undefined once you hit OOM. It should not be hard to avoid. It should not cause cluster to hang, but without logs from server nodes it's hard to understand what

Re: Inserting data into Ignite got stuck when memory is full with persistent store enabled.

2017-11-14 Thread ilya.kasnacheev
Hello Ray, Have you tried to rewrite ingestion using cache API, DML or better yet DataStreamer? Because it's non-trivial to reason about problem when extra Spark layer is added. Why do you have such non-trivial amount of fields (and indices) in cache key object? Maybe try synthetic keys? Regards

Re: cache closed or destroyed issue

2017-11-28 Thread ilya.kasnacheev
Hello Pradeep! Are you still having this issue? What is the type of exception that gets thrown? If it's IgniteClientDisconnectedException, you can get reconnectFuture() from it and get() it, after this cache should be usable again. If it's not, logs are needed to figure this out. Regards, --

Re: MarshallerContextImpl: Failed to write class name to file

2017-11-28 Thread ilya.kasnacheev
Hello, You should have IGNITE_HOME set to some dedicated directory for every node. If you run your nodes from your main classes, you should either 1) set IGNITE_HOME to some unique directory for every run, 2) start those main classes with different starting directories, which will be used in abse

Re: Error inserting into H2 database special symbols

2017-11-28 Thread ilya.kasnacheev
Hello! What Ignite version do you happen to use? It seems that there's an issue https://issues.apache.org/jira/browse/IGNITE-5204 about this NPE, which was fixed in 2.1. Please consider updating to recent version (I recommend 2.3) and try again. Regards, -- Sent from: http://apache-ignite-user

Re: Ignite Cluster Disconnects After Idle Time

2017-11-28 Thread ilya.kasnacheev
Hello! We have fixed a related problem here: https://issues.apache.org/jira/browse/IGNITE-6818 As a workaround you can try setting pairedConnections to true on TcpCommunicationSpi in your Ignite configuration. Please report if it helped against idle cluster failures. Regards, -- Sent from: h

Re: Re:Poor performance select query with jdbc thin mode

2017-11-28 Thread ilya.kasnacheev
Hello Lucky. Please try setting enforceJoinOrder parameter on connection to true, retrying the request with various order of tables joined to see if it helps. It might turn out that one order of joins performs much better than the other one. Setting the parameter is documented here: https://ignit

Re: Error inserting into H2 database special symbols

2017-11-28 Thread ilya.kasnacheev
Hello! API is backwards compatible between 2.0 and 2.3, but rolling updates are not supported by Ignite without third party tools: You will need to stop your grid and restart it. You can't add 2.3 nodes to 2.0 grid. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

  1   2   >