Re: Performance with increase in node

2016-12-05 Thread Denis Magda
Basic scale-out deployment is to use multiple Ignite nodes deployed on multiple physical machines and stored data in partitioned distributed caches. So, I would moving in this direction: - start a cluster of multiple Ignite nodes deployed on several machines. - launch the application from the oth

Re: Cassandra cache info

2016-12-05 Thread Igor Rudyak
Hi Riccardo, It depends on how you are asking for the record which is not in Ignite cache. If you are doing this using *get* method of Ignite cache API it will load this record from DB (if it's not already in Ignite cache), put it into in-memory cache and return it to you. But if you are using Ig

Re: Performance with increase in node

2016-12-05 Thread javastuff....@gmail.com
Actual application is multiple machines and various threads doing get and put. As a simple test which can provide average get and put time, I tried attached test program. Tried same program on multiple physical machines (each with 48 CPU, 40GB Ram) and see similar behavior. To rule out network l

Re: How to pass variable to the configuration file

2016-12-05 Thread Alexey Goncharuk
Hi Yuci, Ignite uses Spring XML for configuration creation, so standard PropertyPlaceholderConfigurer perfectly meets your needs. Just add to your configuration file and it will do the trick. Make sure to consult the PropertyPlaceholderConfigurer javadoc for the available system properties reso

How to pass variable to the configuration file

2016-12-05 Thread yucigou
Suppose I have the following configuration file for standalone Ignite server nodes: http://www.springframework.org/schema/beans"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.spr

Re: Cassandra cache info

2016-12-05 Thread Riccardo Iacomini
Hi Val, I have a related question regarding SQL queries. Does it mean that it cannot be used as cache layer for an operational DB? What if I ask for a record which is not currently in the cache, but is stored in the persistence DB? Will a get an empty result set or Ignite will ask it to the DB? Th

Re: Not able to join cluster with Zookeeper based IP finder

2016-12-05 Thread Taras Ledkov
Please provide the logs from all 3 nodes. Also please provide FULL logs if it is possible: [15:05:05] Quiet mode. [15:05:05] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} On Mon, Dec 5, 2016 at 6:22 PM, ghughal wrote: > Yes, issue is only reproduci

Re: Not able to join cluster with Zookeeper based IP finder

2016-12-05 Thread ghughal
Yes, issue is only reproducible when nodes are started simultaneously. We are using marathon (on mesos) to start apps so we don't have control over when node starts. Marathon almost always starts multiple instance at same time. I'm attaching logs for both nodes as well entrie from zookeeper. Pleas

Re: Building complex queries to query ignite Cache

2016-12-05 Thread vdpyatkov
Please, see my answer in upper post. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Building-complex-queries-to-query-ignite-Cache-tp9392p9398.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Building complex queries to query ignite Cache

2016-12-05 Thread Vladislav Pyatkov
Hi, I see a way to improve the approach. 1) You use "affinity collocation"[1] by TradeType (that allow to match partition of cache and TreadeType). 2) Add index by TradeStatus[2] (that accelerate a SQL query by TradeStatus). 3) Use affinity call[3] (with asinc) by particular TradeType and execut

Re: Building complex queries to query ignite Cache

2016-12-05 Thread Andrey Mashenkov
Hi, You can try to add index with setting: cacheConfig.setIndexedTypes(Integer.class, Trade.class); and annotate "status" field with @QuerySqlField(index = true) Then you will be able to make sql query with grouping, smth like: "select count(*) from Trade group by status; If you need to group b

Re: Building complex queries to query ignite Cache

2016-12-05 Thread begineer
Hi, Thanks for reply. I need this map to build a dashboard UI page which looks like below(image attached). So specific part of entries would still be more than 100,000 items which is minimum as data set for given input parameters. So just wondering if some inbuilt query could help me here.

Re: Building complex queries to query ignite Cache

2016-12-05 Thread Vladislav Pyatkov
Hi You should explain your task in detail. What for are you get all entries as map in one node? You can get increase performance if you will get only local entries (or particular partition entries on thread) on node. What will you do with huge map? You can to get only specific part of entries (usi

Re: Apache Spark & Ignite Integration

2016-12-05 Thread pragmaticbigdata
I have tried translating my understanding in these two images. Kindly let me know if the diagrams depict the ignite-spark integration in terms of data visibility and persistence correctly.

Building complex queries to query ignite Cache

2016-12-05 Thread begineer
Hi, I have below sample bean which I am storing as value in cache. I want to build a map such that it gives me count of trade status for each trade type(Pls see sample output, done thru java 8 streams). Problem with this approach is I have to pull millions of entries from cache to some collection

Re: Problem with ReentranLocks on shutdown of one node in cluster

2016-12-05 Thread Taras Ledkov
Hi, Thanks a lot for reproducible scenario and for the test. I create the issue to track: https://issues.apache.org/jira/browse/IGNITE-4369. On Wed, Nov 30, 2016 at 7:35 PM, vladiisy wrote: > Hi, > > i have a problem with my application using reentrant locks, they seems to > going corrupt after

Re: Not able to join cluster with Zookeeper based IP finder

2016-12-05 Thread Taras Ledkov
Hi, So, is the case reproduced only when the nodes are started simultaneously? Could you add any delay between instances starts? Looks like an issue. Please provide the logs, please. On Thu, Dec 1, 2016 at 1:29 AM, ghughal wrote: > We are seeing intermittent issue where ignite node is not ab