usage of Apache ignite as Key value DB

2018-01-17 Thread Rajesh Kishore
need for Ignite. The idea is to replace berkley db apis to Ignite apis to use Ignite as key value DB. I could not find any docs for the usage of ignite libraries to be used in the application. Any pointers please Thanks & Regards, Rajesh Kishore

Re: usage of Apache ignite as Key value DB

2018-01-17 Thread Rajesh Kishore
, you can't just use the key value store on it's own, a LOCAL > cache would be the closest to a Berkeley DB store. > > Docs at : https://apacheignite.readme.io/docs/data-grid > > > > Den 2018-01-17 kl. 11:05, skrev Rajesh Kishore: > >> Hi, >> >>

Re: usage of Apache ignite as Key value DB

2018-01-17 Thread Rajesh Kishore
w that can be configured Thanks, Rajesh On Wed, Jan 17, 2018 at 5:37 PM, Mikael wrote: > There are lots of examples not using SQL, have a look at: > > https://apacheignite.readme.io/docs/jcache > > Ignite implements the JCache API, just use get/put and so on. > > > Den 2018

Re: usage of Apache ignite as Key value DB

2018-01-18 Thread Rajesh Kishore
work on the entire cache even if items not > in RAM, if you use 3rd party persistence SQL queries will only work on > items in RAM. > > Hope that helps a little. > Mikael > > > Den 2018-01-17 kl. 13:30, skrev Rajesh Kishore: > > Hello Mikael, > > Thanks a ton for you

how to create Index for binary or byte type value

2018-01-18 Thread Rajesh Kishore
Hi All, The problem statement is in context of "In-Memory Data Grid" persistence enabled. I have requirement/limitation to store the value of a class's object as byte [] , understood by the application in certain format. IgniteCache cache = ignite.getOrCreateCache(cacheCfg); // here ke

Re: how to create Index for binary or byte type value

2018-01-18 Thread Rajesh Kishore
Yes, correct object is stored as byte array As my attribute name is not fixed. I want to have index on different attributes which is not directly visible as the pojo instance variable Rajesh On 19 Jan 2018 3:56 a.m., "vkulichenko" wrote: > Hi Rajesh, > > It's not clear what you're trying to ach

Re: how to create Index for binary or byte type value

2018-01-18 Thread Rajesh Kishore
Hi Val, Would indices be possible on binary data value , I dont think so. I think I will stick with the POJO for now. I have queries on indices and l am not relying on external persistence system. a) What are the different indices type Ignite supports apart from equality i.e does it support the

index for like criteria

2018-01-19 Thread Rajesh Kishore
Hi All, My query is on substring index working for Ignite. I am using - data grid , default file system persistence enabled. Let us say, I have Organization POJO and index defined on its field as defined below: public class Organization { /** */ private static final AtomicLong ID_GEN = n

query on BinaryObject index and table

2018-01-20 Thread Rajesh Kishore
Hi, I have requirement that my schema is not fixed , so I have to use the BinaryObject approach instead of fixed POJO I am relying on OOTB file system persistence mechanism My questions are: - How can I specify the indexes on BinaryObject? - If I have to use sql query for retrieving objects , wh

Re: query on BinaryObject index and table

2018-01-21 Thread Rajesh Kishore
I create the index? Thanks, Rajesh On Sun, Jan 21, 2018 at 12:25 PM, Denis Magda wrote: > > > > On Jan 20, 2018, at 7:20 PM, Rajesh Kishore > wrote: > > > > Hi, > > > > I have requirement that my schema is not fixed , so I have to use the > BinaryObject app

Ignite Index - unique or non unique

2018-01-24 Thread Rajesh Kishore
Hi All, Wanted to know - what does ignite supports unique or non -unique index. I have requirement to create non unique index on a field / group of field. Whats the way? Also, with the EXPLAIN plan , we can get to know the index used for a query, sometimes my log is not getting generated properl

Re: Ignite Index - unique or non unique

2018-01-25 Thread Rajesh Kishore
any pointers please Thanks, Rajes On Thu, Jan 25, 2018 at 10:07 AM, Rajesh Kishore wrote: > Hi All, > > Wanted to know - what does ignite supports unique or non -unique index. > I have requirement to create non unique index on a field / group of field. > Whats the way? >

cache configuration without Key

2018-01-28 Thread Rajesh Kishore
Hi All, I have a requirement to define a cache class, for which its instance qualifies only for value. public class EntryIndexedAttributes { @QuerySqlField( orderedGroups = { @QuerySqlField.Group( name = "generic_attr_idx", order = 0) , @QuerySqlField.Group( name = "gener

starting Ignite server in embedded mode

2018-01-28 Thread Rajesh Kishore
Hi All, We have requirement to manage Ignite server and client by the same application in embedded mode. Whats the way forward? Thanks, Rajesh

default location for ignite file db

2018-01-29 Thread Rajesh Kishore
Hi All. How do we determine the default location for ignite file based DB Thanks in advance -Rajesh

Re: starting Ignite server in embedded mode

2018-01-29 Thread Rajesh Kishore
ly shouldn't need two instances of ignite in the same > application. If you want your application to natively use Ignite and > > have server running alongside it, you can just make API calls on the > server instance, no need to create an additional client for that. > > >

Re: default location for ignite file db

2018-01-29 Thread Rajesh Kishore
> > > > Stan > > > > *From: *Rajesh Kishore > *Sent: *29 января 2018 г. 15:04 > *To: *user@ignite.apache.org > *Subject: *default location for ignite file db > > > > Hi All. > > How do we determine the default location for ignite file based DB > > Thanks in advance > > -Rajesh > > >

Re: cache configuration without Key

2018-01-29 Thread Rajesh Kishore
Thanks Ilya it answers my question On 29 Jan 2018 3:34 p.m., "ilya.kasnacheev" wrote: > Hello Rajesh! > > In Ignite, cache (and SQL table) maps not to one object but to two - key > and > value. > > Keys are unique per cache per cluster. They act as primary key in SQL and > as, well, keys in cach

RE: default location for ignite file db

2018-01-29 Thread Rajesh Kishore
tandard system location (e.g. /tmp on Linux) > > to store Ignite’s DB and other files such as logs. > > > > Stan > > > > *From: *Rajesh Kishore > *Sent: *29 января 2018 г. 15:18 > *To: *user@ignite.apache.org > *Subject: *Re: default location for ignite file db >

Issues with sub query IN clause

2018-02-01 Thread Rajesh Kishore
Hi All, As of now, we have less than 1 M records , and attribute split into few(3) tables with index created. We are using combination of join & IN clause(sub query) in the SQL query , for some reason this query does not return any response. But, the moment we remove the IN clause and use just th

Re: Issues with sub query IN clause

2018-02-01 Thread Rajesh Kishore
ity-considerations > [2] https://apacheignite.readme.io/docs/affinity- > collocation#section-collocate-data-with-data > > On Thu, Feb 1, 2018 at 3:44 PM, Rajesh Kishore > wrote: > >> Hi All, >> >> As of now, we have less than 1 M records , and attribute split into &g

Re: Issues with sub query IN clause

2018-02-01 Thread Rajesh Kishore
__C0_2 AS ATTRVALUE, __C0_3 AS ATTRSTYPE FROM PUBLIC.__T0 /* "Ignite_DSAttributeStore"."merge_sorted" */ ORDER BY 1 /* index sorted */]] Thanks -Rajesh On Fri, Feb 2, 2018 at 5:32 AM, Dmitriy Setrakyan wrote: > Rajesh, can you please show your query here toge

Re: Issues with sub query IN clause

2018-02-02 Thread Rajesh Kishore
3.ATTRVALUE = 'ldapsubentry') ORDER BY 1], [SELECT __C0_0 AS ENTRYID, __C0_1 AS ATTRNAME, __C0_2 AS ATTRVALUE, __C0_3 AS ATTRSTYPE FROM PUBLIC.__T0 /* "dn"."merge_sorted" */ ORDER BY 1 /* index sorted */]] Note that the subquery has no recor

Re: Issues with sub query IN clause

2018-02-02 Thread Rajesh Kishore
My bad still I am using the IN clause with variable parameter. I am exploring other queries. Thanks a ton Rajesh On 2 Feb 2018 10:41 p.m., "Rajesh Kishore" wrote: > Hi Andrey, > > This query remains stuck > "EXPLAIN SELECT store.entryID,store.attrName,store.attrVa

Re: Issues with sub query IN clause

2018-02-03 Thread Rajesh Kishore
+/ WHERE (ATTRVALUE = 'person') AND (ENTRYID IS ?1): ENTRYID = ST.ENTRYID */ ON 1=1 WHERE ST.ENTRYID = T.ENTRYID (1 row, 1 ms) How should I approach that "Ignite_DSAttributeStore".IGNITE_DSATTRIBUTESTORE full scan can be avoided ? Thanks in advance. -Rajesh

[Resolved]Re: Issues with sub query IN clause

2018-02-03 Thread Rajesh Kishore
= 'person' */ INNER JOIN "Ignite_DSAttributeStore".IGNITE_DSATTRIBUTESTORE ST__Z2 /* "Ignite_DSAttributeStore".IGNITE_DSATTRIBUTESTORE_ENTRYID_IDX: ENTRYID = T__Z1.ENTRYID */ ON 1=1 WHERE ST__Z2.ENTRYID = T__Z1.ENTRYID ORDER BY 1], [SELECT __C0_0 AS ENTRYI

slow query performance against berkley db

2018-02-05 Thread Rajesh Kishore
Hi, We are in the process of evaluating Ignite native persistence against berkely db. For some reason Ignite query does not seem to be performant the way application code behaves against berkley db Background: Berkley db - As of now, we have berkley db for our application and the data is stored a

Re: slow query performance against berkley db

2018-02-05 Thread Rajesh Kishore
You need to consider having multiple nodes and portion and collocate your > data before. > > Thanks, > C > > On 5 Feb 2018, at 16:36, Rajesh Kishore wrote: > > Hi, > > We are in the process of evaluating Ignite native persistence against > berkely db. For some

Re: slow query performance against berkley db

2018-02-05 Thread Rajesh Kishore
Any pointers please Thanks Rajesh On 5 Feb 2018 10:53 p.m., "Rajesh Kishore" wrote: > Hi Christos > > Does that mean Ignite cannot scale well against Berkley dB Incase of > single node? > > Regards > Rajesh > > On 5 Feb 2018 10:08 p.m., "Chri

Re: slow query performance against berkley db

2018-02-05 Thread Rajesh Kishore
nue to work? Ignite is not just SQL DB, Ignite is a distributed data grid, it's strongly consistent and HA database, please make this into account when comparing it with other solutions. Thanks, Mike. 2018-02-05 9:23 GMT-08:00 Rajesh Kishore : > Hi Christos > > Does that mean Ign

Re: slow query performance against berkley db

2018-02-06 Thread Rajesh Kishore
- The above query takes *24 sec* to retrieve the records which we feel defeats the purpose , our application existing berkley db can retrieve this faster. Question is - a) I have attached my application models & client code , am I doing something wrong

Re: slow query performance against berkley db

2018-02-06 Thread Rajesh Kishore
On 6 Feb 2018 6:11 p.m., "Rajesh Kishore" wrote: > Further to this, > > I am re-framing what I have , pls correct me if my approach is correct or > not. > > As of now, using only node as local cache and using native persistence > file system. The system has less num

Re: slow query performance against berkley db

2018-02-06 Thread Rajesh Kishore
does some level of scanning, then the more nodes you add, the > faster it will get. > > D. > > On Tue, Feb 6, 2018 at 5:02 PM, Rajesh Kishore > wrote: > >> Hi All >> Please help me in getting the pointers, this is deciding factor for us to >> further evaluate ign

code sample for cluster configuration

2018-02-07 Thread Rajesh Kishore
Hi, I want to try a two node setup for Ignite cluster with native file based persistence enabled . Any samples, or pointer ? -Rajesh

Re: code sample for cluster configuration

2018-02-07 Thread Rajesh Kishore
apacheignite.readme.io/docs/distributed-persistent-store. > > > 2018-02-07 13:14 GMT+03:00 Rajesh Kishore : > >> Hi, >> >> I want to try a two node setup for Ignite cluster with native file based >> persistence enabled . >> >> Any samples, or pointer ? >> >> >> -Rajesh >> > > > > -- > > Regards > > Pavel Vinokurov >

Re: slow query performance against berkley db

2018-02-08 Thread Rajesh Kishore
Igniters any pointers pls. Regards, Rajesh On Wed, Feb 7, 2018 at 9:15 AM, Rajesh Kishore wrote: > Hi Dmitry, > > Thanks a ton. > > What is not convincing to me is with just *.1 M in main table and* *2 M > records in other table * , sql query is taking around 24 sec, that is

ignite support for multii data center replication

2018-02-08 Thread Rajesh Kishore
Hi, Does Ignite replication works on Multi Data Center /WAN ? Regards, -Rajesh

Re: slow query performance against berkley db

2018-02-11 Thread Rajesh Kishore
Dear all Request you to kindly suggest me if my approach is wrong ? The idea of replacing berkley db with Ignite would not work out if the query is slow , whats the best model to be used with Ignite for my usecase. Thanks, Rajesh On Fri, Feb 9, 2018 at 9:38 AM, Rajesh Kishore wrote

Re: slow query performance against berkley db

2018-02-14 Thread Rajesh Kishore
Thanks Stan for looking into it. Unfortunately, it still takes 23 sec on 240gb RAM system, the corresponding EXPLAIN PLAN [[SELECT ST.ENTRYID, ST.ATTRNAME, ST.ATTRVALUE, ST.ATTRSTYPE FROM "objectclass".IGNITE_OBJECTCLASS T /* "objectclass".OBJECTCLASSNDEXED_ATTRVAL_IDX: ATTRVAL