Re: Adding TTL to new or existing table

2019-11-21 Thread akorensh
Hi, You can create a cache template with expiry set:

Adding TTL to new or existing table

2019-11-21 Thread devinbost
We created a table (which automatically creates a cache in Ignite), but we need to apply a TTL/expiration to the data. We've figured out how to do this with a table-less cache, but we need to do this with a cache that's linked to a table. We can recreate the table if necessary to add the TTL, but i

Re: Cannot Run Spatial Query Example

2019-11-21 Thread Humphrey
I’ve never used that setup before, so can’t help you there. Mostly I just downloaded the zip distribution [1] and unpack it. You can drop the extra jars needed in the lib folder. Hope this helps you to get it working. Let me know when you succeed. [1] https://ignite.apache.org/download.cgi#bina

Re: Cannot Run Spatial Query Example

2019-11-21 Thread richard.ows...@viasat.com
I see, thank you. I was trying to deploy the dependencies to an Ignite Cluster installed with the DEB Setup: https://apacheignite.readme.io/docs/rpm-and-deb-setup I was under the impression that I could deploy the ignite-geospatial jar dependency and it should work? -- Sent from: http://apach

Re: how to config On-Heap Caching by xml files?

2019-11-21 Thread Ilya Kasnacheev
Hello! Onheap is also obviously availabye by doing onheapCacheEnabled=true (and preferably copyOnRead=false if you're ready to be careful to never modify these objects). Regards, -- Ilya Kasnacheev чт, 21 нояб. 2019 г. в 16:57, Pavel Tupitsyn : > > Data in Ignite is *always* stored off-heap

Re: excessive timeouts and load on new cache creations

2019-11-21 Thread ihalilaltun
Hi Anton, Timeouts can be found at the logs that i shared; [query-#13207879][GridMapQueryExecutor] Failed to execute local query. org.apache.ignite.cache.query.QueryCancelledException: The query was cancelled while executing. huge loads on server nodes are monitored via zabbix agent;

Re: Streaming exception

2019-11-21 Thread Ilya Kasnacheev
Hello! Increasing checkpoint page buffer is very useful, this is the approach I recommend taking. Also, we recommend using SSD with Ignite and not HDDs. Regards, -- Ilya Kasnacheev чт, 21 нояб. 2019 г. в 01:23, Mikael : > Hi! > > When I get timeout exceptions on the striping threads (like bel

Re: excessive timeouts and load on new cache creations

2019-11-21 Thread akurbanov
Hello, could you please provide the samples for such timeouts and huge load, how do you measure it? Quick glance shows only one really large VM pause: 2019-11-21T10:28:30.062+: 4734099.138: [Full GC (Allocation Failure) 8169M->3377M(8192M), 8.7213845 secs] [Eden: 0.0B(408.0M)->0.0B(408.0M

Re: Apache Ignite High Memory Usage

2019-11-21 Thread Abdulrahman Semrie
The objects are relatively large objects but not large enough to warrant using 8.5GB of memory because loading the objects into memory from a file without using Ignite doesn’t use that much memory. However, as you mentioned if there is 200MB overhead for 1MB object then it might make sense why i

Re: Issue while using transactions in sql apache ignite console grid gain

2019-11-21 Thread akurbanov
Hello, what do you use to execute there queries? Could you please try using JDBC and check if it is working there. Also, please share the cache configuration, do you use TRANSACTIONAL_SNAPSHOT? https://apacheignite.readme.io/docs/multiversion-concurrency-control -- Sent from: http://apache-

excessive timeouts and load on new cache creations

2019-11-21 Thread ihalilaltun
Hi Igniters, Everytime a new cache is created dynamically we get exessive number of timeouts and huge load on grid nodes. Current grid-node metrics are the followings; [2019-11-21T14:03:16,079][INFO ][grid-timeout-worker-#199][IgniteKernal] Metrics for local node (to disable set 'metricsLogFrequ

Re: Benefits of near cache other than get() ?

2019-11-21 Thread Igor Belyakov
Hi, In case near cache contains requested data it will be used for read operations, such as get() and getAll(). If all the data from the cache doesn't fit into Near cache, then eviction will be applied and existing records in the cache will be replaced by the records from the remote node. Capacity

Re: how to config On-Heap Caching by xml files?

2019-11-21 Thread Pavel Tupitsyn
> Data in Ignite is *always* stored off-heap On-heap caching is possible with Near Caches: https://apacheignite.readme.io/docs/near-caches On Thu, Nov 21, 2019 at 4:39 PM Stephen Darlington < stephen.darling...@gridgain.com> wrote: > What do you mean by “doesn’t work”? > > The on-heap cache is,

Re: how to config On-Heap Caching by xml files?

2019-11-21 Thread Stephen Darlington
What do you mean by “doesn’t work”? The on-heap cache is, effectively, a cache of a cache. Data in Ignite is always stored off-heap. That setting creates another copy of the data on-heap. Regards, Stephen > On 21 Nov 2019, at 13:34, ?青春狂-^ wrote: > > hi: > I want know how to config On-Heap

how to config On-Heap Caching by xml files?

2019-11-21 Thread ???????-^
hi: I want know how to config  On-Heap Caching by xml, i have config onheapCacheEnabled = true, but  i found it doesn??t work currectly??throw the  ignitevisitor.sh tools, only i can see off-heap infos.

Re: Does ignite suite for large data search without index?

2019-11-21 Thread c c
HI, We have some filter condition like this:age >= 18 and level =1 and gender = 1; (age >= 18 or level = 2) and hobby = 'music' If one cache for each column, join the result is complicate. Is there any way make searching without index fast? Mikael 于2019年11月21日周四 下午8:08写道: > Hi! > > One idea

Re: Overriding GridQueryProcessor

2019-11-21 Thread Ilya Kasnacheev
Hello! GridQueryProcessor is an internal class (residing in internal package) so it is not supposed to be user serviceable. It may work for you, but we can't support a configuration like this one. Regards, -- Ilya Kasnacheev ср, 20 нояб. 2019 г. в 18:22, Hemambara : > Hi > > In order to fix t

Re: Does ignite suite for large data search without index?

2019-11-21 Thread Mikael
Hi! One idea would be to have one cache for each column, so the key is name and value is the hobby for example, you get an index on the key for "free" and create one index on the value. If the cache does not contain name that person does not have a hobby, only names that does have a hobby is

Re: Support for Unique columns in Ignite

2019-11-21 Thread Shravya Nethula
Hi Anton, Thank you for the information. Regards, Shravya Nethula, BigData Developer, [cid:6447e351-fbb4-44f3-94f2-94b638753545] Hyderabad. From: akurbanov Sent: Thursday, November 21, 2019 5:23 PM To: user@ignite.apache.org Subject: Re: Support for Unique

Re: Support for Unique columns in Ignite

2019-11-21 Thread akurbanov
Hello, Unique constraints are not yet implemented in Ignite and I would assume they won't be generally available soon enough. The reasoning behind that is in general each put/insert is a distributed insert/put. There are some circumstances under which this operation might happen to be local: if c

Re: Does ignite suite for large data search without index?

2019-11-21 Thread c c
yes, we may add more columns in the future. You mean creating index create on one column or multiple columns? And some columns value difference are not big. So many index is not efficient and will cost a lot of ram and decrease update or insert performance(this table may udpate real time). So we th

Re: Apache Ignite High Memory Usage

2019-11-21 Thread Mikael
Hi! Difficult to say without knowing anything about the data, you say "the object", I assume you have lots of them ? How big is a serialized object, how many do you have ? Each entry in the cache have an overhead of around 200 bytes or so, so 1M entries have an overhead of 200MB, pages are 4

Re: Does ignite suite for large data search without index?

2019-11-21 Thread Mikael
Hi! Are the queries limited to something like "select name from ... where hobby=x and location=y..." or you need more complex queries ? If the columns are fixed to 15, I don't see why you could not create 15 indices, it would use lots of ram and I don't think it's the best solution either bu

Issue while using transactions in sql apache ignite console grid gain

2019-11-21 Thread harinath
Hi, I was trying to use Transactions in Console Grid. The following is my statement. BEGIN; INSERT INTO TempTable (id, name, LastName, age) VALUES (997, 'Avhy', 'Ghale', 32); COMMIT; While trying to execute the query i was encountering the following error Error: Unsupported DDL/DML operation: or

Apache Ignite High Memory Usage

2019-11-21 Thread xabush
I have a serialized object that I load into memory to use it as a cache for retrieving data. I am thinking of using Apache Ignite to scale my application so that I can distribute the object over multiple nodes. However, when trying to save the object in a single ignite cache, my program uses around

Re: Does ignite suite for large data search without index?

2019-11-21 Thread c c
HI, Mikael Thanks for you reply very much! The type of data like this: member [name, location, age, gender, hobby, level, credits, expense ...] We need filter data by arbitrary fileds combination, so creating index is not of much use. We thought traveling all data in memory work

Re: Does ignite suite for large data search without index?

2019-11-21 Thread Mikael
Hi! The comparison is not of much use, when you talk about ignite, it's not just to search a list, there is serialization/deserialization and other things to consider that will make it slower compared to a simple list search, a linear search on an Ignite cache depends on how you store data (o