Same Affinity For Same Key On All Caches

2017-02-22 Thread Alper Tekinalp
Hi all. Is it possible to configures affinities in a way that partition for same key will be on same node? So calling ignite.affinity(CACHE).mapKeyToNode(KEY).id() with same key for any cache will return same node id. Is that possible with a configuration etc.? -- Alper Tekinalp Software Develo

Re: Pessimistic TXN did not release lock on a key, all subsequent txns failed

2017-02-22 Thread bintisepaha
Andrey, I finally have an error that might help. this happened again in production today for us. Ignite-Console-3.zip This is the last update that threw an error, after this error every update just times out. Th

Re: Missing records Ignite cache size grows

2017-02-22 Thread diopek
Val, Is it possible if there is a bug in CacheLoadOnlyStoreAdapter, below is my CacheStore object that extends CacheLoadOnlyStoreAdapter. Again, if we use Java Collection directly, count always matches so that rules out possibility of bug in our code that populates Ignite cache. Please advise. Than

Re: Scala API

2017-02-22 Thread timothy
thank you for your reply, it is very useful -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Scala-API-tp10793p10825.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Ignite cache range query using cache keys

2017-02-22 Thread diopek
we are doing pagination (like processing 5000 records at a time) during batch processing. thats where we use range query using cache keys, ScanWuery worked fine, SqlQuery throws the following exception that I posted earlier. we were debugging some missing records issue, I wanted to change cache que

Re: Missing records Ignite cache size grows

2017-02-22 Thread diopek
Within LoadOnlyCacheStore inputIterator method, we populate ArrayList>> collection and iterator of that collection is being returned from that method and also parse method is straight forward; *@Override protected IgniteBiTuple> parse(Tuple2> rec, Object... args) { return new T2<>(rec.v1(

Re: what is the message guaranteed level about distributed messaging

2017-02-22 Thread vkulichenko
If you're talking about IgniteMessaging API, then it's at least once. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-is-the-message-guaranteed-level-about-distributed-messaging-tp10781p10822.html Sent from the Apache Ignite Users mailing list archive

Re: IGNITE-2680

2017-02-22 Thread vkulichenko
I believe it was missed, I created a ticket: https://issues.apache.org/jira/browse/IGNITE-4748 Hopefully someone will fix it in 1.9. Feel free to pick it up ;) -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IGNITE-2680-tp10783p10821.html Sent from the Apa

Re: java.lang.OutOfMemoryError: Java heap space

2017-02-22 Thread vkulichenko
Saif, Out of memory means that you're out of heap memory. Note that there is at least half a minute between latest metrics print out and the failure, so it's very possible. Take a heap dump and check what is consuming memory. You can also try to simple increase heap size. -Val -- View this mes

Re: How to force all node to join cluster

2017-02-22 Thread vkulichenko
Ranjit, What are the addresses you provide in config and on which addresses nodes are started? If configuration is correct, check that there are no firewall issues, etc. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-force-all-node-to-join-cluster

Re: Get high throughput for loading data in ignite

2017-02-22 Thread vkulichenko
I think the answer is no. Partition-aware loading implies selecting subset of data based on partition, while Kafka is a queue that streams entries. I actually don't see why you would use anything except IgniteDataStreamer to loading the data from Kafka. -Val -- View this message in context: ht

Re: Lucene like Contains phrase query

2017-02-22 Thread vkulichenko
Ranjit, Can you clarify what you mean by that? Why doesn't Lucene work for you? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Lucene-like-Contains-phrase-query-tp10808p10817.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Missing records Ignite cache size grows

2017-02-22 Thread vkulichenko
It looks like you have your own implementation of CacheStore. I believe the error can be there, try to debug it and see where the data is lost. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Missing-records-Ignite-cache-size-grows-tp10809p10816.html Sent f

Re: Ignite cache range query using cache keys

2017-02-22 Thread vkulichenko
Hi, If you search only based on key, I would recommend to use get() and getAll() methods instead of SQL. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-cache-range-query-using-cache-keys-tp10717p10815.html Sent from the Apache Ignite Users mailing

Re: NOT IN in ignite

2017-02-22 Thread vkulichenko
Anil, I meant that you CAN set this flag per query when using IgniteCache API, but not JDBC. And I don't know any way to do this in JDBC, API just doesn't provide it. So the limitation you mention before makes sense, but it more cause by JDBC rather than Ignite. If you have ideas on how to overcom

Real-time computing

2017-02-22 Thread Neeraj Vaidya
Hi, I have a use case where I need to perform computation on records in files (specifically files containing telecom CDRs). To this, I have a few questions : 1) Should I have just one client node which reads these records and creates Callable compute jobs for each record ? With just 1 client n

Re: Ignite cache range query using cache keys

2017-02-22 Thread diopek
While SqlQuery fails, ScanQuery works without any issue. Another issue we've notices some records are being missed when data loaded into IgniteCache gets larger. cache size() method returns 522511 records, 64 records less that 522575 which should be actual number of records in Ignite cache. if w

Re: getOrCreateCache hang

2017-02-22 Thread Matt Warner
One other observation: with the third application acting as just the server, and just one of the clients running, there is no issue. Only when there are multiple clients do I get the deadlock on getOrCreateCache. Matt -- View this message in context: http://apache-ignite-users.70518.x6.nabble.

Re: getOrCreateCache hang

2017-02-22 Thread Matt Warner
I tried three different scenarios: In the first, I updated both test projects to act as servers (setClientMode is commented out), but the two nodes do not seem to see each other and it results in conflicting primary keys at the database level, leading to errors. Second, I setClientMode on just on

Missing records Ignite cache size grows

2017-02-22 Thread diopek
We are experiencing missing cached records if number of records exceeds certain numbers Currently actual number of records from database is 522575 (key entries). After loading to Ignite Cache, and cache size returning 522511 records, missing 64 entries. if we replace Ignite Cache with regular java

Lucene like Contains phrase query

2017-02-22 Thread Ranjit Sahu
Hi Guys, As per my understanding as of today ignite provides free text search using lucene index. Is there any plan to support contains phrase search ? If not what is the best way to achive this. I was trying the sql like search but its very expensive. Thanks, Ranjit

Re: java.lang.NoClassDefFoundError: Could not initialize class org.apache.ignite.sink.flink.IgniteSink$SinkContext$Holder

2017-02-22 Thread dkarachentsev
Hi, I tried your sample and it works fine to me. In case of initialization error, exception would be thrown on IgniteSink constructor invocation step, but it looks like Holder was successfully intialized, but failed later. Could you please attach logs for provided example? -Dmitry. -- View thi

Re: Help Needed regarding Apache Ignite Deploying on Cloud Environment

2017-02-22 Thread Denis Magda
Hi Abhilash, By default, it should be able to deploy Apache Ignite in any kind of cloud environment thanks to a variety of IP finders available: https://apacheignite.readme.io/docs/cluster-config We don't have any specific integration with Cloud Foundry. However, you can give a try to a shared IP

Re: Get high throughput for loading data in ignite

2017-02-22 Thread rishi007bansod
hi, Is it possible to use partition aware data loading in case of streaming data? Like in my case I have stored data in kafka and then I am passing it to ignite instance, so in this case how can we use partition aware data loading? Example provided at link : http://apacheignite.gridgain.org/doc

Re: Ignite cache range query using cache keys

2017-02-22 Thread diopek
Hi Denis After adding cacheConfig.setIndexedTypes(Long.class, ArrayList.class), below is my current configuration; *CacheConfiguration> cacheCfg = new CacheConfiguration<>(cacheName); cacheCfg.setStartSize(startSize); cacheCfg.setCacheMode(CacheMode.LOCAL); cacheCfg.setIndexedTypes(Long.class,Ar

Re: getOrCreateCache hang

2017-02-22 Thread Matt Warner
I will try this in about 2 hours and let you know. > On Feb 22, 2017, at 5:43 AM, Nikolai Tikhonov wrote: > > Could you try start to server from java code and look at results? > > Thanks, > Nikolay > >> On Wed, Feb 22, 2017 at 4:36 PM, Matt Warner >> wrote: >> I am using the default configu

Re: getOrCreateCache hang

2017-02-22 Thread Matt Warner
Yes, the jar files contain the classes. You should be able to see this in the jar files created by the maven project I sent. > On Feb 22, 2017, at 5:45 AM, Nikolai Tikhonov wrote: > > Also are you sure that jar files from testIgnite1 and testIgnite2 projects > (which deployed into libs dir) c

Re: Scala API

2017-02-22 Thread Alexey Kuznetsov
Hi, If you are talking about Scalar module, it is a kind of deprecated. Ignite has nice API that could be easily used from directly Scala without any problems. On Wed, Feb 22, 2017 at 6:22 PM, timothy wrote: > Hi Guys: > > just want to know the Scala api for ignite, is it stable for > produ

Re: getOrCreateCache hang

2017-02-22 Thread Nikolai Tikhonov
Also are you sure that jar files from testIgnite1 and testIgnite2 projects (which deployed into libs dir) contain needed classes? Might be you have a build issue? On Wed, Feb 22, 2017 at 4:43 PM, Nikolai Tikhonov wrote: > Could you try start to server from java code and look at results? > > Than

Re: getOrCreateCache hang

2017-02-22 Thread Nikolai Tikhonov
Could you try start to server from java code and look at results? Thanks, Nikolay On Wed, Feb 22, 2017 at 4:36 PM, Matt Warner wrote: > I am using the default configuration for the server and starting it with > ignite.sh. > > Yes, the Store classes are being deployed into the Ignite libs direct

Re: getOrCreateCache hang

2017-02-22 Thread Matt Warner
I am using the default configuration for the server and starting it with ignite.sh. Yes, the Store classes are being deployed into the Ignite libs directory as well as part of the both testIgnite1 and testIgnite2. I feel like I'm missing something? Matt On Wed, Feb 22, 2017 at 4:50 AM, Nikolai

Re: Ignite cluster unstable when doing continuous query

2017-02-22 Thread Nikolai Tikhonov
Hi! You perform cache operation from filter. The callback is invoked from sensitive part of code and in synchronous mode it can lead to thread starvation and deadlock (see ContinuousQuery#setRemoteFilterFactory javadoc). @IgniteAsyncCallback was designed exactly for resolving this issue. > but it

Re: Ignite client doing asynchronously operation will be jammed

2017-02-22 Thread Nikolai Tikhonov
Hi! In current implementation .chain() and .listen() callbacks will be executed in completion thread (for your case in system pool) that leads to starvation. https://issues.apache.org/jira/browse/IGNITE-4477 You need to execute callback to other thread. For example: Executor exec = ... fut.list

Re: getOrCreateCache hang

2017-02-22 Thread Nikolai Tikhonov
Hi Matt! I've run your test and didn't faced with the issue. I used the following code for start server node (placed in your project): public class Server { public static void main(String[] args) throws Exception { TcpDiscoverySpi spi = new TcpDiscoverySpi(); TcpDiscoveryVmIpFinder

Re: How to configure MongoDB Client? I'm getting NotSerializableException

2017-02-22 Thread Alexey Goncharuk
Hi Mauricio, You encounter this exception because SingletonFactory actually stores a reference to the factory instance which is later is serialized. Instead of SingletonFactory, you can use org.apache.ignite.configuration.IgniteReflectionFactory which does not store this reference and can be succe

Scala API

2017-02-22 Thread timothy
Hi Guys: just want to know the Scala api for ignite, is it stable for production, is it always updated when ignite update ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Scala-API-tp10793.html Sent from the Apache Ignite Users mailing list archive at Nabbl

Re: GROUP_CONCAT function is unsupported

2017-02-22 Thread Sergi Vladykin
Yes, this stuff is not implemented right now. Patches are welcome! Sergi 2017-02-22 8:39 GMT+03:00 zaid : > Related to the question: > > http://apache-ignite-users.70518.x6.nabble.com/List-of- > supported-SQL-functions-same-as-H2-td10722.html > > > > -- > View this message in context: http://apa

Re: List of supported SQL functions (same as H2?)

2017-02-22 Thread Sergi Vladykin
I don't see any right now. Patches are welcome! Sergi 2017-02-22 2:32 GMT+03:00 Denis Magda : > Sergi, > > Is there any technical reason that prevents us supporting GROUP_CONCAT? > > — > Denis > > > On Feb 21, 2017, at 2:46 AM, zaid wrote: > > > > > > Yes, everything that is supported in H2 ava

Re: Node hangs while accessing cache from Compute Task

2017-02-22 Thread GB
Thanks Dmitry. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Node-hangs-while-accessing-cache-from-Compute-Task-tp10637p10790.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

How to force all node to join cluster

2017-02-22 Thread Ranjit Sahu
Hi, I am having issue making all nodes joining one topology. What i am trying to do is start one server node first. And pass the ip address of that to other nodes using the vm ip finder and start those. val ipFinder = new TcpDiscoveryVmIpFinder(); ipFinder.setAddresses(addresses); When i star