Re: LOOK THORUGH THIS ERROR

2016-08-16 Thread Ravi Puri
No i'm not using maven . I am adding this jars to project and using it.. Everything was working fine but this error doesnt allow me to go forward..? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LOOK-THORUGH-THIS-ERROR-tp6977p7125.html Sent from the Apache Igni

Re: IgniteException: No FileSystem for scheme: hdfs

2016-08-16 Thread vikramT
Hi Vladimir, I tried the way you mentioned using java -cp, but still the error persists, can you please provide solution or an alternative as early as possible. tried command: java -cp /opt/apache-ignite-hadoop-1.7.0-bin/libs/ignite-hadoop/,/opt/cloudera/parcels/CDH-5.8.0-1.cdh5.8.0.p0.42/lib/ha

Re: Embedded mode ignite on spark

2016-08-16 Thread percent620
Can you please help me to fix this issue on this week, i will apply this function to our production env. thanks again for you great help on this issue. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Embedded-mode-ignite-on-spark-tp6942p7123.html Sent from the A

Re: Embedded mode ignite on spark

2016-08-16 Thread percent620
==5)=== SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/filecache/652/spark-assembly-1.6.0-hadoop2.5.0-cdh5.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/u01/hbase/hadoop-2.5

Re: Embedded mode ignite on spark

2016-08-16 Thread percent620
4) SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/filecache/785/spark-assembly-1.6.0-hadoop2.5.0-cdh5.3.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/u01/hbase/hadoop-

Re: Embedded mode ignite on spark

2016-08-16 Thread percent620
Thanks vkulichenko. 1)I have tried this code as your new method on our production env and submit to yarn cluster, final result is not correct, it seems that case data was lost. val sharedRDD = ic.fromCache(new CacheConfiguration[String, String]().setCacheMode(CacheMode.REPLICATED)); 2) this is a

Re: Cassandra - Ignite Exception

2016-08-16 Thread Igor Rudyak
Kamal, You see such *warnings* on client nodes because Cassandra throws such exceptions *NoHostAvailableException *or *ReadTimeoutException.* It happens when Cassandra node you are trying to communicate with is overloaded. In a such situation Ignite-Cassandra module just tries to retry the operati

what are the differences between put and replace method

2016-08-16 Thread timothy
what are the differences between put and replace API? in the document, replace method is described as Atomic method -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/what-are-the-differences-between-put-and-replace-method-tp7117.html Sent from the Apache Ignite Us

Re: Near Cache

2016-08-16 Thread javastuff....@gmail.com
How can I monitor NEAR cache? MBEAN and Visor not helping, is there another way? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Near-Cache-tp7033p7116.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: IgniteException: No FileSystem for scheme: hdfs

2016-08-16 Thread vkulichenko
Hi Vikram, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. vikramT wrote > I would like to know about how I can s

Re: CacheWriter#writeAll javadocs inconsistent with implementations ?

2016-08-16 Thread vkulichenko
Hi Kristian, That's actually a good point! I see that we're handling this properly in the cache store manager, but our own implementation are not correct. I created a ticket: https://issues.apache.org/jira/browse/IGNITE-3700 -Val -- View this message in context: http://apache-ignite-users.705

Re: Puzzled about JVM configuration

2016-08-16 Thread vkulichenko
I would also add that these setting are optimized for on-heap caches. If you have a different use case (especially if it's a compute use case which can introduce a lot of different types of load), additional tuning can be required. -Val -- View this message in context: http://apache-ignite-use

Re: Any plan for a book on Apache Ignite

2016-08-16 Thread Denis Magda
Shamim, The table of contents is impressive. Do you plan to sell the book or going to spread it out for free? In both the cases I don’t see anything wrong if we add the book to docs [1] or some other site section. However before adding it to the Apache Ignite main side I think that the book s

Re: Ignite read through cache with cache loader factory does not work with CreatedExpiryPolicy

2016-08-16 Thread vkulichenko
Hi, Please properly subscribe to the mailing list so that the community can receive email notifications for your messages. To subscribe, send empty email to user-subscr...@ignite.apache.org and follow simple instructions in the reply. itzmedinesh wrote > I have enabled read-through and created c

Re: IncompatibleClassChange error in Java/Spark/Ignite program

2016-08-16 Thread vkulichenko
Ranjit, Looks like this is because you using Spark 2.0.0, while Ignite module is based on 1.5.2 for now. Can you try with 1.5.2 and check if it helps? -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IncompatibleClassChange-error-in-Java-Spark-Ignite-progra

Re: LOOK THORUGH THIS ERROR

2016-08-16 Thread vkulichenko
Ravi, Can you use Maven to resolve dependencies? There are also transitive ones that can be missing. A lot of different issues are possible when you do this manually. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LOOK-THORUGH-THIS-ERROR-tp6977p7109.html

Re: Data collocation question

2016-08-16 Thread vkulichenko
AdamDec wrote > hmm...but I have several indexes///with different types, what than? In setIndexedTypes you have to provide classes that are scanned for annotations. These classes can define multiple indexes. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/

Re: IncompatibleClassChange error in Java/Spark/Ignite program

2016-08-16 Thread Ranjit
Hi Val, Really appreciate your responses. I did the following things but still see the error: 1. In IntelliJ, removed all dependent JARs 2. Deleted the ~/.m2/repository (local maven repo) 3. Reimported the POM.xml 4. Ran the program in debug, put breakpoints, inspected that the class definitio

Re: Puzzled about JVM configuration

2016-08-16 Thread Vladislav Pyatkov
Hello, Please, provide additional information. Can you provide thread dump from server? What processes doing on cluster? Need to understanding, where garbage is generated. On Tue, Aug 16, 2016 at 12:39 PM, yucigou wrote: > I'm a bit puzzled about the basic JVM configuration (which is said has

Re: Cannot get the data in Tableau

2016-08-16 Thread austin solomon
Hi Igor, I have specified "Cache" connection argument while connecting to Ignite's ODBC, also I can see the column names of the created schema. (Check my previous post for screen shots) I can't able to preview or query the cache. Below is my full xml configuration. http://www.springframework.o

Re: how to verify the cached elements in each of partitions

2016-08-16 Thread Alexey Goncharuk
Hi, If I understand correctly, you want to reduce the total number of partitions for your cache to 2. Is there any reason you want to do this? It is impossible to change the number of partitions without the full cluster restart, so if at some point in time you want to add more nodes to your cluste

Re: LOOK THORUGH THIS ERROR

2016-08-16 Thread Ravi Puri
THIS IS MY JAR LIST IN DEPENDENCIES which i reduced and matched as per ur suggestions . Still the same error , now what to do ? -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/LOOK-THORUGH-T

CacheWriter#writeAll javadocs inconsistent with implementations ?

2016-08-16 Thread Kristian Rosenvold
The javadocs for CacheWriter#writeAll say "If this operation fails (by throwing an exception) after a partial success, the writer must remove any successfully written entries from the entries collection so that the caching implementation knows what succeeded and can mutate the cache." Now it look

Re: how to verify the cached elements in each of partitions

2016-08-16 Thread Vladislav Pyatkov
Hi, At first. This method (public int partition(final Object key)) returns partition number by key, if you have 1024 partitions it must will be returned number between 0 and 1023. Look at the implementation for RendezvousAffinityFunction[1]. If you want to understand how partitions distributed by

Re: LOOK THORUGH THIS ERROR

2016-08-16 Thread Vladislav Pyatkov
Hi, Is you have reason to use variouse Ignite vertion library? It is not right, also I do not recomend to use betta relise (like 1.5.0-b1). Hibernate-core 4.1.8.final do not match Ignite 1.5.0.final. Look at the pom [1]. You need to use hibernate-core 4.2.6.Final, like at the dependency: org.hi

RE: Local mode recommended setup

2016-08-16 Thread Piubelli, Manuel
Perfect, that answers my question, thank you Vladislav. From: Vladislav Pyatkov [mailto:vldpyat...@gmail.com] Sent: 16 August 2016 11:49 To: user@ignite.apache.org Subject: Re: Local mode recommended setup Hello, If I understand correctly, you want to create node which works until it will by ca

Re: Local mode recommended setup

2016-08-16 Thread Vladislav Pyatkov
Hello, If I understand correctly, you want to create node which works until it will by cancelation by system (for eample by kill comand). If yes, you need do not invoke ignite.close() (explisitly or in try{} block): public static void main(String[] args) throws URISyntaxException, IOException {

Re: Ignite Compute - Rebalance Scenario

2016-08-16 Thread Taras Ledkov
Hi, Affinity job doesn't block rebalance. We reserve partition to prevent remove data from the node while job is running. So, topology is changed, partitions are moved to another nodes but data is available locally during affinity job. Magic! Please modify your test like below and be sure that

Local mode recommended setup

2016-08-16 Thread Piubelli, Manuel
Hi All, I am trying to setup a cluster in Local Mode: all my data fits in RAM and operations are read only , data is loaded from a cache or disk at startup. I have a very simple question: How can I configure some code to be run at startup of every node? When defining an own start class the ign

Rebalance is skipped

2016-08-16 Thread Sergii Tyshlek
Hello there! Some time ago we started moving from old GridGain to current Apache Ignite (1.6, now 1.7). Here are some cache config properties we use: cacheMode=PARTITIONED atomicityMode=ATOMIC atomicWriteOrderMode=PRIMARY writeSynchronizationMode=PRIM

Re: Fail to join topology and repeat join process

2016-08-16 Thread Jason
hi Vladislav, By scanning through the log, found that the serialization error may be the root cause. When the previous node of the new added node tried to send the messages (NodeAddedMessage/NodeAddFinishedMessage) to the new node, it failed, so it marked the new node as "failed" and sent an NodeF

RE: Ignite performance

2016-08-16 Thread Piubelli, Manuel
Hello, Just to close this off I separated the latency and throughput measurements and also noticed the main reason for the flat growth: a slow node in the cluster. With all clusters in the same subnet, I am seeing the following latencies: Latency (ms) Entries (K) 50 75 90 95 99

Puzzled about JVM configuration

2016-08-16 Thread yucigou
I'm a bit puzzled about the basic JVM configuration (which is said has proven to provide fairly smooth throughput without large spikes) on the Ignite JVM and System Tuning page (https://apacheignite.readme.io/docs/jvm-and-system-tuning): -XX:NewSize=128m -XX:MaxNewSize=128m -XX:MaxTenuringThresh

Re: Cassandra - Ignite Exception

2016-08-16 Thread Kamal C
Igor, I'm facing this issue in the cassandra nodes side. I've added a distributed lock (Ignite BinarySemaphore) in the client to avoid the error as you've mentioned when multiple clients start simultaneously. Sometimes, In client nodes, I face the below warnings: WARN [2016-07-30T10:11:08,092] C

Re: Ignite Compute - Rebalance Scenario

2016-08-16 Thread Kamal C
Vladislav, Partitions are moved to another node while executing the job. Val, I've tried with the latest nighty build. Still, it has the same behavior. To reproduce the issue, I've used `while(true)` inside the IgniteRunnable task. You can reproduce it with the below gist[1]. [1]: https://gist.