Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Vladimir Ozerov
Igniters, I see growing community interest to implementation of so-called "clients" to other platforms, such as R, Python, etc.. Let me briefly describe architecture of our existing integrations - C++ and .NET. *1) Not a client!* We do not have clients in classical sense. Our C++ and .NET integra

Re: Write IgniteUuid with BinaryMarshaller

2017-01-25 Thread Pavel Tupitsyn
Val, Not sure about UUID. It is a very common thing and writing it as an object will introduce a lot of overhead (17 bytes now vs 40+ bytes for object). May be we should even add a special case for IgniteUuid? On Wed, Jan 25, 2017 at 1:52 AM, Dmitriy Setrakyan wrote: > Why not add IgniteUuid t

[jira] [Created] (IGNITE-4611) Write IgniteUuid with BinaryMarshaller

2017-01-25 Thread Pavel Tupitsyn (JIRA)
Pavel Tupitsyn created IGNITE-4611: -- Summary: Write IgniteUuid with BinaryMarshaller Key: IGNITE-4611 URL: https://issues.apache.org/jira/browse/IGNITE-4611 Project: Ignite Issue Type: Impro

Re: Write IgniteUuid with BinaryMarshaller

2017-01-25 Thread Pavel Tupitsyn
Ticket created: https://issues.apache.org/jira/browse/IGNITE-4611 Linked to the "Apache Ignite 2.0 quick and needed tasks" https://issues.apache.org/jira/browse/IGNITE-4547 On Wed, Jan 25, 2017 at 11:27 AM, Pavel Tupitsyn wrote: > Val, > > Not sure about UUID. > It is a very common thing and wr

[GitHub] ignite pull request #1460: IGNITE-4582 Async API: IgniteFileSystem refactori...

2017-01-25 Thread tledkov-gridgain
GitHub user tledkov-gridgain opened a pull request: https://github.com/apache/ignite/pull/1460 IGNITE-4582 Async API: IgniteFileSystem refactoring You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-458

Re: Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Shashank Gandham
So if we have to make full-fledged python platform for ignite. We can use C++ common API to integrate and have an high level API of Python. Object serialisation can be achieved in python using libraries like marshal, pickle, shelve or something similar. Theoretically speaking this should be pos

Re: Updates reordering in transaction with cache store

2017-01-25 Thread Yakov Zhdanov
Val, actually there is no reordering. It seems you use pessimistic repeatable read transaction and entries are flushed into DB in the same order entries are locked in memory. You can do: 1. Lock all the keys in the same order, i.e. add cache.get("key1"); 2. switch to non-repeatable read transactio

[jira] [Created] (IGNITE-4612) Minor code cleanup

2017-01-25 Thread Alexander Menshikov (JIRA)
Alexander Menshikov created IGNITE-4612: --- Summary: Minor code cleanup Key: IGNITE-4612 URL: https://issues.apache.org/jira/browse/IGNITE-4612 Project: Ignite Issue Type: Task

Re: Unused variables in code

2017-01-25 Thread Александр Меньшиков
Okay, I created issue: https://issues.apache.org/jira/browse/IGNITE-4612 2017-01-24 18:19 GMT+03:00 Alexey Kuznetsov : > I think it is better to have such issue in JIRA "Minor code cleanup": > > 1) Cleanup unused imports. > 2) Rename e -> ignored > 3) Remove unused variables > 4)... > 5) PROFIT

[GitHub] ignite pull request #1461: IGNITE-4562 .NET: Add mapping for BinaryObjectExc...

2017-01-25 Thread ptupitsyn
GitHub user ptupitsyn opened a pull request: https://github.com/apache/ignite/pull/1461 IGNITE-4562 .NET: Add mapping for BinaryObjectException You can merge this pull request into a Git repository by running: $ git pull https://github.com/ptupitsyn/ignite ignite-4562 Alterna

[GitHub] ignite pull request #1461: IGNITE-4562 .NET: Add mapping for BinaryObjectExc...

2017-01-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/ignite/pull/1461 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] ignite pull request #1462: IGNITE-4583 Async API: Other components refactori...

2017-01-25 Thread tledkov-gridgain
GitHub user tledkov-gridgain opened a pull request: https://github.com/apache/ignite/pull/1462 IGNITE-4583 Async API: Other components refactoring You can merge this pull request into a Git repository by running: $ git pull https://github.com/gridgain/apache-ignite ignite-458

Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Vladimir Ozerov
Igniters, Please see this article [1] from Kotlin guys. They had to re-pack public API because Java 9 doesn't allow several modules to share the same public package. Looks like this limitation could impact us at some point, so that we will not be able to support Java 9 without breaking API changes

[jira] [Created] (IGNITE-4613) Allow to create text index without sql table

2017-01-25 Thread Vladimir Ozerov (JIRA)
Vladimir Ozerov created IGNITE-4613: --- Summary: Allow to create text index without sql table Key: IGNITE-4613 URL: https://issues.apache.org/jira/browse/IGNITE-4613 Project: Ignite Issue Typ

Re: Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Yakov Zhdanov
Agree. We need to start tests with 9 as soon as possible. --Yakov 2017-01-25 16:47 GMT+03:00 Vladimir Ozerov : > Igniters, > > Please see this article [1] from Kotlin guys. They had to re-pack public > API because Java 9 doesn't allow several modules to share the same public > package. Looks lik

Re: IGNITE-4374 - Ignite should validate JVM and OS configuration and output warning in log

2017-01-25 Thread Vyacheslav Daradur
GridPerformanceSuggestions isn't changed. JVM checks are encapsulated in JvmConfigurationSuggestions OS checks are encapsulated in OsConfigurationSuggestions More information.

[jira] [Created] (IGNITE-4614) .NET: Binary schema is not reset in BinaryReader

2017-01-25 Thread Pavel Tupitsyn (JIRA)
Pavel Tupitsyn created IGNITE-4614: -- Summary: .NET: Binary schema is not reset in BinaryReader Key: IGNITE-4614 URL: https://issues.apache.org/jira/browse/IGNITE-4614 Project: Ignite Issue T

Re: moving to geronimo JCache jar

2017-01-25 Thread Denis Magda
We need to replace content of ignite-core-licenses.txt file which is the following at the moment // -- // List of ignite-core module's dependencies provided as a part of this distribution // which licenses differ from Apache Softwar

Error Retrieving data from IgniteCache

2017-01-25 Thread hemanta
We are using Ignite version 1.6 and everything is looking good except one new machine which has all same configurations. However we are seeing below error in log file. INFO | jvm 1 | 2017/01/25 11:09:04 | at java.lang.Thread.run(Thread.java:745) INFO | jvm 1 | 2017/01/25 11:09:04 | Caused by: cla

Re: Write IgniteUuid with BinaryMarshaller

2017-01-25 Thread Valentin Kulichenko
Pavel, Makes sense, I think this is the best way. -Val On Wed, Jan 25, 2017 at 12:27 AM, Pavel Tupitsyn wrote: > Val, > > Not sure about UUID. > It is a very common thing and writing it as an object will introduce a lot > of overhead (17 bytes now vs 40+ bytes for object). > > May be we should

Re: Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Dmitriy Setrakyan
+1 On Wed, Jan 25, 2017 at 6:45 AM, Yakov Zhdanov wrote: > Agree. We need to start tests with 9 as soon as possible. > > --Yakov > > 2017-01-25 16:47 GMT+03:00 Vladimir Ozerov : > > > Igniters, > > > > Please see this article [1] from Kotlin guys. They had to re-pack public > > API because Java

Re: Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Nikita Ivanov
+1 -- Nikita Ivanov On Wed, Jan 25, 2017 at 12:31 PM, Dmitriy Setrakyan wrote: > +1 > > On Wed, Jan 25, 2017 at 6:45 AM, Yakov Zhdanov > wrote: > > > Agree. We need to start tests with 9 as soon as possible. > > > > --Yakov > > > > 2017-01-25 16:47 GMT+03:00 Vladimir Ozerov : > > > > > Ignite

Re: Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Dmitriy Setrakyan
On Wed, Jan 25, 2017 at 1:12 AM, Shashank Gandham wrote: > So if we have to make full-fledged python platform for ignite. We can use > C++ common API to integrate and have an high level API of Python. Object > serialisation can be achieved in python using libraries like marshal, > pickle, shelve

Re: Regarding gsoc 2017

2017-01-25 Thread Denis Magda
Hello Prakhar, Please join this discussion. http://apache-ignite-developers.2346864.n4.nabble.com/Read-this-if-you-want-to-integrate-Ignite-with-other-platforms-Python-R-etc-td14006.html

Re: Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Denis Magda
> On Jan 25, 2017, at 12:09 AM, Vladimir Ozerov wrote: > > *1) Not a client!* > We do not have clients in classical sense. Our C++ and .NET integration are > fully-fledged platforms. C++/.NET node can act both as a client and as a > server. This is a good point. To avoid confusion I renamed res

Re: Error Retrieving data from IgniteCache

2017-01-25 Thread Denis Magda
You’re trying to deserialize some object on that machine and it misses object’s class. Try to find out what the object is and either add its class to the classpath of the machine or (preferably) try to use binary marshaller for this class avoiding deserialization. https://apacheignite.readme.io/

Re: Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Denis Magda
Vovan, As far as I understand, under the module they mean new component/feature of Java 9 [1]. If you don’t use Java modules then there shouldn’t be any issues at all. In any case, let me try to build the project with JDK 9 that has passed feature complete phase. [1] http://openjdk.java.net/p

Re: about lucene version dependent on ignite-indexing module

2017-01-25 Thread Denis Magda
Hi, Here is a ticket for that. https://issues.apache.org/jira/browse/IGNITE-3562 As a temporary solution can you exclude the new version from your maven file? Sergi, Igniters, Is there any technical reason why we’re still on this ancient vers

Re: Should we take care of Java 9 in Ignite 2.0 scope?

2017-01-25 Thread Denis Magda
Well, the build fails almost immediately on the latest JDK 9. This is the reason (https://issues.jenkins-ci.org/browse/JENKINS-25993 ). [ERROR] Failed to execute goal on project ignite-tools: Could not resolve dependencies for project org.apac

Re: Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Dmitriy Setrakyan
Should we add this to our documentation somewhere? On Wed, Jan 25, 2017 at 2:59 PM, Denis Magda wrote: > > > On Jan 25, 2017, at 12:09 AM, Vladimir Ozerov > wrote: > > > > *1) Not a client!* > > We do not have clients in classical sense. Our C++ and .NET integration > are > > fully-fledged plat

Re: Updates reordering in transaction with cache store

2017-01-25 Thread Valentin Kulichenko
Yakov, I understand all that, but I think there is still a usability issue. Order of updates in a transactional persistent store can be very important due to constraints. And currently this order is unpredictable, counterintuitive and uncontrollable from user's point of view. I create a transacti

Error while running GridCommandLineLoaderTest in core module

2017-01-25 Thread Rohit Mohta
Hi, Running "mvn test" fails GridCommandLineLoaderTest for ignite-2.0 branch. I haven't looked deep into the test case, but this test under "core" uses a Spring XML file. The class responsible to read the configuration file and start Ignite is present under ignite-spring module. Should this te

Re: about lucene version dependent on ignite-indexing module

2017-01-25 Thread 李玉珏
If the new version is not available, we can only use the 3.5.0 version, because the major version of the incompatibility, we have to discuss this problem. Is this version used because of technical limitations? If there is no limit, our team can look at, assess the workload and time to see if t

Re: Read this if you want to integrate Ignite with other platforms (Python, R, etc.)

2017-01-25 Thread Vladimir Ozerov
Shashank, Dmitriy, In principle it should be possible to use 3rd party marshalling frameworks, but with some limitations. Java side expects objects in certain format. At the very high level it looks like [HEADER][BODY][FOOTER]. This is enough for Java to process the object. While you *MUST* marsh