[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.4.0 released

2021-04-22 Thread Ivan Daschinsky
https://archive.apache.org/dist/ignite/pyignite/0.4.0/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

Re: Get always return null in java thick client for data inserted in python thin client

2021-05-10 Thread Ivan Daschinsky
Hi, you should use IgniteCache in java. Pythoninc int maps directly to Long in java. If you want use Integer, you should put in python using key_hint like this: >> cache.put(1, (CollectionObject.HASH_SET, [1, 2, 3]), key_hint=IntObject) чт, 6 мая 2021 г. в 17:53, waipy : > > Hello, I am trying to

Re: Thin client access Ignite cluster with ZooKeeper Discovery

2021-05-26 Thread Ivan Daschinsky
Hi! I'm afraid that it is impossible. If you are using ZookeperDiscovery (not TcpDiscovery with TcpDiscoveryZookeeperIpFinder, this is important!), every ignite node maintains EPHEMERAL_SEQUENTIAL znode in /apacheIgnite/n/. But it doesn't contains any information regarding ip addresses, node attri

Re: Ignite Critical Failure -- Compound exception for CountDownFuture

2021-05-28 Thread Ivan Daschinsky
Hi! In this method we call fallocate with flags FALLOC_FL_PUNCH_HOLE | FALLOC_FL_KEEP_SIZE. Excerpts from man page of fallocate: Not all filesystems support FALLOC_FL_PUNCH_HOLE; if a filesystem doesn't support the operation, an error is returned. The operation is supported o

Re: Ignite Critical Failure -- Compound exception for CountDownFuture

2021-05-28 Thread Ivan Daschinsky
Hi, docker uses osxfs for shared filesystem (http://docs.docker.oeynet.com/docker-for-mac/osxfs/) It definitely doesn't support this functionality. But, I suppose that we should add checks that FS is eligible for compression and also proper error handling. fallocate returns -1 and sets errno, but w

Re: Ignite Critical Failure -- Compound exception for CountDownFuture

2021-05-28 Thread Ivan Daschinsky
Here is the ticket https://issues.apache.org/jira/browse/IGNITE-14796 пт, 28 мая 2021 г. в 10:57, Ivan Daschinsky : > > Hi, docker uses osxfs for shared filesystem > (http://docs.docker.oeynet.com/docker-for-mac/osxfs/) > It definitely doesn't support this functionality. > Bu

Re: Ignite crashed with CorruptedTreeException

2021-06-09 Thread Ivan Daschinsky
Hi Marcus. Yes, it is a bug on ignite, but I suppose that you insert UUID instead of String Here is the actual cause of CorruptedTreeException: Caused by: java.lang.UnsupportedOperationException: Value type doesn't match: exp=20, act=13 at org.apache.ignite.internal.processors.query.h2.database.i

Re: Ignite crashed with CorruptedTreeException

2021-06-09 Thread Ivan Daschinsky
I mean that you have accidentally insert string key, not UUID. During insertion, ignite checks types of key during updating index B+ tree and this check currently lead to CorruptedTreeException. ср, 9 июн. 2021 г. в 17:37, Ivan Daschinsky : > > Hi Marcus. Yes, it is a bug on ignite, but I s

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.5.0 released

2021-06-21 Thread Ivan Daschinsky
m here: https://dist.apache.org/repos/dist/release/ignite/pyignite/0.5.0/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

Re: Thin client data structures

2021-07-16 Thread Ivan Daschinsky
Hi! Pavel, it is fun stuff. But is there any real use case for this feature? I'd rather use RabbitMQ for this :) пт, 16 июл. 2021 г. в 13:28, Pavel Tupitsyn : > Igniters, > > I was asked a few times about Data Structures [1] in thin clients. > > While there are plans to add them eventually, it is

Re: Thin client data structures

2021-07-16 Thread Ivan Daschinsky
hat is possible :) > > On Fri, Jul 16, 2021 at 3:20 PM Ivan Daschinsky > wrote: > >> Hi! Pavel, it is fun stuff. But is there any real use case for this >> feature? I'd rather use RabbitMQ for this :) >> >> пт, 16 июл. 2021 г. в 13:28, Pavel Tupitsyn : &

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.5.1 released

2021-07-27 Thread Ivan Daschinsky
oad sources and binary packages (wheels) from here: https://dist.apache.org/repos/dist/release/ignite/pyignite/0.5.1/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.5.2 released

2021-09-17 Thread Ivan Daschinsky
wnload sources and binary packages (wheels) from here: https://dist.apache.org/repos/dist/release/ignite/pyignite/0.5.2/ Please let us know if you have any problems https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

[ANNOUNCE] Apache IGNITE python thin client (pyignite) 0.6.0 have been released

2022-11-16 Thread Ivan Daschinsky
https://ignite.apache.org/community/resources.html#ask Regards, Ivan Daschinsky on behalf of the Apache Ignite community.

Re: Ignite OpenSSL Vulnerability

2022-11-16 Thread Ivan Daschinsky
Few additional notes: You could also set OPENSSL_HOME env variable to the specific folder with the valid openssl binaries. вт, 8 нояб. 2022 г. в 13:01, Entwicklung : > Hello Stephen, > > so it‘s on my responsibility to install the correct version. > > Thank you for your quick answer. > > Guido >

Re: IGNITE ODBC and ADODB Recordset problem fetching data

2022-11-21 Thread Ivan Daschinsky
Could you please also share a document (an ms access file or ms excel file), that reproduces the issue? пн, 21 нояб. 2022 г. в 17:32, Igor Sapego : > Guido, > > Thank you for sharing logs. > > It seems like we do not support a bunch of connection and statement > attributes > which are used by AD

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-21 Thread Ivan Daschinsky
Couls you please specify the exact versions of pyignite and ignite-core (java thin client)? ср, 21 дек. 2022 г., 18:36 Айсина Роза Мунеровна : > Hola again! > > I accidently discovered some strange behaviour when trying to get value by > key in Python. > > I do this in part 3: > > cache = ignite_

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-21 Thread Ivan Daschinsky
to false, but on server side and pyignite it is by default enabled. But pyignite has an ability to detect this param after fetching the data. That is the reason why you code started working after fetching few data by a scan query. чт, 22 дек. 2022 г. в 09:13, Ivan Daschinsky : > Couls

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-21 Thread Ivan Daschinsky
Firstly, please run the java snippet, then run the python snippet I got this output: /home/ivandasch/.virtualenvs/pyignite-py38/bin/python /home/ivandasch/.config/JetBrains/PyCharm2022.2/scratches/scratch.py ValueType(name='test', version=1) чт, 22 дек. 2022 г. в 10:40, Ivan Daschinsky

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Ivan Daschinsky
nite', name: 'ignite-core', version: > ‘2.13.0’ in Java > > The same version that we have for production cluster. > > So how can I fix this? And where - in Python connection or server config? > > Thanks! > > > On 22 Dec 2022, at 10:40 AM, Ivan Daschinsky

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Ivan Daschinsky
Actually, cache doesn't care about what you put inside it. This is just a configuration of serialization. And this parameter must be the same throughout the cluster. Otherwise, surprises will arise undoubtedly

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Ivan Daschinsky
put this flag on server config? > > > On 22 Dec 2022, at 1:18 PM, Ivan Daschinsky wrote: > > Внимание: Внешний отправитель! > Если вы не знаете отправителя - не открывайте вложения, не переходите по > ссылкам, не пересылайте письмо! > > Actually, cache doesn't care abou

Re: [!!Массовая рассылка]Can't access binary key from Python client

2022-12-22 Thread Ivan Daschinsky
y we will set > compact_footer = True currently for our thin java client. > > Thank you very much for your help! > > On 22 Dec 2022, at 2:08 PM, Ivan Daschinsky wrote: > > It is required only for older java client. If you choose client version > 2.14.0, everything will wor

Re: DataRegion not releasing memory back to OS

2022-12-23 Thread Ivan Daschinsky
Hi, but Ignite doesn't and never did release memory back to the OS, except only on deactivation or shutting down. пт, 23 дек. 2022 г. в 10:46, Humphrey Lopez : > Hello, > > I've been doing some test with Ignite 2.14, creating one cache filling it > with data and then clearing back the cache, even

Re: DataRegion not releasing memory back to OS

2022-12-24 Thread Ivan Daschinsky
One more time, ignite doesn't call UNSAFE.freeMemory (default memory allocator) except on deactivation or shutting down. It allocates memory up to org.apache.ignite.configuration.DataRegionConfiguration#getMaxSize. Nothing more. No matter persistence is used or in-memory. пт, 23 дек. 2022 г. в 1

Re: Method get_all does not work in Python

2022-12-26 Thread Ivan Daschinsky
You can use unwrap_binary: data = cache.get_all([Key(id=10)]) for k,v in data.items(): print(client.unwrap_binary(k)) print(v) пн, 26 дек. 2022 г. в 11:31, Айсина Роза Мунеровна < roza.ays...@sbermarket.ru>: > Hola! > > I can’t use method *get_all* for caches from PyIgnite client. > The

Re: Method get_all does not work in Python

2022-12-26 Thread Ivan Daschinsky
Nope, unfotunately there is not any built in method. But it seems that this is not necessary at all to do this? def wrap_binary(client, value) : with BinaryStream(client) as stream: BinaryObject.from_python(stream, value) return (stream.getvalue(), 0) for k in data.keys():

Re: Method get_all does not work in Python

2022-12-26 Thread Ivan Daschinsky
meta registry and possibly with network requests. Possible solution is to return not a dictionary, but a list of kv tuples. But it will also break backward compatibility. I don't understand why this variant was not chosen. пн, 26 дек. 2022 г. в 18:52, Ivan Daschinsky : > Nope, unfotunate

Re: Method get_all does not work in Python

2022-12-26 Thread Ivan Daschinsky
Also, please use pyignite 0.6.0 if possible. пн, 26 дек. 2022 г. в 18:58, Ivan Daschinsky : > I perfectly understand that the API is awful, but there is no way to > change it without breaking backward compatibility. > > It is impossible to make classes with the metaclass Gener

[ANNOUNCE] Release pyignite-0.6.1

2023-03-02 Thread Ivan Daschinsky
Hi, Igniters! The release was releases and uploaded to pypi 02/17/22 Sorry for the late announcement

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
Hi, Dren! Unfortunatelly, pyignite doesn't have an efficient native serialization library, whereas psycopg2 has (it is a thin wrapper around libpq). I would suggest two options: 1. Reduce a default batch size like this : `client.sql("SELECT * FROM TABLE", page_size=10)`. Default 1024 seems too bi

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
An ignite odbc driver works well on linux and windows OSes, but it seems that it is impossible to compile it on Mac OS. вт, 14 мар. 2023 г. в 14:47, Ivan Daschinsky : > Hi, Dren! > > Unfortunatelly, pyignite doesn't have an efficient native serialization > library, whereas psyc

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
at 16:02, Igor Sapego wrote: > > Unfortunately, we do not have Mac agents, so we can not detect when > compilation on Mac OS is broken, so yeah... > > Best Regards, > Igor > > > On Tue, Mar 14, 2023 at 2:48 PM Ivan Daschinsky > wrote: > >> An ignite odbc dri

Re: pyignite - performance issue

2023-03-14 Thread Ivan Daschinsky
It seems that epoll-shim can help to mitigate this issue without much code. вт, 14 мар. 2023 г. в 21:11, Ivan Daschinsky : > Yep, it has been broken since the introduction of epoll in the network > code. So kqueue support needs to be implemented. > > вт, 14 мар. 2023 г. в 19

Re: Apache ignite 2.16

2024-01-23 Thread Ivan Daschinsky
Hi, today I've started voting for the release of ignite-ml-ext 1.0.0. It is expected to be released (if voting will be successful) in a few days. Stay tuned. пн, 22 янв. 2024 г. в 20:53, Stephen Darlington : > Moving to Java 21 has its own risks, and the chances of you being affected > by this vu

[ANNOUNCE] Apache Ignite ML Extension 1.0.0 released

2024-01-29 Thread Ivan Daschinsky
/org.apache.ignite/ignite-ml-ext Please let us know if you encounter any problems: https://ignite.apache.org/community/resources.html#ask --- Best Regards Ivan Daschinsky on behalf of Apache Ignite PMC

Re: [ANNOUNCE] Apache Ignite ML Extension 1.0.0 released

2024-01-29 Thread Ivan Daschinsky
All parsers also have been uploaded to maven central: https://central.sonatype.com/artifact/org.apache.ignite/ignite-ml-ext/dependents пн, 29 янв. 2024 г. в 12:00, Ivan Daschinsky : > The Apache Ignite Community is pleased to announce the release of Apache > Ignite ML Extension 1.0.0. &

Re: Apache ignite 2.16

2024-01-29 Thread Ivan Daschinsky
Hi, the extension has been released and uploaded to maven central https://central.sonatype.com/artifact/org.apache.ignite/ignite-ml-ext вт, 23 янв. 2024 г. в 16:37, Ivan Daschinsky : > Hi, today I've started voting for the release of ignite-ml-ext 1.0.0. It > is expected to be r

Re: IgniteCache.destory does delete CacheName*.dat file from persistent store directory

2018-06-09 Thread Ivan Daschinsky
Hi! This issue was fixed in 2.5 Fix to issue here -- https://issues.apache.org/jira/browse/IGNITE-8021 2018-06-09 16:21 GMT+03:00 aMark : > Hi, > > We are using Ignite 2.3 as distributed offheap persistent store to various > caches in a cache group. > When we create the cache, it creates the CA