Re: nodes are restarting when i try to drop a table created with persistence enabled

Hi, Stacktrace and exception message has some valuable details: org.apache.ignite.internal.mem.IgniteOutOfMemoryException: Failed to find a page for eviction [segmentCapacity=126515, loaded=49628, maxDirtyPages=37221, dirtyPages=49627, cpPages=0, pinnedInSegment=1, failedToPrepare=49628] I see a

Re: JavaDoc for Event's subjectId methods

Hi, Do we allow commits to master without a ticket? I can imagine only reverts as an exception. Otherwise a ticket is a primary process item. Work description, review, CI checks (we have a job checking javadocs). ср, 25 сент. 2019 г. в 01:15, Denis Magda : > > Denis, please feel free to go and e

Re: JavaDoc for Event's subjectId methods

Hello! I suggested to Maksim Stepachev include these changes in the scope of your thicket [1] and it looks like he agreed [2]. Maksim Stepachev, could you please reflect JavaDoc and behavior changes of events in your ticket? 1. https://issues.apache.org/jira/browse/IGNITE-11992 2. http://apache-

Re: New SQL execution engine

Folks, Thanks everyone for a hot discussion! Not every open source community has such open and boiling discussions. It means that people here really do care. And I am proud of it! As I understood, nobody is strictly against the proposed initiative. And I am glad that we can move forward (with som

Re: Apache Ignite 2.8 RELEASE [Time, Scope, Manager]

Maxim, Folks, Could you please share a results of the Slack discussion from Sep 25? ср, 25 сент. 2019 г. в 15:50, Dmitriy Pavlov : > > Hi Maxim, > > Thank you for preparing the release page! > > Could you please add Require release notes filter? You can find an example > in https://cwiki.apache.

Re: JavaDoc for Event's subjectId methods

Denis, I added it in my ticket and pull-request. Should I change the only first sentence or full comment? пн, 30 сент. 2019 г. в 11:27, Denis Garus : > Hello! > > I suggested to Maksim Stepachev include these changes in the scope of your > thicket [1] > and it looks like he agreed [2]. > > Maksi

Unassigned issue IGNITE-12174

Hi, I have opened a bug issue some time ago about a NullPointerException thrown if geospatial indexing is used together with durable memory: https://issues.apache.org/jira/browse/IGNITE-12174 Even though I provided a minimal reproducing code example the issue was not assigned or reviewed t

Re: JavaDoc for Event's subjectId methods

Thank you, Maksim! I think that the description should look like: "Gets security subject ID initiated this task event if IgniteSecurity is enabled, otherwise returns null. This property is not available for GridEventType#EVT_TASK_SESSION_ATTR_SET task event." Please pay close attention that descr

[jira] [Created] (IGNITE-12242) .NET: Add tests for Thin Client async continuation behavior

Pavel Tupitsyn created IGNITE-12242: --- Summary: .NET: Add tests for Thin Client async continuation behavior Key: IGNITE-12242 URL: https://issues.apache.org/jira/browse/IGNITE-12242 Project: Ignite

[jira] [Created] (IGNITE-12243) [Spark] Add support of HAVING without GROUP BY

Alexey Zinoviev created IGNITE-12243: Summary: [Spark] Add support of HAVING without GROUP BY Key: IGNITE-12243 URL: https://issues.apache.org/jira/browse/IGNITE-12243 Project: Ignite Iss

[jira] [Created] (IGNITE-12244) [Spark] Fix test with Multiple Joins

Alexey Zinoviev created IGNITE-12244: Summary: [Spark] Fix test with Multiple Joins Key: IGNITE-12244 URL: https://issues.apache.org/jira/browse/IGNITE-12244 Project: Ignite Issue Type: S

[jira] [Created] (IGNITE-12245) [Spark] Support of Null Handling in JOIN condition

Alexey Zinoviev created IGNITE-12245: Summary: [Spark] Support of Null Handling in JOIN condition Key: IGNITE-12245 URL: https://issues.apache.org/jira/browse/IGNITE-12245 Project: Ignite

[jira] [Created] (IGNITE-12246) [Spark] Add support of changes in External Catalog

Alexey Zinoviev created IGNITE-12246: Summary: [Spark] Add support of changes in External Catalog Key: IGNITE-12246 URL: https://issues.apache.org/jira/browse/IGNITE-12246 Project: Ignite

[jira] [Created] (IGNITE-12247) [Spark] Add initial support of Spark 2.4

Alexey Zinoviev created IGNITE-12247: Summary: [Spark] Add initial support of Spark 2.4 Key: IGNITE-12247 URL: https://issues.apache.org/jira/browse/IGNITE-12247 Project: Ignite Issue Typ

The Spark 2.4 support

Hi, Igniters I've started the work on the Spark 2.4 support We started the discussion here, in https://issues.apache.org/jira/browse/IGNITE-12054 The Spark internals were totally refactored between 2.3 and 2.4 versions, main changes touches - External catalog and listeners refactoring - Ch

Re: Improvements for new security approach.

Subject's size is unlimited, that can lead to a dramatic increase in traffic between nodes. >>I added network optimization for this case. I add a subject in the case when ctx.discovery().node(secSubjId) == null. Yes, this optimization is good, but we have to send SecurityContext whenever a cl

Re: Improvements for new security approach.

I suppose that code works only with requests are made from GridRestProcessor (It isn't a client, I call it like a fake client). As a result, you can't load security on demand. If you want to do it, you should transmit HTTP session and backward address of a node which received REST request. пн, 30

Re: Improvements for new security approach.

>>As a result, you can't load security on demand. Why? What is the difference between sending SecurityContext with every job's request and sending SecurityContext once when remote node demand it? пн, 30 сент. 2019 г. в 17:25, Maksim Stepachev : > I suppose that code works only with requests are

Fwd: Gracefully shutting down the data grid

Hi all, I am trying to deactivate a cluster which is being connected with few clients over JDBC. As part of these clients connections, it inserts some records to many tables and runs some long-running queries. At this time I am trying to deactivate the cluster [basically trying to take data backup

[jira] [Created] (IGNITE-12248) Apache Calcite based query execution engine

Igor Seliverstov created IGNITE-12248: - Summary: Apache Calcite based query execution engine Key: IGNITE-12248 URL: https://issues.apache.org/jira/browse/IGNITE-12248 Project: Ignite Issu

[jira] [Created] (IGNITE-12249) Concurrent guarantees for TransactionView

Nikolay Izhikov created IGNITE-12249: Summary: Concurrent guarantees for TransactionView Key: IGNITE-12249 URL: https://issues.apache.org/jira/browse/IGNITE-12249 Project: Ignite Issue Ty

Re: The Spark 2.4 support

Hi Alexey, As an external watcher very far from Ignite Spark integration I would like to ask a humble question for my understanding. Why this integration uses Spark internals? Is it a common approach for integrating with Spark? пн, 30 сент. 2019 г. в 16:17, Alexey Zinoviev : > > Hi, Igniters > I'

Re: The Spark 2.4 support

Yes, as I understand it uses Spark internals from the first commit))) The reason - we take Spark SQL query execution plan and try to execute it on Ignite cluster Also we inherit a lot of Developer API related classes that could be unstable. Spark has no good point for extension and this is a reason

Re: The Spark 2.4 support

Hello, Ivan. I had a talk about internals of Spark integration in Ignite. It answers on question why we should use Spark internals. You can take a look at my meetup talk(in Russian) [1] or read an article if you prefer text [2]. [1] https://www.youtube.com/watch?v=CzbAweNKEVY [2] https://habr.

Re: The Spark 2.4 support

Nikolay, Would you be able to review the changes? I'm not sure there is a better candidate for now. - Denis On Mon, Sep 30, 2019 at 11:01 AM Nikolay Izhikov wrote: > Hello, Ivan. > > I had a talk about internals of Spark integration in Ignite. > It answers on question why we should use Spark

Re: The Spark 2.4 support

Yes, I can :) В Пн, 30/09/2019 в 11:40 -0700, Denis Magda пишет: > Nikolay, > > Would you be able to review the changes? I'm not sure there is a better > candidate for now. > > - > Denis > > > On Mon, Sep 30, 2019 at 11:01 AM Nikolay Izhikov wrote: > > Hello, Ivan. > > > > I had a talk abou

Re: Unassigned issue IGNITE-12174

Hi Jan. Lucene and spatial indexes do not support persistence. This is known limitation which would probably be addressed in the future releases. пн, 30 сент. 2019 г. в 13:23, : > Hi, > > I have opened a bug issue some time ago about a NullPointerException > thrown if geospatial indexing is used

Re: Text queries/indexes (GridLuceneIndex, @QueryTextFiled)

Yuriy, I've seen you opening a pull-request with the first changes: https://issues.apache.org/jira/browse/IGNITE-12189 Alex Scherbakov and Ivan are you the right guys to do the review? - Denis On Fri, Sep 27, 2019 at 8:48 AM Павлухин Иван wrote: > Yuriy, > > Thank you for providing details!

Re: New SQL execution engine

Ivan, we need more of these discussions, totally agree with you ;) I've updated the Motivation paragraph outlining some high-level users we see by working with our users. Hope it helps. Let's carry on and let me send a note to Apache Calcite community. - Denis On Mon, Sep 30, 2019 at 1:56 AM Iv

Ignite community is building Calcite-based prototype

Hey ASF-mates, Just wanted to send a note for Ignite dev community who has started prototyping with a new Ignite SQL engine and Calcite was selected as the most favorable option. We will truly appreciate

Re: New SQL execution engine

Hello, Igniters. I extends IEP [1] with the tickets caused by H2 limitations. Please, let's write down requirements for engine in the IEP. https://cwiki.apache.org/confluence/display/IGNITE/IEP-33%3A+New+SQL+executor+engine+infrastructure В Пн, 30/09/2019 в 17:20 -0700, Denis Magda пишет: > Iva

[DISCUSSION][IEP-35] Replace RunningQueryManager with GridSystemViewManager

Hello, Igniters. Since the last release `RunningQueryManager` [1] was added. It used to track a running query. In IEP-35 [2] SystemView API was added. SystemView API supposed to be used to track all kinds of internal Ignite objects. I think this RunningQueryManager should be replaced [3] with t

Re: The Spark 2.4 support

Great talk and paper, I've learnt it last year пн, 30 сент. 2019 г., 21:42 Nikolay Izhikov : > Yes, I can :) > > В Пн, 30/09/2019 в 11:40 -0700, Denis Magda пишет: > > Nikolay, > > > > Would you be able to review the changes? I'm not sure there is a better > candidate for now. > > > > - > > Denis

Re: The Spark 2.4 support

Alexey, Nikolay, Thank you for sharing details! вт, 1 окт. 2019 г. в 07:42, Alexey Zinoviev : > > Great talk and paper, I've learnt it last year > > пн, 30 сент. 2019 г., 21:42 Nikolay Izhikov : > > > Yes, I can :) > > > > В Пн, 30/09/2019 в 11:40 -0700, Denis Magda пишет: > > > Nikolay, > > > >

Re: Improvements for new security approach.

Folks, Could you please create a slack channel to discuss this in an effective way? On Mon, Sep 30, 2019 at 5:36 PM Denis Garus wrote: > >>As a result, you can't load security on demand. > > Why? > What is the difference between sending SecurityContext with every job's > request and sending Sec