Re: Non-blocking PME discussion, ASF Slack, September 10, 13.00 (MSK)

2019-09-10 Thread Alexey Goncharuk
Anton, I will not be able to attend the meeting in person, so I will test this new communication channel from the other side. Let's see how well decisions and discussion is translated to the dev list :) пн, 9 сент. 2019 г. в 13:52, Anton Vinogradov : > Alexey, > thanks for pointing this. > > I'v

[jira] [Created] (IGNITE-12154) Test testCheckpointFailBeforeMarkEntityWrite fail in compression suit

2019-09-10 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created IGNITE-12154: -- Summary: Test testCheckpointFailBeforeMarkEntityWrite fail in compression suit Key: IGNITE-12154 URL: https://issues.apache.org/jira/browse/IGNITE-12154 P

[jira] [Created] (IGNITE-12155) [ML] Implementation of distributed estimator

2019-09-10 Thread Alexey Platonov (Jira)
Alexey Platonov created IGNITE-12155: Summary: [ML] Implementation of distributed estimator Key: IGNITE-12155 URL: https://issues.apache.org/jira/browse/IGNITE-12155 Project: Ignite Issue

[jira] [Created] (IGNITE-12156) [ML] Add meta information to models

2019-09-10 Thread Alexey Platonov (Jira)
Alexey Platonov created IGNITE-12156: Summary: [ML] Add meta information to models Key: IGNITE-12156 URL: https://issues.apache.org/jira/browse/IGNITE-12156 Project: Ignite Issue Type: Im

Re: The ASF Slack

2019-09-10 Thread Denis Mekhanikov
Anton, You need to have an apache email to register in the ASF Slack. Is it supposed to be like this? I don't think it's fair to limit the circle of communication this way. Non-blocking PME discussion is going to happen there, for example, and I won't be able to attend it, since I don't have an Ap

Re: The ASF Slack

2019-09-10 Thread Alex Plehanov
Denis, You don't need an apache email to register in the ASF Slack. Here is the link [1] to join with any email. [1]: https://s.apache.org/slack-invite вт, 10 сент. 2019 г. в 12:52, Denis Mekhanikov : > Anton, > > You need to have an apache email to register in the ASF Slack. Is it > supposed

Re: The ASF Slack

2019-09-10 Thread Denis Mekhanikov
Guys, please disregard my previous message. What I was missing is the following link: https://s.apache.org/slack-invite Denis On 10 Sep 2019, 12:52 +0300, Denis Mekhanikov , wrote: > Anton, > > You need to have an apache email to register in the ASF Slack. Is it > supposed to be like this? I don'

[ML] Distributed metrics computation

2019-09-10 Thread Алексей Платонов
Hi Igniters! I've been working on a prototype of distributed metrics computation for ML-models. Unfortunately, we don't have an ability to compute metrics in a distributed manner, so, it leads to gathering metric statistics to client node via ScanQuery and all flow of vectors from partitions will b

[jira] [Created] (IGNITE-12157) [ML] Implement distributed ROC AUC computation

2019-09-10 Thread Alexey Platonov (Jira)
Alexey Platonov created IGNITE-12157: Summary: [ML] Implement distributed ROC AUC computation Key: IGNITE-12157 URL: https://issues.apache.org/jira/browse/IGNITE-12157 Project: Ignite Iss

Re: [ML] Distributed metrics computation

2019-09-10 Thread Nikolay Izhikov
Hello, Alexey. Why do we need distributed metrics in the first place? It seems, there are many metric processing system out there: Prometheus, Zabbix, Splunk, etc. Each of then can aggregate metrics in many ways. I think, we should not use Ignite as an metrics aggregation system. What do you t

Re: [ML] Distributed metrics computation

2019-09-10 Thread Алексей Платонов
I mean metrics for model evaluation like Accuracy or Precision/Recall for ML models. It isn't same as system metrics (like throughput). Such metrics should be computed over a test set after model training. if it is interesting for you, please, have a look at this material: https://en.wikipedia.org/

Re: [ML] Distributed metrics computation

2019-09-10 Thread Vyacheslav Daradur
Hi, Alexey, I agree that Map-Reduce on demand looks more promising solution. We can use Compute tasks for implementation. 'Map' phase can be tunned to process data by some trigger (dataset update?) on ContiniousQuery manner and call 'Reduce' (with some cache?) on demand. On Tue, Sep 10, 2019 at

Re: [ML] Distributed metrics computation

2019-09-10 Thread Алексей Платонов
Hi, Vyacheslav, Thanks for the advice. Actually, we already have the MapReduce approach implementation in ML dataset and this implementation is based on compute task. So, I think that I just can to reuse this solution. Best regards, Alexey Platonov вт, 10 сент. 2019 г., 14:27 Vyacheslav Daradur :

Re: [ML] Distributed metrics computation

2019-09-10 Thread Alexey Zinoviev
Dear Alexey, thank you for your PR, as an author of non-distributed metrics should say, that it was fast solution to keep parity with Spark ML. I have no time to implement it via our internal MR approach and your pR is really helpful. Dear Nikolay, there is another kind of metrics (not that was me

[jira] [Created] (IGNITE-12158) Failing test RebuildIndexLogMessageTest on ignite-2.5-master

2019-09-10 Thread Denis Chudov (Jira)
Denis Chudov created IGNITE-12158: - Summary: Failing test RebuildIndexLogMessageTest on ignite-2.5-master Key: IGNITE-12158 URL: https://issues.apache.org/jira/browse/IGNITE-12158 Project: Ignite

[jira] [Created] (IGNITE-12159) Ignite spark doesn't support Alter Column syntax

2019-09-10 Thread Andrey Aleksandrov (Jira)
Andrey Aleksandrov created IGNITE-12159: --- Summary: Ignite spark doesn't support Alter Column syntax Key: IGNITE-12159 URL: https://issues.apache.org/jira/browse/IGNITE-12159 Project: Ignite

Re: Non-blocking PME discussion, ASF Slack, September 10, 13.00 (MSK)

2019-09-10 Thread Павлухин Иван
Anton, Thank you very much for performing the discussion! I found it pretty much useful. And I really like such kind of collaboration and hope that we will go forward in that direction. Looking forward for meeting minutes and slides. вт, 10 сент. 2019 г. в 10:24, Alexey Goncharuk : > > Anton, >

Re: Nabble message wrapping

2019-09-10 Thread Denis Magda
Denis, could you set up the dev list the way needed? - Denis On Thu, Aug 29, 2019 at 1:18 PM Denis Magda wrote: > Denis, > > I granted your account the admin access. Please do all the required > changes and let me know once done. > > - > Denis > > > On Thu, Aug 29, 2019 at 2:00 AM Denis Mekhan

Re: Start contributing Ignite

2019-09-10 Thread Denis Magda
Hello Lev! Welcome, it's nice to see you as part of the community. I've just added you to the contributors'rs list in JIRA. Please go ahead and select a task you'd like to work on. Btw, do you already have any Ignite-related experience? - Denis On Mon, Sep 9, 2019 at 6:36 AM Lev Agafonov wro