Ivan, Thank you for initialising the master branch, much appreciate it.
Denis, Emmanouil,
We use both local server and mockito to write the tests for flink. Incase
of sink it is easier to use a local server mode and publish the data into
Ignite Sink where as in case of Ignite used as data source
Hi,
I just took another look at the Kafka Implementation and I realised that it
is a local implementation that is used on the tests (I thought it was a
server already existing somewhere).
It seems I might be able to spin up the Pub/Sub server locally (I found an
official tool which might work), in
Saikat, Roman,
What's your thinking? I'm not sure we set any infrastructure to validate
our Kafka or Flink integrations. For instance, for Flink we use Mockito
just to ensure that basic tests pass: https://en.wikipedia.org/wiki/Mockito
Our IP finders for AWS, GCE or K8 don't start up any environm
+1 for Alexey Goncharuk (binding)
пн, 28 окт. 2019 г. в 21:06, Denis Magda :
> Ignite community,
>
> Please cast a vote for one of the following candidates:
>
>- Alexey Goncharuk
>- Dmitry Pavlov
>- Nikolay Izhikov
>- Pavel Tupitsyn
>
> Everybody is encouraged to take part in the
Hi all,
That's great news! Yes I am ready to do a pull request on the new repo.
I believe it is ok to create a ticket for the Pub/Sub proposal [1].
My next question has to do with the CI and the integration tests. In order
for my tests to work, a local Pub/Sub server needs to be up and running.
I
Ignite community, the votes were spread this way.
Binding (votes of Ignite PMC members):
• Alexey Goncharuk - 3
• Dmitry Pavlov - 2
• Nikolay Izhikov - 3
• Pavel Tupitsyn - 1
Non-binding (votes of other community members):
• Alexey Goncharuk - 2
• Dmitry Pavlov - 11
• Nikolay Izhikov - 1
• Pavel
The vote is stopped. I'll share results in another email shortly.
-
Denis
On Thu, Oct 31, 2019 at 11:51 AM Ilya Lantukh wrote:
> +1 Alexey Goncharuk
>
> On Thu, Oct 31, 2019 at 12:53 PM Sergey Antonov >
> wrote:
>
> > +1 Dmitry Pavlov
> >
> > чт, 31 окт. 2019 г. в 13:59, Вячеслав Коптилин >:
Denis,
I am mostly concerned about gathering use cases. It would be great to
critically assess such cases to identify why it cannot be solved by
using distributed SQL. Also it sounds similar to some kind of "hints",
but very limited and with all hints drawbacks (impossibility to use
full strength
Ivan,
I was involved in a couple of such use cases personally, so, that's not my
imagination ;) Even more, as far as I remember, the primary reason why we
improved our affinityRuns ensuring no partition is purged from a node until
a task is completed is because many users were running local SQL fr
Denis,
Would be nice to see real use-cases of affinity call + local SQL
combination. Generally, new engine will be able to infer collocation
resulting in the same collocated execution automatically.
пт, 1 нояб. 2019 г. в 19:11, Denis Magda :
>
> Hi Igor,
>
> Local queries feature is broadly used
Hi Igor,
Local queries feature is broadly used together with affinity-based compute
tasks:
https://apacheignite.readme.io/docs/collocate-compute-and-data#section-affinity-call-and-run-methods
The use case is as follows. The user knows that all required data needed
for computation is collocated, a
Hi Igor!
IMO we need to maintain the backward compatibility between old and new
query engines as much as possible. And therefore we shouldn't change the
behavior of local queries.
So, for local queries Calcite's planner shouldn't consider the
distribution trait at all.
--
Kind Regards
Rom
Hi Igniters,
Working on new generation of Ignite SQL I faced a question: «Do we need local
queries at all and, if so, what semantic they should have?».
Current planing flow consists of next steps:
1) Parsing SQL to AST
2) Validating AST (against Schema)
3) Optimizing (Building execution graph)
Pavel Pereslegin created IGNITE-12349:
-
Summary: File transmission can cause the cluster to freeze.
Key: IGNITE-12349
URL: https://issues.apache.org/jira/browse/IGNITE-12349
Project: Ignite
Hi, Igniters, I've presented a new topic "Ensembles of ML algorithms and
Distributed Online Machine Learning with Apache Ignite" on ApacheCon in
Berlin this year.
Video is here https://www.youtube.com/watch?v=3CmnV6IQtTw
Slides are here
https://speakerdeck.com/zaleslaw/ensembles-of-ml-algorithms-a
15 matches
Mail list logo
