It makes sense. Thank you very much, Jamie!
> On Jan 15, 2019, at 12:48 PM, Jamie Grier wrote:
>
> Ethan, it depends on what you mean by easy ;) It just depends a lot on what
> infra tools you already have in place. On bare metal it's probably safe to
> say there is no "easy" way. You ne
Ethan, it depends on what you mean by easy ;) It just depends a lot on
what infra tools you already have in place. On bare metal it's probably
safe to say there is no "easy" way. You need a lot of automation to make
it easy.
Bastien, IMO, #1 applies to batch jobs as well.
On Tue, Jan 15, 2019
Hello Jamie,
Does #1 apply to batch jobs too ?
Regards,
--
Bastien DINE
Data Architect / Software Engineer / Sysadmin
bastiendine.io
Le lun. 14 janv. 2019 à 20:39, Jamie Grier a écrit :
> There are a lot of different ways to deploy Flink. It would be easier to
> answer your
Thank you Jamie!
Sorry didn’t add more context because it’s mostly a general question without
any specific use cases in mind.
We currently deploy flink on bare metal and then submit jobs to it. And it’s
how we deploy storm cluster. Looks like we need to move away from this setup
for flink. We
There are a lot of different ways to deploy Flink. It would be easier to
answer your question with a little more context about your use case but in
general I would advocate the following:
1) Don't run a "permanent" Flink cluster and then submit jobs to it.
Instead what you should do is run an "ep
Hello,
I am setting up a standalone flink cluster and I am wondering what’s the best
way to distribute TaskManagers. Do we usually launch one TaskManager (with
many slots) per node or multiple TaskManagers per node (with smaller number of
slots per tm) ? Also with one TaskManager per node, I
