Hi Yaroslav,
Thanks for your efforts in finding out all the details.
I think making `getHostName` possible with a config + some additional
warnings in the documentation can be considered.
You need to evaluate your security standards but you win something on one
side and introduce new attack vecto
Yeah I was thinking of enforcing that restriction myself by taking the max
too. Anyway, since the change is simple enough, I think that it makes sense
to offer that (global scale factor) option, specially for coarse-grained
resource management.
We could create a ticket for that, what do you think C
[supplement to my last email]
Also, how about advertising to rest.address instead of IP address form
of rest.bind-address? At least for YARN case, where rest.address is
forcefully overwritten to Node Manager's hostname, this should solve the
problem. Not sure about other runtime environments.
Hi Gobor,
Thank you for such a quick response, I appreciate it.
Actually, I'm not very good at all this security and networking stuff,
so I apologize in advance if I'm wrong in some statement.
> Does YARN containers share the host’s network in your case?
Yes, it does. And as far as I have
{
"emoji": "👍",
"version": 1
}
Not quite possible based on the current version. We run an internal version of
the Autoscaler in our production env. One major diff is that we let the whole
pipeline (except the source/sink) to have the same parallelism to avoid uneven
task distribution. The change is relatively simple, just run
Unsubscribe
realleop...@126.com
