Hi Jins,
Do these settings have to be in the Jar File? Since you’re using Beam, you
could also use PipelineOptions to make the options accessible to functions at
runtime.
Best,
Aljoscha
> On 12. Jul 2017, at 20:21, Jins George wrote:
>
> Hi Aljoscha,
>
> I am still using Beam on Flink. I ha
Hi Aljoscha,
I am still using Beam on Flink. I have one yarn session running multiple
streaming jobs. The application jar contains some environment specific
run time properties( like ip addresses, rest api end points etc). This
adds overhead in my usecase as we have to deploy this in multiple
Can I The specific the jars that I depend on when I submit my project?
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/System-properties-when-submitting-flink-job-to-YARN-Session-tp14158p14207.html
Sent from the Apache Flink User Mailing
Hi,
Yes, setting the property using -D when creating the session should work to
make it available on all workers. I think after that it cannot be changed since
they JVMs are already running.
If I may ask, what’s your use case for this? Are you still using Beam on Flink
or are you using vanilla
Thanks Nico. I am able to pass arguments to the main program, that
works, but not exactly that I was looking for.
I guess to have all worker jvms the same system property, I have to
set it at yarn-session creation time using -D ( haven't tried it yet)
Thanks,
Jins George
On 07/10/2017 06:
Hi Jins,
I'm not sure whether you can define a system property, but you can include it
in the program arguments of "flink run [OPTIONS] "
You may also be able to define system properties but these are probably only
valid in your main() function executed within the flink run script, not any
ope
Hello,
I want to set the path of a properties file as System property in my
application(something like -Dkey=value).
Is there a way to set it while submitting a flink job to running YARN
Session? I am using //bin/flink run/ to submit the job to a already
running YARN session.
Thanks,
Jins Ge
