Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-11-22 Thread vinay patil
u please let me know what I am doing wrong here. > >> >>> > >> >>> Regards, > >> >>> Vinay Patil > >> >>> > >> >>> > >> >>> > >> >>> -- > >> >>> View this message in context:

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-11-22 Thread Maximilian Michels
> >>> -- >> >>> View this message in context: >> >>> >> >>> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/add-FLINK-LIB-DIR-to-classpath-on-yarn-tp8097p9702.html >> >>> Sent from the Apache Flink User Mail

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-11-18 Thread vinay patil
ache-flink-user-mailing-list-archive.2336050. > n4.nabble.com/add-FLINK-LIB-DIR-to-classpath-on-yarn-tp8097p9702.html > >>> Sent from the Apache Flink User Mailing List archive. mailing list > >>> archive at Nabble.com. > >> > >> > >> > >&

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-11-17 Thread Maximilian Michels
list >>> archive at Nabble.com. >> >> >> >> >> >> If you reply to this email, your message will be added to the discussion >> below: >> >> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.c

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-11-17 Thread vinay patil
Hi Robert, Sorry for the late response. I checked the TM and JM logs but am not able to see that file added in the classpath. I have deployed Flink on EMR, and placed the yaml file in /usr/lib/flink/lib folder. What am I doing wrong here ? Regards, Vinay Patil On Wed, Oct 26, 2016 at 1:25 PM,

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-10-26 Thread Robert Metzger
Hi Vinay, the JobManager and TaskManager logs contain the classpath used when starting a container on YARN. Can you check if the yaml file is in the classpath? On Tue, Oct 25, 2016 at 8:28 AM, vinay patil wrote: > Hi Max, > > As discussed here , I have put my yaml file in the flink lib director

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-10-24 Thread vinay patil
Hi Max, As discussed here , I have put my yaml file in the flink lib directory, but still I am not able to get this file from classpath. I am using Flink 1.1.1 and cfg4j to load the file from classpath. Running the job on YARN in EMR using the below command: ./bin/flink run Can you please let

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-07-25 Thread Maximilian Michels
Hi! In the latest master and in the upcoming 1.1, all files in the lib folder will be shipped to the Yarn cluster and added to the class path. In Flink version <= 1.0.x no files will be added to the ship files by default (only the flink-dist*.jar will be shipped). Regardless of the version, if yo

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-07-25 Thread Aljoscha Krettek
Looping in Max directly because he probably knows the Yarn stuff best. @Max: Do you have any idea how to do this? On Fri, 22 Jul 2016 at 05:46 김동일 wrote: > I’saw the source code > of > flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java > Flink ships the FLINK_LIB

Re: add FLINK_LIB_DIR to classpath on yarn -> add properties file to class path on yarn

2016-07-21 Thread 김동일
I’saw the source code of flink-yarn/src/main/java/org/apache/flink/yarn/AbstractYarnClusterDescriptor.java Flink ships the FLINK_LIB_DIR and add to classpath only jar files. I want to know how to add resource file to classpath. Best Regards, Dong-iL, Kim. > On Jul 22, 2016, at 4:28 AM, Dong iL,

add FLINK_LIB_DIR to classpath on yarn

2016-07-21 Thread Dong iL, Kim
Hello. I have a flink cluster on yarn. I wanna add FLINK_LIB_DIR to classpath. because hibernate.cfg.xml need to be on the classpath. when i'm using stand alone cluster, just add FLINK_LIB_DIR to FLINK_CLASSPATH. but on yarn, Fixing config.sh, yarn-session.sh and flink-daemon.sh is not working. Be