Flink Error/Exception Handling

2017-03-03 Thread raikarsunil
Hi, Scenario : I am reading data from Kafka.The FlinkKafkaConsumer reads data from it . There are some application specific logic to check if the data is valid/in-valid. When i receive an invalid message i am throwing an custom Exception and it's handled in that class. But the problem is,the flin

Flink Application Log :Custom Log properties

2017-02-28 Thread raikarsunil
Hi , Is there any way we can configure application logging by passing the custom log4j properties file in flink run command? The aim is to write all the application logs in a specific file rather than the default yarn/flink log file. Currently I am using the below command to run my application :

Re: Set custom file as ClassPath in flink yarn command

2017-02-28 Thread raikarsunil
Thanks lining jing -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Set-custom-file-as-ClassPath-in-flink-yarn-command-tp11929p11959.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Set custom file as ClassPath in flink yarn command

2017-02-27 Thread raikarsunil
Hi Folks, Is there any way where we can set classpath value in the below command similar to java -cp? flink run -m yarn-cluster -yst -yn 2 -ynm APPNAME -yd JARFILE ArgsForJAR java -cp JARFILE;CustomFileLocation MainClass Args Thanks, Sunil -- View this message in context: http://apache-flin

Re: Flink Run command :Replace placeholder value in spring xml

2017-01-17 Thread raikarsunil
Hi, Let me give a overall picture : I am using properties file which contains values(passwords,kafkahostnames,schemaName etc..) related to DB,kafka ,flink etc.. which is Environment Specific(Dev,QA,Production) . Using this properties file in spring xml ,set values to beans .

Re: Flink Run command :Replace placeholder value in spring xml

2017-01-17 Thread raikarsunil
Hi, args[0]=/home/myfilepath/file.properties Thanks, Sunil -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Run-command-Replace-placeholder-value-in-spring-xml-tp11109p2.html Sent from the Apache Flink User Mailing List archive. m

Flink Run command :Replace placeholder value in spring xml

2017-01-17 Thread raikarsunil
Hi,I am not able to replace value into spring place holder .Below is the xml code snippet . file:#{systemProperties['configFileName']} In the above code I need to replace *configFileName* with actual file which I need to provide externally.Below is the