Re: Custom log appender for YARN

2019-07-31 Thread Biao Liu
Hi Gyula, How about putting the appender class in lib folder, but choosing the appender only for user code through log4j.properties? That way only the user logger would be sent to Kafka. It seems what you want... Thanks, Biao /'bɪ.aʊ/ On Thu, Aug 1, 2019 at 2:25 PM Gyula Fóra wrote: > Hi Bia

Re: Custom log appender for YARN

2019-07-31 Thread Gyula Fóra
Hi Biao, Thanks for the input! This is basically where we got ourselves as well. We are trying to avoid putting things in the lib folder so separating the loggers would be great but we don't have a solution for it yet. Thanks Gyula On Thu, 1 Aug 2019, 07:09 Biao Liu Hi Gyula, > > I guess it sh

Re: Custom log appender for YARN

2019-07-31 Thread Biao Liu
Hi Gyula, I guess it should work if you put log appender jar under $flink/lib folder. There are two different kinds of classloader in your case. One is for Flink framework, the other is for user code. The framework classloader is the parent of user classloader. The parent classloader could not fi

Custom log appender for YARN

2019-07-31 Thread Gyula Fóra
Hi All! We are trying to configure a custom Kafka log appender for our YARN application and we hit the following problem. We included the log appender dependency in the fatjar of the application because in YARN that should be part of the system class path. However when the YARN cluster entrypoin