Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-12 Thread Li Peng
>>>> >>>> Li Peng 于2019年12月11日周三 下午1:24写道: >>>> >>>>> Ah I see. I think the Flink app is reading files from >>>>> /opt/flink/conf correctly as it is, since changes I make to flink-conf are >>>>> picked up as expected, it&

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-12 Thread Li Peng
used, or don't apply to stdout or whatever source k8 uses for its >>>> logs? Given that the pods don't seem to have logs written to file >>>> anywhere, contrary to the properties, I'm inclined to say it's the former >>>> and that the log4j pr

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-12 Thread ouywl
have no idea why though.On Tue, Dec 10, 2019 at 6:56 PM Yun Tang <myas...@live.com> wrote: Sure, /opt/flink/conf is mounted as a volume from the configmap.   Best Yun Tang   From: Li Peng <li.p...@doordash.com> Date: Wednesday, December 11, 2019 at 9:37 AM To: Yang Wang <danr

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-11 Thread ouywl
#x27;t being picked up. Still have no idea why though.On Tue, Dec 10, 2019 at 6:56 PM Yun Tang <myas...@live.com> wrote: Sure, /opt/flink/conf is mounted as a volume from the configmap.   Best Yun Tang   From: Li Peng <li.p...@doordash.com> Date: Wednesday, December 11, 2019 at 9:

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-11 Thread Yang Wang
Dec 10, 2019 at 6:56 PM Yun Tang wrote: >>> >>>> Sure, /opt/flink/conf is mounted as a volume from the configmap. >>>> >>>> >>>> >>>> Best >>>> >>>> Yun Tang >>>> >>>> >>>>

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-11 Thread Li Peng
;t being picked up. Still have no >> idea why though. >> >> On Tue, Dec 10, 2019 at 6:56 PM Yun Tang wrote: >> >>> Sure, /opt/flink/conf is mounted as a volume from the configmap. >>> >>> >>> >>> Best >>> >>> Yun

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-10 Thread Yang Wang
ue, Dec 10, 2019 at 6:56 PM Yun Tang wrote: > >> Sure, /opt/flink/conf is mounted as a volume from the configmap. >> >> >> >> Best >> >> Yun Tang >> >> >> >> *From: *Li Peng >> *Date: *Wednesday, December 11, 2019 at 9:37

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-10 Thread Li Peng
, /opt/flink/conf is mounted as a volume from the configmap. > > > > Best > > Yun Tang > > > > *From: *Li Peng > *Date: *Wednesday, December 11, 2019 at 9:37 AM > *To: *Yang Wang > *Cc: *vino yang , user > *Subject: *Re: Flink on Kubernetes seems to ignore

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-10 Thread Yun Tang
Sure, /opt/flink/conf is mounted as a volume from the configmap. Best Yun Tang From: Li Peng Date: Wednesday, December 11, 2019 at 9:37 AM To: Yang Wang Cc: vino yang , user Subject: Re: Flink on Kubernetes seems to ignore log4j.properties 1. Hey Yun, I'm calling /opt/flink/bin/stand

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-10 Thread Li Peng
1. Hey Yun, I'm calling /opt/flink/bin/standalone-job.sh and /opt/flink/bin/taskmanager.sh on my job and task managers respectively. It's based on the setup described here: http://shzhangji.com/blog/2019/08/24/deploy-flink-job-cluster-on-kubernetes/ . I haven't tried the configmap approach yet, doe

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-09 Thread Yang Wang
Hi Li Peng, You are running standalone session cluster or per-job cluster on kubernetes. Right? If so, i think you need to check your log4j.properties in the image, not local. The log is stored to /opt/flink/log/jobmanager.log by default. If you are running active Kubernetes integration for a fre

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-09 Thread Yun Tang
AM To: user Subject: Flink on Kubernetes seems to ignore log4j.properties Hey folks, I noticed that my kubernetes flink logs (reached via kubectl logs ) completely ignore any of the configurations I put into /flink/conf/. I set the logger level to WARN, yet I still see INFO level logging from

Re: Flink on Kubernetes seems to ignore log4j.properties

2019-12-09 Thread vino yang
Hi Li, A potential reason could be conflicting logging frameworks. Can you share the log in your .out file and let us know if the print format of the log is the same as the configuration file you gave. Best, Vino Li Peng 于2019年12月10日周二 上午10:09写道: > Hey folks, I noticed that my kubernetes flink

Flink on Kubernetes seems to ignore log4j.properties

2019-12-09 Thread Li Peng
Hey folks, I noticed that my kubernetes flink logs (reached via *kubectl logs *) completely ignore any of the configurations I put into /flink/conf/. I set the logger level to WARN, yet I still see INFO level logging from flink loggers like org.apache.flink.runtime.checkpoint.CheckpointCoordinator.