Re: Flink and kerberos

2019-08-29 Thread Vishwas Siravara
Thanks, I'll check it out. On Thu, Aug 29, 2019 at 1:08 PM David Morin wrote: > Vishwas, > > A config that works on my Kerberized cluster (Flink on Yarn). > I hope this will help you. > > Flink conf: > security.kerberos.login.use-ticket-cache: true > security.kerberos.login.keytab: /home/myuser/

Re: Flink and kerberos

2019-08-29 Thread David Morin
Vishwas, A config that works on my Kerberized cluster (Flink on Yarn). I hope this will help you. Flink conf: security.kerberos.login.use-ticket-cache: true security.kerberos.login.keytab: /home/myuser/myuser.keytab security.kerberos.login.principal: myuser@ security.kerberos.login.contexts:

Re: Flink and kerberos

2019-08-29 Thread Vishwas Siravara
Hey David , My consumers are registered , here is the debug log. The problem is the broker does not belong to me , so I can’t see what is going on there . But this is a new consumer group , so there is no state yet . org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer s

Re: Flink and kerberos

2019-08-29 Thread David Morin
Hello Vishwas, You can use a keytab if you prefer. You generate a keytab for your user and then you can reference it in the Flink configuration. Then this keytab will be handled by Flink in a secure way and TGT will be created based on this keytab. However, that seems to be working. Did you check

Re: Flink and kerberos

2019-08-29 Thread Vishwas Siravara
I see this log as well , but I can't see any messages . I know for a fact that the topic I am subscribed to has messages as I checked with a simple java consumer with a different group. org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase - Consumer subtask 0 will start reading th