Re: Flink using Yarn on MapR

2016-11-30 Thread Naveen Tirupattur
Thanks Max for a quick response. I will try it out and let you know how it goes. -Naveen > On Nov 25, 2016, at 6:05 AM, Maximilian Michels wrote: > > Fix is now in the master and everything should run smooth with MapR > Hadoop. I'd be happy if you gave it another try. > > -Max > > > On Thu, No

RE: Flink using Yarn on MapR

2016-11-25 Thread Anton Solovev
Sorry, wrong thread -Original Message- From: Anton Solovev [mailto:anton_solo...@epam.com] Sent: Friday, November 25, 2016 7:20 PM To: dev@flink.apache.org Subject: RE: Flink using Yarn on MapR I agree that we should improve RowTypeInfo. But why not to keep it in Scala? In case flink

RE: Flink using Yarn on MapR

2016-11-25 Thread Anton Solovev
om/apache/flink/compare/master...tonycox:FLINK-2186-x) (https://travis-ci.org/tonycox/flink/builds/178846355) -Original Message- From: Maximilian Michels [mailto:m...@apache.org] Sent: Friday, November 25, 2016 6:06 PM To: dev@flink.apache.org Cc: Naveen Tirupattur Subject: Re: Flink using Yarn on

Re: Flink using Yarn on MapR

2016-11-25 Thread Maximilian Michels
Fix is now in the master and everything should run smooth with MapR Hadoop. I'd be happy if you gave it another try. -Max On Thu, Nov 24, 2016 at 6:22 PM, Maximilian Michels wrote: > Hi Naveen, > > The new Kerberos authentication code in Flink assumes that we're > running against vanilla Hadoop

Re: Flink using Yarn on MapR

2016-11-24 Thread Maximilian Michels
Hi Naveen, The new Kerberos authentication code in Flink assumes that we're running against vanilla Hadoop. The unmodified Hadoop's behavior is to skip a secure login if security is not configured. This is different for the MapR Hadoop version. Thus, we need to make sure we don't perform any logi

Re: Flink using Yarn on MapR

2016-11-11 Thread vijikarthi
Flink security context gets initialized during the application start phase. As part of the initialization, the UserGroupInformation (UGI) instance is bootstrapped using the Hadoop configuration files (read: HADOOP_CONF_DIR or YARN_CONF_DIR environment variable is set). If the hadoop configuration (

Re: Flink using Yarn on MapR

2016-11-11 Thread Till Rohrmann
Hi Naveen, I could reproduce your problem with the given Hadoop version (2.7.0-mapr-1607). It seems to me as if this version always tries to use Kerberos even though I selected the AuthenticationMethod.SIMPLE (no Kerberos activated). I've also tested it with vanilla Hadoop 2.7.3 and there it works