Re: Incompatible changes between branch-2.8 and branch-2.9

2019-09-25 Thread Robert Kanter
> > * For YARN-6050, there's a bit here: > https://developers.google.com/protocol-buffers/docs/proto that says > "optional is compatible with repeated", so I think we should be OK there. > - Optional is compatible with repeatable over the wire such that > protobuf won't blow up, but does that a

[jira] [Created] (HADOOP-15853) TestConfigurationDeprecation leaves behind a temp file, resulting in a license issue

2018-10-15 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-15853: -- Summary: TestConfigurationDeprecation leaves behind a temp file, resulting in a license issue Key: HADOOP-15853 URL: https://issues.apache.org/jira/browse/HADOOP-15853

Re: Hadoop 3.2 Release Plan proposal

2018-10-02 Thread Robert Kanter
Looks like there's two that weren't updated: >> [115] 16:32 : hadoop-common (trunk) :: grep "3.2.0-SNAPSHOT" . -r --include=pom.xml ./hadoop-project/pom.xml: 3.2.0-SNAPSHOT ./pom.xml:3.2.0-SNAPSHOT I've just pushed in an addendum commit to fix those. In the future, please make sure to do a san

Re: [VOTE] Release Apache Hadoop 3.0.1 (RC1)

2018-03-21 Thread Robert Kanter
+1 (binding) - verified signatures and checksums - setup pseudo cluster using Fair Scheduler from binary tarball - ran some of the example jobs, clicked around the UI a bit By the way, ASF recommends using a 4096 bit key for signing, though 2048 is fine for now. https://www.apache.org/dev/release

[jira] [Created] (HADOOP-15282) HADOOP-15235 broke TestHttpFSServerWebServer

2018-03-02 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-15282: -- Summary: HADOOP-15235 broke TestHttpFSServerWebServer Key: HADOOP-15282 URL: https://issues.apache.org/jira/browse/HADOOP-15282 Project: Hadoop Common

[jira] [Created] (HADOOP-15235) Authentication Tokens should use HMAC instead of MAC

2018-02-14 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-15235: -- Summary: Authentication Tokens should use HMAC instead of MAC Key: HADOOP-15235 URL: https://issues.apache.org/jira/browse/HADOOP-15235 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-12 Thread Robert Kanter
+1 (binding) + Downloaded the binary release + Deployed on a 3 node cluster on CentOS 7.3 + Ran some MR jobs, clicked around the UI, etc + Ran some CLI commands (yarn logs, etc) Good job everyone on Hadoop 3! - Robert On Tue, Dec 12, 2017 at 1:56 PM, Arun Suresh wrote: > +1 (binding) > > - V

[jira] [Created] (HADOOP-14998) Make AuthenticationFilter @Public

2017-10-31 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-14998: -- Summary: Make AuthenticationFilter @Public Key: HADOOP-14998 URL: https://issues.apache.org/jira/browse/HADOOP-14998 Project: Hadoop Common Issue Type

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

2017-07-06 Thread Robert Kanter
Thanks Andrew! - Deployed binary artifacts in a pseudo-distributed cluster (MacOS Sierra, Java 1.8.0_91) - Ran pi job - Clicked around the web UIs - Tried log aggregation - Played a bit with HDFS - Tried yarn top +1 (binding) - Robert On Thu, Jul 6, 2017 at 4:21 PM, Hanisha Koneru wrote: >

[jira] [Created] (HADOOP-14246) Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets

2017-03-27 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-14246: -- Summary: Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets Key: HADOOP-14246 URL: https://issues.apache.org/jira/browse/HADOOP-14246

[jira] [Reopened] (HADOOP-10075) Update jetty dependency to version 9

2016-10-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reopened HADOOP-10075: > Update jetty dependency to versio

[jira] [Resolved] (HADOOP-9244) Upgrade servlet-api dependency from version 2.5 to 3.0.

2016-10-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved HADOOP-9244. --- Resolution: Duplicate I've been working on HADOOP-10075 to update Jetty 6.x to 9.x, and

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-27 Thread Robert Kanter
+1 (binding) - Downloaded binary tarball - verified signatures - setup pseudo cluster - ran some of the example jobs, clicked around the UI a bit - Robert On Mon, Jul 25, 2016 at 3:28 PM, Jason Lowe wrote: > +1 (binding) > - Verified signatures and digests- Built from source with native supp

Re: Different JIRA permissions for HADOOP and HDFS

2016-05-17 Thread Robert Kanter
We've also had a related long-standing issue (or at least I have) where I can't add any more contributors to HADOOP or HDFS because JIRA times out on looking up their username. I'm guessing we have too many contributors for those projects. I bet YARN and MAPREDUCE are close. Is there some way fo

[jira] [Created] (HADOOP-12954) Add a way to change hadoop.security.token.service.use_ip

2016-03-22 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-12954: -- Summary: Add a way to change hadoop.security.token.service.use_ip Key: HADOOP-12954 URL: https://issues.apache.org/jira/browse/HADOOP-12954 Project: Hadoop Common

[jira] [Created] (HADOOP-12902) JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter

2016-03-07 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-12902: -- Summary: JavaDocs for SignerSecretProvider are out-of-date in AuthenticationFilter Key: HADOOP-12902 URL: https://issues.apache.org/jira/browse/HADOOP-12902

[jira] [Created] (HADOOP-12817) Enable TLS v1.1 and 1.2

2016-02-17 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-12817: -- Summary: Enable TLS v1.1 and 1.2 Key: HADOOP-12817 URL: https://issues.apache.org/jira/browse/HADOOP-12817 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-22 Thread Robert Kanter
+1 (binding) - Verified md5 - Deployed single node cluster from binary tarball - Ran some sample jobs, a few of the CLI commands, and the web UIs - Ran some Oozie jobs - Robert On Fri, Jan 22, 2016 at 5:53 PM, Rohith Sharma K S wrote: > +1(non binding) > -downloaded package and installed in 3

[jira] [Created] (HADOOP-12625) Add a config to disable the /logs endpoints

2015-12-08 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-12625: -- Summary: Add a config to disable the /logs endpoints Key: HADOOP-12625 URL: https://issues.apache.org/jira/browse/HADOOP-12625 Project: Hadoop Common

[jira] [Created] (HADOOP-12584) Disable directory browsing in HttpServer2

2015-11-18 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-12584: -- Summary: Disable directory browsing in HttpServer2 Key: HADOOP-12584 URL: https://issues.apache.org/jira/browse/HADOOP-12584 Project: Hadoop Common

Re: [DISCUSS] About the details of JDK-8 support

2015-10-14 Thread Robert Kanter
The only problem with trying to get the JDK 8 trunk builds green (or blue I guess) is that it's like trying to hit a moving target because of how many new commits keep coming in. I was looking at fixing these a while ago, and managed to at least make them compile and fixed (or worked with others t

[jira] [Created] (HADOOP-11870) [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues

2015-04-22 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11870: -- Summary: [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues Key: HADOOP-11870 URL: https://issues.apache.org/jira

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-22 Thread Robert Kanter
You're absolutely right Steve. We should get the jobs under control. At the very least, before we move to JDK 8 in Jenkins, we should get the Java8 nightly builds working. I didn't realize we had these, and I had thought all compiling and most test issues with JDK8 were already fixed based on wh

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
t; to do in any case since it'll still target 1.7. > > I'll note that HADOOP-10530 details the pain Steve went through switching > us to JDK7. Might be some lessons learned about how to do this transition > more smoothly. > > Thanks, > Andrew > > On Tue, Apr 21,

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
+ yarn-dev, hdfs-dev, mapred-dev On Tue, Apr 21, 2015 at 3:14 PM, Robert Kanter wrote: > Hi all, > > Moving forward on some of the discussions on Hadoop 3, I've created > HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just > wanted to let everyone know

Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
Hi all, Moving forward on some of the discussions on Hadoop 3, I've created HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just wanted to let everyone know in case there's some reason we shouldn't go ahead with this. thanks - Robert

[jira] [Created] (HADOOP-11858) [JDK8] Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11858: -- Summary: [JDK8] Set minimum version of Hadoop 3 to JDK 8 Key: HADOOP-11858 URL: https://issues.apache.org/jira/browse/HADOOP-11858 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-14 Thread Robert Kanter
+1 (non-binding) + verified checksum + Deployed binary tarball, ran some examples, clicked around in the Web UIs thanks - Robert On Tue, Apr 14, 2015 at 10:22 AM, Masatake Iwasaki < iwasak...@oss.nttdata.co.jp> wrote: > +1 (non-binding) > > + verified signature and mds of source and binary tarb

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Robert Kanter
+1 Happy to help too On Mon, Mar 2, 2015 at 3:57 PM, Yongjun Zhang wrote: > Thanks Andrew for the proposal. > > +1, and I will be happy to help. > > --Yongjun > > > > > On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang > wrote: > > > Hi devs, > > > > It's been a year and a half since 2.x went GA, an

[jira] [Created] (HADOOP-11616) Remove workaround for Curator's ChildReaper requiring Guava 15+

2015-02-19 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11616: -- Summary: Remove workaround for Curator's ChildReaper requiring Guava 15+ Key: HADOOP-11616 URL: https://issues.apache.org/jira/browse/HADOOP-11616 Pr

[jira] [Created] (HADOOP-11612) Workaround for Curator's ChildReaper requiring Guava 15+

2015-02-18 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11612: -- Summary: Workaround for Curator's ChildReaper requiring Guava 15+ Key: HADOOP-11612 URL: https://issues.apache.org/jira/browse/HADOOP-11612 Project: Hadoop C

Re: InterfaceStability and InterfaceAudience stability

2015-01-13 Thread Robert Kanter
+1 Though it is kinda funny that the InterfaceStability annotation was marked as Evolving :) @InterfaceStability.Evolving public class InterfaceStability {...} On Tue, Jan 13, 2015 at 2:21 PM, Ted Yu wrote: > +1 > > On Tue, Jan 13, 2015 at 1:47 PM, Abraham Elmahrek > wrote: > > > Hey guys, >

[jira] [Created] (HADOOP-11467) KerberosAuthenticator can connect to a non-secure cluster

2015-01-07 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11467: -- Summary: KerberosAuthenticator can connect to a non-secure cluster Key: HADOOP-11467 URL: https://issues.apache.org/jira/browse/HADOOP-11467 Project: Hadoop

[jira] [Reopened] (HADOOP-11217) Disable SSLv3 in KMS

2014-11-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reopened HADOOP-11217: > Disable SSLv3 in KMS > > > Key:

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Robert Kanter
Hi Arun, We were testing the RC and ran into a problem with the recent fixes that were done for POODLE for Tomcat (HADOOP-11217 for KMS and HDFS-7274 for HttpFS). Basically, in disabling SSLv3, we also disabled SSLv2Hello, which is required for older clients (e.g. Java 6 with openssl 0.9.8x) so t

[jira] [Created] (HADOOP-11230) [JDK 8] KeyStoreTestUtil#generateCertificate fails due to "subject class type invalid"

2014-10-24 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11230: -- Summary: [JDK 8] KeyStoreTestUtil#generateCertificate fails due to "subject class type invalid" Key: HADOOP-11230 URL: https://issues.apache.org/jira/browse/HA

[jira] [Created] (HADOOP-11218) Add TLSv1.2 to HttpFS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11218: -- Summary: Add TLSv1.2 to HttpFS Key: HADOOP-11218 URL: https://issues.apache.org/jira/browse/HADOOP-11218 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-11217) Disable SSLv3 (POODLEbleed vulnerability) in KMS

2014-10-21 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-11217: -- Summary: Disable SSLv3 (POODLEbleed vulnerability) in KMS Key: HADOOP-11217 URL: https://issues.apache.org/jira/browse/HADOOP-11217 Project: Hadoop Common

Re: Time to address the Guava version problem

2014-09-23 Thread Robert Kanter
At the same time, not being able to use Curator will require a lot of extra code, a lot of which we probably already have from the ZKRMStateStore, but it's not available to use in hadoop-auth. We'd need to create our own ZK libraries that Hadoop components can use, but (a) that's going to take a w

[jira] [Created] (HADOOP-10868) Create a ZooKeeper-backed secret provider

2014-07-21 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-10868: -- Summary: Create a ZooKeeper-backed secret provider Key: HADOOP-10868 URL: https://issues.apache.org/jira/browse/HADOOP-10868 Project: Hadoop Common

[jira] [Created] (HADOOP-10711) Cleanup some extra dependencies from hadoop-auth

2014-06-16 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-10711: -- Summary: Cleanup some extra dependencies from hadoop-auth Key: HADOOP-10711 URL: https://issues.apache.org/jira/browse/HADOOP-10711 Project: Hadoop Common

[jira] [Created] (HADOOP-10402) Configuration.getValByRegex doesn't do variable substitution

2014-03-11 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-10402: -- Summary: Configuration.getValByRegex doesn't do variable substitution Key: HADOOP-10402 URL: https://issues.apache.org/jira/browse/HADOOP-10402 Project: H

Re: Re-swizzle 2.3

2014-02-06 Thread Robert Kanter
I think we should revert YARN-1490 from Hadoop 2.3 branch. I think it was causing some strange behavior in the Oozie unit tests: Basically, we use a single MiniMRCluster and MiniDFSCluster across all unit tests in a module. With YARN-1490 we saw that, regardless of test order, the last few tests

[jira] [Created] (HADOOP-10100) MiniKDC shouldn't use apacheds-all artifact

2013-11-13 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-10100: -- Summary: MiniKDC shouldn't use apacheds-all artifact Key: HADOOP-10100 URL: https://issues.apache.org/jira/browse/HADOOP-10100 Project: Hadoop C

[jira] [Created] (HADOOP-10078) KerberosAuthenticator always does SPNEGO

2013-10-31 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-10078: -- Summary: KerberosAuthenticator always does SPNEGO Key: HADOOP-10078 URL: https://issues.apache.org/jira/browse/HADOOP-10078 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-9054) Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers

2012-11-16 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-9054: - Summary: Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers Key: HADOOP-9054 URL: https://issues.apache.org/jira

[jira] [Created] (HADOOP-8898) Improve description of "dfsthroughput" in hadoop-test jar

2012-10-08 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-8898: - Summary: Improve description of "dfsthroughput" in hadoop-test jar Key: HADOOP-8898 URL: https://issues.apache.org/jira/browse/HADOOP-8898 Project: Had

[jira] [Created] (HADOOP-8897) Make arguments in TestDFSIO case insensitive

2012-10-08 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-8897: - Summary: Make arguments in TestDFSIO case insensitive Key: HADOOP-8897 URL: https://issues.apache.org/jira/browse/HADOOP-8897 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-8883) Anonymous fallback in KerberosAuthenticator is broken

2012-10-04 Thread Robert Kanter (JIRA)
Robert Kanter created HADOOP-8883: - Summary: Anonymous fallback in KerberosAuthenticator is broken Key: HADOOP-8883 URL: https://issues.apache.org/jira/browse/HADOOP-8883 Project: Hadoop Common