[jira] [Created] (HADOOP-14930) Upgrade Jetty to 9.4 version

2017-10-05 Thread Ted Yu (JIRA)
Ted Yu created HADOOP-14930:
---

 Summary: Upgrade Jetty to 9.4 version
 Key: HADOOP-14930
 URL: https://issues.apache.org/jira/browse/HADOOP-14930
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Ted Yu


Currently 9.3.19.v20170502 is used.

In hbase 2.0+, 9.4.6.v20170531 is used.

When starting mini dfs cluster in hbase unit tests, we get the following:
{code}
java.lang.NoSuchMethodError: 
org.eclipse.jetty.server.session.SessionHandler.getSessionManager()Lorg/eclipse/jetty/server/SessionManager;
  at 
org.apache.hadoop.http.HttpServer2.initializeWebServer(HttpServer2.java:548)
  at org.apache.hadoop.http.HttpServer2.(HttpServer2.java:529)
  at org.apache.hadoop.http.HttpServer2.(HttpServer2.java:119)
  at org.apache.hadoop.http.HttpServer2$Builder.build(HttpServer2.java:415)
  at 
org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:157)
  at 
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:887)
  at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:723)
  at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:949)
  at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:928)
  at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1637)
  at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1277)
  at 
org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1046)
  at 
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:921)
{code}
This issue is to upgrade Jetty to 9.4 version



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-14932) Move Mockito up to 1.10.19 to be compatible with HBase

2017-10-05 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created HADOOP-14932:
--

 Summary: Move Mockito up to 1.10.19 to be compatible with HBase
 Key: HADOOP-14932
 URL: https://issues.apache.org/jira/browse/HADOOP-14932
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: test
Reporter: Akira Ajisaka
Priority: Critical


HADOOP-14178 will upgrade Mockito up to 2.x, however, the progress is slow and 
probably this won't be in Hadoop 3.0 GA. Apache HBase community wants Hadoop to 
upgrade Mockito up to 1.10.19 to compile HBase test code with Hadoop 3.0 
successfully if we cannot upgrade Mockito to 2.x.
Thanks [~tedyu] for the 
[report|https://issues.apache.org/jira/browse/HADOOP-14178?focusedCommentId=16193128&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-16193128].



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-14933) CLONE - KMSClientProvider won't work with KMS delegation token retrieved from non-Java client.

2017-10-05 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HADOOP-14933:
---

 Summary: CLONE - KMSClientProvider won't work with KMS delegation 
token retrieved from non-Java client.
 Key: HADOOP-14933
 URL: https://issues.apache.org/jira/browse/HADOOP-14933
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Xiaoyu Yao
Assignee: Xiaoyu Yao


HADOOP-13381 added support to use KMS delegation token to connect to KMS server 
for key operations. However, the logic to check if the UGI container KMS 
delegation token assumes that the token must contain a service attribute. 
Otherwise, a KMS delegation token won't be recognized.

For delegation token obtained via non-java client such curl (http), the default 
DelegationTokenAuthenticationHandler only support *renewer* parameter and 
assume the client itself will add the service attribute. This makes a java 
client with KMSClientProvdier can't use for KMS delegation token retrieved form 
non-java client because the token does not contain a service attribute. 

I did some investigation on this and found two solutions:

1. Similar use case exists for webhdfs, and webhdfs supports it with a 
["service" 
parameter|https://hadoop.apache.org/docs/r2.8.0/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Get_Delegation_Token].

We can do this similarly by allowing client to specify a service attribute in 
the request URL and included in the token returned like webhdfs. Even though 
this will change in DelegationTokenAuthenticationHandler and may affect many 
other web component,  this seems to be a clean and low risk solution because it 
will be an optional parameter. Also, other components get non-java client 
interop support for free if they have the similar use case. 

2. The other way to solve this is to release the token check in 
KMSClientProvider to check only the token kind instead of the service.  This is 
an easy work around but seems less optimal to me. 

cc: [~xiaochen] for additional input.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-14934) Remove Warnings when building ozone

2017-10-05 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HADOOP-14934:
---

 Summary: Remove Warnings when building ozone
 Key: HADOOP-14934
 URL: https://issues.apache.org/jira/browse/HADOOP-14934
 Project: Hadoop Common
  Issue Type: Bug
Reporter: Bharat Viswanadham


[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hadoop:hadoop-ozone:jar:3.1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for 
org.apache.maven.plugins:maven-project-info-reports-plugin is missing. @ 
org.apache.hadoop:hadoop-ozone:[unknown-version], 
/Users/aengineer/codereview/hadoop-tools/hadoop-ozone/pom.xml, line 36, column 
15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for 
org.apache.hadoop:hadoop-dist:jar:3.1.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for 
org.apache.maven.plugins:maven-gpg-plugin is missing. @ line 133, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten 
the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support 
building such malformed projects.
[WARNING]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org