Re: Retrieving keys via KMS from map/reduce phase.

2015-06-18 Thread Arun Suresh
You really do not need to talk to the KMS directly from the MR code.. The MR framework and the DFSClient will automatically decrypt for you when the mappers are reading a file (one of the reasons why this is called "transparent" data encryption). Similarly, files that are written to an output direc

[jira] [Created] (HDFS-8638) Move the quota commands out from dfsadmi.

2015-06-18 Thread surendra singh lilhore (JIRA)
surendra singh lilhore created HDFS-8638: Summary: Move the quota commands out from dfsadmi. Key: HDFS-8638 URL: https://issues.apache.org/jira/browse/HDFS-8638 Project: Hadoop HDFS I

questions about concurrent access secure HDFS with different principals

2015-06-18 Thread Yeqi
Hi All I need to access a secure HDFS with a multi thread process, each thread with its own principal, or several threads with a same principal. Is it possible and any sample codes? Second, I need to access 2 secure HDFSs with each other's principals in a single process, but it seems impossibl

Retrieving keys via KMS from map/reduce phase.

2015-06-18 Thread Sitaraman Vilayannur
Hi, Using the key management system will i be able to store a set of keys in my keystore and then retrieve those keys later based on their aliases from within the map/reduce phase to do my encyrption/decryption activities from map reduce? Thanks Sitaraman

[jira] [Created] (HDFS-8637) OzoneHandler : Add Error Table

2015-06-18 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8637: -- Summary: OzoneHandler : Add Error Table Key: HDFS-8637 URL: https://issues.apache.org/jira/browse/HDFS-8637 Project: Hadoop HDFS Issue Type: Sub-task

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #221

2015-06-18 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-8636) Tolerate disk errors during block pool initialization

2015-06-18 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-8636: - Summary: Tolerate disk errors during block pool initialization Key: HDFS-8636 URL: https://issues.apache.org/jira/browse/HDFS-8636 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-8635) Migrate HDFS native build to new CMake framework

2015-06-18 Thread Alan Burlison (JIRA)
Alan Burlison created HDFS-8635: --- Summary: Migrate HDFS native build to new CMake framework Key: HDFS-8635 URL: https://issues.apache.org/jira/browse/HDFS-8635 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-8634) OzoneHandler: Add userAuth Interface and Simple userAuth handler

2015-06-18 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8634: -- Summary: OzoneHandler: Add userAuth Interface and Simple userAuth handler Key: HDFS-8634 URL: https://issues.apache.org/jira/browse/HDFS-8634 Project: Hadoop HDFS

[jira] [Created] (HDFS-8633) Fix mismatch for default value of dfs.datanode.readahead.bytes in DFSConfigKeys

2015-06-18 Thread Ray Chiang (JIRA)
Ray Chiang created HDFS-8633: Summary: Fix mismatch for default value of dfs.datanode.readahead.bytes in DFSConfigKeys Key: HDFS-8633 URL: https://issues.apache.org/jira/browse/HDFS-8633 Project: Hadoop H

[jira] [Created] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-06-18 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8632: -- Summary: Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes Key: HDFS-8632 URL: https://issues.apache.org/jira/browse/HDFS-8632 Project: Hadoop HDFS

[jira] [Created] (HDFS-8631) WebHDFS : Support list/setQuota

2015-06-18 Thread nijel (JIRA)
nijel created HDFS-8631: --- Summary: WebHDFS : Support list/setQuota Key: HDFS-8631 URL: https://issues.apache.org/jira/browse/HDFS-8631 Project: Hadoop HDFS Issue Type: Sub-task Reporter: ni

[jira] [Created] (HDFS-8630) WebHDFS : Support get/setStoragePolicy

2015-06-18 Thread nijel (JIRA)
nijel created HDFS-8630: --- Summary: WebHDFS : Support get/setStoragePolicy Key: HDFS-8630 URL: https://issues.apache.org/jira/browse/HDFS-8630 Project: Hadoop HDFS Issue Type: Sub-task Repo

[jira] [Created] (HDFS-8629) WebHDFS Improvements: support Missing Features (quota, storagepolicy)

2015-06-18 Thread nijel (JIRA)
nijel created HDFS-8629: --- Summary: WebHDFS Improvements: support Missing Features (quota, storagepolicy) Key: HDFS-8629 URL: https://issues.apache.org/jira/browse/HDFS-8629 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8628) Update missing command option for fetchdt

2015-06-18 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8628: Summary: Update missing command option for fetchdt Key: HDFS-8628 URL: https://issues.apache.org/jira/browse/HDFS-8628 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8627) NPE thrown if unable to fetch token from Namenode

2015-06-18 Thread J.Andreina (JIRA)
J.Andreina created HDFS-8627: Summary: NPE thrown if unable to fetch token from Namenode Key: HDFS-8627 URL: https://issues.apache.org/jira/browse/HDFS-8627 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8626) Reserved RBW space is not released if creation of RBW File fails

2015-06-18 Thread kanaka kumar avvaru (JIRA)
kanaka kumar avvaru created HDFS-8626: - Summary: Reserved RBW space is not released if creation of RBW File fails Key: HDFS-8626 URL: https://issues.apache.org/jira/browse/HDFS-8626 Project: Hadoo

[jira] [Created] (HDFS-8625) count with -h option displays namespace quota in human readable format

2015-06-18 Thread Archana T (JIRA)
Archana T created HDFS-8625: --- Summary: count with -h option displays namespace quota in human readable format Key: HDFS-8625 URL: https://issues.apache.org/jira/browse/HDFS-8625 Project: Hadoop HDFS

[jira] [Created] (HDFS-8624) fix javadoc broken links

2015-06-18 Thread Walter Su (JIRA)
Walter Su created HDFS-8624: --- Summary: fix javadoc broken links Key: HDFS-8624 URL: https://issues.apache.org/jira/browse/HDFS-8624 Project: Hadoop HDFS Issue Type: Bug Components: docume