Re: data security

2014-04-09 Thread Matt Fellows
There are quite a few projects that are looking into this.  I myself am part of a TSB (part government funded research) project involving securing data in the cloud.  Generally the data is secured in a layer on top of hadoop rather than specifically as part of hadoop itself.  Our solution esse

Re: data security

2014-04-09 Thread Abhay Dandekar
Data security is one of the major challenges being faced for Hadoop computing. And now, when people have started using more of public clouds OVER private hadoop clusters, the concerns have gained a priority. There is a good demo from intel below. Might give you more insights : http://hadoop.intel

[jira] [Created] (HDFS-6228) comments typo fix for FsDatasetImpl.java

2014-04-09 Thread zhaoyunjiong (JIRA)
zhaoyunjiong created HDFS-6228: -- Summary: comments typo fix for FsDatasetImpl.java Key: HDFS-6228 URL: https://issues.apache.org/jira/browse/HDFS-6228 Project: Hadoop HDFS Issue Type: Improvemen

[jira] [Created] (HDFS-6227) ShortCuit Read failed due to ClosedChannelException

2014-04-09 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6227: --- Summary: ShortCuit Read failed due to ClosedChannelException Key: HDFS-6227 URL: https://issues.apache.org/jira/browse/HDFS-6227 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6226) Replace logging calls that use StringUtils.stringifyException to pass the exception instance to the log call.

2014-04-09 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-6226: --- Summary: Replace logging calls that use StringUtils.stringifyException to pass the exception instance to the log call. Key: HDFS-6226 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-6225) Remove the o.a.h.hdfs.server.common.UpgradeStatusReport

2014-04-09 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-6225: Summary: Remove the o.a.h.hdfs.server.common.UpgradeStatusReport Key: HDFS-6225 URL: https://issues.apache.org/jira/browse/HDFS-6225 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-5983) TestSafeMode#testInitializeReplQueuesEarly fails

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5983. - Resolution: Duplicate Resolving since this should be fixed now. > TestSafeMode#testInitializeRepl

[jira] [Created] (HDFS-6224) Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent

2014-04-09 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6224: -- Summary: Add a unit test to TestAuditLogger for file permissions passed to logAuditEvent Key: HDFS-6224 URL: https://issues.apache.org/jira/browse/HDFS-6224 Project: Hado

[jira] [Created] (HDFS-6223) Using the command setrep to set the replication factor more than the number of datanodes with the -w parameter, the command gets in a infinite loop.

2014-04-09 Thread Jinghui Wang (JIRA)
Jinghui Wang created HDFS-6223: -- Summary: Using the command setrep to set the replication factor more than the number of datanodes with the -w parameter, the command gets in a infinite loop. Key: HDFS-6223 URL: http

[jira] [Created] (HDFS-6222) Remove background token renewer from webhdfs

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6222: - Summary: Remove background token renewer from webhdfs Key: HDFS-6222 URL: https://issues.apache.org/jira/browse/HDFS-6222 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6221) Webhdfs should recover from dead DNs

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6221: - Summary: Webhdfs should recover from dead DNs Key: HDFS-6221 URL: https://issues.apache.org/jira/browse/HDFS-6221 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Created] (HDFS-6220) Webhdfs should differentiate remote exceptions

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6220: - Summary: Webhdfs should differentiate remote exceptions Key: HDFS-6220 URL: https://issues.apache.org/jira/browse/HDFS-6220 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6219) Proxy superuser configuration should use true client IP for address checks

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6219: - Summary: Proxy superuser configuration should use true client IP for address checks Key: HDFS-6219 URL: https://issues.apache.org/jira/browse/HDFS-6219 Project: Hadoop HDFS

[jira] [Created] (HDFS-6218) Audit log should use true client IP for proxied webhdfs operations

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6218: - Summary: Audit log should use true client IP for proxied webhdfs operations Key: HDFS-6218 URL: https://issues.apache.org/jira/browse/HDFS-6218 Project: Hadoop HDFS

[jira] [Created] (HDFS-6217) Webhdfs PUT operations may not work via a http proxy

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6217: - Summary: Webhdfs PUT operations may not work via a http proxy Key: HDFS-6217 URL: https://issues.apache.org/jira/browse/HDFS-6217 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-6216) Issues with webhdfs and http proxies

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6216: - Summary: Issues with webhdfs and http proxies Key: HDFS-6216 URL: https://issues.apache.org/jira/browse/HDFS-6216 Project: Hadoop HDFS Issue Type: Bug Co

[jira] [Created] (HDFS-6215) Wrong error message for upgrade

2014-04-09 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6215: Summary: Wrong error message for upgrade Key: HDFS-6215 URL: https://issues.apache.org/jira/browse/HDFS-6215 Project: Hadoop HDFS Issue Type: Bug Affects Version

[jira] [Created] (HDFS-6214) Webhdfs has poor throughput for files >2GB

2014-04-09 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-6214: - Summary: Webhdfs has poor throughput for files >2GB Key: HDFS-6214 URL: https://issues.apache.org/jira/browse/HDFS-6214 Project: Hadoop HDFS Issue Type: Bug

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1726

2014-04-09 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-6213) TestDataNode failing on Jenkins runs due to DN web port in use

2014-04-09 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-6213: Summary: TestDataNode failing on Jenkins runs due to DN web port in use Key: HDFS-6213 URL: https://issues.apache.org/jira/browse/HDFS-6213 Project: Hadoop HDFS