[jira] [Resolved] (HDFS-7091) Add forwarding constructor for INodeFile for existing callers

[ https://issues.apache.org/jira/browse/HDFS-7091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7091. - Resolution: Fixed Release Note: Thanks Nicholas! Revised title and committed to the feature b

[jira] [Created] (HDFS-7093) Allow unprivileged users to set storage policy on a directory

Arpit Agarwal created HDFS-7093: --- Summary: Allow unprivileged users to set storage policy on a directory Key: HDFS-7093 URL: https://issues.apache.org/jira/browse/HDFS-7093 Project: Hadoop HDFS

[jira] [Created] (HDFS-7092) Document the logic about Delegation Token is generated and used in both HA and non-HA setup

Jing Zhao created HDFS-7092: --- Summary: Document the logic about Delegation Token is generated and used in both HA and non-HA setup Key: HDFS-7092 URL: https://issues.apache.org/jira/browse/HDFS-7092 Project

[jira] [Created] (HDFS-7091) Prepare branch for merging with HDFS-6584

Arpit Agarwal created HDFS-7091: --- Summary: Prepare branch for merging with HDFS-6584 Key: HDFS-7091 URL: https://issues.apache.org/jira/browse/HDFS-7091 Project: Hadoop HDFS Issue Type: Sub-tas

[jira] [Created] (HDFS-7090) Use unbuffered writes when persisting in-memory replicas

Arpit Agarwal created HDFS-7090: --- Summary: Use unbuffered writes when persisting in-memory replicas Key: HDFS-7090 URL: https://issues.apache.org/jira/browse/HDFS-7090 Project: Hadoop HDFS Issu

Re: [VOTE] Merge HDFS-6584 Archival Storage to trunk

Hi HDFS dev, We have four +1's (Vinay, Jitendra, Arpit and me) and no -1's. The VOTE passed. PS: Sorry that my email box seems having some problem. I somehow did not receive Arpit's VOTE and some other emails. The email I sent last time (forwarded below) did not go out. Thanks everyone.

[jira] [Resolved] (HDFS-6815) Verify that alternate access methods work properly with Data at Rest Encryption

[ https://issues.apache.org/jira/browse/HDFS-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6815. --- Resolution: Done We've gone through the various other HDFS access methods at this point, and have JIRA

[jira] [Created] (HDFS-7089) Fix findbugs and release audit warnings in the branch

Arpit Agarwal created HDFS-7089: --- Summary: Fix findbugs and release audit warnings in the branch Key: HDFS-7089 URL: https://issues.apache.org/jira/browse/HDFS-7089 Project: Hadoop HDFS Issue T

Re: Restarting HDFS datanode process

DFSClient would resume reading from where it stops from the next data node. Cheers On Thu, Sep 18, 2014 at 11:53 AM, Biju N wrote: > It is for the duration of the restart. The concern is what will happen to > any reads which is inflight that is using the data node. Will HDFS client > know the o

Re: Restarting HDFS datanode process

It is for the duration of the restart. The concern is what will happen to any reads which is inflight that is using the data node. Will HDFS client know the offset to start reading from where the read failed using another DN? On Thu, Sep 18, 2014 at 1:57 PM, Ted Yu wrote: > How long would your d

[jira] [Resolved] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-7084. - Resolution: Fixed Fix Version/s: HDFS-6581 Hadoop Flags: Reviewed +1, committed to the

Re: [DISCUSS] Allow continue reading from being-written file using same stream

bq. I don't know about the merits of this, but I do know that native filesystems implement this by not raising the EOF exception on the seek() but only on the read ... some of the non-HDFS filesystems Hadoop support work this way. I agree with you steve. read only will throw EOF. But when we know

Re: Restarting HDFS datanode process

How long would your datanode be out of service ? If the duration is long (say 1 day), you'd better decommission it first. Otherwise, datanode restart can be done without going through decommissioning. On Thu, Sep 18, 2014 at 8:25 AM, Biju N wrote: > Hello There, > Can individual datanodes

[jira] [Resolved] (HDFS-7088) Archival Storage: fix TestBalancer and TestBalancerWithMultipleNameNodes

[ https://issues.apache.org/jira/browse/HDFS-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-7088. - Resolution: Fixed Hadoop Flags: Reviewed I've committed this. > Archival Storage: fix TestBalancer a

Restarting HDFS datanode process

Hello There, Can individual datanodes restarted (through service command) or do we need to add it to the exclude file in NN, restart DN it, remove it from the exclude file in NN as if the data node is being decommissioned and put back? Any feedback on this is much appreciated. Thanks, Biju

Build failed in Jenkins: Hadoop-Hdfs-trunk #1875

See Changes: [tucu] HADOOP-11099. KMS return HTTP UNAUTHORIZED 401 on ACL failure. (tucu) [tucu] HADOOP-11016. KMS should support signing cookies with zookeeper secret manager. (tucu) [tucu] HADOOP-10982 [tucu] Revert "HADOOP-1098

Hadoop-Hdfs-trunk - Build # 1875 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1875/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6035 lines...] [INFO] [INFO] --- maven-source-plugin:2.1

Re: [DISCUSS] Allow continue reading from being-written file using same stream

I don't know about the merits of this, but I do know that native filesystems implement this by not raising the EOF exception on the seek() but only on the read ... some of the non-HDFS filesystems Hadoop support work this way. -I haven't ever looked to see what code assumes that it is the seek tha

[DISCUSS] Allow continue reading from being-written file using same stream

Hi all, Currently *DFSInputStream *doen't allow reading a write-inprogress file, once all written bytes, by the time of opening an input stream, are read. To read further update on the same file, needs to be read by opening another stream to the same file again. Instead how about refreshing leng