[jira] Created: (HDFS-1253) bin/hdfs conflicts with common user shortcut

2010-06-21 Thread Allen Wittenauer (JIRA)
bin/hdfs conflicts with common user shortcut Key: HDFS-1253 URL: https://issues.apache.org/jira/browse/HDFS-1253 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 0.21.0 Repor

[jira] Created: (HDFS-1254) 0.20: mark dfs.supprt.append to be true by default for the 0.20-append branch

2010-06-21 Thread dhruba borthakur (JIRA)
0.20: mark dfs.supprt.append to be true by default for the 0.20-append branch - Key: HDFS-1254 URL: https://issues.apache.org/jira/browse/HDFS-1254 Project: Hadoop HDFS

Overwriting the same block instead of creating a new one

2010-06-21 Thread Vidur Goyal
Hi All, In FSNamesystem#startFileInternal , whenever there is a overwrite flag set , why is the INode removed from the namespace and a new INodeFileUnderConstruction is created. Why can't we use the convert the same INode to INodeFileUnderConstruction. And we start writing to the same blocks at th

[jira] Created: (HDFS-1255) test-libhdfs.sh fails

2010-06-21 Thread Tom White (JIRA)
test-libhdfs.sh fails - Key: HDFS-1255 URL: https://issues.apache.org/jira/browse/HDFS-1255 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Tom White Assignee: Tom White

[jira] Resolved: (HDFS-609) Create a file with the append flag does not work in HDFS

2010-06-21 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom White resolved HDFS-609. Hadoop Flags: [Reviewed] Fix Version/s: (was: 0.22.0) Resolution: Fixed I've committed this.

Re: Overwriting the same block instead of creating a new one

2010-06-21 Thread Todd Lipcon
HDFS assumes in hundreds of places that blocks never shrink. So, there is no option to truncate a block. -Todd On Mon, Jun 21, 2010 at 9:41 PM, Vidur Goyal wrote: > Hi All, > > In FSNamesystem#startFileInternal , whenever there is a overwrite flag set > , why is the INode removed from the namesp

Re: Overwriting the same block instead of creating a new one

2010-06-21 Thread Vidur Goyal
Dear Todd, By truncating i meant removing unused *blocks* from the namespace and let them be garbage collected. There will be no truncation of the last block(even if it is not full). This way , rather then garbage collecting all the blocks of a file , we will only be garbage collecting the remaini

Re: Overwriting the same block instead of creating a new one

2010-06-21 Thread Todd Lipcon
Hi Vidur, I'm not following. The "overwrite" flag causes the file to be overwritten starting at offset 0 - it doesn't allow you to retain any bit of the preexisting file. It's equivalent to a remove followed by a create. Think of it like O_TRUNC. -Todd On Mon, Jun 21, 2010 at 10:03 PM, Vidur Goy

[jira] Created: (HDFS-1256) libhdfs is missing from the tarball

2010-06-21 Thread Tom White (JIRA)
libhdfs is missing from the tarball --- Key: HDFS-1256 URL: https://issues.apache.org/jira/browse/HDFS-1256 Project: Hadoop HDFS Issue Type: Bug Reporter: Tom White Priority: Blocker