Re: RFC: review of HADOOP-9361

2014-06-13 Thread Andrew Wang
I'd just like to add that I've been reviewing HADOOP-9361 for Steve and think it's pretty close, but would appreciate a look from the broader HDFS audience. The spec is pretty explicit about just being an attempt to document HDFS' current behavior, so there's no danger of the text locking us into

RFC: review of HADOOP-9361

2014-06-13 Thread Steve Loughran
Something I've been doing as a spare-time activity is trying to specify what filesystems are expected to do -using HDFS as the reference, being rigorous about expectations (size of file in ls == size of data in file, seek(0) always works, seek(-ve) always fails, close() idempotent), slightly tuning