Cannot read a local file that's being written to when using the local read short circuit ----------------------------------------------------------------------------------------
Key: HDFS-2757 URL: https://issues.apache.org/jira/browse/HDFS-2757 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 1.0.0 Reporter: Jean-Daniel Cryans Fix For: 1.1.0 When testing the tail'ing of a local file with the read short circuit on, I get: {noformat} 2012-01-06 00:17:31,598 WARN org.apache.hadoop.hdfs.DFSClient: BlockReaderLocal requested with incorrect offset: Offset 0 and length 8230400 don't match block blk_-2842916025951313698_454072 ( blockLen 124 ) 2012-01-06 00:17:31,598 WARN org.apache.hadoop.hdfs.DFSClient: BlockReaderLocal: Removing blk_-2842916025951313698_454072 from cache because local file /export4/jdcryans/dfs/data/blocksBeingWritten/blk_-2842916025951313698 could not be opened. 2012-01-06 00:17:31,599 INFO org.apache.hadoop.hdfs.DFSClient: Failed to read block blk_-2842916025951313698_454072 on local machine java.io.IOException: Offset 0 and length 8230400 don't match block blk_-2842916025951313698_454072 ( blockLen 124 ) 2012-01-06 00:17:31,599 INFO org.apache.hadoop.hdfs.DFSClient: Try reading via the datanode on /10.4.13.38:51010 java.io.EOFException: hdfs://sv4r11s38:9100/hbase-1/.logs/sv4r13s38,62023,1325808100311/sv4r13s38%2C62023%2C1325808100311.1325808100818, entryStart=7190409, pos=8230400, end=8230400, edit=5 {noformat} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira