Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-07-01 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- Review request for hadoop-hdfs, Dhruba Borthakur and Hairong Kuang. Summary -

Re: Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-07-01 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- (Updated 2011-07-01 20:34:17.116645) Review request for hadoop-hdfs, Dhruba Borth

Re: Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-07-11 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- (Updated 2011-07-11 21:06:02.473171) Review request for hadoop-hdfs, Dhruba Borth

Re: Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-07-27 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- (Updated 2011-07-28 00:40:14.000447) Review request for hadoop-hdfs, Dhruba Borth

Re: Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-08-24 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- (Updated 2011-08-24 03:33:32.850921) Review request for hadoop-hdfs, Dhruba Borth

Re: Review Request: HDFS-395 DFS Scalability: Incremental block reports

2011-08-24 Thread Tomasz Nykiel
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/998/ --- (Updated 2011-08-23 22:55:47.297820) Review request for hadoop-hdfs, Dhruba Borth

[jira] [Created] (HDFS-2476) More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks

2011-10-19 Thread Tomasz Nykiel (Created) (JIRA)
Project: Hadoop HDFS Issue Type: Sub-task Components: name-node Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel This patch introduces two hash data structures for storing under-replicated, over-replicated and invalidated blocks. 1. LightWeightHashSet 2

[jira] [Created] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

2011-10-19 Thread Tomasz Nykiel (Created) (JIRA)
Issue Type: Sub-task Components: name-node Reporter: Tomasz Nykiel When a block report is processed at the NN, the BlockManager.reportDiff traverses all blocks contained in the report, and for each one block, which is also present in the corresponding datanode descriptor

[jira] [Created] (HDFS-2490) Upgradable lock to allow simutaleous read operation while reportDiff is in progress in processing block reports

2011-10-21 Thread Tomasz Nykiel (Created) (JIRA)
://issues.apache.org/jira/browse/HDFS-2490 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel Attachments: FSNamesystemLock.java Currently, FSNamesystem operations are protected by a single ReentrantReadWriteLock

[jira] [Created] (HDFS-2495) Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock

2011-10-24 Thread Tomasz Nykiel (Created) (JIRA)
/browse/HDFS-2495 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Tomasz Nykiel Assignee: Tomasz Nykiel For processing blocks in ReplicationMonitor (BlockManager.computeReplicationWork), we first obtain a list of blocks to be replicated by calling