Re: [Discuss] Hadoop-Ozone repository mailing list configurations

2019-10-23 Thread Matt Foley
Definitely yes on ‘ozone-issues’. Whether we want to keep ozone-dev and hdfs-dev together or separate, I’m neutral. Thanks, —Matt On Oct 23, 2019, at 2:11 PM, Elek, Marton wrote: Thanks to report this problem Rohith, Yes, it seems to be configured with the wrong mailing list. I think the rig

Fwd: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Matt Foley
+1 (binding) Apache is supposed to be about the community. We have here a community of developers, who have actively and openly worked to add a major improvement to Hadoop: the ability to work cross-platform. Furthermore, the size of the substantive part of the needed patch is only about 1500 li

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-02 Thread Matt Foley
Konstantin, I would like to explore what it would take to remove this perceived impediment -- although I reserve the right to argue that this is not pre-requisite to merging the cross-platform support patch. If we implemented full "test-patch" support for Windows on trunk, would that fulfill both

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-03 Thread Matt Foley
7:32 PM, Konstantin Shvachko wrote: > Hi Matt, > > On Sat, Mar 2, 2013 at 12:32 PM, Matt Foley > wrote: > > Konstantin, > > I would like to explore what it would take to remove this perceived > > impediment -- > > Glad you decided to explore. Thank you. > >

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
sed work sounds like it will satisfy the requirements. Thank you, --Matt On Sun, Mar 3, 2013 at 12:16 PM, Konstantin Shvachko wrote: > Didn't I explain in details what I am asking for? > > Thanks, > --Konst > > On Sun, Mar 3, 2013 at 11:08 AM, Matt Foley > wrote: > > H

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
Thanks. I agree Windows -1's in test-patch should not block commits. --Matt On Mon, Mar 4, 2013 at 2:30 PM, Konstantin Shvachko wrote: > On Mon, Mar 4, 2013 at 12:22 PM, Matt Foley > wrote: > > Konstantine, you have voted -1, and stated some requirements before > you

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
e. > > I am glad we agreed. > Having Jira to track the CI effort is a good idea. > > Thanks, > --Konstantin > > On Mon, Mar 4, 2013 at 3:29 PM, Matt Foley wrote: > > Thanks. I agree Windows -1's in test-patch should not block commits. > > > >

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Matt Foley
Hi Cos, I would also request that you renumber the release candidate to just three-numbers, hence "2.0.5-alpha". Arun, are you willing to start the 2.1.x name-space for your next release, so that 2.0.x-alpha can become an intermediate stabilization branch as Cos and Konst want? I just think that

Re: Retire 0.20-append branch?

2011-10-04 Thread Matt Foley
+1. On Mon, Oct 3, 2011 at 10:47 PM, Jitendra Pandey wrote: > +1. > > On Mon, Oct 3, 2011 at 10:15 PM, Owen O'Malley > wrote: > > > On Mon, Oct 3, 2011 at 2:50 PM, Todd Lipcon wrote: > > > In essence, that means that we would: > > > 1) Ask contributors to provide patches against 0.20-security b

Re: [jira] [Resolved] (HDFS-3310) Make sure that we abort when no edit log directories are left

2012-04-26 Thread Matt Foley
Thanks Colin and Eli! Colin, for future reference, it is common to cut-and-paste the testpatch results into a comment in the Jira. Thanks.

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Matt Foley
Hi Wangda, thanks for this. A question about the schedule correction: > > 1) In the proposal, repeats are not properly. (I used bi-weekly instead of > 2nd/4th week as repeat frequency). I'd like to fix the frequency on Thu and > it will take effect starting next week. I understand that “bi-weekly

Re: Hadoop Community Sync Up Schedule

2019-08-22 Thread Matt Foley
Wangda and Eric, We can express the intent, I think, by scheduling two recurring meetings: - monthly, on the 2nd Wednesday, and - monthly, on the 4th Wednesday. This is pretty easy to understand, and not too onerous to maintain. But I’m okay with simple bi-weekly too. I’m neutral on 10 vs 11am, P

Re: Hadoop storage community online sync

2019-08-22 Thread Matt Foley
+1 for publishing notes. Thanks! On Aug 21, 2019, at 4:16 PM, Aaron Fabbri wrote: Thank you Wei-Chiu for organizing this and sending out notes! On Wed, Aug 21, 2019 at 1:10 PM Wei-Chiu Chuang mailto:weic...@apache.org>> wrote: > We had a great turnout today, thanks to Konstantin for leading t

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Matt Foley
Sorry I won’t be able to come today; a work meeting interferes. —Matt On Sep 4, 2019, at 9:10 AM, Wei-Chiu Chuang wrote: It's a short week so I didn't set up a predefined topic to discuss. What should we be discussing? How about Erasure Coding? I'm starting to see tricky EC bug reports coming i

[jira] [Reopened] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-4261: -- > TestBalancerWithNodeGroup times out > --- > >

[jira] [Reopened] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-6953: -- > HDFS file append failing in single node configurat

[jira] [Resolved] (HDFS-6953) HDFS file append failing in single node configuration

2016-02-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-6953. -- Resolution: Invalid Corrected resolution field to 'invalid' since there was no fix. > HDF

[jira] [Created] (HDFS-8809) HDFS fsck reports file corruption (Missing blocks) when HBase is running, with Hadoop 2.7.1 and HBase 1.1.1

2015-07-22 Thread Matt Foley (JIRA)
Matt Foley created HDFS-8809: Summary: HDFS fsck reports file corruption (Missing blocks) when HBase is running, with Hadoop 2.7.1 and HBase 1.1.1 Key: HDFS-8809 URL: https://issues.apache.org/jira/browse/HDFS-8809

[jira] [Resolved] (HDFS-2325) Fuse-DFS fails to build on Hadoop 20.203.0

2011-09-25 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2325. -- Resolution: Fixed Fix Version/s: 0.20.205.0 > Fuse-DFS fails to build on Hadoop 20.20

[jira] [Reopened] (HDFS-3316) jsvc should be listed as a dependency for "package" and "bin-package"

2012-05-06 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3316: -- > jsvc should be listed as a dependency for "package" and

[jira] [Created] (HDFS-3617) Port HDFS-96 to branch-1 (support blocks greater than 2GB)

2012-07-08 Thread Matt Foley (JIRA)
Matt Foley created HDFS-3617: Summary: Port HDFS-96 to branch-1 (support blocks greater than 2GB) Key: HDFS-3617 URL: https://issues.apache.org/jira/browse/HDFS-3617 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-3700) Backport HDFS-3568 to branch-1 (fuse_dfs: add support for security)

2012-07-22 Thread Matt Foley (JIRA)
Matt Foley created HDFS-3700: Summary: Backport HDFS-3568 to branch-1 (fuse_dfs: add support for security) Key: HDFS-3700 URL: https://issues.apache.org/jira/browse/HDFS-3700 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-1108) Log newly allocated blocks

2012-08-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1108: -- Incorrectly resolved as duplicate. The OTHER bug (HDFS-978) was the one closed. The fix was committed

[jira] [Resolved] (HDFS-1108) Log newly allocated blocks

2012-08-23 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1108. -- Resolution: Fixed > Log newly allocated blocks > -- > >

[jira] [Resolved] (HDFS-3461) HFTP should use the same port & protocol for getting the delegation token

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-3461. -- Resolution: Fixed Fix was committed by Owen on 10/1/2012. > HFTP should use the s

[jira] [Reopened] (HDFS-3553) Hftp proxy tokens are broken

2012-10-17 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-3553: -- 1.1.0 was released without this patch. Changing the Target Version to 1.1.1. However, is this really

[jira] Created: (HDFS-1443) Improve Datanode startup time

2010-10-07 Thread Matt Foley (JIRA)
Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0 One of the factors slowing down cluster restart is the startup time for the Datanodes. In particular, if Upgrade is needed, the Datanodes must do a Snapshot and this can take 5-15 minutes per volume

[jira] Created: (HDFS-1445) Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

2010-10-07 Thread Matt Foley (JIRA)
: https://issues.apache.org/jira/browse/HDFS-1445 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley It was a bit of a puzzle why we can do a full scan of a disk in about 30 seconds during FSDir() or getVolumeMap(), but the same disk took 11 minutes to do

[jira] Created: (HDFS-1446) Refactor the start-time Directory Tree and Replicas Map constructors to share data and run volume-parallel

2010-10-07 Thread Matt Foley (JIRA)
/jira/browse/HDFS-1446 Project: Hadoop HDFS Issue Type: Sub-task Components: data-node Affects Versions: 0.20.2 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0 Refactor the FSDir() and getVolumeMap() call chains in

[jira] Created: (HDFS-1447) Make getGenerationStampFromFile() more efficient, so it doesn't reprocess full directory listing for every block

2010-10-07 Thread Matt Foley (JIRA)
https://issues.apache.org/jira/browse/HDFS-1447 Project: Hadoop HDFS Issue Type: Sub-task Components: data-node Affects Versions: 0.20.2 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0 Make getGenerationStampFromFile()

[jira] Created: (HDFS-1617) CLONE to COMMON - Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

2011-02-09 Thread Matt Foley (JIRA)
: HDFS-1617 URL: https://issues.apache.org/jira/browse/HDFS-1617 Project: Hadoop HDFS Issue Type: Sub-task Components: data-node Affects Versions: 0.20.2 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0

[jira] Resolved: (HDFS-1617) CLONE to COMMON - Batch the calls in DataStorage to FileUtil.createHardLink(), so we call it once per directory instead of once per file

2011-02-09 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1617. -- Resolution: Fixed Release Note: (was: Batch hardlinking during "upgrade" snapshot

[jira] Created: (HDFS-1667) Consider redesign of block report processing

2011-02-27 Thread Matt Foley (JIRA)
Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley The current implementation of block reporting has the datanode send the entire list of blocks resident on that node in every report, hourly. BlockManager.processReport in the namenode runs each block

[jira] Created: (HDFS-1687) HDFS Federation: DirectoryScanner changes for federation

2011-03-01 Thread Matt Foley (JIRA)
: data-node Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch DirectoryScanner scans substantially all of the directory tree of entire volumes. It needs to be extended to work with Blockpools in

[jira] Created: (HDFS-1699) HDFS Federation: fix failure of TestBlockReport

2011-03-02 Thread Matt Foley (JIRA)
Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch FS is no longer immediately available when a datanode activates; one must wait for it to negotiate with a namenode and establish a blockpool. The current

[jira] Created: (HDFS-1700) HDFS Federation: Fsck needs to work with nameservice-suffixed configuration parameters

2011-03-02 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Bug Components: hdfs client Affects Versions: Federation Branch Reporter: Matt Foley Assignee: Matt Foley Fix For: Federation Branch Fsck fails trying to find machine "0.0.0.0", because fsck not yet

[jira] Resolved: (HDFS-1687) HDFS Federation: DirectoryScanner changes for federation

2011-03-02 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1687. -- Resolution: Fixed > HDFS Federation: DirectoryScanner changes for federat

[jira] Created: (HDFS-1726) query method for what kind of safe mode the Namenode is in

2011-03-04 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 If we could differentiate between "startup safemode" vs other safemode, it would be easier to do startup optimizations like HDFS-1295.

[jira] Created: (HDFS-1732) Enhance NNThroughputBenchmark to observe scale-dependent changes in IBR processing

2011-03-07 Thread Matt Foley (JIRA)
HDFS Issue Type: Improvement Components: name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Rework NNThroughputBenchmark to provide more detailed info about Initial Block Report (IBR) processing time, as a function of

[jira] Created: (HDFS-1767) Delay second Block Reports until after cluster finishes startup, to improve startup times

2011-03-17 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Improvement Components: data-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 Consider a large cluster that takes 40 minutes to start up. The datanodes compete to

[jira] [Created] (HDFS-1790) review use of synchronized methods in FSNamesystem

2011-03-25 Thread Matt Foley (JIRA)
Affects Versions: 0.23.0 Reporter: Matt Foley Fix For: 0.23.0 While analyzing SafeMode semantics for HDFS-1726, I noticed the following usage of synchronized methods in FSNamesystem that raised questions: 1. incVolumeFailure() is synchronized on the FSNamesystem

[jira] [Created] (HDFS-1798) saveNamespace should background the writing of the FSImage files when in SafeMode

2011-03-30 Thread Matt Foley (JIRA)
HDFS Issue Type: Improvement Reporter: Matt Foley Even with parallel writes of the FSImage files (HDFS-1071), large clusters still typically spend 5 minutes writing the files. When in SafeMode, it should be safe to background these writes instead of waiting for them. To

[jira] [Created] (HDFS-1806) TestBlockReport.blockReport_08() and _09() are timing-dependent and likely to fail on fast servers

2011-04-05 Thread Matt Foley (JIRA)
-1806 Project: Hadoop HDFS Issue Type: Bug Components: data-node, name-node Affects Versions: 0.22.0 Reporter: Matt Foley Method waitForTempReplica() polls every 100ms during block replication, attempting to "catch" a datanode in the state

[jira] [Created] (HDFS-1808) TestBalancer waits forever, errs without giving information

2011-04-05 Thread Matt Foley (JIRA)
Components: data-node, name-node Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley In three locations in the code, TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error message with no informa

[jira] [Resolved] (HDFS-953) TestBlockReport times out intermittently

2011-04-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-953. - Resolution: Duplicate For analysis and solution, please see HDFS-1806. > TestBlockReport times

[jira] [Resolved] (HDFS-733) TestBlockReport fails intermittently

2011-04-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-733. - Resolution: Duplicate For analysis and solution, please see HDFS-1806. > TestBlockReport fa

[jira] [Created] (HDFS-1827) TestBlockReplacement waits forever, errs without giving information

2011-04-11 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In method checkBlocks(), TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error me

[jira] [Created] (HDFS-1828) TestBlocksWithNotEnoughRacks intermittently fails assert

2011-04-11 Thread Matt Foley (JIRA)
: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In server.namenode.TestBlocksWithNotEnoughRacks.testSufficientlyReplicatedBlocksWithNotEnoughRacks assert fails at curReplicas == REPLICATION_FACTOR, but it

[jira] [Created] (HDFS-1829) TestNodeCount waits forever, errs without giving information

2011-04-11 Thread Matt Foley (JIRA)
Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.23.0 In three locations in the code, TestBalancer waits forever on a condition. Failures result in Hudson/Jenkins "Timeout occurred" error messa

[jira] [Created] (HDFS-1830) auto-test intermittently doesn't trigger in HDFS project

2011-04-12 Thread Matt Foley (JIRA)
nents: test Reporter: Matt Foley For HDFS-1295, the Hudson QA test would not run on the 02/Apr/11 01:13 submission, IBR_shortcut_v3atrunk.patch [ 12475272 ], until Nicholas (szetszwo) triggered it manually for me. Now, with the 11/Apr/11 06:59 submission of IBR_shortcut_v4atrunk.

[jira] [Resolved] (HDFS-1729) Improve metrics for measuring NN startup costs.

2011-04-20 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1729. -- Resolution: Invalid Withdrawn. > Improve metrics for measuring NN startup co

[jira] [Created] (HDFS-1852) Umbrella task: Clean up HDFS unit tests for timing-sensitive conditions, improve both condition stimulators and condition detection loops

2011-04-20 Thread Matt Foley (JIRA)
: HDFS-1852 URL: https://issues.apache.org/jira/browse/HDFS-1852 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Both namenode and datanode have multiple background threads

[jira] [Created] (HDFS-1853) refactor TestNodeCount to import standard node counting and "wait for replication" methods

2011-04-20 Thread Matt Foley (JIRA)
/HDFS-1853 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Eli's suggestions for refactoring the three "wait for" loops in TestNodeCount for re-usability (similar to what was done for HDFS

[jira] [Created] (HDFS-1854) make failure message more useful in DFSTestUtil.waitReplication()

2011-04-20 Thread Matt Foley (JIRA)
-task Reporter: Matt Foley Assignee: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1855) TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy() part 2 fails in two different ways

2011-04-21 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.22.0, 0.23.0 The second part of test case

[jira] [Created] (HDFS-1856) TestDatanodeBlockScanner waits forever, errs without giving information

2011-04-21 Thread Matt Foley (JIRA)
Type: Sub-task Reporter: Matt Foley Assignee: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1857) Hudson auto test for HDFS has started throwing javadoc: warning - Error fetching URL: http://java.sun.com/javase/6/docs/api/package-list

2011-04-21 Thread Matt Foley (JIRA)
: HDFS-1857 URL: https://issues.apache.org/jira/browse/HDFS-1857 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.22.0 Reporter: Matt Foley Hudson automated testing has started failing with one javadoc

[jira] [Created] (HDFS-1878) race condition in FSNamesystem.close() causes NullPointerException without serious consequence - TestHDFSServerPorts unit test failure

2011-05-02 Thread Matt Foley (JIRA)
-1878 URL: https://issues.apache.org/jira/browse/HDFS-1878 Project: Hadoop HDFS Issue Type: Bug Components: name-node Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Minor

[jira] [Created] (HDFS-1879) disambiguate "datanode dead" vs "datanode heartbeat expired"

2011-05-02 Thread Matt Foley (JIRA)
ue Type: Improvement Components: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Priority: Minor HDFS-1541 changed FSNamesystem.heartbeatCheck() so it would not call removeDatanode() while the name system is in Safe Mode. However, calls to FSNamesystem.is

[jira] [Created] (HDFS-1882) Recurring failures in TestDatanodeBlockScanner since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1883) Recurring failures in TestBackupNode since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1884) Recurring failures in TestDFSStorageStateRecovery since HDFS-1052

2011-05-03 Thread Matt Foley (JIRA)
-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1885) Recurring failures in TestFileConcurrentReader

2011-05-03 Thread Matt Foley (JIRA)
Recurring failures in TestFileConcurrentReader -- Key: HDFS-1885 URL: https://issues.apache.org/jira/browse/HDFS-1885 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley

[jira] [Created] (HDFS-1886) Recurring failures in TestFileAppend4, TestLargeBlock, TestWriteConfigurationToDFS for > 12 days

2011-05-03 Thread Matt Foley (JIRA)
886 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-1679) TestFileConcurrentReader fails intermittently

2011-05-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1679. -- Resolution: Duplicate > TestFileConcurrentReader fails intermitten

[jira] [Resolved] (HDFS-1885) Recurring failures in TestFileConcurrentReader for > 12 days

2011-05-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1885. -- Resolution: Duplicate Duplicate of HDFS-1401 > Recurring failures in TestFileConcurrentReader for &

[jira] [Resolved] (HDFS-1886) Recurring failures in TestFileAppend4, TestLargeBlock, TestWriteConfigurationToDFS for > 12 days

2011-05-10 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1886. -- Resolution: Fixed > Recurring failures in TestFileAppend4, TestLargeBl

[jira] [Created] (HDFS-1922) Recurring failure in TestJMXGet.testNameNode since build 477 on May 11

2011-05-11 Thread Matt Foley (JIRA)
Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-1923) Intermittent recurring failure in TestFiDataTransferProtocol2.pipeline_Fi_29

2011-05-11 Thread Matt Foley (JIRA)
Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-1883) Recurring failures in TestBackupNode since HDFS-1052

2011-05-11 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1883. -- Resolution: Fixed Fix Version/s: 0.23.0 We are now at build 488, and have had no further

[jira] [Created] (HDFS-1952) FSEditLog.open() appears to succeed even if all EDITS directories fail

2011-05-17 Thread Matt Foley (JIRA)
Type: Bug Affects Versions: 0.22.0, 0.23.0 Reporter: Matt Foley Assignee: Aaron T. Myers Priority: Blocker Fix For: 0.22.0 After HDFS-1071, saveNamespace now appears to "succeed" even if all of the individual directories failed to save

[jira] [Created] (HDFS-1955) CLONE - saveNamespace appears to succeed even if all directories fail to save

2011-05-18 Thread Matt Foley (JIRA)
Issue Type: Bug Affects Versions: 0.22.0, 0.23.0 Reporter: Matt Foley Assignee: Aaron T. Myers Priority: Blocker Fix For: 0.22.0 After HDFS-1071, saveNamespace now appears to "succeed" even if all of the individual directories

[jira] [Resolved] (HDFS-1921) Save namespace can cause NN to be unable to come up on restart

2011-05-22 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1921. -- Resolution: Fixed > Save namespace can cause NN to be unable to come up on rest

[jira] [Created] (HDFS-1988) TestTrash infinite loops if run on a home directory with stuff in .Trash

2011-05-24 Thread Matt Foley (JIRA)
Type: Sub-task Affects Versions: 0.22.0 Reporter: Matt Foley Fix For: 0.22.0 Seems to have started failing recently in many commit builds as well as the last two nightly builds of 22: https://builds.apache.org/hudson/job/Hadoop-Hdfs-22-branch/51/testReport

[jira] [Resolved] (HDFS-1401) TestFileConcurrentReader test case is still timing out / failing

2011-06-01 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1401. -- Resolution: Cannot Reproduce TestFileConcurrentReader has not had a failure in the last 60+ builds over

[jira] [Resolved] (HDFS-1471) TestHDFSTrash times out on trunk

2011-06-02 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1471. -- Resolution: Duplicate > TestHDFSTrash times out on tr

[jira] [Reopened] (HDFS-1836) Thousand of CLOSE_WAIT socket

2011-06-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1836: -- Assignee: Bharath Mundlapudi (was: Todd Lipcon) Reopening because Bharath's adapted patc

[jira] [Created] (HDFS-2031) request test-patch to work with -Dresolvers=internal, for pre-patch and/or post-patch builds

2011-06-03 Thread Matt Foley (JIRA)
Project: Hadoop HDFS Issue Type: Improvement Components: build Reporter: Matt Foley For dev test, need to test an HDFS patch that is dependent on a modified COMMON jar. For casual testing, one can build in COMMON with "ant mvn-install", then buil

[jira] [Resolved] (HDFS-2019) Fix all the places where Java method File.list is used with FileUtil.list API

2011-06-04 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2019. -- Resolution: Fixed Committed to trunk. Thanks Bharath! HDFS-2019 depends upon HADOOP-7342. It is

[jira] [Resolved] (HDFS-2023) Backport of NPE for File.list and File.listFiles

2011-06-04 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2023. -- Resolution: Fixed Committed to 0.20-security. Thanks Bharath! > Backport of NPE for File.list

[jira] [Created] (HDFS-2044) TestQueueProcessingStatistics failing automatic test due to timing issues

2011-06-07 Thread Matt Foley (JIRA)
Issue Type: Test Components: test Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Fix For: 0.20.205.0 The test makes assumptions about timing issues that hold true in workstation environments but not in Hudson auto-test

[jira] [Resolved] (HDFS-2044) TestQueueProcessingStatistics failing automatic test due to timing issues

2011-06-07 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2044. -- Resolution: Fixed Note this is a v20 issue only. > TestQueueProcessingStatistics failing automa

[jira] [Resolved] (HDFS-1878) TestHDFSServerPorts unit test failure - race condition in FSNamesystem.close() causes NullPointerException without serious consequence

2011-06-08 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1878. -- Resolution: Fixed Committed to 0.20-security and 0.20-security-205. > TestHDFSServerPorts unit t

[jira] [Reopened] (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2011-06-08 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1295: -- This patch needs to be ported to yahoo-merge branch. Also, the integration of HDFS-1052 into trunk

[jira] [Created] (HDFS-2061) two minor bugs in BlockManager block report processing

2011-06-10 Thread Matt Foley (JIRA)
: name-node Affects Versions: 0.23.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Minor Fix For: 0.23.0 In a recent review of HDFS-1295 patches (speedup for block report processing), found two very minor bugs in BlockManager, as documented in

[jira] [Resolved] (HDFS-1295) Improve namenode restart times by short-circuiting the first block reports from datanodes

2011-06-10 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1295. -- Resolution: Fixed Fix Version/s: Federation Branch Hadoop Flags: [Reviewed] Committed to

[jira] [Resolved] (HDFS-1836) Thousand of CLOSE_WAIT socket

2011-06-14 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1836. -- Resolution: Fixed Fix Version/s: (was: 0.20.205.0) Committed to 0.20-security for .206

[jira] [Resolved] (HDFS-1952) FSEditLog.open() appears to succeed even if all EDITS directories fail

2011-06-15 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1952. -- Resolution: Fixed Fix Version/s: 0.23.0 0.22.0 Committed to v22. Thanks

[jira] [Resolved] (HDFS-1656) getDelegationToken in HftpFileSystem should renew TGT if needed.

2011-06-16 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-1656. -- Resolution: Fixed Fix Version/s: 0.23.0 Committed to trunk. Thanks, Jitendra

[jira] [Created] (HDFS-2126) [umbrella task] Improve Namenode startup time

2011-07-05 Thread Matt Foley (JIRA)
Affects Versions: 0.20.2 Reporter: Matt Foley This is an umbrella task to group the improvements in Namenode startup latency made over the last few months, and track remaining ideas. -- This message is automatically generated by JIRA. For more information on JIRA, see: http

[jira] [Created] (HDFS-2136) Fault injection for StorageDirectory failures during read/write of FSImage/Edits files

2011-07-07 Thread Matt Foley (JIRA)
: Hadoop HDFS Issue Type: Sub-task Reporter: Matt Foley -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HDFS-2217) TestHdfsProxy.testHdfsProxyInterface fails in Jenkins with "org.apache.hadoop.ipc.RemoteException: hudson is not allowed to impersonate hudson"

2011-08-01 Thread Matt Foley (JIRA)
ld servers Reporter: Matt Foley See https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-0.20.204-Build/20/testReport/org.apache.hadoop.hdfsproxy/TestHdfsProxy/testHdfsProxyInterface/ Error Message hudson is not allowed to impersonate hudson Stacktrace org.apache.hadoop.ipc.RemoteExcepti

[jira] [Created] (HDFS-2218) Remove TestHdfsProxy.testHdfsProxyInterface from automated test suite for 0.20-security-204 release

2011-08-01 Thread Matt Foley (JIRA)
-2218 Project: Hadoop HDFS Issue Type: Test Components: contrib/hdfsproxy, test Affects Versions: 0.20.204.0 Reporter: Matt Foley Assignee: Matt Foley Priority: Blocker Fix For: 0.20.204.0 To enable release of

[jira] [Resolved] (HDFS-2218) Disable TestHdfsProxy.testHdfsProxyInterface in automated test suite for 0.20-security-204 release

2011-08-01 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2218. -- Resolution: Fixed Committed to 0.20-security-204. > Disable TestHdfsProxy.testHdfsProxyInterface

[jira] [Reopened] (HDFS-1330) Make RPCs to DataNodes timeout

2011-08-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-1330: -- Assignee: John George (was: Hairong Kuang) Re-opening to add enhanced unit testing in v0.23 (moved

[jira] [Created] (HDFS-2352) improve TestOfflineEditsViewer to accomodate comment in editsStored.xml, for Apache license header

2011-09-20 Thread Matt Foley (JIRA)
-2352 Project: Hadoop HDFS Issue Type: Test Components: test Affects Versions: 0.23.0 Reporter: Matt Foley Priority: Minor In HDFS-2344, we had to remove the license header comment from hadoop-hdfs-project/hadoop-hdfs/src/test/resources

[jira] [Reopened] (HDFS-2395) webhdfs api's should return a root element in the json response

2011-10-05 Thread Matt Foley (Reopened) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HDFS-2395: -- Bug was erroneously marked "Duplicate" instead of "Fixed". Fixing...

[jira] [Resolved] (HDFS-2395) webhdfs api's should return a root element in the json response

2011-10-05 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2395. -- Resolution: Fixed Fix Version/s: (was: 0.20.206.0) > webhdfs api's should retur

[jira] [Resolved] (HDFS-2385) Support delegation token renewal in webhdfs

2011-10-06 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2385. -- Resolution: Fixed Fix Version/s: (was: 0.20.206.0) Merged to 0.20.205. Thanks, Nicholas

[jira] [Resolved] (HDFS-2404) webhdfs liststatus json response is not correct

2011-10-06 Thread Matt Foley (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HDFS-2404. -- Resolution: Fixed Fix Version/s: 0.20.205.0 Committed to 0.20-sec and 0.20.205. Thanks Suresh

  1   2   >