Re: Apache Hadoop 3.0.1 Release plan

2018-02-01 Thread Aaron T. Myers
Hey Anu, My feeling on HDFS-12990 is that we've discussed it quite a bit already and it doesn't seem at this point like either side is going to budge. I'm certainly happy to have a phone call about it, but I don't expect that we'd make much progress. My suggestion is that we simply include the pa

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-11 Thread Aaron T. Myers
+1 (binding) - downloaded the src tarball and built the source (-Pdist -Pnative) - verified the checksum - brought up a secure pseudo distributed cluster - did some basic file system operations (mkdir, list, put, cat) and confirmed that everything was working - confirmed that the web UI worked Be

[jira] [Created] (HDFS-11441) Add escaping to error messages in web UIs

2017-02-22 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-11441: - Summary: Add escaping to error messages in web UIs Key: HDFS-11441 URL: https://issues.apache.org/jira/browse/HDFS-11441 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Aaron T. Myers
+1 (binding) from me. Downloaded the source, built from source, set up a pseudo cluster, and ran a few of the sample jobs. Thanks a lot for doing all this release work, Andrew. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Aug 30, 2016 at 8:51 AM, Andrew Wang wrote: > Hi

Re: Why there are so many revert operations on trunk?

2016-06-06 Thread Aaron T. Myers
Junping, All of this is being discussed on HDFS-9924. Suggest you follow the conversation there. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Jun 6, 2016 at 7:20 AM, Junping Du wrote: > Hi Andrew, > > I just noticed you revert 8 commits on trunk last Friday: > &g

Re: 'Target Version' field missing in Jira

2016-02-16 Thread Aaron T. Myers
Great news. Thanks a lot for looking into this, Vinod. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 16, 2016 at 11:42 AM, Vinod Kumar Vavilapalli < vino...@apache.org> wrote: > The data is still intact as I can see that I can continue to search on > JIRA against target-

Re: 'Target Version' field missing in Jira

2016-02-16 Thread Aaron T. Myers
Has anyone followed up with ASF Infra about getting this addressed? I worry that all the data for the target versions has disappeared as well... -- Aaron T. Myers Software Engineer, Cloudera On Fri, Feb 12, 2016 at 1:35 PM, Kihwal Lee wrote: > It's still here: > https://issues.apac

Re: Hadoop encryption module as Apache Chimera incubator project

2016-01-28 Thread Aaron T. Myers
xport/maintain/concern itself with yet another publicly-consumed interface. c) Chimera can have its own (presumably much faster) release cadence completely separate from Hadoop. -- Aaron T. Myers Software Engineer, Cloudera

Re: Hadoop encryption module as Apache Chimera incubator project

2016-01-20 Thread Aaron T. Myers
approaching the Apache Commons folks saying that you'd like to contribute Chimera? I'd recommend saying that Hadoop and Spark are both on board to depend on this. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 20, 2016 at 4:31 PM, Andrew Wang wrote: > Thanks Uma for pu

Re: INotify stability

2015-09-16 Thread Aaron T. Myers
fy. That's fixed now, and in addition to HDFS-8964 should fully address that issue. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Sep 16, 2015 at 12:41 PM, Ravi Prakash wrote: > Hi Mohammad! > > Thanks for reporting the issue. Could you please take a heap dump of the > NN

[jira] [Resolved] (HDFS-2433) TestFileAppend4 fails intermittently

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-2433. -- Resolution: Cannot Reproduce I don't think I've seen this fail in a long, long time

[jira] [Resolved] (HDFS-3811) TestPersistBlocks#TestRestartDfsWithFlush appears to be flaky

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3811. -- Resolution: Cannot Reproduce I don't think I've seen this fail in a very long time

[jira] [Resolved] (HDFS-3660) TestDatanodeBlockScanner#testBlockCorruptionRecoveryPolicy2 times out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3660. -- Resolution: Cannot Reproduce Target Version/s: (was: ) This is an ancient/stale

[jira] [Resolved] (HDFS-4001) TestSafeMode#testInitializeReplQueuesEarly may time out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4001. -- Resolution: Fixed Haven't seen this fail in a very long time. Closing this out. Feel fr

[jira] [Resolved] (HDFS-3532) TestDatanodeBlockScanner.testBlockCorruptionRecoveryPolicy1 times out

2015-07-20 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3532. -- Resolution: Cannot Reproduce This is an ancient/stale flaky test JIRA. Resolving

[jira] [Created] (HDFS-8194) Add administrative tool to be able to examine the NN's view of DN storages

2015-04-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-8194: Summary: Add administrative tool to be able to examine the NN's view of DN storages Key: HDFS-8194 URL: https://issues.apache.org/jira/browse/HDFS-8194 Pr

[jira] [Created] (HDFS-8193) Add the ability to delay replica deletion for a period of time

2015-04-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-8193: Summary: Add the ability to delay replica deletion for a period of time Key: HDFS-8193 URL: https://issues.apache.org/jira/browse/HDFS-8193 Project: Hadoop HDFS

Re: upstream jenkins build broken?

2015-03-10 Thread Aaron T. Myers
oop-hdfs/target/test/data/dfs/data/data3/ has 500 perms, so I'm guessing that's the problem. Been that way since 9:32 UTC on March 5th." -- Aaron T. Myers Software Engineer, Cloudera On Tue, Mar 10, 2015 at 1:24 PM, Colin P. McCabe wrote: > Hi all, > > A very quick (and not t

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Aaron T. Myers
+1, this sounds like a good plan to me. Thanks a lot for volunteering to take this on, Andrew. Best, Aaron On Mon, Mar 2, 2015 at 3:19 PM, Andrew Wang wrote: > Hi devs, > > It's been a year and a half since 2.x went GA, and I think we're about due > for a 3.x release. > Notably, there are two

[jira] [Resolved] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2015-01-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-7421. -- Resolution: Duplicate > Move processing of postponed over-replicated blocks to a background t

[jira] [Created] (HDFS-7421) Move processing of postponed over-replicated blocks to a background task

2014-11-21 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-7421: Summary: Move processing of postponed over-replicated blocks to a background task Key: HDFS-7421 URL: https://issues.apache.org/jira/browse/HDFS-7421 Project: Hadoop

Re: [DISCUSS] Switch to log4j 2

2014-08-15 Thread Aaron T. Myers
Not necessarily opposed to switching logging frameworks, but I believe we can actually support async logging with today's logging system if we wanted to, e.g. as was done for the HDFS audit logger in this JIRA: https://issues.apache.org/jira/browse/HDFS-5241 -- Aaron T. Myers Software Eng

Re: [VOTE] Migration from subversion to git for version control

2014-08-11 Thread Aaron T. Myers
+1 (binding) Thanks for driving this, Karthik. -- Aaron T. Myers Software Engineer, Cloudera On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla wrote: > I have put together this proposal based on recent discussion on this topic. > > Please vote on the proposal. The vote runs f

[jira] [Created] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

2014-07-09 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6647: Summary: Edit log corruption when pipeline recovery occurs for deleted file present in snapshot Key: HDFS-6647 URL: https://issues.apache.org/jira/browse/HDFS-6647

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-27 Thread Aaron T. Myers
't lose any sleep over it. -- Aaron T. Myers Software Engineer, Cloudera > On Jun 27, 2014, at 3:04 PM, "Arun C. Murthy" wrote: > > Aaron, > > Since the amend was just to the test, I'll keep this RC as-is. > > I'll also comment on jira. >

Re: [VOTE] Release Apache Hadoop 2.4.1

2014-06-27 Thread Aaron T. Myers
t. Best, Aaron -- Aaron T. Myers Software Engineer, Cloudera On Fri, Jun 20, 2014 at 11:51 PM, Arun C Murthy wrote: > Folks, > > I've created another release candidate (rc1) for hadoop-2.4.1 based on the > feedback that I would like to push out. > > The RC is av

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Aaron T. Myers
+1 (binding) -- Aaron T. Myers Software Engineer, Cloudera On Tue, Jun 24, 2014 at 1:53 AM, Arun C Murthy wrote: > Folks, > > As discussed, I'd like to call a vote on changing our by-laws to change > release votes from 7 days to 5. > > I've attached the cha

[jira] [Created] (HDFS-6563) NameNode cannot save fsimage in certain circumstances when snapshots are in use

2014-06-18 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6563: Summary: NameNode cannot save fsimage in certain circumstances when snapshots are in use Key: HDFS-6563 URL: https://issues.apache.org/jira/browse/HDFS-6563 Project

[jira] [Created] (HDFS-6463) Incorrect permission can be created after setting ACLs

2014-05-28 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6463: Summary: Incorrect permission can be created after setting ACLs Key: HDFS-6463 URL: https://issues.apache.org/jira/browse/HDFS-6463 Project: Hadoop HDFS

[jira] [Created] (HDFS-6435) Add support for specifying a static uid/gid mapping for the NFS gateway

2014-05-20 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6435: Summary: Add support for specifying a static uid/gid mapping for the NFS gateway Key: HDFS-6435 URL: https://issues.apache.org/jira/browse/HDFS-6435 Project: Hadoop

[jira] [Created] (HDFS-6406) Add capability for NFS gateway to reject connections from unprivileged ports

2014-05-15 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6406: Summary: Add capability for NFS gateway to reject connections from unprivileged ports Key: HDFS-6406 URL: https://issues.apache.org/jira/browse/HDFS-6406 Project

[jira] [Created] (HDFS-6289) HA failover can fail if there are pending DN messages for DNs which no longer exist

2014-04-25 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6289: Summary: HA failover can fail if there are pending DN messages for DNs which no longer exist Key: HDFS-6289 URL: https://issues.apache.org/jira/browse/HDFS-6289

[jira] [Created] (HDFS-6281) Provide option to use the NFS Gateway without having to use the Hadoop portmapper

2014-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6281: Summary: Provide option to use the NFS Gateway without having to use the Hadoop portmapper Key: HDFS-6281 URL: https://issues.apache.org/jira/browse/HDFS-6281

[jira] [Created] (HDFS-6280) Provide option to

2014-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6280: Summary: Provide option to Key: HDFS-6280 URL: https://issues.apache.org/jira/browse/HDFS-6280 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-6280) Provide option to

2014-04-24 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-6280. -- Resolution: Invalid Accidentally hit "create" too soon. :) > Prov

[jira] [Created] (HDFS-6112) NFS Gateway docs are incorrect for allowed hosts configuration

2014-03-17 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6112: Summary: NFS Gateway docs are incorrect for allowed hosts configuration Key: HDFS-6112 URL: https://issues.apache.org/jira/browse/HDFS-6112 Project: Hadoop HDFS

[jira] [Created] (HDFS-6056) Clean up NFS config settings

2014-03-04 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6056: Summary: Clean up NFS config settings Key: HDFS-6056 URL: https://issues.apache.org/jira/browse/HDFS-6056 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-6048) DFSClient fails if native library doesn't exist

2014-03-03 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-6048. -- Resolution: Duplicate Hi Akira, I think this will be addressed by HDFS-6040, which should be

[jira] [Created] (HDFS-6033) PBImageXmlWriter incorrectly handles processing cache directives

2014-02-27 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-6033: Summary: PBImageXmlWriter incorrectly handles processing cache directives Key: HDFS-6033 URL: https://issues.apache.org/jira/browse/HDFS-6033 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
I don't think any of what you describe below is a regression in behavior from earlier releases. The fs.defaultFS has been set to file:/// for a long time, and likewise you've similarly had to set up your YARN configs. Given that, I don't think this warrants a new RC. -- Aaron T.

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Aaron T. Myers
+1 (binding) I downloaded the source tar ball, checked signatures, built from the source, ran a few of the sample jobs on a pseudo cluster. Everything was as expected. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy wrote: > Folks, >

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
There's still ongoing discussion on HDFS-4858 and I don't think we should hold up 2.3.0 for that. IMO we should target that for 2.3.1 or 2.4.0. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 5:53 PM, Konstantin Shvachko wrote: > Sorry for the last minute r

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
Just committed a fix for HDFS-5921 to branch-2.3. Fire away. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 1:34 PM, Aaron T. Myers wrote: > OK. I think I should be able to get it in by 6pm PT, thanks to a quick +1 > from Andrew, but certainly don't let it

[jira] [Created] (HDFS-5922) DN heartbeat thread can get stuck in tight loop

2014-02-10 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5922: Summary: DN heartbeat thread can get stuck in tight loop Key: HDFS-5922 URL: https://issues.apache.org/jira/browse/HDFS-5922 Project: Hadoop HDFS Issue Type

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
OK. I think I should be able to get it in by 6pm PT, thanks to a quick +1 from Andrew, but certainly don't let it hold up the train if for some reason it takes longer than that. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Feb 10, 2014 at 12:04 PM, Arun C Murthy wrote: > Lo

Re: Re-swizzle 2.3

2014-02-10 Thread Aaron T. Myers
ot going to get 2.3 out today anyway, I'd like to put this in. It's a small fix, and since many people have the sticky bit set on /tmp, they won't be able to browse any of the FS hierarchy from the NN without this fix. -- Aaron T. Myers Software Engineer, Cloudera On Fri, Feb 7,

[jira] [Created] (HDFS-5921) Cannot browse file system via NN web UI if any directory has the sticky bit set

2014-02-10 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5921: Summary: Cannot browse file system via NN web UI if any directory has the sticky bit set Key: HDFS-5921 URL: https://issues.apache.org/jira/browse/HDFS-5921 Project

Re: Re-swizzle 2.3

2014-01-30 Thread Aaron T. Myers
I just committed HADOOP-10310 to branch-2.3, so we're good to go there. (Thanks to Andrew and Daryn for the prompt reviews.) -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 29, 2014 at 6:52 PM, Aaron T. Myers wrote: > I just filed this JIRA as a blocker for 2.3:

Re: Re-swizzle 2.3

2014-01-29 Thread Aaron T. Myers
r the priority, but it seems pretty important to me. Best, Aaron -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 29, 2014 at 6:24 PM, Andrew Wang wrote: > I just finished tuning up branch-2.3 and fixing up the HDFS and Common > CHANGES.txt in trunk, branch-2, and branch-2.3. I h

[jira] [Created] (HDFS-5840) Follow-up to HDFS-5138 to improve error handling during partial upgrade failures

2014-01-27 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5840: Summary: Follow-up to HDFS-5138 to improve error handling during partial upgrade failures Key: HDFS-5840 URL: https://issues.apache.org/jira/browse/HDFS-5840 Project

[jira] [Created] (HDFS-5517) Lower the default maximum number of blocks per file

2013-11-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5517: Summary: Lower the default maximum number of blocks per file Key: HDFS-5517 URL: https://issues.apache.org/jira/browse/HDFS-5517 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5433) When reloading fsimage during checkpointing, we should clear existing snapshottable directories

2013-10-25 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5433: Summary: When reloading fsimage during checkpointing, we should clear existing snapshottable directories Key: HDFS-5433 URL: https://issues.apache.org/jira/browse/HDFS-5433

Re: [VOTE] Merge HDFS-4949 to trunk

2013-10-24 Thread Aaron T. Myers
I don't necessarily disagree with the general questions about the procedural issues of merge votes. Thanks for bringing that up in the other thread you mentioned. To some extent it seems like much of this has been based on custom, and if folks feel that more precisely defining the merge vote proces

Re: [VOTE] Merge HDFS-4949 to trunk

2013-10-24 Thread Aaron T. Myers
On Thu, Oct 24, 2013 at 6:18 AM, Andrew Wang wrote: > Right now we're on track to have all of those things done by tomorrow. > Since the remaining issues are either not technical or do not involve major > changes, I was hoping we could +1 this merge vote in the spirit of "+1 > pending jenkins". We

[jira] [Created] (HDFS-5408) Optional fields in PB definitions should be optional in HTTP deserialization as well

2013-10-23 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5408: Summary: Optional fields in PB definitions should be optional in HTTP deserialization as well Key: HDFS-5408 URL: https://issues.apache.org/jira/browse/HDFS-5408

[jira] [Created] (HDFS-5403) WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306

2013-10-22 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5403: Summary: WebHdfs client cannot communicate with older WebHdfs servers post HDFS-5306 Key: HDFS-5403 URL: https://issues.apache.org/jira/browse/HDFS-5403 Project

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-13 Thread Aaron T. Myers
+1 (binding) Downloaded the release, built from tarball, tested a single node cluster. Everything worked as expected. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Oct 7, 2013 at 12:00 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for had

[jira] [Resolved] (HDFS-3958) Integrate upgrade/finalize/rollback with external journals

2013-10-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3958. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion

[jira] [Resolved] (HDFS-3133) Add support for DFS upgrade with HA enabled

2013-10-02 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-3133. -- Resolution: Duplicate Resolving as a duplicate of HDFS-5138, which has a lot more discussion

[jira] [Created] (HDFS-5289) Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure

2013-10-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5289: Summary: Race condition in TestRetryCacheWithHA#testCreateSymlink causes spurious test failure Key: HDFS-5289 URL: https://issues.apache.org/jira/browse/HDFS-5289

[jira] [Created] (HDFS-5223) Allow edit log/fsimage format changes without changing layout version

2013-09-18 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5223: Summary: Allow edit log/fsimage format changes without changing layout version Key: HDFS-5223 URL: https://issues.apache.org/jira/browse/HDFS-5223 Project: Hadoop

[jira] [Resolved] (HDFS-4299) WebHDFS Should Support HA Configuration

2013-09-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4299. -- Resolution: Duplicate Assignee: (was: Haohui Mai) Thanks, Daisuke. Closing this one

[jira] [Created] (HDFS-5159) Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint

2013-09-03 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5159: Summary: Secondary NameNode fails to checkpoint if error occurs downloading edits on first checkpoint Key: HDFS-5159 URL: https://issues.apache.org/jira/browse/HDFS-5159

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

2013-08-21 Thread Aaron T. Myers
+1 (binding) I downloaded the bits, set up a 4-node cluster, and ran some example jobs. Looks good to me. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Aug 15, 2013 at 10:29 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc1) for hadoop-2.0.6-a

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-20 Thread Aaron T. Myers
t JIRA to be correct. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Aug 15, 2013 at 2:15 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would > like to get released - this fixes the bugs we saw since the last go-aroun

[jira] [Created] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

2013-08-15 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5102: Summary: Snapshot names should not be allowed to contain slash characters Key: HDFS-5102 URL: https://issues.apache.org/jira/browse/HDFS-5102 Project: Hadoop HDFS

[jira] [Created] (HDFS-5097) TestDoAsEffectiveUser can fail on JDK 7

2013-08-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5097: Summary: TestDoAsEffectiveUser can fail on JDK 7 Key: HDFS-5097 URL: https://issues.apache.org/jira/browse/HDFS-5097 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5064) Standby checkpoints should not block concurrent readers

2013-08-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5064: Summary: Standby checkpoints should not block concurrent readers Key: HDFS-5064 URL: https://issues.apache.org/jira/browse/HDFS-5064 Project: Hadoop HDFS

[jira] [Created] (HDFS-5060) NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions

2013-08-02 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5060: Summary: NN should proactively perform a saveNamespace if it has a huge number of outstanding uncheckpointed transactions Key: HDFS-5060 URL: https://issues.apache.org/jira

[jira] [Created] (HDFS-5027) On startup, DN should scan volumes in parallel

2013-07-23 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5027: Summary: On startup, DN should scan volumes in parallel Key: HDFS-5027 URL: https://issues.apache.org/jira/browse/HDFS-5027 Project: Hadoop HDFS Issue Type

Re: Question for edit log retain

2013-07-01 Thread Aaron T. Myers
Hi Azuryy, On Wed, Jun 26, 2013 at 6:12 PM, Azuryy Yu wrote: > Hi Dear all, > > I have some confusion for edit log retain, > > NNStorageRetentionManager.java: > > 1) > purgeCheckpointsOlderThan() > What's mean of check point here? > Here, "checkpoint" is referring to the fsimage files on the

[jira] [Created] (HDFS-4906) HDFS Output streams should not accept writes after being closed

2013-06-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4906: Summary: HDFS Output streams should not accept writes after being closed Key: HDFS-4906 URL: https://issues.apache.org/jira/browse/HDFS-4906 Project: Hadoop HDFS

[jira] [Created] (HDFS-4830) Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml

2013-05-16 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4830: Summary: Typo in config settings for AvailableSpaceVolumeChoosingPolicy in hdfs-default.xml Key: HDFS-4830 URL: https://issues.apache.org/jira/browse/HDFS-4830

[jira] [Resolved] (HDFS-4352) Encapsulate arguments to BlockReaderFactory in a class

2013-05-10 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4352. -- Resolution: Won't Fix Seems some folks don't think this is the

Re: [VOTE] Merge HDFS-2802 snapshot feature to trunk

2013-05-07 Thread Aaron T. Myers
the discussion to a JIRA, but I don't think that JIRA ever got filed. Mind doing that? -- Aaron T. Myers Software Engineer, Cloudera On Wed, May 1, 2013 at 11:54 AM, Suresh Srinivas wrote: > This is a follow up to my earlier heads up about merging Snapshot feature > to

[jira] [Created] (HDFS-4747) Convert snapshot user guide to APT from XDOC

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4747: Summary: Convert snapshot user guide to APT from XDOC Key: HDFS-4747 URL: https://issues.apache.org/jira/browse/HDFS-4747 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4739) NN can miscalculate the number of extra edit log segments to retain

2013-04-24 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4739: Summary: NN can miscalculate the number of extra edit log segments to retain Key: HDFS-4739 URL: https://issues.apache.org/jira/browse/HDFS-4739 Project: Hadoop HDFS

Re: Cannot communicate

2013-04-23 Thread Aaron T. Myers
Hi Kevin, Since it seems like this is a CDH-specific question, I recommend you email cdh-u...@cloudera.org where you should be able to get some help with this. -- Aaron T. Myers Software Engineer, Cloudera On Mon, Apr 22, 2013 at 10:33 AM, wrote: > > I am on a Ubuntu server. When I

Re: Convention question for using DFSConfigKey constants : are zeros magic?

2013-04-23 Thread Aaron T. Myers
certainly no "enforcement" of it, no. We try to use consistent prefixes, append units like "millis" or "seconds" to config settings which represent time, etc. but this is just by convention. -- Aaron T. Myers Software Engineer, Cloudera

Re: Convention question for using DFSConfigKey constants : are zeros magic?

2013-04-19 Thread Aaron T. Myers
Hi Jay, On Sat, Apr 20, 2013 at 1:10 AM, Jay Vyas wrote: > I recently looked into the HDFS source tree to determine idioms with > respect to a hairy debate about the threshold between what is and is not a > magic number, and found that : And it appears that the number zero is NOT > considered m

Re: Heads up - Snapshots feature merge into trunk

2013-04-18 Thread Aaron T. Myers
public API for HDFS-specific operations. Regardless, my point is not necessarily that these operations should go into the HdfsAdmin class, but rather that they shouldn't go into the FileSystem class, since the snapshots API doesn't seem to me like it will generalize to other FileSystem impl

Re: Heads up - Snapshots feature merge into trunk

2013-04-18 Thread Aaron T. Myers
to be a broad, stable interface. If we were to move these operations into the HdfsAdmin interface, there's nothing to stop users from using that interface instead of FileSystem. After all, that was the point of adding the HdfsAdmin class in the first place - to have a public API for perform

Re: Heads up - Snapshots feature merge into trunk

2013-04-17 Thread Aaron T. Myers
tural place for both of these APIs is in the HdfsAdmin class, which is a public/evolving interface explicitly for these sorts of operations. What are others thoughts on this subject? Best, Aaron -- Aaron T. Myers Software Engineer, Cloudera On Sat, Apr 13, 2013 at 10:05 AM, Suresh Srinivas w

Re: VOTE: HDFS-347 merge

2013-04-12 Thread Aaron T. Myers
Since the merge vote passed, I have merged the HDFS-347 branch to trunk. Leaving the JIRA open for now until we also do the merge to branch-2. Colin, thanks a ton for the monster contribution. This is a long time in coming. -- Aaron T. Myers Software Engineer, Cloudera On Thu, Apr 11, 2013 at

Re: VOTE: HDFS-347 merge

2013-04-10 Thread Aaron T. Myers
I'm +1 as well. I've reviewed much of the code as well and have personally seen it running in production at several different sites. I agree with Todd that it's a substantial improvement in operability. Best, Aaron On Apr 8, 2013, at 1:19 PM, Todd Lipcon wrote: > +1 for the branch merge. I'v

[jira] [Created] (HDFS-4658) Standby NN will log that it has received a block report "after becoming active"

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4658: Summary: Standby NN will log that it has received a block report "after becoming active" Key: HDFS-4658 URL: https://issues.apache.org/jira/browse/HDFS-4658

[jira] [Created] (HDFS-4657) If incremental BR is received before first full BR NN will log a line for every block on a DN

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4657: Summary: If incremental BR is received before first full BR NN will log a line for every block on a DN Key: HDFS-4657 URL: https://issues.apache.org/jira/browse/HDFS-4657

[jira] [Created] (HDFS-4656) DN heartbeat loop can be briefly tight

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4656: Summary: DN heartbeat loop can be briefly tight Key: HDFS-4656 URL: https://issues.apache.org/jira/browse/HDFS-4656 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4655) DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN

2013-04-01 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4655: Summary: DNA_FINALIZE is logged as being an unknown command by the DN when received from the standby NN Key: HDFS-4655 URL: https://issues.apache.org/jira/browse/HDFS-4655

[jira] [Created] (HDFS-4614) FSNamesystem#getContentSummary should use getPermissionChecker helper method

2013-03-19 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4614: Summary: FSNamesystem#getContentSummary should use getPermissionChecker helper method Key: HDFS-4614 URL: https://issues.apache.org/jira/browse/HDFS-4614 Project

[jira] [Created] (HDFS-4592) Default values for access time precision are out of sync between hdfs-default.xml and the code

2013-03-11 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4592: Summary: Default values for access time precision are out of sync between hdfs-default.xml and the code Key: HDFS-4592 URL: https://issues.apache.org/jira/browse/HDFS-4592

[jira] [Created] (HDFS-4591) HA clients can fail to fail over while Standby NN is performing long checkpoint

2013-03-11 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-4591: Summary: HA clients can fail to fail over while Standby NN is performing long checkpoint Key: HDFS-4591 URL: https://issues.apache.org/jira/browse/HDFS-4591 Project

Re: are the HDFS javadocs published on the website?

2013-02-25 Thread Aaron T. Myers
That sounds like a good plan to me. -- Aaron T. Myers Software Engineer, Cloudera On Sat, Feb 23, 2013 at 6:11 PM, Andrew Wang wrote: > Taking silence here to mean we aren't that concerned with the javadocs. > > Are we okay with Doug's proposed fix for the broken links? &

Re: VOTE: HDFS-347 merge

2013-02-22 Thread Aaron T. Myers
hat - keep HDFS-2246 around in branch-2 to let HDFS-347 soak a bit on trunk and then remove HDFS-2246 from branch-2 once we're confident in HDFS-347 and trunk adds Windows support. As Colin pointed out, this VOTE has always been about only merging this branch to trunk. -- Aaron T. Myers Software Engineer, Cloudera

Re: VOTE: HDFS-347 merge

2013-02-20 Thread Aaron T. Myers
e path alongside the HDFS-347 code path indefinitely. -- Aaron T. Myers Software Engineer, Cloudera

[jira] [Resolved] (HDFS-4476) HDFS-347: style cleanups

2013-02-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4476. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 b

[jira] [Resolved] (HDFS-4453) Make a simple doc to describe the usage and design of the shortcircuit read feature

2013-02-11 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4453. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 b

[jira] [Resolved] (HDFS-4485) HDFS-347: DN should chmod socket path a+w

2013-02-08 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4485. -- Resolution: Fixed I've just committed this to the HDFS-347 branch. Thanks a lot fo

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-08 Thread Aaron T. Myers
RM came up just fine. -- Aaron T. Myers Software Engineer, Cloudera On Wed, Feb 6, 2013 at 7:59 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I would > like to release. > > This release contains several major enh

[jira] [Resolved] (HDFS-4473) don't create domain socket unless we need it

2013-02-06 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HDFS-4473. -- Resolution: Fixed Hadoop Flags: Reviewed I've just committed this to the HDFS-347 b

  1   2   3   4   >