Re: Hadoop-2 generics compilation error

2012-06-29 Thread Andy Isaacson
I ran into this as well, and am prepping a patch. Lars, if you could file the Jira explaining why s/boolean/Boolean/ is the right fix, I'll test and submit the patch. -andy On Fri, Jun 29, 2012 at 11:08 AM, Alejandro Abdelnur wrote: > This change is from HDFS-3481, the wrong JIRA number is becau

Re: Hadoop-2 generics compilation error

2012-06-29 Thread Andy Isaacson
oes accept an incorrect program). -andy On Fri, Jun 29, 2012 at 12:01 PM, Andy Isaacson wrote: > I ran into this as well, and am prepping a patch. Lars, if you could file > the Jira explaining why s/boolean/Boolean/ is the right fix, I'll test and > submit the patch. > > -a

Re: Hadoop-2 generics compilation error

2012-06-29 Thread Andy Isaacson
> > generic method where the parameter that resolves the generic infers > > the type to do the un-boxing on. While SunJDK does handle it. > > > > Now, to the question which one is correct? I'm not sure but SunJDK > > does a valid inference. > > >

Re: A question about the namenode's decision on the data placement of a new file

2012-08-24 Thread Andy Isaacson
On Fri, Aug 24, 2012 at 3:33 PM, wei xu wrote: > I am doing some research on the data placement, but I am not quite familiar > with the Hadoop, is there any one who can tell me when a new file be added > into the HDFS, which function will be called by namenode to make a decision > on the allocatio

Re: Is there a way to mount HAR the same way HDFS can be mounted with FUSE?

2012-10-17 Thread Andy Isaacson
we deprecated the *-user@hadoop lists in favor of a general-purpose user@hadoop list, back in August. https://issues.apache.org/jira/browse/INFRA-5123 So Peter, you may find more help on the u...@hadoop.apache.org mailing list. (Unfortunately I haven't any insight into using HAR.) -andy On Wed,

Re: profiling hdfs write path

2012-12-05 Thread Andy Isaacson
On Tue, Dec 4, 2012 at 6:00 PM, Radim Kolar wrote: > Its not about writing patches, its about to get them committed. I have > experience that getting something committed takes months even on simple > patch. I have about 10 patches floating around none of them was committed in > last 4 weeks. Coul

Re: profiling hdfs write path

2012-12-06 Thread Andy Isaacson
On Wed, Dec 5, 2012 at 6:02 PM, Radim Kolar wrote: > YARN-223 > YARN-211 > YARN-210 > MAPREDUCE-4839

Re: New to Hadoop

2012-12-14 Thread Andy Isaacson
On Fri, Dec 14, 2012 at 10:43 AM, Joseph Kniest wrote: > Hi, not sure if anyone has gotten my previous emails, but I would like to > contribute to HDFS. I was wondering if anyone can answer two questions: > > What is a good JIRA to work on to get familiar with the HDFS source? Look for JIRAs with

[jira] [Created] (HDFS-4439) umask-mode does not support 4-digit umask value

2013-01-24 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4439: --- Summary: umask-mode does not support 4-digit umask value Key: HDFS-4439 URL: https://issues.apache.org/jira/browse/HDFS-4439 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3485) DataTransferThrottler will over-throttle when currentTimeMillis jumps

2012-05-31 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3485: --- Summary: DataTransferThrottler will over-throttle when currentTimeMillis jumps Key: HDFS-3485 URL: https://issues.apache.org/jira/browse/HDFS-3485 Project: Hadoop HDFS

[jira] [Created] (HDFS-3489) hdfs fsck usage message is outdated

2012-06-01 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3489: --- Summary: hdfs fsck usage message is outdated Key: HDFS-3489 URL: https://issues.apache.org/jira/browse/HDFS-3489 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3535) audit logging should log denied accesses as well as permitted ones

2012-06-13 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3535: --- Summary: audit logging should log denied accesses as well as permitted ones Key: HDFS-3535 URL: https://issues.apache.org/jira/browse/HDFS-3535 Project: Hadoop HDFS

[jira] [Created] (HDFS-3542) chmod does not parse ugo+rwx,+t correctly

2012-06-18 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3542: --- Summary: chmod does not parse ugo+rwx,+t correctly Key: HDFS-3542 URL: https://issues.apache.org/jira/browse/HDFS-3542 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3569) clean up isInfoEnabled usage re logAuditEvent

2012-06-26 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3569: --- Summary: clean up isInfoEnabled usage re logAuditEvent Key: HDFS-3569 URL: https://issues.apache.org/jira/browse/HDFS-3569 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3580) incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK

2012-06-29 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3580: --- Summary: incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK Key: HDFS-3580 URL: https

[jira] [Created] (HDFS-3643) hdfsJniHelper.c unchecked string pointers

2012-07-11 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3643: --- Summary: hdfsJniHelper.c unchecked string pointers Key: HDFS-3643 URL: https://issues.apache.org/jira/browse/HDFS-3643 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3687) BlockPoolSliceScanner reportBadBlocks fails with Operation category WRITE is not supported in state standby

2012-07-19 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3687: --- Summary: BlockPoolSliceScanner reportBadBlocks fails with Operation category WRITE is not supported in state standby Key: HDFS-3687 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-3710) libhdfs misuses O_RDONLY/WRONLY/RDWR

2012-07-23 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3710: --- Summary: libhdfs misuses O_RDONLY/WRONLY/RDWR Key: HDFS-3710 URL: https://issues.apache.org/jira/browse/HDFS-3710 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3733) audit logging must cover WebHdfs access

2012-07-26 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3733: --- Summary: audit logging must cover WebHdfs access Key: HDFS-3733 URL: https://issues.apache.org/jira/browse/HDFS-3733 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3760) primitiveCreate is a write, not a read

2012-08-03 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3760: --- Summary: primitiveCreate is a write, not a read Key: HDFS-3760 URL: https://issues.apache.org/jira/browse/HDFS-3760 Project: Hadoop HDFS Issue Type: Bug

[jira] [Reopened] (HDFS-3803) BlockPoolSliceScanner new work period notice is very chatty at INFO level

2012-08-14 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson reopened HDFS-3803: - Please revert this change and review HDFS-3194. > BlockPoolSliceScanner new w

[jira] [Resolved] (HDFS-3787) BlockManager#close races with ReplicationMonitor#run

2012-08-15 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson resolved HDFS-3787. - Resolution: Duplicate > BlockManager#close races with ReplicationMonitor#

[jira] [Created] (HDFS-3815) CorruptBlocks documentation is misleading

2012-08-17 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3815: --- Summary: CorruptBlocks documentation is misleading Key: HDFS-3815 URL: https://issues.apache.org/jira/browse/HDFS-3815 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3828) Block Scanner rescans blocks too frequently

2012-08-21 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3828: --- Summary: Block Scanner rescans blocks too frequently Key: HDFS-3828 URL: https://issues.apache.org/jira/browse/HDFS-3828 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-3194) DataNode block scanner is running too frequently

2012-08-21 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson resolved HDFS-3194. - Resolution: Fixed Created HDFS-3828 to track the repeated rescans issue

[jira] [Created] (HDFS-3868) Add SHA1 implementation and add NIST test vectors

2012-08-29 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3868: --- Summary: Add SHA1 implementation and add NIST test vectors Key: HDFS-3868 URL: https://issues.apache.org/jira/browse/HDFS-3868 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3902) TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828

2012-09-07 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3902: --- Summary: TestDatanodeBlockScanner is flaky, broke entirely after HDFS-3828 Key: HDFS-3902 URL: https://issues.apache.org/jira/browse/HDFS-3902 Project: Hadoop HDFS

[jira] [Created] (HDFS-3911) Tests setLevel(Level.OFF) should be Level.ERROR

2012-09-10 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3911: --- Summary: Tests setLevel(Level.OFF) should be Level.ERROR Key: HDFS-3911 URL: https://issues.apache.org/jira/browse/HDFS-3911 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3913) Refactor DataBlockScanner and clean up tests

2012-09-10 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3913: --- Summary: Refactor DataBlockScanner and clean up tests Key: HDFS-3913 URL: https://issues.apache.org/jira/browse/HDFS-3913 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3919) MiniDFSCluster:waitClusterUp can hang forever

2012-09-11 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3919: --- Summary: MiniDFSCluster:waitClusterUp can hang forever Key: HDFS-3919 URL: https://issues.apache.org/jira/browse/HDFS-3919 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-3934) duplicative dfs_hosts entries handled wrong

2012-09-13 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3934: --- Summary: duplicative dfs_hosts entries handled wrong Key: HDFS-3934 URL: https://issues.apache.org/jira/browse/HDFS-3934 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3982) report failed replications in DN heartbeat

2012-09-26 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3982: --- Summary: report failed replications in DN heartbeat Key: HDFS-3982 URL: https://issues.apache.org/jira/browse/HDFS-3982 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-3991) NN webui should mention safemode

2012-09-28 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-3991: --- Summary: NN webui should mention safemode Key: HDFS-3991 URL: https://issues.apache.org/jira/browse/HDFS-3991 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Created] (HDFS-4042) send Cache-Control header on JSP pages

2012-10-11 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4042: --- Summary: send Cache-Control header on JSP pages Key: HDFS-4042 URL: https://issues.apache.org/jira/browse/HDFS-4042 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4104) dfs -test -d prints inappropriate error on nonexistent directory

2012-10-22 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4104: --- Summary: dfs -test -d prints inappropriate error on nonexistent directory Key: HDFS-4104 URL: https://issues.apache.org/jira/browse/HDFS-4104 Project: Hadoop HDFS

[jira] [Created] (HDFS-4139) fuse-dfs RO mode still allows file truncation

2012-11-01 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4139: --- Summary: fuse-dfs RO mode still allows file truncation Key: HDFS-4139 URL: https://issues.apache.org/jira/browse/HDFS-4139 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4140) fuse-dfs silently truncates files being overwritten

2012-11-01 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4140: --- Summary: fuse-dfs silently truncates files being overwritten Key: HDFS-4140 URL: https://issues.apache.org/jira/browse/HDFS-4140 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4178) shell scripts should not close stderr

2012-11-12 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4178: --- Summary: shell scripts should not close stderr Key: HDFS-4178 URL: https://issues.apache.org/jira/browse/HDFS-4178 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4197) SNN JMX is lacking checkpoint info

2012-11-15 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4197: --- Summary: SNN JMX is lacking checkpoint info Key: HDFS-4197 URL: https://issues.apache.org/jira/browse/HDFS-4197 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-4205) fsck fails with symlinks

2012-11-16 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4205: --- Summary: fsck fails with symlinks Key: HDFS-4205 URL: https://issues.apache.org/jira/browse/HDFS-4205 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-4253) block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance

2012-11-30 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4253: --- Summary: block replica reads get hot-spots due to NetworkTopology#pseudoSortByDistance Key: HDFS-4253 URL: https://issues.apache.org/jira/browse/HDFS-4253 Project

[jira] [Created] (HDFS-4284) BlockReaderLocal not notified of failed disks

2012-12-06 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4284: --- Summary: BlockReaderLocal not notified of failed disks Key: HDFS-4284 URL: https://issues.apache.org/jira/browse/HDFS-4284 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4329) DFSShell issues with directories with spaces in name

2012-12-20 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4329: --- Summary: DFSShell issues with directories with spaces in name Key: HDFS-4329 URL: https://issues.apache.org/jira/browse/HDFS-4329 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4335) dfs -mkdir /foo reports "/" rather than "/foo" in error output

2012-12-21 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4335: --- Summary: dfs -mkdir /foo reports "/" rather than "/foo" in error output Key: HDFS-4335 URL: https://issues.apache.org/jira/browse/HDFS-4335

[jira] [Created] (HDFS-4387) test_libhdfs_threaded SEGV on OpenJDK 7

2013-01-10 Thread Andy Isaacson (JIRA)
Andy Isaacson created HDFS-4387: --- Summary: test_libhdfs_threaded SEGV on OpenJDK 7 Key: HDFS-4387 URL: https://issues.apache.org/jira/browse/HDFS-4387 Project: Hadoop HDFS Issue Type: Bug