Re: non-local map task input

Try looking at DFSOutputStream / DFSInputStream. Sent from a mobile device Colin On Jul 21, 2013 8:41 PM, "Grandl Robert" wrote: > Hi guys, > > I am trying to figure out all the points in hdfs code where hdfs traffic > is read/written. As far as I can tell, it seems most of the traffic goes > t

[jira] [Created] (HDFS-9147) ExternalBlockReader should not treat bytesRemaining as visibleLength

Colin Patrick McCabe created HDFS-9147: -- Summary: ExternalBlockReader should not treat bytesRemaining as visibleLength Key: HDFS-9147 URL: https://issues.apache.org/jira/browse/HDFS-9147 Project

[jira] [Created] (HDFS-9177) TestTextCommand: use mkdirs rather than mkdir to create test directory

Colin Patrick McCabe created HDFS-9177: -- Summary: TestTextCommand: use mkdirs rather than mkdir to create test directory Key: HDFS-9177 URL: https://issues.apache.org/jira/browse/HDFS-9177

[jira] [Created] (HDFS-9307) fuseConnect should be private to fuse_connect.c

Colin Patrick McCabe created HDFS-9307: -- Summary: fuseConnect should be private to fuse_connect.c Key: HDFS-9307 URL: https://issues.apache.org/jira/browse/HDFS-9307 Project: Hadoop HDFS

[jira] [Created] (HDFS-9541) Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

Colin Patrick McCabe created HDFS-9541: -- Summary: Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB Key: HDFS-9541 URL: https://issues.apache.org/jira/browse/HDFS-9541

[jira] [Created] (HDFS-9589) Block files which have been hardlinked should be duplicated before the DataNode appends to the them

Colin Patrick McCabe created HDFS-9589: -- Summary: Block files which have been hardlinked should be duplicated before the DataNode appends to the them Key: HDFS-9589 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (HDFS-3290) Use a better local directory layout for the datanode

[ https://issues.apache.org/jira/browse/HDFS-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3290. Resolution: Duplicate > Use a better local directory layout for the datan

[jira] [Created] (HDFS-4428) FsDatasetImpl should disclose what the error is when a rename fails

Colin Patrick McCabe created HDFS-4428: -- Summary: FsDatasetImpl should disclose what the error is when a rename fails Key: HDFS-4428 URL: https://issues.apache.org/jira/browse/HDFS-4428 Project

[jira] [Created] (HDFS-4433) make TestPeerCache not flaky

Colin Patrick McCabe created HDFS-4433: -- Summary: make TestPeerCache not flaky Key: HDFS-4433 URL: https://issues.apache.org/jira/browse/HDFS-4433 Project: Hadoop HDFS Issue Type: Sub

[jira] [Resolved] (HDFS-4417) HDFS-347: fix case where local reads get disabled incorrectly

[ https://issues.apache.org/jira/browse/HDFS-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-4417. Resolution: Fixed submitted > HDFS-347: fix case where local re

[jira] [Created] (HDFS-4438) TestDomainSocket fails when system umask is set to 0002

Colin Patrick McCabe created HDFS-4438: -- Summary: TestDomainSocket fails when system umask is set to 0002 Key: HDFS-4438 URL: https://issues.apache.org/jira/browse/HDFS-4438 Project: Hadoop HDFS

[jira] [Created] (HDFS-4440) avoid annoying log message when dfs.domain.socket.path is not set

Colin Patrick McCabe created HDFS-4440: -- Summary: avoid annoying log message when dfs.domain.socket.path is not set Key: HDFS-4440 URL: https://issues.apache.org/jira/browse/HDFS-4440 Project

[jira] [Created] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

Colin Patrick McCabe created HDFS-4461: -- Summary: DirectoryScanner: volume path prefix takes up memory for every block that is scanned Key: HDFS-4461 URL: https://issues.apache.org/jira/browse/HDFS-4461

[jira] [Created] (HDFS-4473) don't create domain socket unless we need it

Colin Patrick McCabe created HDFS-4473: -- Summary: don't create domain socket unless we need it Key: HDFS-4473 URL: https://issues.apache.org/jira/browse/HDFS-4473 Project: Hadoop

[jira] [Created] (HDFS-4476) HDFS-347: style cleanups

Colin Patrick McCabe created HDFS-4476: -- Summary: HDFS-347: style cleanups Key: HDFS-4476 URL: https://issues.apache.org/jira/browse/HDFS-4476 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-4484) libwebhdfs compilation broken with gcc 4.6.2

Colin Patrick McCabe created HDFS-4484: -- Summary: libwebhdfs compilation broken with gcc 4.6.2 Key: HDFS-4484 URL: https://issues.apache.org/jira/browse/HDFS-4484 Project: Hadoop HDFS

[jira] [Created] (HDFS-4496) DomainSocketFactory: don't create a domain socket unless we need it

Colin Patrick McCabe created HDFS-4496: -- Summary: DomainSocketFactory: don't create a domain socket unless we need it Key: HDFS-4496 URL: https://issues.apache.org/jira/browse/HDFS-4496 Pr

[jira] [Created] (HDFS-4504) DFSOutputStream#close doesn't always release resources (such as leases)

Colin Patrick McCabe created HDFS-4504: -- Summary: DFSOutputStream#close doesn't always release resources (such as leases) Key: HDFS-4504 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-4521) invalid network toploogies should not be cached

Colin Patrick McCabe created HDFS-4521: -- Summary: invalid network toploogies should not be cached Key: HDFS-4521 URL: https://issues.apache.org/jira/browse/HDFS-4521 Project: Hadoop HDFS

[jira] [Created] (HDFS-4522) LightWeightGSet expects incrementing a volatile to be atomic

Colin Patrick McCabe created HDFS-4522: -- Summary: LightWeightGSet expects incrementing a volatile to be atomic Key: HDFS-4522 URL: https://issues.apache.org/jira/browse/HDFS-4522 Project: Hadoop

[jira] [Created] (HDFS-4538) allow use of legacy blockreader

Colin Patrick McCabe created HDFS-4538: -- Summary: allow use of legacy blockreader Key: HDFS-4538 URL: https://issues.apache.org/jira/browse/HDFS-4538 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-3947) If there are multiple edit logs with the same fstime, Recovery Mode should load a different one than the normal loading process

[ https://issues.apache.org/jira/browse/HDFS-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3947. Resolution: Won't Fix > If there are multiple edit logs with the sam

[jira] [Created] (HDFS-4640) JniBasedUnixGroupsMapping: fix some crash bugs

Colin Patrick McCabe created HDFS-4640: -- Summary: JniBasedUnixGroupsMapping: fix some crash bugs Key: HDFS-4640 URL: https://issues.apache.org/jira/browse/HDFS-4640 Project: Hadoop HDFS

[jira] [Created] (HDFS-4661) code style fixes suggested by Nicholas

Colin Patrick McCabe created HDFS-4661: -- Summary: code style fixes suggested by Nicholas Key: HDFS-4661 URL: https://issues.apache.org/jira/browse/HDFS-4661 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-4697) short-circuit reads do not honor readahead settings

Colin Patrick McCabe created HDFS-4697: -- Summary: short-circuit reads do not honor readahead settings Key: HDFS-4697 URL: https://issues.apache.org/jira/browse/HDFS-4697 Project: Hadoop HDFS

[jira] [Created] (HDFS-4698) provide client-side metrics for remote reads, local reads, and short-circuit reads

Colin Patrick McCabe created HDFS-4698: -- Summary: provide client-side metrics for remote reads, local reads, and short-circuit reads Key: HDFS-4698 URL: https://issues.apache.org/jira/browse/HDFS-4698

[jira] [Created] (HDFS-4812) add hdfsReadFully, hdfsWriteFully

Colin Patrick McCabe created HDFS-4812: -- Summary: add hdfsReadFully, hdfsWriteFully Key: HDFS-4812 URL: https://issues.apache.org/jira/browse/HDFS-4812 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4817) make HDFS advisory caching configurable on a per-file basis

Colin Patrick McCabe created HDFS-4817: -- Summary: make HDFS advisory caching configurable on a per-file basis Key: HDFS-4817 URL: https://issues.apache.org/jira/browse/HDFS-4817 Project: Hadoop

[jira] [Created] (HDFS-4839) add NativeIO#mkdirs, that provides an error message on failure

Colin Patrick McCabe created HDFS-4839: -- Summary: add NativeIO#mkdirs, that provides an error message on failure Key: HDFS-4839 URL: https://issues.apache.org/jira/browse/HDFS-4839 Project

[jira] [Resolved] (HDFS-4855) DFSOutputStream reference should be cleared from DFSClient#filesBeingWritten if the file closure fails.

[ https://issues.apache.org/jira/browse/HDFS-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-4855. Resolution: Duplicate > DFSOutputStream reference should be cleared f

[jira] [Created] (HDFS-4864) fuse_dfs's rename can't rename over a file

Colin Patrick McCabe created HDFS-4864: -- Summary: fuse_dfs's rename can't rename over a file Key: HDFS-4864 URL: https://issues.apache.org/jira/browse/HDFS-4864 Project: H

[jira] [Created] (HDFS-4870) periodically re-resolve hostnames in included and excluded datanodes list

Colin Patrick McCabe created HDFS-4870: -- Summary: periodically re-resolve hostnames in included and excluded datanodes list Key: HDFS-4870 URL: https://issues.apache.org/jira/browse/HDFS-4870

[jira] [Created] (HDFS-4911) Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive

Colin Patrick McCabe created HDFS-4911: -- Summary: Reduce PeerCache timeout to be commensurate with dfs.datanode.socket.reuse.keepalive Key: HDFS-4911 URL: https://issues.apache.org/jira/browse/HDFS-4911

[jira] [Created] (HDFS-4950) newly created files in fuse_dfs appear to be length 0 for a while

Colin Patrick McCabe created HDFS-4950: -- Summary: newly created files in fuse_dfs appear to be length 0 for a while Key: HDFS-4950 URL: https://issues.apache.org/jira/browse/HDFS-4950 Project

[jira] [Created] (HDFS-4953) enable HDFS local reads via mmap

Colin Patrick McCabe created HDFS-4953: -- Summary: enable HDFS local reads via mmap Key: HDFS-4953 URL: https://issues.apache.org/jira/browse/HDFS-4953 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-4957) NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved

Colin Patrick McCabe created HDFS-4957: -- Summary: NameNode failover should not fail because a DNS entry for a quorum node cannot be resolved Key: HDFS-4957 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-4966) implement advisory caching for RawLocalFilesystem

Colin Patrick McCabe created HDFS-4966: -- Summary: implement advisory caching for RawLocalFilesystem Key: HDFS-4966 URL: https://issues.apache.org/jira/browse/HDFS-4966 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-1154) libhdfs::hdfsExists should return different value in case of 1. error and 2. file does not exist

[ https://issues.apache.org/jira/browse/HDFS-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-1154. Resolution: Duplicate This was fixed in HDFS-3579. In that JIRA, we decided that

[jira] [Resolved] (HDFS-2042) Require c99 when building libhdfs

[ https://issues.apache.org/jira/browse/HDFS-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-2042. Resolution: Fixed Fix Version/s: 2.1.0-beta The stuff this JIRA talks about

[jira] [Created] (HDFS-4997) libhdfs doesn't return correct error codes in most cases

Colin Patrick McCabe created HDFS-4997: -- Summary: libhdfs doesn't return correct error codes in most cases Key: HDFS-4997 URL: https://issues.apache.org/jira/browse/HDFS-4997 Project: Hadoop

[jira] [Resolved] (HDFS-3994) misleading comment in CommonConfigurationKeysPublic

[ https://issues.apache.org/jira/browse/HDFS-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-3994. Resolution: Won't Fix I looked at this again, and I think the intention is

[jira] [Created] (HDFS-5021) FileSystem#delete and FileSystem#rename should operate on symlinks, not their targets

Colin Patrick McCabe created HDFS-5021: -- Summary: FileSystem#delete and FileSystem#rename should operate on symlinks, not their targets Key: HDFS-5021 URL: https://issues.apache.org/jira/browse/HDFS-5021

[jira] [Created] (HDFS-5048) FileSystem#globStatus and FileContext#globStatus need to work with symlinks

Colin Patrick McCabe created HDFS-5048: -- Summary: FileSystem#globStatus and FileContext#globStatus need to work with symlinks Key: HDFS-5048 URL: https://issues.apache.org/jira/browse/HDFS-5048

[jira] [Created] (HDFS-5049) Add JNI mlock support

Colin Patrick McCabe created HDFS-5049: -- Summary: Add JNI mlock support Key: HDFS-5049 URL: https://issues.apache.org/jira/browse/HDFS-5049 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5050) Add DataNode support for mlock and munlock

Colin Patrick McCabe created HDFS-5050: -- Summary: Add DataNode support for mlock and munlock Key: HDFS-5050 URL: https://issues.apache.org/jira/browse/HDFS-5050 Project: Hadoop HDFS

[jira] [Created] (HDFS-5051) Add cache status information to the DataNode heartbeat

Colin Patrick McCabe created HDFS-5051: -- Summary: Add cache status information to the DataNode heartbeat Key: HDFS-5051 URL: https://issues.apache.org/jira/browse/HDFS-5051 Project: Hadoop HDFS

[jira] [Created] (HDFS-5052) Add cacheRequest/uncacheRequest support to DFSAdmin and NameNode

Colin Patrick McCabe created HDFS-5052: -- Summary: Add cacheRequest/uncacheRequest support to DFSAdmin and NameNode Key: HDFS-5052 URL: https://issues.apache.org/jira/browse/HDFS-5052 Project

[jira] [Created] (HDFS-5053) NameNode should invoke DataNode mlock APIs to coordinate caching

Colin Patrick McCabe created HDFS-5053: -- Summary: NameNode should invoke DataNode mlock APIs to coordinate caching Key: HDFS-5053 URL: https://issues.apache.org/jira/browse/HDFS-5053 Project

[jira] [Reopened] (HDFS-5021) FileSystem#delete and FileSystem#rename should operate on symlinks, not their targets

[ https://issues.apache.org/jira/browse/HDFS-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-5021: > FileSystem#delete and FileSystem#rename should operate on symlinks, not th

[jira] [Resolved] (HDFS-5021) FileSystem#delete and FileSystem#rename should operate on symlinks, not their targets

[ https://issues.apache.org/jira/browse/HDFS-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5021. Resolution: Fixed This was actually being caused by HADOOP-9817. That bug led to

[jira] [Resolved] (HDFS-5021) FileSystem#delete and FileSystem#rename should operate on symlinks, not their targets

[ https://issues.apache.org/jira/browse/HDFS-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5021. Resolution: Duplicate > FileSystem#delete and FileSystem#rename should oper

[jira] [Created] (HDFS-5062) org.apache.hadoop.fs.Df should not use bash -c

Colin Patrick McCabe created HDFS-5062: -- Summary: org.apache.hadoop.fs.Df should not use bash -c Key: HDFS-5062 URL: https://issues.apache.org/jira/browse/HDFS-5062 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5062) org.apache.hadoop.fs.Df should not use bash -c

[ https://issues.apache.org/jira/browse/HDFS-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5062. Resolution: Duplicate > org.apache.hadoop.fs.Df should not use bash

[jira] [Resolved] (HDFS-5072) fuse_dfs: ERROR: could not connect open file fuse_impls_open.c:54

[ https://issues.apache.org/jira/browse/HDFS-5072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5072. Resolution: Invalid JIRA isn't for troubleshooting. Try asking your question

[jira] [Resolved] (HDFS-5051) Propagate cache status information from the DataNode to the NameNode

[ https://issues.apache.org/jira/browse/HDFS-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5051. Resolution: Fixed > Propagate cache status information from the DataNode to

[jira] [Created] (HDFS-5092) piggyback incremental cache reports on DN heartbeats

Colin Patrick McCabe created HDFS-5092: -- Summary: piggyback incremental cache reports on DN heartbeats Key: HDFS-5092 URL: https://issues.apache.org/jira/browse/HDFS-5092 Project: Hadoop HDFS

[jira] [Created] (HDFS-5101) ZCR should work with blocks bigger than 2 GB

Colin Patrick McCabe created HDFS-5101: -- Summary: ZCR should work with blocks bigger than 2 GB Key: HDFS-5101 URL: https://issues.apache.org/jira/browse/HDFS-5101 Project: Hadoop HDFS

[jira] [Created] (HDFS-5119) Persist CacheManager state in the edit log

Colin Patrick McCabe created HDFS-5119: -- Summary: Persist CacheManager state in the edit log Key: HDFS-5119 URL: https://issues.apache.org/jira/browse/HDFS-5119 Project: Hadoop HDFS

[jira] [Created] (HDFS-5120) add command-line support for manipulating cache directives and cache pools

Colin Patrick McCabe created HDFS-5120: -- Summary: add command-line support for manipulating cache directives and cache pools Key: HDFS-5120 URL: https://issues.apache.org/jira/browse/HDFS-5120

[jira] [Created] (HDFS-5121) add RPCs for creating and manipulating cache pools

Colin Patrick McCabe created HDFS-5121: -- Summary: add RPCs for creating and manipulating cache pools Key: HDFS-5121 URL: https://issues.apache.org/jira/browse/HDFS-5121 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5052) Add cacheRequest/uncacheRequest support to NameNode

[ https://issues.apache.org/jira/browse/HDFS-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5052. Resolution: Fixed committed > Add cacheRequest/uncacheRequ

[jira] [Resolved] (HDFS-5050) Add DataNode support for mlock and munlock

[ https://issues.apache.org/jira/browse/HDFS-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5050. Resolution: Fixed Fix Version/s: HDFS-4949 Target Version/s: HDFS

[jira] [Resolved] (HDFS-5121) add RPCs for creating and manipulating cache pools

[ https://issues.apache.org/jira/browse/HDFS-5121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5121. Resolution: Fixed committed > add RPCs for creating

[jira] [Created] (HDFS-5158) add command-line support for manipulating cache directives

Colin Patrick McCabe created HDFS-5158: -- Summary: add command-line support for manipulating cache directives Key: HDFS-5158 URL: https://issues.apache.org/jira/browse/HDFS-5158 Project: Hadoop

[jira] [Created] (HDFS-5163) miscellaneous cache pool RPC fixes

Colin Patrick McCabe created HDFS-5163: -- Summary: miscellaneous cache pool RPC fixes Key: HDFS-5163 URL: https://issues.apache.org/jira/browse/HDFS-5163 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5164) deleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock

Colin Patrick McCabe created HDFS-5164: -- Summary: deleteSnapshot should check if OperationCategory.WRITE is possible before taking write lock Key: HDFS-5164 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Created] (HDFS-5166) caching PB cleanups

Colin Patrick McCabe created HDFS-5166: -- Summary: caching PB cleanups Key: HDFS-5166 URL: https://issues.apache.org/jira/browse/HDFS-5166 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-5169) hdfs.c: translateZCRException: null pointer deref when translating some exceptions

Colin Patrick McCabe created HDFS-5169: -- Summary: hdfs.c: translateZCRException: null pointer deref when translating some exceptions Key: HDFS-5169 URL: https://issues.apache.org/jira/browse/HDFS-5169

[jira] [Resolved] (HDFS-5169) hdfs.c: translateZCRException: null pointer deref when translating some exceptions

[ https://issues.apache.org/jira/browse/HDFS-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5169. Resolution: Fixed Fix Version/s: HDFS-4949 > hdf

[jira] [Resolved] (HDFS-5163) miscellaneous cache pool RPC fixes

[ https://issues.apache.org/jira/browse/HDFS-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5163. Resolution: Fixed committed to branch, thanks > miscellane

[jira] [Created] (HDFS-5173) prettier dfsadmin -listCachePools output

Colin Patrick McCabe created HDFS-5173: -- Summary: prettier dfsadmin -listCachePools output Key: HDFS-5173 URL: https://issues.apache.org/jira/browse/HDFS-5173 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5182) BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid

Colin Patrick McCabe created HDFS-5182: -- Summary: BlockReaderLocal must allow zero-copy reads only when the DN believes it's valid Key: HDFS-5182 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Resolved] (HDFS-5173) prettier dfsadmin -listCachePools output

[ https://issues.apache.org/jira/browse/HDFS-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5173. Resolution: Duplicate Fix Version/s: HDFS-4949 Target Version/s

[jira] [Resolved] (HDFS-5158) add command-line support for manipulating cache directives

[ https://issues.apache.org/jira/browse/HDFS-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5158. Resolution: Fixed Fix Version/s: HDFS-4949 committed; thanks all

[jira] [Created] (HDFS-5190) move cache pool manipulation commands to dfsadmin, add to TestHDFSCLI

Colin Patrick McCabe created HDFS-5190: -- Summary: move cache pool manipulation commands to dfsadmin, add to TestHDFSCLI Key: HDFS-5190 URL: https://issues.apache.org/jira/browse/HDFS-5190

[jira] [Created] (HDFS-5191) revisit zero-copy API in FSDataInputStream to make it more intuitive

Colin Patrick McCabe created HDFS-5191: -- Summary: revisit zero-copy API in FSDataInputStream to make it more intuitive Key: HDFS-5191 URL: https://issues.apache.org/jira/browse/HDFS-5191 Project

[jira] [Created] (HDFS-5198) NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report

Colin Patrick McCabe created HDFS-5198: -- Summary: NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report Key: HDFS-5198 URL: https://issues.apache.org/jira/browse/HDFS-5198

[jira] [Resolved] (HDFS-5198) NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report

[ https://issues.apache.org/jira/browse/HDFS-5198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5198. Resolution: Fixed committed to branch > NameNodeRpcServer must

[jira] [Created] (HDFS-5201) NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit

Colin Patrick McCabe created HDFS-5201: -- Summary: NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit Key: HDFS-5201 URL: https://issues.apache.org/jira/browse/HDFS-5201 Project

[jira] [Created] (HDFS-5202) umbrella JIRA for Windows support in HDFS caching

Colin Patrick McCabe created HDFS-5202: -- Summary: umbrella JIRA for Windows support in HDFS caching Key: HDFS-5202 URL: https://issues.apache.org/jira/browse/HDFS-5202 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5201) NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit

[ https://issues.apache.org/jira/browse/HDFS-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5201. Resolution: Fixed > NativeIO: consolidate getrlimit into Nativ

[jira] [Created] (HDFS-5213) separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId

Colin Patrick McCabe created HDFS-5213: -- Summary: separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId Key: HDFS-5213 URL: https://issues.apache.org/jira/browse/HDFS-5213 Project

[jira] [Resolved] (HDFS-5191) revisit zero-copy API in FSDataInputStream to make it more intuitive

[ https://issues.apache.org/jira/browse/HDFS-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5191. Resolution: Fixed Fix Version/s: HDFS-4949 committed to HDFS-4949 branch

[jira] [Created] (HDFS-5298) make symlinks production-ready

Colin Patrick McCabe created HDFS-5298: -- Summary: make symlinks production-ready Key: HDFS-5298 URL: https://issues.apache.org/jira/browse/HDFS-5298 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-5314) Do not expose CachePool type in AddCachePoolOp

Colin Patrick McCabe created HDFS-5314: -- Summary: Do not expose CachePool type in AddCachePoolOp Key: HDFS-5314 URL: https://issues.apache.org/jira/browse/HDFS-5314 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5314) Do not expose CachePool type in AddCachePoolOp

[ https://issues.apache.org/jira/browse/HDFS-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5314. Resolution: Fixed Fix Version/s: HDFS-4949 > Do not expose CachePool type

[jira] [Created] (HDFS-5323) Remove some deadcode in BlockManager

Colin Patrick McCabe created HDFS-5323: -- Summary: Remove some deadcode in BlockManager Key: HDFS-5323 URL: https://issues.apache.org/jira/browse/HDFS-5323 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5326) add modifyDirective to cacheAdmin

Colin Patrick McCabe created HDFS-5326: -- Summary: add modifyDirective to cacheAdmin Key: HDFS-5326 URL: https://issues.apache.org/jira/browse/HDFS-5326 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-5348) Fix error message when dfs.datanode.max.locked.memory is improperly configured

Colin Patrick McCabe created HDFS-5348: -- Summary: Fix error message when dfs.datanode.max.locked.memory is improperly configured Key: HDFS-5348 URL: https://issues.apache.org/jira/browse/HDFS-5348

[jira] [Created] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

Colin Patrick McCabe created HDFS-5349: -- Summary: DNA_CACHE and DNA_UNCACHE should be by blockId only Key: HDFS-5349 URL: https://issues.apache.org/jira/browse/HDFS-5349 Project: Hadoop HDFS

[jira] [Created] (HDFS-5358) add 'replication' field to PathBasedCacheDirective

Colin Patrick McCabe created HDFS-5358: -- Summary: add 'replication' field to PathBasedCacheDirective Key: HDFS-5358 URL: https://issues.apache.org/jira/browse/HDFS-5358 Project: H

[jira] [Resolved] (HDFS-5349) DNA_CACHE and DNA_UNCACHE should be by blockId only

[ https://issues.apache.org/jira/browse/HDFS-5349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5349. Resolution: Fixed Fix Version/s: HDFS-4949 > DNA_CACHE and DNA_UNCA

[jira] [Created] (HDFS-5359) allow GSet#Iterator to remove elements

Colin Patrick McCabe created HDFS-5359: -- Summary: allow GSet#Iterator to remove elements Key: HDFS-5359 URL: https://issues.apache.org/jira/browse/HDFS-5359 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-5366) recaching improvements

Colin Patrick McCabe created HDFS-5366: -- Summary: recaching improvements Key: HDFS-5366 URL: https://issues.apache.org/jira/browse/HDFS-5366 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Resolved] (HDFS-5096) Automatically cache new data added to a cached path

[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5096. Resolution: Fixed Fix Version/s: HDFS-4949 Target Version/s: HDFS

[jira] [Created] (HDFS-5378) In CacheReport, don't send genstamp and length on the wire

Colin Patrick McCabe created HDFS-5378: -- Summary: In CacheReport, don't send genstamp and length on the wire Key: HDFS-5378 URL: https://issues.apache.org/jira/browse/HDFS-5378 Project: H

[jira] [Created] (HDFS-5381) ExtendedBlock#hashCode should use both blockId and block pool ID

Colin Patrick McCabe created HDFS-5381: -- Summary: ExtendedBlock#hashCode should use both blockId and block pool ID Key: HDFS-5381 URL: https://issues.apache.org/jira/browse/HDFS-5381 Project

[jira] [Resolved] (HDFS-5388) Loading fsimage fails to find cache pools during namenode startup.

[ https://issues.apache.org/jira/browse/HDFS-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5388. Resolution: Fixed Fix Version/s: HDFS-4949 > Loading fsimage fails to f

[jira] [Resolved] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-5203. Resolution: Fixed Fix Version/s: HDFS-4949 > Concurrent clients that ad

[jira] [Created] (HDFS-5394) fix race conditions in DN caching and uncaching

Colin Patrick McCabe created HDFS-5394: -- Summary: fix race conditions in DN caching and uncaching Key: HDFS-5394 URL: https://issues.apache.org/jira/browse/HDFS-5394 Project: Hadoop HDFS

  1   2   3   4   5   >