Re: Next Hadoop Storage Online Meetup (APAC Mandarin)

2019-12-20 Thread Chen Liang
Thanks again for driving the syncup Wei-Chiu! I am also super interested in learning about this upgrade. Moving forward, I am happy to help with the translation. Please feel free to let me know if you need more hands on it :). Chen Wei-Chiu Chuang 于2019年12月19日周四 下午6:23写道: > Yeah, for sure. I

Re: Cost Based FairCallQueue latency issue

2020-11-04 Thread Chen Liang
Hi Fengnan, We had been testing cost based faire call queue internally. We also saw latency increase, and we are trying to debug into this issue as well. Current suspicion is that the way that the metrics were generated might be introducing too much overhead. We are in the process of trying to rep

Re: [VOTE] Adopt HDSL as a new Hadoop subproject

2018-03-22 Thread Chen Liang
+1 (non-binding). Thanks, Chen > On Mar 20, 2018, at 11:20 AM, Owen O'Malley wrote: > > All, > > Following our discussions on the previous thread (Merging branch HDFS-7240 > to trunk), I'd like to propose the following: > > * HDSL become a subproject of Hadoop. > * HDSL will release separate

Re: [VOTE] Release Apache Hadoop 2.7.6 (RC0)

2018-04-13 Thread Chen Liang
Thanks for working on this Konstantin! +1 (non-binding) - verified checksum - built from source - started a single node HDFS cluster - performed basic operations of ls/mkdir/put/get - checked web UI - ran the MR job pi Regards, Chen > On Apr 9, 2018, at 4:14 PM, Konstantin Shvachko wrote: >

Re: [VOTE] Merge HDDS (HDFS-7240) *code* into trunk

2018-04-22 Thread Chen Liang
+1 (non-binding) Thanks! Chen 2018-04-22 14:04 GMT-07:00 Elek, Marton : > +1 (non-binding) > > Tested the branch and everything worked well, even with turning on the > optional maven profile. (Yarn wordcount, Hive, Spark, HBase) > > Marton > > > On 04/17/2018 01:48 AM, Jitendra Pandey wrote: >

Re: ERROR: oz is not COMMAND nor fully qualified CLASSNAME

2017-02-02 Thread Chen Liang
Hi Margus, It looks like there might have been some error when merging trunk into HDFS-7240, which mistakenly changed some entries in hdfs script. Thanks for the catch! We will update the branch to fix it. In the meantime, as a quick fix, you can apply the attached patch file and re-compile, O

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-07-31 Thread Chen Liang
Hi Konstantin, Thanks for putting up 2.7.4-RC0 release! +1 (non-binding). With following checks: - build the source on MacOS 10.12.5 with java version 1.8.0_91. - deployed on a single node pseudo-custer - tested HDFS basics: write/read/append/acl - mapreduce job wordcount/bbp/grep Thanks! Chen

Re: [VOTE] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-06 Thread Chen Liang
Hi Daryn, This is an interesting and valid point to consider different implications for security. The purpose of the alignment context is to allow clients and servers sync on their global state, so that when clients switch between ANN/SBN or between SBNs, the reads are always consistent. One reas

Re: Changing RPC SASL options without full cluster restart?

2018-12-14 Thread Chen Liang
Hi Wei-Chiu, HDFS-13566 and HDFS-13547 do allow different SASL configurations to coexist on different NameNode ports, but for the whole feature to work, a upgrade on the client jar is still required. I'm not too familiar with how HBase accesses HDFS, based on your description, for this particular

Re: [VOTE - 2] Merge HDFS-12943 branch to trunk - Consistent Reads from Standby

2018-12-18 Thread Chen Liang
+1 Thanks Konstantin for driving the merge vote! I have been working on the development and testing of the feature. It has been running for several weeks on our cluster with ~100 nodes, which has HA and Kerberos enabled. I have been able to run several different MapReduce jobs and HDFS benchmarks

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-08 Thread Chen Liang
Late +1. I am interested in the project too. Please include me. Regards, Chen Varun Saxena 于2019年9月7日周六 上午10:35写道: > Belated +1. > I too am interested in the project. Please include me. > > Regards, > Varun Saxena > > On Sat, Sep 7, 2019 at 9:35 PM Sunil Govindan wrote: > > > +1 to the propo

[jira] [Created] (HDFS-14941) Potential editlog race condition can cause corrupted file

2019-10-29 Thread Chen Liang (Jira)
Chen Liang created HDFS-14941: - Summary: Potential editlog race condition can cause corrupted file Key: HDFS-14941 URL: https://issues.apache.org/jira/browse/HDFS-14941 Project: Hadoop HDFS

[jira] [Created] (HDFS-14991) Backport HDFS-14346 Better time precision in getTimeDuration to branch-2

2019-11-15 Thread Chen Liang (Jira)
Chen Liang created HDFS-14991: - Summary: Backport HDFS-14346 Better time precision in getTimeDuration to branch-2 Key: HDFS-14991 URL: https://issues.apache.org/jira/browse/HDFS-14991 Project: Hadoop

[jira] [Created] (HDFS-15148) dfs.namenode.send.qop.enabled should not apply to primary NN port

2020-01-27 Thread Chen Liang (Jira)
Chen Liang created HDFS-15148: - Summary: dfs.namenode.send.qop.enabled should not apply to primary NN port Key: HDFS-15148 URL: https://issues.apache.org/jira/browse/HDFS-15148 Project: Hadoop HDFS

[jira] [Created] (HDFS-15153) TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently

2020-02-04 Thread Chen Liang (Jira)
Chen Liang created HDFS-15153: - Summary: TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently Key: HDFS-15153 URL: https://issues.apache.org/jira/browse/HDFS-15153 Project

[jira] [Resolved] (HDFS-15153) TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fails intermittently

2020-02-12 Thread Chen Liang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-15153. --- Resolution: Duplicate > TestDelegationTokensWithHA.testObserverReadProxyProviderWithDT fa

[jira] [Created] (HDFS-15197) Change ObserverRetryOnActiveException log to debug

2020-02-27 Thread Chen Liang (Jira)
Chen Liang created HDFS-15197: - Summary: Change ObserverRetryOnActiveException log to debug Key: HDFS-15197 URL: https://issues.apache.org/jira/browse/HDFS-15197 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-15293) Relax FSImage upload time delta check restriction

2020-04-21 Thread Chen Liang (Jira)
Chen Liang created HDFS-15293: - Summary: Relax FSImage upload time delta check restriction Key: HDFS-15293 URL: https://issues.apache.org/jira/browse/HDFS-15293 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-15404) ShellCommandFencer should expose info about source

2020-06-09 Thread Chen Liang (Jira)
Chen Liang created HDFS-15404: - Summary: ShellCommandFencer should expose info about source Key: HDFS-15404 URL: https://issues.apache.org/jira/browse/HDFS-15404 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12454: - Summary: Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work Key: HDFS-12454 URL: https://issues.apache.org/jira/browse/HDFS-12454 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-12268) Ozone: Add metrics for pending storage container requests

2017-09-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reopened HDFS-12268: --- > Ozone: Add metrics for pending storage container reque

[jira] [Created] (HDFS-12475) Ozone : add document for port sharing with WebHDFS

2017-09-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12475: - Summary: Ozone : add document for port sharing with WebHDFS Key: HDFS-12475 URL: https://issues.apache.org/jira/browse/HDFS-12475 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12543: - Summary: Ozone : allow create key without specifying size Key: HDFS-12543 URL: https://issues.apache.org/jira/browse/HDFS-12543 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12626) Ozone : delete open key entries that will no longer be closed

2017-10-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12626: - Summary: Ozone : delete open key entries that will no longer be closed Key: HDFS-12626 URL: https://issues.apache.org/jira/browse/HDFS-12626 Project: Hadoop HDFS

[jira] [Created] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-08 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12793: - Summary: Ozone : TestSCMCli is failing consistently Key: HDFS-12793 URL: https://issues.apache.org/jira/browse/HDFS-12793 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12879) Ozone : add scm init command to document.

2017-11-30 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12879: - Summary: Ozone : add scm init command to document. Key: HDFS-12879 URL: https://issues.apache.org/jira/browse/HDFS-12879 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

2017-12-13 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-12265. --- Resolution: Fixed Release Note: Looks like this has been handled as part of HDFS-12387, close

[jira] [Created] (HDFS-12925) Ozone: Container : Add key versioning support-2

2017-12-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12925: - Summary: Ozone: Container : Add key versioning support-2 Key: HDFS-12925 URL: https://issues.apache.org/jira/browse/HDFS-12925 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12954) Ozone: Container : Add key versioning support-3

2017-12-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12954: - Summary: Ozone: Container : Add key versioning support-3 Key: HDFS-12954 URL: https://issues.apache.org/jira/browse/HDFS-12954 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12958) Ozone: remove setAllocatedBytes method in ContainerInfo

2017-12-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12958: - Summary: Ozone: remove setAllocatedBytes method in ContainerInfo Key: HDFS-12958 URL: https://issues.apache.org/jira/browse/HDFS-12958 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12989) Ozone: Container : Add key versioning support-4

2018-01-04 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12989: - Summary: Ozone: Container : Add key versioning support-4 Key: HDFS-12989 URL: https://issues.apache.org/jira/browse/HDFS-12989 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13541) NameNode Port based selective encryption

2018-05-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13541: - Summary: NameNode Port based selective encryption Key: HDFS-13541 URL: https://issues.apache.org/jira/browse/HDFS-13541 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-13547) Add ingress port based sasl resolver

2018-05-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13547: - Summary: Add ingress port based sasl resolver Key: HDFS-13547 URL: https://issues.apache.org/jira/browse/HDFS-13547 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-13566) Add configurable additional RPC listener to NameNode

2018-05-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13566: - Summary: Add configurable additional RPC listener to NameNode Key: HDFS-13566 URL: https://issues.apache.org/jira/browse/HDFS-13566 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13617) Allow wrapping NN QOP into token in encrypted message

2018-05-24 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13617: - Summary: Allow wrapping NN QOP into token in encrypted message Key: HDFS-13617 URL: https://issues.apache.org/jira/browse/HDFS-13617 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-13688) Introduce msync API call

2018-06-18 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13688: - Summary: Introduce msync API call Key: HDFS-13688 URL: https://issues.apache.org/jira/browse/HDFS-13688 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-13699) Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP

2018-06-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13699: - Summary: Add DFSClient sending handshake token to DataNode, and allow DataNode overwrite downstream QOP Key: HDFS-13699 URL: https://issues.apache.org/jira/browse/HDFS-13699

[jira] [Created] (HDFS-13767) Add msync server implementation.

2018-07-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13767: - Summary: Add msync server implementation. Key: HDFS-13767 URL: https://issues.apache.org/jira/browse/HDFS-13767 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-13880) Add mechanism to allow certain RPC calls to bypass sync

2018-08-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-13880: - Summary: Add mechanism to allow certain RPC calls to bypass sync Key: HDFS-13880 URL: https://issues.apache.org/jira/browse/HDFS-13880 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10682) Add metric to measure lock held time in FSDataSetImpl

2016-07-22 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10682: - Summary: Add metric to measure lock held time in FSDataSetImpl Key: HDFS-10682 URL: https://issues.apache.org/jira/browse/HDFS-10682 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-10613) Wrong real size when a DSQuotaExceededException occur

2016-08-04 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-10613. --- Resolution: Resolved > Wrong real size when a DSQuotaExceededException oc

[jira] [Created] (HDFS-10742) Measurement of lock held time in FsDatasetImpl

2016-08-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10742: - Summary: Measurement of lock held time in FsDatasetImpl Key: HDFS-10742 URL: https://issues.apache.org/jira/browse/HDFS-10742 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10932) Ozone : fix XceiverClient slow shutdown

2016-09-29 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10932: - Summary: Ozone : fix XceiverClient slow shutdown Key: HDFS-10932 URL: https://issues.apache.org/jira/browse/HDFS-10932 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-10995) Ozone : move ozone client to hdfs-client

2016-10-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-10995: - Summary: Ozone : move ozone client to hdfs-client Key: HDFS-10995 URL: https://issues.apache.org/jira/browse/HDFS-10995 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11004) Ozone : move Chunk IO and container protocol calls to hdfs-client

2016-10-13 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11004: - Summary: Ozone : move Chunk IO and container protocol calls to hdfs-client Key: HDFS-11004 URL: https://issues.apache.org/jira/browse/HDFS-11004 Project: Hadoop HDFS

[jira] [Created] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11036: - Summary: Ozone : reuse Xceiver connection Key: HDFS-11036 URL: https://issues.apache.org/jira/browse/HDFS-11036 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11076) Add unit test for extended Acls

2016-10-31 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11076: - Summary: Add unit test for extended Acls Key: HDFS-11076 URL: https://issues.apache.org/jira/browse/HDFS-11076 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11127) Block Storage : add block storage service protocol

2016-11-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11127: - Summary: Block Storage : add block storage service protocol Key: HDFS-11127 URL: https://issues.apache.org/jira/browse/HDFS-11127 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11130) Block Storage : add storage client to server protocol

2016-11-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11130: - Summary: Block Storage : add storage client to server protocol Key: HDFS-11130 URL: https://issues.apache.org/jira/browse/HDFS-11130 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11138) Block Storage : add block storage server

2016-11-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11138: - Summary: Block Storage : add block storage server Key: HDFS-11138 URL: https://issues.apache.org/jira/browse/HDFS-11138 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11147) Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos

2016-11-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11147: - Summary: Remove confusing log output in FsDatasetImpl#getInitialVolumeFailureInfos Key: HDFS-11147 URL: https://issues.apache.org/jira/browse/HDFS-11147 Project: Hadoop

[jira] [Created] (HDFS-11154) Block Storage : store server state to persistent storage

2016-11-17 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11154: - Summary: Block Storage : store server state to persistent storage Key: HDFS-11154 URL: https://issues.apache.org/jira/browse/HDFS-11154 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11162) Block Storage : add command line tool

2016-11-21 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11162: - Summary: Block Storage : add command line tool Key: HDFS-11162 URL: https://issues.apache.org/jira/browse/HDFS-11162 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11355) Block Storage : merge configuration into ozone configuration classes

2017-01-20 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11355: - Summary: Block Storage : merge configuration into ozone configuration classes Key: HDFS-11355 URL: https://issues.apache.org/jira/browse/HDFS-11355 Project: Hadoop HDFS

[jira] [Created] (HDFS-11386) Ozone: fix the missing entries in hdfs script

2017-02-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11386: - Summary: Ozone: fix the missing entries in hdfs script Key: HDFS-11386 URL: https://issues.apache.org/jira/browse/HDFS-11386 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-11409) DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized

2017-02-13 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11409: - Summary: DatanodeInfo getNetworkLocation and setNetworkLocation shoud use volatile instead of synchronized Key: HDFS-11409 URL: https://issues.apache.org/jira/browse/HDFS-11409

[jira] [Created] (HDFS-11414) Ozone : move StorageContainerLocation protocol to hdfs-client

2017-02-14 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11414: - Summary: Ozone : move StorageContainerLocation protocol to hdfs-client Key: HDFS-11414 URL: https://issues.apache.org/jira/browse/HDFS-11414 Project: Hadoop HDFS

[jira] [Created] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-02-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11419: - Summary: BlockPlacementPolicyDefault is choosing datanode in an inefficient way Key: HDFS-11419 URL: https://issues.apache.org/jira/browse/HDFS-11419 Project: Hadoop HDFS

[jira] [Created] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11424: - Summary: Block Storage : add container representation to meta data Key: HDFS-11424 URL: https://issues.apache.org/jira/browse/HDFS-11424 Project: Hadoop HDFS

[jira] [Created] (HDFS-11425) Ozone : add client-facing container APIs

2017-02-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11425: - Summary: Ozone : add client-facing container APIs Key: HDFS-11425 URL: https://issues.apache.org/jira/browse/HDFS-11425 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11430) Separate class InnerNode from class NetworkTopology and make it extendable

2017-02-17 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11430: - Summary: Separate class InnerNode from class NetworkTopology and make it extendable Key: HDFS-11430 URL: https://issues.apache.org/jira/browse/HDFS-11430 Project: Hadoop

[jira] [Created] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-02-23 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11450: - Summary: HDFS specific network topology classes with storage type info included Key: HDFS-11450 URL: https://issues.apache.org/jira/browse/HDFS-11450 Project: Hadoop HDFS

[jira] [Created] (HDFS-11473) Ozone : exclude protobuf files from findbugs check

2017-02-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11473: - Summary: Ozone : exclude protobuf files from findbugs check Key: HDFS-11473 URL: https://issues.apache.org/jira/browse/HDFS-11473 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11424. --- Resolution: Duplicate Given the recently checked changes, it will be difficult to make the separation

[jira] [Reopened] (HDFS-11424) Block Storage : add container representation to meta data

2017-02-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reopened HDFS-11424: --- Did not realize that this JIRA and HDFS-11425 are for Ozone are SCM pieces respectively. Still need to

[jira] [Created] (HDFS-11482) Add storage type demand to into DFSNetworkTopology#chooseRandom

2017-03-01 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11482: - Summary: Add storage type demand to into DFSNetworkTopology#chooseRandom Key: HDFS-11482 URL: https://issues.apache.org/jira/browse/HDFS-11482 Project: Hadoop HDFS

[jira] [Created] (HDFS-11507) NetworkTopology#chooseRandom may run into a dead loop due to race condition

2017-03-06 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11507: - Summary: NetworkTopology#chooseRandom may run into a dead loop due to race condition Key: HDFS-11507 URL: https://issues.apache.org/jira/browse/HDFS-11507 Project: Hadoop

[jira] [Resolved] (HDFS-11507) NetworkTopology#chooseRandom may run into a dead loop due to race condition

2017-03-07 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11507. --- Resolution: Not A Problem > NetworkTopology#chooseRandom may run into a dead loop due to r

[jira] [Created] (HDFS-11514) ChooseRandom can potentially be optimized

2017-03-08 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11514: - Summary: ChooseRandom can potentially be optimized Key: HDFS-11514 URL: https://issues.apache.org/jira/browse/HDFS-11514 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11535: - Summary: Performance analysis of new DFSNetworkTopology#chooseRandom Key: HDFS-11535 URL: https://issues.apache.org/jira/browse/HDFS-11535 Project: Hadoop HDFS

[jira] [Created] (HDFS-11537) Block Storage : add cache layer

2017-03-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11537: - Summary: Block Storage : add cache layer Key: HDFS-11537 URL: https://issues.apache.org/jira/browse/HDFS-11537 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11539) Block Storage : configurable max cache size

2017-03-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11539: - Summary: Block Storage : configurable max cache size Key: HDFS-11539 URL: https://issues.apache.org/jira/browse/HDFS-11539 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-11577) Combine the old and the new chooseRandom for better performance

2017-03-24 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11577: - Summary: Combine the old and the new chooseRandom for better performance Key: HDFS-11577 URL: https://issues.apache.org/jira/browse/HDFS-11577 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11535. --- Resolution: Information Provided > Performance analysis of new DFSNetworkTopology#chooseRan

[jira] [Reopened] (HDFS-11535) Performance analysis of new DFSNetworkTopology#chooseRandom

2017-03-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reopened HDFS-11535: --- > Performance analysis of new DFSNetworkTopology#chooseRan

[jira] [Created] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-03-27 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11582: - Summary: Block Storage : add SCSI target access daemon Key: HDFS-11582 URL: https://issues.apache.org/jira/browse/HDFS-11582 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-11631) Block Storage : allow cblock server to be started from hdfs command

2017-04-06 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11631: - Summary: Block Storage : allow cblock server to be started from hdfs command Key: HDFS-11631 URL: https://issues.apache.org/jira/browse/HDFS-11631 Project: Hadoop HDFS

[jira] [Created] (HDFS-11645) DataXceiver thread should log the actual error when getting InvalidMagicNumberException

2017-04-11 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11645: - Summary: DataXceiver thread should log the actual error when getting InvalidMagicNumberException Key: HDFS-11645 URL: https://issues.apache.org/jira/browse/HDFS-11645

[jira] [Created] (HDFS-11649) Ozone : add SCM CLI shell code placeholder classes

2017-04-12 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11649: - Summary: Ozone : add SCM CLI shell code placeholder classes Key: HDFS-11649 URL: https://issues.apache.org/jira/browse/HDFS-11649 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11650) Ozone: fix the consistently timeout test testUpgradeFromRel22Image

2017-04-12 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11650: - Summary: Ozone: fix the consistently timeout test testUpgradeFromRel22Image Key: HDFS-11650 URL: https://issues.apache.org/jira/browse/HDFS-11650 Project: Hadoop HDFS

[jira] [Created] (HDFS-11723) Should log a warning message when users try to make certain directories encryption zone

2017-04-28 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11723: - Summary: Should log a warning message when users try to make certain directories encryption zone Key: HDFS-11723 URL: https://issues.apache.org/jira/browse/HDFS-11723

[jira] [Created] (HDFS-11728) Ozone: add the DB names to OzoneConsts

2017-05-01 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11728: - Summary: Ozone: add the DB names to OzoneConsts Key: HDFS-11728 URL: https://issues.apache.org/jira/browse/HDFS-11728 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11747) Ozone : need to fix OZONE_SCM_DEFAULT_PORT

2017-05-03 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11747: - Summary: Ozone : need to fix OZONE_SCM_DEFAULT_PORT Key: HDFS-11747 URL: https://issues.apache.org/jira/browse/HDFS-11747 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-11756) Ozone : add DEBUG CLI support of blockDB file

2017-05-04 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11756: - Summary: Ozone : add DEBUG CLI support of blockDB file Key: HDFS-11756 URL: https://issues.apache.org/jira/browse/HDFS-11756 Project: Hadoop HDFS Issue Type: Sub

[jira] [Created] (HDFS-11759) Ozone : SCMNodeManager#close() should also close node pool manager object

2017-05-04 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11759: - Summary: Ozone : SCMNodeManager#close() should also close node pool manager object Key: HDFS-11759 URL: https://issues.apache.org/jira/browse/HDFS-11759 Project: Hadoop

[jira] [Created] (HDFS-11788) Ozone : add DEBUG CLI support for nodepool db file

2017-05-09 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11788: - Summary: Ozone : add DEBUG CLI support for nodepool db file Key: HDFS-11788 URL: https://issues.apache.org/jira/browse/HDFS-11788 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11802) Ozone : add DEBUG CLI support for open container db file

2017-05-10 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11802: - Summary: Ozone : add DEBUG CLI support for open container db file Key: HDFS-11802 URL: https://issues.apache.org/jira/browse/HDFS-11802 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11836) Ozone : add sql debug CLI to hdfs script

2017-05-16 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11836: - Summary: Ozone : add sql debug CLI to hdfs script Key: HDFS-11836 URL: https://issues.apache.org/jira/browse/HDFS-11836 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11857) Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB

2017-05-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11857: - Summary: Ozone : need to refactor StorageContainerLocationProtocolServerSideTranslatorPB Key: HDFS-11857 URL: https://issues.apache.org/jira/browse/HDFS-11857 Project

[jira] [Created] (HDFS-11859) Ozone : separate blockLocationProtocol out of containerLocationProtocol

2017-05-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11859: - Summary: Ozone : separate blockLocationProtocol out of containerLocationProtocol Key: HDFS-11859 URL: https://issues.apache.org/jira/browse/HDFS-11859 Project: Hadoop HDFS

[jira] [Created] (HDFS-11872) Ozone : implement StorageContainerManager#getStorageContainerLocations

2017-05-23 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11872: - Summary: Ozone : implement StorageContainerManager#getStorageContainerLocations Key: HDFS-11872 URL: https://issues.apache.org/jira/browse/HDFS-11872 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-11872) Ozone : implement StorageContainerManager#getStorageContainerLocations

2017-05-24 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang resolved HDFS-11872. --- Resolution: Won't Fix I misread {{getStorageContainerLocations}} as the lookup of container

[jira] [Created] (HDFS-11886) Ozone : improving error handling for putkey operation

2017-05-25 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11886: - Summary: Ozone : improving error handling for putkey operation Key: HDFS-11886 URL: https://issues.apache.org/jira/browse/HDFS-11886 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11891: - Summary: DU#refresh should print the path of the directory when an exception is caught Key: HDFS-11891 URL: https://issues.apache.org/jira/browse/HDFS-11891 Project

[jira] [Created] (HDFS-11906) Add log for NameNode#monitorHealth

2017-05-31 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11906: - Summary: Add log for NameNode#monitorHealth Key: HDFS-11906 URL: https://issues.apache.org/jira/browse/HDFS-11906 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-05-31 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11907: - Summary: NameNodeResourceChecker should avoid calling df.getAvailable too frequently Key: HDFS-11907 URL: https://issues.apache.org/jira/browse/HDFS-11907 Project: Hadoop

[jira] [Created] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11920: - Summary: Ozone : add key partition Key: HDFS-11920 URL: https://issues.apache.org/jira/browse/HDFS-11920 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11923: - Summary: Stress test of DFSNetworkTopology Key: HDFS-11923 URL: https://issues.apache.org/jira/browse/HDFS-11923 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-11932) BPServiceActor thread name is not correctly set

2017-06-05 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11932: - Summary: BPServiceActor thread name is not correctly set Key: HDFS-11932 URL: https://issues.apache.org/jira/browse/HDFS-11932 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11939) Ozone : add read/write random access to Chunks of a key

2017-06-06 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11939: - Summary: Ozone : add read/write random access to Chunks of a key Key: HDFS-11939 URL: https://issues.apache.org/jira/browse/HDFS-11939 Project: Hadoop HDFS Issue

  1   2   >