+1.
Thanks,
Yiqun
On 2020/9/25, 2:08 PM, "Elek, Marton" wrote:
External Email
Hi all,
Thank you for all the feedback and requests,
As we discussed in the previous thread(s) [1], Ozone is proposed to be a
separated Apache Top Level Project (TLP)
The proposal with al
Hi hdfs-dev,
Currently in libhdfs, we find that hdfs file create operation doesn’t support
O_CREATE && O_EXCL.
https://github.com/apache/hadoop/blob/trunk/hadoop-hdfs-project/hadoop-hdfs-native-client/src/main/native/libhdfs/hdfs.c#L1148
if ((flags & O_CREAT) && (flags & O_EXCL)) {
fp
Lin Yiqun created HDFS-9303:
---
Summary: Balancer slowly with too many small file blocks
Key: HDFS-9303
URL: https://issues.apache.org/jira/browse/HDFS-9303
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-9375:
---
Summary: Set balancer bandwidth for specific node
Key: HDFS-9375
URL: https://issues.apache.org/jira/browse/HDFS-9375
Project: Hadoop HDFS
Issue Type: Improvement
Lin Yiqun created HDFS-9468:
---
Summary: DfsAdmin command set dataXceiver count for datanode
Key: HDFS-9468
URL: https://issues.apache.org/jira/browse/HDFS-9468
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-9510:
---
Summary: FsVolume should add the operation of creating file's time
metrics
Key: HDFS-9510
URL: https://issues.apache.org/jira/browse/HDFS-9510
Project: Hadoop
Lin Yiqun created HDFS-9624:
---
Summary: DataNode start slowly due to the initial DU command
operations
Key: HDFS-9624
URL: https://issues.apache.org/jira/browse/HDFS-9624
Project: Hadoop HDFS
Lin Yiqun created HDFS-9662:
---
Summary: Wrong checking penultimate block replicated in
FSNamesystem
Key: HDFS-9662
URL: https://issues.apache.org/jira/browse/HDFS-9662
Project: Hadoop HDFS
Issue
Hi Chaitanya,
I suppose you can get more details that you wanted to know from EC design doc
attached in JIRA HDFS-7285(https://issues.apache.org/jira/browse/HDFS-7285).
Hope this makes sense to you.
Thanks
Yiqun
-邮件原件-
发件人: Chaitanya M V S [mailto:chaitanya.mvs2...@gmail.com]
发送时间: 201
Hi Igor,
It’s not appropriate to ask for a review request in dev mailing list. Dev
mailing list is mainly used for discussing and answering user’s questions. You
can ask for the review under specific JIRA, that will be seen by committers or
others. If they have time, they will help take the rev
Hi Uma,
Seeing the discussion under JIRA HDFS-10285, external SPS running will be a
recommend way for the users, right? As you also mentioned, there are some
additional works need to test and be integrated. One more question from me,
that maybe also cared by other developers, what's the major d
+1.
-邮件原件-
发件人: Subru Krishnan [mailto:su...@apache.org]
发送时间: 2018年7月6日 5:59
收件人: Wei-Chiu Chuang
抄送: Rohith Sharma K S; Subramaniam Krishnan; yarn-...@hadoop.apache.org;
Hdfs-dev; Hadoop Common; mapreduce-...@hadoop.apache.org
主题: Re: [VOTE] reset/force push to clean up inadvertent merg
+1, looking forward to seeing the Ozone/HDDS, : ).
-邮件原件-
发件人: Anu Engineer [mailto:aengin...@hortonworks.com]
发送时间: 2018年8月7日 6:51
收件人: Elek, Marton; common-...@hadoop.apache.org;
mapreduce-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
hdfs-dev@hadoop.apache.org
主题: Re: [DISCUSS] A
Hi hdfs developers:
We meet a bad problem after rolling upgrade our hadoop version from
2.5.0-cdh5.3.2 to 2.6.0-cdh5.13.1. The problem is that we find NN running slow
periodically (around a week). Concretely to say, For example, we startup NN on
Monday, it will run fast. But time coming to Week
9月26日 1:11
收件人: 林意群[运营中心]
抄送: Hdfs-dev
主题: Re: NN run progressively slower
Are you using CMS? How big is young gen?
How often does the NN do young gen collection when it is slow?
On Tue, Sep 25, 2018 at 4:04 AM Lin,Yiqun(vip.com<http://vip.com>)
mailto:yiqun01@vipshop.com>> wr
o take a heap dump and analyze
what's in there?
There were quite some NN scalability and GC improvements between CDH5.5 ~
CDH5.8 time frame. We have customers at/beyond your scale in your version but I
don't think I've heard similar symptoms.
Regards
On Tue, Sep 25, 2018 at 2:
og for Excessive Spew ( there are some jira's which are fixed later to
2.6.0) like decommission nodes,...
v) Any recursive calls are very frequently?
-Original Message-
From: Lin,Yiqun(vip.com) [mailto:yiqun01@vipshop.com]
Sent: Wednesday, September 26, 2018 10:26 AM
To: Wei-Chiu Chuang
It's great to see this release. But I caught a broken url when read more
information from the page you gave https://hadoop.apache.org/ozone.
The steps:
1).Click download page: https://hadoop.apache.org/ozone/downloads/
2).Click Announcement button
3).Click Documentation button, will redirect to a
Lin Yiqun created HDFS-9673:
---
Summary: Incomplete annotation in FSNamesystem#checkFileProgress
Key: HDFS-9673
URL: https://issues.apache.org/jira/browse/HDFS-9673
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-9685:
---
Summary: StopDecommission for datanode should remove the
underReplicatedBlocks
Key: HDFS-9685
URL: https://issues.apache.org/jira/browse/HDFS-9685
Project: Hadoop HDFS
Lin Yiqun created HDFS-9727:
---
Summary: Improve the exception's log output in DataXceiver
Key: HDFS-9727
URL: https://issues.apache.org/jira/browse/HDFS-9727
Project: Hadoop HDFS
Issue
Lin Yiqun created HDFS-9747:
---
Summary: Reuse objectMapper instance in MapReduce
Key: HDFS-9747
URL: https://issues.apache.org/jira/browse/HDFS-9747
Project: Hadoop HDFS
Issue Type: Improvement
Lin Yiqun created HDFS-9756:
---
Summary: Hard-Code value in DataTransferThrottler
Key: HDFS-9756
URL: https://issues.apache.org/jira/browse/HDFS-9756
Project: Hadoop HDFS
Issue Type: Bug
Affects
Lin Yiqun created HDFS-9768:
---
Summary: Reuse objectMapper instance in HDFS to improve the
performance
Key: HDFS-9768
URL: https://issues.apache.org/jira/browse/HDFS-9768
Project: Hadoop HDFS
Lin Yiqun created HDFS-9772:
---
Summary: TestBlockReplacement#testThrottler use falut variable to
calculate bandwidth
Key: HDFS-9772
URL: https://issues.apache.org/jira/browse/HDFS-9772
Project: Hadoop HDFS
Lin Yiqun created HDFS-9812:
---
Summary: Streamer threads leak if failure happens when closing the
dfsoutputstream
Key: HDFS-9812
URL: https://issues.apache.org/jira/browse/HDFS-9812
Project: Hadoop HDFS
Lin Yiqun created HDFS-9819:
---
Summary: FsVolume should tolerate few times check-dir failed due
to deletion by mistake
Key: HDFS-9819
URL: https://issues.apache.org/jira/browse/HDFS-9819
Project: Hadoop
Lin Yiqun created HDFS-9832:
---
Summary: Erasure Coding: Improve exception handling in
ErasureCodingWorker#ReconstructAndTransferBlock
Key: HDFS-9832
URL: https://issues.apache.org/jira/browse/HDFS-9832
Lin Yiqun created HDFS-9842:
---
Summary: dfs.datanode.balance.bandwidthPerSec should accept
friendly size units
Key: HDFS-9842
URL: https://issues.apache.org/jira/browse/HDFS-9842
Project: Hadoop HDFS
Lin Yiqun created HDFS-9847:
---
Summary: HDFS configuration without time unit name should accept
friendly time units
Key: HDFS-9847
URL: https://issues.apache.org/jira/browse/HDFS-9847
Project: Hadoop HDFS
Lin Yiqun created HDFS-9863:
---
Summary: DataNode doesn't log any shutdown info when the process
of DataNode exiting
Key: HDFS-9863
URL: https://issues.apache.org/jira/browse/HDFS-9863
Project: Hadoop
Lin Yiqun created HDFS-9865:
---
Summary: TestBlockReplacement fails intermittently in trunk
Key: HDFS-9865
URL: https://issues.apache.org/jira/browse/HDFS-9865
Project: Hadoop HDFS
Issue Type: Bug
Lin Yiqun created HDFS-9872:
---
Summary: HDFS bytes-default configurations should accept multiply
size units
Key: HDFS-9872
URL: https://issues.apache.org/jira/browse/HDFS-9872
Project: Hadoop HDFS
Lin Yiqun created HDFS-9883:
---
Summary: Replace the hard-code value to variable
Key: HDFS-9883
URL: https://issues.apache.org/jira/browse/HDFS-9883
Project: Hadoop HDFS
Issue Type: Improvement
Lin Yiqun created HDFS-9919:
---
Summary: TestStandbyCheckpoints#testNonPrimarySBNUploadFSImage
waitForCheckpoint incorrectly
Key: HDFS-9919
URL: https://issues.apache.org/jira/browse/HDFS-9919
Project
Lin Yiqun created HDFS-9935:
---
Summary: Remove LEASE_{SOFTLIMIT,HARDLIMIT}_PERIOD constants from
HdfsServerConstants
Key: HDFS-9935
URL: https://issues.apache.org/jira/browse/HDFS-9935
Project: Hadoop HDFS
Lin Yiqun created HDFS-9936:
---
Summary: Remove unused import in HdfsServerConstants
Key: HDFS-9936
URL: https://issues.apache.org/jira/browse/HDFS-9936
Project: Hadoop HDFS
Issue Type: Bug
Lin Yiqun created HDFS-9950:
---
Summary: TestDecommissioningStatus fails intermittently in trunk
Key: HDFS-9950
URL: https://issues.apache.org/jira/browse/HDFS-9950
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-9951:
---
Summary: Improve the Node key definition in
OfflineImageReconstructor
Key: HDFS-9951
URL: https://issues.apache.org/jira/browse/HDFS-9951
Project: Hadoop HDFS
Issue
Lin Yiqun created HDFS-10181:
Summary: TestHFlush frequently fails due to theadInterrupt
Key: HDFS-10181
URL: https://issues.apache.org/jira/browse/HDFS-10181
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-10185:
Summary: TestHFlushInterrupted verifies interrupt state incorrectly
Key: HDFS-10185
URL: https://issues.apache.org/jira/browse/HDFS-10185
Project: Hadoop HDFS
Issue
Lin Yiqun created HDFS-10197:
Summary: TestFsDatasetCache failing intermittently due to timeout
Key: HDFS-10197
URL: https://issues.apache.org/jira/browse/HDFS-10197
Project: Hadoop HDFS
Issue
Lin Yiqun created HDFS-10204:
Summary: Use HadoopIllegalArgumentException replace
IllegalArgumentException in hadoop-hdfs
Key: HDFS-10204
URL: https://issues.apache.org/jira/browse/HDFS-10204
Project
Lin Yiqun created HDFS-10227:
Summary: BlockManager should decrease blocksScheduled count for
timeout replication
Key: HDFS-10227
URL: https://issues.apache.org/jira/browse/HDFS-10227
Project: Hadoop
Lin Yiqun created HDFS-10269:
Summary: Invalid value configured for
dfs.datanode.failed.volumes.tolerated cause the datanode exit
Key: HDFS-10269
URL: https://issues.apache.org/jira/browse/HDFS-10269
Lin Yiqun created HDFS-10275:
Summary: TestDataNodeMetrics failing intermittently due to
TotalWriteTime counted incorrectly
Key: HDFS-10275
URL: https://issues.apache.org/jira/browse/HDFS-10275
Project
Lin Yiqun created HDFS-10279:
Summary: Improve the validation for tolerated volumes
Key: HDFS-10279
URL: https://issues.apache.org/jira/browse/HDFS-10279
Project: Hadoop HDFS
Issue Type
Lin Yiqun created HDFS-10302:
Summary: BlockPlacementPolicyDefault should use default
replication considerload value
Key: HDFS-10302
URL: https://issues.apache.org/jira/browse/HDFS-10302
Project: Hadoop
Lin Yiqun created HDFS-10336:
Summary: TestBalancer failing intermittently because of not
reseting UserGroupInformation completely
Key: HDFS-10336
URL: https://issues.apache.org/jira/browse/HDFS-10336
Lin Yiqun created HDFS-10358:
Summary: Refactor EncryptionZone and EncryptionZoneInt
Key: HDFS-10358
URL: https://issues.apache.org/jira/browse/HDFS-10358
Project: Hadoop HDFS
Issue Type: Sub
Hi developers,
Recently, I found following error frequently appeared in HDFS/HDDS Jenkins
building.
The link:
https://builds.apache.org/job/PreCommit-HDDS-Build/1632/artifact/out/patch-unit-hadoop-ozone_ozone-manager.txt
[ERROR] ExecutionException The forked VM terminated without properly sayin
51 matches
Mail list logo
