mukul1987 commented on issue #98: HDDS-2363. Fail to create Ratis container.
URL: https://github.com/apache/hadoop-ozone/pull/98#issuecomment-548239263
Thanks for working on this @ChenSammi, I cannot understand the changes, How
does moving the createIfNeccessary function fixes the issue ?
Hi folks,
This is the meeting minutes of today's YARN + MR online sync up (Mandarin).
There're engineers from several companies which all have large Hadoop
clusters joined the online meeting.
Mainly two topics were discussed today:
1. YARN autoscaling on cloud
2. YARN RM Event dispatcher performan
bshashikant commented on issue #82: HDDS-2359. Seeking randomly in a key with
more than 2 blocks of data leads to inconsistent reads
URL: https://github.com/apache/hadoop-ozone/pull/82#issuecomment-548236013
Thanks @lokeshj1703 for having a look. The test failure in KeyInputStream is
happe
zhuqi created HDFS-14944:
Summary: ec -enablePolicy should support multi federation
namespace not only the default namespace in core-site.xml
Key: HDFS-14944
URL: https://issues.apache.org/jira/browse/HDFS-14944
swagle commented on issue #98: HDDS-2363. Fail to create Ratis container.
URL: https://github.com/apache/hadoop-ozone/pull/98#issuecomment-548214402
+1 LGTM.
This is an automated message from the Apache Git Service.
To respond
[
https://issues.apache.org/jira/browse/HDDS-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan resolved HDDS-2355.
-
Resolution: Cannot Reproduce
> Om double buffer flush termination with rocksdb error
> ---
[
https://issues.apache.org/jira/browse/HDDS-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan reopened HDDS-2355:
-
Reopening for changing Resolution.
> Om double buffer flush termination with rocksdb error
>
dineshchitlangia commented on a change in pull request #51: HDDS-2311. Fix
logic of RetryPolicy in OzoneClientSideTranslatorPB.
URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r340954388
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OM
dineshchitlangia commented on a change in pull request #51: HDDS-2311. Fix
logic of RetryPolicy in OzoneClientSideTranslatorPB.
URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r340954497
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OM
dineshchitlangia commented on a change in pull request #51: HDDS-2311. Fix
logic of RetryPolicy in OzoneClientSideTranslatorPB.
URL: https://github.com/apache/hadoop-ozone/pull/51#discussion_r340954007
##
File path:
hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/ha/OM
+1
> On Oct 27, 2019, at 1:25 AM, Elek, Marton wrote:
>
>
> As discussed earlier in the thread of "Hadoop-Ozone repository mailing list
> configurations" [1] I suggested to solve the current misconfiguration problem
> with creating separated mailing lists (dev/issues) for Hadoop Ozone.
>
> I
ChenSammi commented on issue #98: HDDS-2363. Fail to create Ratis container.
URL: https://github.com/apache/hadoop-ozone/pull/98#issuecomment-548197807
Thanks @swagle for the review. A new patch is submitted to address the
issues.
-
For more details, see
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/491/
No changes
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache
hanishakoneru commented on issue #11: HDDS-2291. Acceptance tests for OM HA.
URL: https://github.com/apache/hadoop-ozone/pull/11#issuecomment-548181506
/retest
This is an automated message from the Apache Git Service.
To respo
[
https://issues.apache.org/jira/browse/HDDS-2381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia resolved HDDS-2381.
-
Fix Version/s: 0.5.0
Target Version/s: 0.5.0
Resolution: Fixed
[~bharat]
dineshchitlangia merged pull request #104: HDDS-2381. In ExcludeList, add if
not exist only.
URL: https://github.com/apache/hadoop-ozone/pull/104
This is an automated message from the Apache Git Service.
To respond to the me
dineshchitlangia merged pull request #106: HDDS-2292. Create Ozone specific
README.md to the new hadoop-ozone repository
URL: https://github.com/apache/hadoop-ozone/pull/106
This is an automated message from the Apache Git S
[
https://issues.apache.org/jira/browse/HDDS-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia resolved HDDS-2387.
-
Resolution: Duplicate
> Build is broken - needs fixing
> --
>
Chris Teoh created HDDS-2387:
Summary: Build is broken - needs fixing
Key: HDDS-2387
URL: https://issues.apache.org/jira/browse/HDDS-2387
Project: Hadoop Distributed Data Store
Issue Type: Bug
Tsz-wo Sze created HDDS-2386:
Summary: Implement incremental ChunkBuffer
Key: HDDS-2386
URL: https://issues.apache.org/jira/browse/HDDS-2386
Project: Hadoop Distributed Data Store
Issue Type: Imp
anuengineer commented on issue #108: HDDS-1987. Fix listStatus API
URL: https://github.com/apache/hadoop-ozone/pull/108#issuecomment-548105219
1. First of all, this is complicated code. But not your fault, what you need
to do at this level is complicated.
2. I agree that is one way of
smengcl opened a new pull request #108: HDDS-1987. Fix listStatus API
URL: https://github.com/apache/hadoop-ozone/pull/108
## What changes were proposed in this pull request?
Fix listStatus API in HA code path.
In HA, we have an in-memory cache, where we put the result to in-me
Thanks Yiqun for sharing with us this morning.
The following is my note taken today. Feel free to update the Google doc in
case I missed something.
https://docs.google.com/document/d/1jXM5Ujvf-zhcyw_5kiQVx6g-HeKe-YGnFS_1-qFXomI/edit?usp=sharing
11/30/2019
10/30
Attendee: Yiqun, Weichiu, Chao, Ma
hanishakoneru commented on issue #11: HDDS-2291. Acceptance tests for OM HA.
URL: https://github.com/apache/hadoop-ozone/pull/11#issuecomment-548075645
Thank you very much @elek for the explanation. Appreciate it.
> And we can continue the thinking about how these tests can be evolve
anuengineer commented on issue #107: HDDS-2301. Write path: Reduce read
contention in rocksDB.
URL: https://github.com/apache/hadoop-ozone/pull/107#issuecomment-548070017
1. First of all, the mkdir -p is does not match the object store semantics
of Ozone.
there is no notion of a path, w
Íñigo Goiri created HDFS-14943:
--
Summary: RBF: Add Namespace to the Overview page in the Web UI
Key: HDFS-14943
URL: https://issues.apache.org/jira/browse/HDFS-14943
Project: Hadoop HDFS
Issue T
anuengineer commented on issue #107: HDDS-2301. Write path: Reduce read
contention in rocksDB.
URL: https://github.com/apache/hadoop-ozone/pull/107#issuecomment-548063613
Please do not commit this patch with out a proper design trade-off
discussion. Thanks
anuengineer commented on issue #107: HDDS-2301. Write path: Reduce read
contention in rocksDB.
URL: https://github.com/apache/hadoop-ozone/pull/107#issuecomment-548060802
I think you should write a design document discuss this before this patch is
checked in. Thanks
--
Vivek Ratnavel Subramanian created HDDS-2385:
Summary: Ozone shell list volume command lists only user owned
volumes and not all the volumes
Key: HDDS-2385
URL: https://issues.apache.org/jira/browse/HD
[
https://issues.apache.org/jira/browse/HDDS-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharat Viswanadham resolved HDDS-2355.
--
Resolution: Fixed
> Om double buffer flush termination with rocksdb error
>
adoroszlai edited a comment on issue #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#issuecomment-548024756
> is it ok with just do a copy of `test.sh` from ozones3 to ozone-hdfs
Yes, copy and `git add` (and try
adoroszlai edited a comment on issue #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#issuecomment-548024756
> is it ok with just do a copy of `test.sh` from ozones3 to ozone-hdfs
Yes, copy and `git add` (and try
[
https://issues.apache.org/jira/browse/HDDS-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bharat Viswanadham resolved HDDS-2379.
--
Resolution: Fixed
> OM terminates with RocksDB error while continuously writing keys.
>
adoroszlai commented on issue #105: HDDS-2370.Support HddsDatanodeService run
as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#issuecomment-548024756
> is it ok with just do a copy of `test.sh` from ozones3 to ozone-hdfs
Yes, copy and `git add`. All subfolders
supratimdeka opened a new pull request #107: HDDS-2301. Write path: Reduce read
contention in rocksDB.
URL: https://github.com/apache/hadoop-ozone/pull/107
https://issues.apache.org/jira/browse/HDDS-2301
This change introduces 'mkdir -p' behaviour in these 2 OM Requests:
1. create
anuengineer commented on issue #106: Hdds 2292
URL: https://github.com/apache/hadoop-ozone/pull/106#issuecomment-548002367
yes, the build failure is the cp command now. I will wait for the next
commit.
This is an automated me
chimney-lee commented on issue #105: HDDS-2370.Support HddsDatanodeService run
as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#issuecomment-548000210
> Also, can you please copy `test.sh` to `ozone-hdfs` from one of the other
compose environments, eg. `ozones3`? By
[
https://issues.apache.org/jira/browse/HDDS-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anu Engineer resolved HDDS-2366.
Fix Version/s: 0.5.0
Resolution: Fixed
Committed to the master branch. [~swagle] Thank you fo
anuengineer commented on issue #90: HDDS-2366. Remove ozone.enabled as a flag
and config item.
URL: https://github.com/apache/hadoop-ozone/pull/90#issuecomment-547997114
Thanks for the reviews and patch. Merged to the master.
anuengineer merged pull request #90: HDDS-2366. Remove ozone.enabled as a flag
and config item.
URL: https://github.com/apache/hadoop-ozone/pull/90
This is an automated message from the Apache Git Service.
To respond to the
Gentle reminder. Yiqun will present in 30 minutes!
On Mon, Oct 28, 2019 at 7:41 PM Wei-Chiu Chuang wrote:
> Hello, I am super stoked to have Yiqun Lin with us this Wednesday morning
> Oct 30 US Pacific 10am/CET (Budapest) 6pm/ IST (Banglore) 10:30pm/ CST
> (Beijing) Oct 31 1am / JST (Tokyo) 2am
anuengineer commented on issue #103: HDDS-2378 - Change OZONE as string used in
the code where OzoneConsts.OZONE is suitable
URL: https://github.com/apache/hadoop-ozone/pull/103#issuecomment-547992696
Once I read the patch, the JIRA makes sense. Thank you for getting this
done, @dineshchit
[
https://issues.apache.org/jira/browse/HDDS-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dinesh Chitlangia resolved HDDS-2378.
-
Fix Version/s: 0.5.0
Resolution: Fixed
[~pifta] Thank you for the contribution. Thi
dineshchitlangia merged pull request #103: HDDS-2378 - Change OZONE as string
used in the code where OzoneConsts.OZONE is suitable
URL: https://github.com/apache/hadoop-ozone/pull/103
This is an automated message from the Ap
For more details, see
https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/490/
No changes
-1 overall
The following subsystems voted -1:
asflicense findbugs hadolint pathlen unit xml
The following subsystems voted -1 but
were configured to be filtered/ignored:
cc check
adoroszlai commented on a change in pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#discussion_r340565182
##
File path:
hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/HddsUtils.java
#
adoroszlai commented on a change in pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#discussion_r340559787
##
File path: hadoop-ozone/dist/src/main/compose/ozone-hdfs/docker-compose.yaml
##
adoroszlai commented on a change in pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#discussion_r340557495
##
File path:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/HddsDatan
Thanks Zhenyu Zheng for the offer to donate machines for ARM CI.
We will definitely make use of it. Let me check how we can set up Jenkins
job for ARM.
-Thanks
Vinay
On Tue, 22 Oct 2019, 1:04 pm Zhenyu Zheng,
wrote:
> Hi All,
>
> Some updates for ARM CI, our team has succesfully donated ARM r
cxorm commented on issue #85: HDDS-2219. Move all the ozone dist
scripts/configs to one location
URL: https://github.com/apache/hadoop-ozone/pull/85#issuecomment-547841930
Hi @elek
Could you please help me review the PR
-
Rajesh Balamohan created HDDS-2384:
--
Summary: Large chunks during write can have memory pressure on DN
with multiple clients
Key: HDDS-2384
URL: https://issues.apache.org/jira/browse/HDDS-2384
Projec
mukul1987 commented on issue #82: HDDS-2359. Seeking randomly in a key with
more than 2 blocks of data leads to inconsistent reads
URL: https://github.com/apache/hadoop-ozone/pull/82#issuecomment-547833481
/retest
This is an
fapifta commented on a change in pull request #103: HDDS-2378 - Change OZONE as
string used in the code where OzoneConsts.OZONE is suitable
URL: https://github.com/apache/hadoop-ozone/pull/103#discussion_r340525633
##
File path:
hadoop-hdds/container-service/src/test/java/org/apach
Rajesh Balamohan created HDDS-2383:
--
Summary: Closing open container via SCMCli throws exception
Key: HDDS-2383
URL: https://issues.apache.org/jira/browse/HDDS-2383
Project: Hadoop Distributed Data St
elek commented on issue #106: Hdds 2292
URL: https://github.com/apache/hadoop-ozone/pull/106#issuecomment-547819017
Build script has been fixed. The first build should be failed. If the
problem is visible I will update the branch with the fix.
--
elek opened a new pull request #106: Hdds 2292
URL: https://github.com/apache/hadoop-ozone/pull/106
**This is the follow-up PR after reverting #55**
## What changes were proposed in this pull request?
Replace the almost empty README with an Ozone specific one.
## What is
elek commented on issue #55: HDDS-2292. Create Ozone specific README.md to the
new hadoop-ozone re…
URL: https://github.com/apache/hadoop-ozone/pull/55#issuecomment-547817654
When I migrated the PRs from the ozone repository to hadoop-ozone repository
I accidentally used a state where the
Rajesh Balamohan created HDDS-2382:
--
Summary: Consider reducing number of file::exists() calls during
write operation
Key: HDDS-2382
URL: https://issues.apache.org/jira/browse/HDDS-2382
Project: Hado
chimney-lee commented on a change in pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#discussion_r340483109
##
File path:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/HddsData
adoroszlai commented on a change in pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105#discussion_r340470980
##
File path:
hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/HddsDatan
chimney-lee opened a new pull request #105: HDDS-2370.Support
HddsDatanodeService run as DataNode Plugin
URL: https://github.com/apache/hadoop-ozone/pull/105
## What changes were proposed in this pull request?
With cuuent version, cannot run hddsdatanodeservice as hdfs datanode pulgi
Lisheng Sun created HDFS-14942:
--
Summary: Change Log Level to warn in
JournalNodeSyncer#syncWithJournalAtIndex
Key: HDFS-14942
URL: https://issues.apache.org/jira/browse/HDFS-14942
Project: Hadoop HDFS
lokeshj1703 commented on issue #81: HDDS-2347. XCeiverClientGrpc's parallel use
leads to NPE
URL: https://github.com/apache/hadoop-ozone/pull/81#issuecomment-547769051
@fapifta Thanks for the contribution! @bshashikant @hanishakoneru Thanks for
the reviews! I have merged the PR to master b
[
https://issues.apache.org/jira/browse/HDDS-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lokesh Jain resolved HDDS-2347.
---
Fix Version/s: 0.5.0
Resolution: Fixed
> XCeiverClientGrpc's parallel use leads to NPE
> --
lokeshj1703 commented on issue #81: HDDS-2347. XCeiverClientGrpc's parallel use
leads to NPE
URL: https://github.com/apache/hadoop-ozone/pull/81#issuecomment-547764518
The changes look good to me. +1.
This is an automated mes
lokeshj1703 merged pull request #81: HDDS-2347. XCeiverClientGrpc's parallel
use leads to NPE
URL: https://github.com/apache/hadoop-ozone/pull/81
This is an automated message from the Apache Git Service.
To respond to the me
66 matches
Mail list logo
