Re: Ozone caching feature like HDFS

To be honest, the HDFS caching didn't take off because somehow it didn't improve application performance a lot (speaking from an Impala perspective, I've been told it seems to help with Solr). As a matter of fact we did some performance tests recently comparing HDFS and Ozone. Depending on the set

Re: [ANNOUNCE] Apache Hadoop Ozone 1.1.0 release

+common-dev@hadoop Prashant, I am inclined to revert the Ozone announcement on the Hadoop website. Sorry, but it looks like it removed a few older Hadoop release announcements (Hadoop 3.3.0 release) For the Hadoop community, I think it would be a good idea to add a news announcement section to de

Re: [ANNOUNCE] Apache Hadoop Ozone 1.1.0 release

We have a Twitter handle for Apache Ozone. Who can post a tweet there for this new release? On Tue, Apr 20, 2021 at 9:46 AM Prashant Pogde wrote: > I am happy to announce that the Apache Hadoop Ozone 1.1.0 has been > released. > > The release details, including links to downloads, list of major

Re: [ANNOUNCE] Apache Hadoop Ozone 1.1.0 release

I reverted the change in the Hadoop website. Will go ahead adding the announcement of Ozone becoming a TLP to the Hadoop website later. On Wed, Apr 21, 2021 at 2:48 PM Wei-Chiu Chuang wrote: > +common-dev@hadoop > Prashant, > > I am inclined to revert the Ozone announcement o

Re: [VOTE] - Merge FSO branch HDDS-2939 to master

I am +1. Reviewed the benchmark report and liked it a lot! Yes, the rename and delete was terrible before. This is going to make certain application operations much better, like Impala's delete table command. BTW there were a few delete bugs (lingering namespace garbage after delete, incorrect s

Re: Joining Ozone slack channel

I've sent you an invite to addmaxim.mys...@gmail.com to the #ozone channel in the ASF slack. Note that due to the ASF policy change, people who are not Apache committers can only be invited as a guest to a specific channel, not all channels. Let me know if you'd like to be added to other ozone sl

Fwd: [NOTICE] Dependabot Updates enabled for all projects

-- Forwarded message - From: Chris Lambertus Date: Tue, Apr 5, 2022 at 12:38 PM Subject: [NOTICE] Dependabot Updates enabled for all projects To: Hi folks, Infra is pleased to announce that GitHub’s Dependabot service has been approved for use by ASF Legal and Infra, and is no

Fwd: Data Engineering Track at ApacheCon (October 3-6, New Orleans) - CFP ends 23/05

There are multiple tracks where Ozone would fit nicely: Big Data, Data Engineering and Cloud. CfP ends on May 24th, so submit yours soon! -- Forwarded message - From: Ismaël Mejía Date: Tue, May 17, 2022 at 2:01 PM Subject: Data Engineering Track at ApacheCon (October 3-6, New Or

[DISCUSS] Supporting partial file rewrite/compose

There were a number of discussions that happened during ApacheCon. In the spirit of the Apache Way, I am taking the conversation online, sharing with the larger community and also capturing requirements. Credits to Owen who started this discussion. There are a number of scenarios where users want

Re: Tracking issues of RocksDB crashing

> > Thanks all contributors. > Does is solve datanode crashing and ozone manager memory leak issues? could > anyone share experiences? > We believe we're addressed most if not all RocksDB memory leaks in OM, SCM, DataNode and client. For what is worth, our internal branch is still using RocksDB 6

Re: Tracking issues of RocksDB crashing

Actually just yesterday @Siyao Meng discovered a new rocksdb crash issue. As far as I am aware it is a bug in Ozone not rocksdb. @Siyao Meng or @Ritesh Shukla would you like to share more details? On Tue, Nov 1, 2022 at 1:22 AM Hui Fei wrote: > Thanks for sharing, Wei-Chiu! > >

Ozone meetup happening today!

Community, We are hosting an Ozone meetup at Cloudera's Santa Clara office. If you can't make it in person (the registration is full), please join us from the comfort of your laptop. https://www.meetup.com/futureofdata-sanfrancisco/events/289290610/ Thursday, November 10, 2022 at 5:00 PM to Thur

Re: [VOTE] Apache Ozone 1.3.0 RC1

Good work! A few comments, not about the release bits itself but other tasks: * As a good hygiene,we should move those unresolved jiras targeting 1.3.0 in bulk to the next release (1.4.0). * the master branch is still using version 1.3.0-SNAPSHOT. We should update it to 1.4.0-SNAPSHOT. * the ozone

Past Ozone Events

zone - State of the Union. Siyao Meng, Ethan Rose. - ApacheCon North America 2022: Performance of Apache Ozone on NVMe. Wei-Chiu Chuang, Ritesh Shukla. - China Apache Hadoop Meetup 2022: What’s new in Apache Ozone 1.3. Sammi Chen. - ApacheCon Asia 2022: Sharing Of Recent Progress A

Re: Past Ozone Events

wrote: > > > > > Thanks for adding this Wei-Chiu, this is a good thing to have as we > start > > > giving more ozone talks. > > > > > > On Fri, Dec 16, 2022 at 3:58 PM Wei-Chiu Chuang > > > wrote: > > > > > > > Hi c

[DISCUSS] Use Matomo for site traffic analysis

Hi community, I've been spending some time on the Ozone website SEO. One thing I'd like to do is site traffic analysis. Per Apache Privacy Policy , we can't embed Google Analytics tracking code. However, Apache Privacy has a Matomo instance, which p

Re: [DISCUSS] Use Matomo for site traffic analysis

Hi Apache Privacy team, We'd like to request a site ID & tracking code from you so we can add to the Ozone web site. Let me know how to proceed. Task jira: HDDS-7671 <https://issues.apache.org/jira/browse/HDDS-7671> Thanks, Weichiu On Fri, Dec 16, 2022 at 9:36 PM Wei-Chiu Chuan

Re: [DISCUSS] Use Matomo for site traffic analysis

+'matomo.js'; s.parentNode.insertBefore(g,s); > })(); > > > > This needs to be included in every page you want to track by including the > code before the tag. > > Results can be viewed via https://analytics.apache.org > > Best regards, > &g

@ApacheOzone Twitter Handle and @ApacheOzoneunofficial YouTube Channel

Hi community, As Ozone is getting more attention, and that 1.3.0 is about to release, we should make every effort to let prospective users know our progress. One thing we can do is make use of social media platforms. I found that we have an ApacheOzone Twitter: https://cwiki.apache.org/confluence

Re: [DISCUSS] Proposal to merge HttpFS support in Ozone feature branch (HDDS-5447-httpfs) into master

+1 (non-binding) On Thu, Feb 9, 2023 at 11:21 AM Prashant Pogde wrote: > +1 > > Prashant > > > On Feb 9, 2023, at 2:50 AM, NILOTPAL NANDI > wrote: > > > > +1 for the merge (non-binding). > > > > - Nilotpal Nandi > > > > On Thu, Feb 9, 2023 at 8:57 AM Ayush Saxena wrote: > > > >> +1 > >> > >> -

Fwd: [NOTICE] Upcoming global changes to default GitHub Actions behavior for outside collaborators

-- Forwarded message - From: Daniel Gruno Date: Mon, Feb 13, 2023 at 11:49 AM Subject: [NOTICE] Upcoming global changes to default GitHub Actions behavior for outside collaborators To: To Project PMCs: GitHub for Apache projects is currently set to allow a non-committer contrib

[DISCUSS] Dropping Hadoop 2.7 runtime support?

Hi community, I want to bring up the Hadoop2 support for discussion -- is it possible to drop 2.7? I am asking because a number of features that I worked on requires Hadoop 3 APIs. Some of them can work with Hadoop 2.10 APIs. Examples: CompositeCRC file checksum, StreamCapabilities APIs. There a

Ozone APAC community meetup

Hello! and especially for community members who are in the Asia-Pacific region: Sammi's been running the community meetup every week. If you're interested in knowing what's happening recently, feel free to join us. Next week's going to be in Mandarin and the week after will be in English. https:/

[DISCUSS] Implement Hadoop's setTimes() API

Hello, this proposal is regarding HDDS-8278 implementing Hadoop compatible file system setTimes() API. I'd like to add this API into ofs and o3fs, to support both OBS and FSO bucket types. Keys/files/directories are supported. No support for volume

Re: [DISCUSS] Implement Hadoop's setTimes() API

8278> overall looks good. > > I just have one question regarding the directory's modification time > behavior of FSO bucket. If one file gets modified, will its all ancestor > directories' modification time get updated too? > > Thanks, > Sammi > > On Tue

Re: [DISCUSS] Proposal to merge Ozone feature branch HDDS-7733-Symmetric-Tokens to master

What does it take to pass a vote? Does it require PMCs or can any contributors can vote? I checked around and don't think there's an Apache org-wide bylaws dictating branch merge votes. And we don't have bylaws for Ozone project itself. On Wed, May 31, 2023 at 11:08 AM Uma Maheswara Rao Gangumalla

Re: [VOTE] Proposal to merge Ozone feature branch HDDS-7733-Symmetric-Tokens to master

+1 (binding) I was involved when Duong discovered the issue and proposed the solution, and was involved in reviewing some of the patches. On Fri, Jun 2, 2023 at 10:35 AM Ritesh Shukla wrote: > +1 from me (disclaimer, I worked with Duong on this project) > For those wanting the TLDR for this bra

Fwd: Call for Presentations, Community Over Code Asia 2023

Shoot your shot! -- Forwarded message - From: Duo Zhang Date: Mon, Jun 5, 2023 at 7:37 PM Subject: Fwd: Call for Presentations, Community Over Code Asia 2023 To: HBase Dev List , hbase-user , user-zh FYI. The CFP deadline has been extended to 6.18, please submit your representa

How to take dependency on Hadoop SNAPSHOT version

Hi developers, Is there a way to update the hadoop dependency to a SNAPSHOT version? I have a draft PR that relies on a new Hadoop feature https://github.com/apache/ozone/pull/4825/files#diff-9c5fb3d1b7e3b0f54bc5c4182965c4fe1f9023d449017cece3005d3f90e8e4d8 So instead of hadoop 3.3.5, i have it con

Re: How to take dependency on Hadoop SNAPSHOT version

f16b4a967ad94010080be59aef2049c/pom.xml#L94-L99 > > Ref: RATIS-820 <https://github.com/apache/ratis/pull/53> > > Also I can see hadoop-build-tools SNAPSHOT jars here: > > > https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-build-tools/3

Re: @ApacheOzone Twitter Handle and @ApacheOzoneunofficial YouTube Channel

ling list moderator since she's the PMC chair. Is there anyone else who's a moderator? Ideally we want to have more than one moderator per ML. On Wed, Dec 21, 2022 at 12:20 AM Elek, Márton wrote: > On 12/19/22 20:33, Wei-Chiu Chuang wrote: > > Hi community, > > > &g

Hue File Browser supports Ozone

Just came across this blog post . There is a new tab in Hue for Ozone, similar to how a user would access HDFS, ABFS or S3. I'm tempted to give it a try. Hue accesses Ozone through ofs://. I imagine it can ac

Impala supports Ozone Erasure Coding

Hi community, We've been developing this feature for a while. Impala now supports Ozone, both Ratis as well as Erasure Coding buckets. IMPALA-11476 tracks the Impala Ozone EC support. The feature is completely supported in Apache Impala 4.3.0 (

[DISCUSS] Ozone user mailing list

Hi Ozone community, Many Apache projects have users@ mailing lists for users to seek answers. As the focus of the project moves from core developers to regular users, I wonder if it makes sense to add a user@ mailing alias. Or, would other channels such as GitHub Discussions be sufficient? We hav

httpfs has ClassNotFoundException

Saw this message in one of the test: httpfs_1| SEVERE: Implementation of JAXB-API has not been found on module path or classpath. httpfs_1| javax.xml.bind.JAXBException: Implementation of JAXB-API has not been found on module path or classpath. httpfs_1| - with linked exception: httpf

[DISCUSS] Drop Hadoop 3.1 3.2 runtime support

Hi Ozoner community, it's me again. I'd like to get your feedback on dropping Hadoop 3.1 3.2 runtime support. Currently, Ozone is built with Hadoop 3.3.6 dependency. Our test matrix certifies Ozone execution with Hadoop 2.7, 3.1, 3.2 and 3.3.6. I am not familiar with the history of this, but give

[DISCUSS] Please limit PR size

Hi Ozoners, In one of the coffee break chats with a colleague of mine, we realized many of the PRs in the Ozone project are quite lengthy. I'm guilty of this myself too. Keeping PR short and sweet is good hygiene. It allows reviewers to spot potential problems in the code easier, and your PR is m

Re: [DISCUSS] Please limit PR size

st. If you're set to review a large change, ask if there > is any way it can be split to a dependency chain of two or more consecutive > PRs. Having something written in COMTRIBUTING.md will provide a source that > reviewers can point devs towards as a reference in these situations. > &g

Re: S3G ETag support

I did not scope that when I added file checksum support, because Steve L. told me the Hadoop S3A etag checksum has some problem and he had to disable it by default. I don't think anyone else is looking at this space currently. On Wed, Aug 2, 2023 at 9:53 AM Slava Tutrinov wrote: > Hi everyone, >

Re: Improving the Apache Ozone Website and Documentation

In addition to layout revamp, one thing I'd love to see is more user docs. Our doc is by and large written for core Ozone developers. We need to have more content around how to run workarounds, how to migrate existing applications from HDFS to Ozone, API guide ... etc. On Mon, Aug 28, 2023 at 5:25

Re: Ozone Jira and PR guidelines

Might be irrelevant but I just want to point out that other open source projects have more stringent requirements when it comes to filing a jira. Infact, Kafka has KIP (Kafka Improvement Proposal) Yunikorn has YIP (Yunikorn Improvement Proposal) and the proposers need to have sufficient support (w

Fwd: Join us at the Storage User Group Meetup!

-- Forwarded message - From: Wei-Chiu Chuang Date: Mon, Oct 16, 2023 at 11:28 AM Subject: Join us at the Storage User Group Meetup! To: Hdfs-dev Hi Please join us at the Storage Meetup at Cloudera's office next Wednesday. https://www.meetup.com/futureofdata-sanfrancisco/e

[ANNOUNCE] Janus Chow (a.k.a. Yiyang Zhou) joins Apache Ozone PMC

Hi Ozoners, I am thrilled to share some exciting news with you all! Janus Chow, also known as Yiyang Zhou, has graciously accepted our invitation to join the Apache Ozone PMC. Janus brings a wealth of experience to our team and is already making significant strides in propelling Ozone 1.4.0 to co

Re: [DISCUSS] Next Ozone major release 1.4.0

Both are fixed now. I see that master branch is still referring to 1.4.0-SNAPSHOT. I'd recommend to branch out to branch-1.4, update master branch to use 1.5.0-SNAPSHOT, so we can move into code freeze phase, allowing only blocker issues in the branch. And declare all fixed issues in master branch

Ozone Snapshot talk at RocksDB Meetup

The recording of Prashant's Ozone Snapshot talk at RocksDB Meetup is now uploaded to YouTube. Check it out here: https://youtu.be/yjPuayNJis8?t=4928 (starting at 1:22:08)

Re: Legal compliance for used cryptography - exploration/design phase

Hi Pifta, I don't know what's going on, but most of your email threads went into my spam folder. I wonder if it's happening to other folks. On Thu, Feb 1, 2024 at 2:28 AM István Fajth wrote: > Hi developers! > > I have filed https://issues.apache.org/jira/browse/HDDS-10234 in order to > track ef

[DISCUSS] Merge HDDS-7593 branch (Supporting HSync and lease recovery) into master

Hi community, After 1.5 years of development, HDDS-7593 Supporting HSync and lease recovery, which enables HBase to run on Ozone is about to merge back into the main dev line. There are still a few blockers: 1. HDDS-9844

Re: [VOTE] Merge HDDS-7593 (HSync and lease recovery) into master

I am +1 (binding) On Tue, Jul 23, 2024 at 4:05 AM Ashish kumar wrote: > Hi Ozone developers, > > I would like to propose merging HDDS-7593 (HSync and lease recovery) > feature branch into master. > > This feature is to support HSync and lease recovery, > which enables HBase to run on Ozone. > Mor

Re: [VOTE] Merge HDDS-7593 (HSync and lease recovery) into master

> > > Additionally, new DataNode layout version "HBASE_SUPPORT" was added. > > > > Can you add some details about what changes on the disk layout after this > > feature is finalized? Is this related to the incremental chunk list or > > something more? P

Re: [VOTE] Merge HDDS-7593 (HSync and lease recovery) into master

sent. Whether or not this causes > problems is dependent on the implementation of the feature. > > Can you clarify what disk and protocol changes are part of this feature on > OM and Datanodes? Then we can work out what is actually required for > compatibility. > > On Tue, Jul 30, 2024

Re: [VOTE] Merge HDDS-7593 (HSync and lease recovery) into master

Thanks Attila for the feedback, It looks to me these protocol versions and layout versions concerns can be addressed quickly. I took a stab at it and posted them in three separate PRs. https://github.com/apache/ozone/pull/7013 HDDS-11258. [hsync] Add new OM layout version. https://github.com/apac

Re: [VOTE] Apache Ozone 1.4.1 RC1

Hi thanks for the effort, We are testing the latest Ozone master and Ratis 3.1.0 internally, and found a few critical issues. (1) RATIS-2132 which has about 10% performance regression penalty. (2) Key put fails for large files (> 20GB) due to a me

[DISCUSS] Apache Ozone 1.5.0 release

Hi community, I’d like to initiate a discussion about the 1.5.0 release. There have been significant changes since 1.4.0 (January 2024) with 1,130 commits added to the git history. I think it’s a good time to start planning for the ne

Re: [DISCUSS] Apache Ozone 1.5.0 release

Oh actually I forgot to mention: What about dropping Hadoop2 support? The last Hadoop2 release 2.10.2 was two years ago and I am not sure who else is using Hadoop 2 at all. Dropping it will simplify our code, making it easier to maintain. On Thu, Aug 22, 2024 at 11:55 AM Wei-Chiu Chuang wrote

[DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

Snapshot support was added in 1.4.0, we significantly enhanced it in the coming release. (5) JDK 17 support also signifies another great milestone. (6) Recon UI went through a major revamp and looks very different now. On Thu, Aug 22, 2024 at 12:44 PM Wei-Chiu Chuang wrote: > Oh actually I forgot

Re: [DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

There's also Website v2 that's been cooking for quite a while now. HDDS-9225 <https://issues.apache.org/jira/browse/HDDS-9225> Good opportunity for optics. On Thu, Aug 22, 2024 at 4:19 PM Yi-Sheng Lien wrote: > +1 > > Wei-Chiu Chuang 於 2024年8月23日 週五 上午6:31 寫道： > >

Re: [DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

z Wo Sze" wrote: > >+1 for Ozone 2.0 > > > >> (1) I want to drop Hadoop2 support. > > > >It would be great if we can also replace proto 2 with proto 3. However, > it > >will take some time for the replacement. It probably has to wait till > >Ozon

Re: [DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

after the deprecation? > > 2024年8月28日(水) 8:32 Wei-Chiu Chuang : > > > I'd also like to propose to deprecate > > > > LEGACY bucket type > > O3fs file system > > IIRC we're still testing Hadoop 3.1 and 3.2 runtime. Can we drop it too? > > > >

Re: [DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

epage and community sections soon but going forward I can't write 200+ > pages of technical docs on my own: > > > $ ./progress.sh > > Total pages: 203 > > > > Complete pages: 1 > > > > Incomplete pages: 202 > > >

Re: [DISCUSS] Apache Ozone 2.0 release was: Re: [DISCUSS] Apache Ozone 1.5.0 release

onal > work to be compatible with ozone. We are currently using Hadoop client > version 2.7. > Is it possible to find a friendly solution to Hadoop2 ? > > > > > > On Aug 23, 2024, at 06:30, Wei-Chiu Chuang > wrote: > > > > Hi, > > I want to throw out

[ANNOUNCE] New Committer: Chung-En Lee

Hi Ozone dev community, The Project Management Committee (PMC) for Apache Ozone has invited Chung-En Lee (GitHub: chungen0126, JIRA: wfps1210) to become a committer and we are pleased to announce that they have accepted. Chung-En was involved in several initiatives in the Ozone project, including

Do we test against Hadoop S3A?

Hi I know Ozone's acceptance test verifies aws s3 cli against Ozone S3 Gateway. Do we test against Hadoop S3A client? Hadoop community is reporting a regression due to AWS v2 SDK (*) so I'm wondering if we have the test coverage to ensure compatibility. In addition, do we test or do we plan to te

Re: Ozone Community Meeting(APAC, 2024 Oct 25th)

ZGC in JDK17 is stable. According to the various reports, ZGC achieves better throughput, latency than G1. If someone in the community would like to give it a try, I know some HBase community members opted in ZGC for HBase and it turned out better than other choices. We don't support JDK21 yet. Bu

Heads up! Version change for Ozone 2.0.0

Finally got the time to do this, I'll be renaming the release version "1.5.0" to "2.0.0". Will also add a future release version 2.1.0 and star to move out jiras to 2.1.0. And then update the version string in the pom.xml from 1.5.0-SNAPSHOT to 2.0.0-SNAPSHOT.

Re: Heads up! Version change for Ozone 2.0.0

Hi I've rename version "1.5.0" to "2.0.0". Please use "2.0.0" for future target and fix versions for anything landing in the master branch. I'll be updating pom.xml soon. On Fri, Sep 27, 2024 at 3:52 PM Wei-Chiu Chuang wrote: > Finally got the time t

Re: Heads up! Version change for Ozone 2.0.0

jiras, most of them are simply carried over from the last release. I'll be reviewing these jiras and move them out if possible. On Mon, Sep 30, 2024 at 1:46 PM Wei-Chiu Chuang wrote: > Hi I've rename version "1.5.0" to "2.0.0". Please use "2.0.0" for fu

Re: Ozone Community Meeting(APAC, 2024 June 7th)

How is the ZGC test going? Newer JDK, JDK 21 brings the "Generational ZGC" which is claimed to have additional improvement in throughput, latency pause time and heap consumption over the original ZGC. https://kstefanj.github.io/2023/12/13/jdk-21-the-gcs-keep-getting-better.html On Fri, Jun 7, 20

Fwd: [VOTE] Release Apache Hadoop 3.4.1 RC2

Quick notes while I took a stab at Hadoop 3.4.1 -- Forwarded message - From: Wei-Chiu Chuang Date: Wed, Oct 2, 2024 at 4:54 PM Subject: Re: [VOTE] Release Apache Hadoop 3.4.1 RC2 To: Steve Loughran Cc: Dongjoon Hyun , TL;DR I think the 3.4.1 RC2 is okay from an Ozone&#

Re: [DISCUSS] bump minimum required Java

Does it also imply dropping Hadoop2 support? On Mon, Nov 18, 2024 at 11:38 AM Siyao Meng wrote: > I am in favor of bumping the minimum JDK. We could also start experimenting > with ZGC in Java 17. > > For Ozone in general, we could change it to require Java 11. > > > @szets...@gmail.com Is ther

Missed the AI & Storage Meetup? Watch the Replay Now!

*Hello Ozone Community!* Still buzzing from our recent AI and Storage meetup? We get it—and we’ve got great news: the full recording is now available! Whether you want to rewatch your favorite parts or couldn’t join us live, you can dive in from the comfort of your couch (or bed!). Give it a look

Moving out "New Feature" jiras targeting Ozone 2.0

Hi community, I'm reviewing the list of new features targeting Ozone 2.0.0 release . There were 30 when I started and after removing stale/implemented ones I expect they will come down to around ~20. Looks to me most of them have no updates

Ozone 2.0 release update

Getting close. Dashboard We are down to 2 blockers . IMO HDDS-11382 (Remove the use of caniuse-lite

Re: [VOTE] Apache Ozone 2.0.0 RC0

I just realized my binary was built using JDK21. openjdk version "21.0.1" 2023-10-17 LTS OpenJDK Runtime Environment Zulu21.30+15-CA (build 21.0.1+12-LTS) OpenJDK 64-Bit Server VM Zulu21.30+15-CA (build 21.0.1+12-LTS, mixed mode, sharing) Will this be a problem? Should I build with JDK8? Or even

Re: [VOTE] Apache Ozone 2.0.0 RC0

Correction: I appended my PGP key here: https://dist.apache.org/repos/dist/release/ozone/KEYS I'm not sure which KEYS file is the correct one -- the one under /release/ or the one under /dev/? On Fri, Mar 21, 2025 at 3:42 PM Wei-Chiu Chuang wrote: > Hi Ozone community, > > Plea

[VOTE] Apache Ozone 2.0.0 RC0

Hi Ozone community, Please try out and cast your vote for the Ozone 2.0.0 release candidate 0. This is a huge release, containing 1691 resolved jiras, numerous features and stability improvements. Release process: https://ozone-site-v2.staged.apache.org/docs/developer-guide/project/release-guide

Re: [VOTE] Apache Ozone 2.0.0 RC0

> > Ethan > > On Fri, Mar 21, 2025 at 7:02 PM Wei-Chiu Chuang > wrote: > > > Correction: > > I appended my PGP key here: > > https://dist.apache.org/repos/dist/release/ozone/KEYS > > I'm not sure which KEYS file is the correct one -- the one under >

Re: [VOTE] Apache Ozone 2.0.0 RC0

I was concerned about the native rocksdb jni library than the Mac generated meta files :) The release build script should include -Drocks_tools_native to build it. Probably better to repeat the build on a Linux box instead. BTW, tools/fault-injection-service build is not managed by Maven. I'll sk

[DISCUSS] An easier way to discover design docs

Hi community, We have a habit of attaching design docs to the jira. While it's convenient, I find it nearly impossible to discover someone posting design docs. We create nearly 200 jiras per month on average, so unless someone tags me in the jira, I wouldn't notice there's a design doc waiting to

Re: [apache/ozone] Run failed: build-branch - master (13c5be8)

1. INFRA-26648 <https://issues.apache.org/jira/browse/INFRA-26648> tracks this exact issue. Thanks Ethan for sharing the link. On Tue, Mar 18, 2025 at 2:26 PM Wei-Chiu Chuang wrote: > I have been seeing these sonar errors since yesterday. > > sonar (default-cli) on pro

Fwd: [apache/ozone] Run failed: build-branch - master (13c5be8)

I have been seeing these sonar errors since yesterday. sonar (default-cli) on project ozone-main: Project not found. Did we change things to sonar? From what I can tell it's been failing since yesterday. -- Forwarded message - From: Wei-Chiu Chuang Date: Tue, Mar 18, 2025

Re: [NOTICE] Branching for Ozone 2.0

ou'd like to land in the ozone-2.0 branch. Feel free to reach out if you have any questions! On Tue, Mar 18, 2025 at 11:10 AM Wei-Chiu Chuang wrote: > I'm about to fork the master branch into ozone-2.0 at this commit: > > commit c9990cacaa7e8f943bc80bdc6d9a7ee8b1a49b32 &g

[NOTICE] Branching for Ozone 2.0

I'm about to fork the master branch into ozone-2.0 at this commit: commit c9990cacaa7e8f943bc80bdc6d9a7ee8b1a49b32 Author: Wei-Chiu Chuang Date: Tue Mar 18 10:53:02 2025 -0700 HDDS-12576. [Ozone 2.0] Update proto.lock files (#8064) For any commits landing in master from now on, p

Re: [VOTE] Apache Ozone 2.0.0 RC1

; > > > Tsz-Wo > > [2] > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=173085374#OzoneReleaseGuideline-Buildandcommittheproto.lockchange > > > > > > > > On Sun, Mar 30, 2025 at 1:12 PM Wei-Chiu Chuang > > wrote: > >

Re: [VOTE] Apache Ozone 2.0.0 RC0

Thanks for checking out the RC bits and feedback! I'm dropping RC0 bits and making an RC1 that incorporates the changes. It'll be built on a Red Hat Linux 8.8 with RocksDB native JNI tools and with JDK8. Expect to post a new thread once I finish up sanity checks. On Sun, Mar 23, 2025 at 10:26 AM

Re: [VOTE] Apache Ozone 2.0.0 RC2

not in https://dist.apache.org/repos/dist/dev/ozone/KEYS . > Also, found two copies in > https://dist.apache.org/repos/dist/release/ozone/KEYS > > Please fix it. We don't need a new rc in this case. > > Tsz-Wo > > > On Fri, Apr 4, 2025 at 3:53 AM Wei-Chiu Chuang wr

Re: [VOTE] Apache Ozone 2.0.0 RC2

o a 2.x > service or vice versa? The application interfaces (s3 and Hadoop FS) should > be stable in any case. > > Thanks, > Arpit > > > On Apr 4, 2025 at 3:28:53 AM, Wei-Chiu Chuang wrote: > > > Here's the RC2: > > > > Git tag: https://githu

[DISCUSS] Apache Ozone 2.0.1

As we wind down the 2.0.0 release activity, I want to start the conversation on the next milestone. It was just three weeks of commits, but we've accumulated 124 commits

Re: [VOTE] Apache Ozone 2.0.0 RC1

r 29, 2025 at 10:04 AM Tsz-Wo Nicholas Sze > wrote: > > > Hi Ozone dev, > > > > HDDS-11351 is unifying the protobuf definition of StorageType. How about > > we get it in 2.0.0? > > > > Sorry that I came with this idea late. > > > > Tsz-Wo > &

Re: Gearing up for Ozone 2.0 release

Ok. Thanks for the heads up. Bumping it up to Blocker. I'm moving the rest to target 2.1.0 On Wed, Mar 12, 2025 at 2:01 PM Attila Doroszlai wrote: > > (the remaining tasks of HDDS-11754 don't look like must-do's) > > I think HDDS-12327 needs to be investigated. Finding upgrade problems > after

Fwd: [ASF] A note to projects with GitHub Discussions in use

FYI Also do we want to enable GitHub wiki? We used to have https://cwiki.apache.org/confluence/display/OZONE/Ozone+Wiki+Home but for some reason its SEO is so bad, I couldn't google it. It's probably time to migrate stuff from the wiki to Ozone's user doc site or GitHub wiki. -- Forwarded

Re: [DISCUSS] An easier way to discover design docs

I've seen other projects following a more formal process to propose change -- Kafka's got KIP (Kafka Improvement Proposal), YuniKorn's got YIP, Spark: SPIP, Pulsar: PIP, RocketMQ: RIP, and I think it makes sense. Having design docs in Markdown format isn't a barrier. There are tools to convert Go

Re: [VOTE] Apache Ozone 2.0.0 RC2

Thanks. Updated release note. Also added a paragraph for the generated AI tool used in accordance to the Apache policy . Generated-by: Google AI Studio + Gemini 2.5 Pro Preview 03-25, with input data from a filtered JIRA list

Re: [DISCUSS] Apache Ozone 2.0.1

> > How about using 2.1.0 instead? > We need to have a discussion thread for 2.1.0 roadmap items as well. Right now I see several near time features that make a good 2.1.0 release. (1) S3 lifecycle management. (2) Short Circuit Read. (3) Diskbalancer. and maybe Trino support and Listener OM?

[DISCUSS] Dropping ODPi mpack

Hi Guan-Hao found that we still have ODPi mpack code in Ambari. ODPi is no longer supported and we transitioned to Bigtop. Can we drop it from the cobase? Easier to maintain. https://github.com/apache/ambari/pull/4005

[DISCUSS] Drop ambari-metrics-flume-slink

Similarly, flume is retired to Apache Attic, Bigtop no longer includes Flume since 3.0.0 stack. ambari-metrics-flume-slink is no longer useful and can be dropped. I'm actively looking for dead code to clean up to make future code easier to maintain. Shout out if you think otherwise. Thoughts?

[DISCUSS] Ozone Snapshot Phase 3

Ozone Snapshot was finished in 1.4.0 HDDS-6517 Ozone Snapshot Phase 2 HDDS-8544 mostly spans across 2.0.0 time frame. Post Ozone 2.0 release, we'll be continuing to drive stability, but we'll also

[ANNOUNCE] Apache Ozone 2.0.0

Hello all, We are excited to announce the release of Apache Ozone 2.0.0! Apache Ozone 2.0.0 adds 1700 new features, improvements and bug fixes on top of Ozone 1.4. Notable features: HDDS-7593 Supporting HSync and lease recovery HDDS-7852

Re: RE: Re: [VOTE] Apache Ozone 2.0.0 RC2

bucket and few OM and SCM admin commands. > > > > > > > > Thanks > > > > Devesh > > > > > > > > > > > > > On 11 Apr 2025, at 6:18 PM, Zita Dombi wrote: > > > > > > > > > > Thank you We

Re: [VOTE] Apache Ozone 2.0.0 RC2

> * Verified checksums > > > * Verified ozone-2.0.0-RC2 tag > > > * Built from source > > > * Verified `ozone version` > > > * Verified all the web UIs > > > * Deployed a pseudo-cluster and verified basic read/write operations > > >

Re: Proposal: Deprecate Google Docs for Design Docs

+1 Initially I was reluctant because of the cost of converting Google Docs to Markdown. However, worry no more! Google Docs has built-in support for Markdown! Follow the instructions in this page https://support.google.com/docs/answer/12014036?hl=en So if anyone writes an initial draft in Google

  1   2   >