Hi Israel, Thanks for your interest in tiered storage. As mentioned by Jun earlier, we decided not to have any implementations in Apache Kafka repo like Kafka connectors. We plan to have RSM implementations for HDFS, S3, GCP, and Azure storages in a separate repo. We will let you know once they are ready for review.
Best, Satish. On Sat, 13 Mar 2021 at 01:27, Israel Ekpo <israele...@gmail.com> wrote: > Thanks @Jun for the prompt response. > > That's ok and I think it is a great strategy just like the Connect > ecosystem. > > However, I am still in search for repos and samples that demonstrate > implementation for the KIP. > > I will keep searching but was just wondering if there were sample > implementations for S3 or HDFS I could take a look at. > > Thanks. > > On Fri, Mar 12, 2021 at 2:19 PM Jun Rao <j...@confluent.io.invalid> wrote: > > > Hi, Israel, > > > > Thanks for your interest. As part of KIP-405, we have made the decision > not > > to host any plugins for external remote storage directly in Apache Kafka. > > Those plugins could be hosted outside of Apache Kafka. > > > > Jun > > > > On Thu, Mar 11, 2021 at 5:15 PM Israel Ekpo <israele...@gmail.com> > wrote: > > > > > Thanks Satish, Sriharsha, Suresh and Ying for authoring this KIP and > > thanks > > > to everyone that participated in the review and discussion to take it > to > > > where it is today. > > > > > > I would like to contribute by working on integrating Azure Storage > (Blob > > > and ADLS) with Tiered Storage for this KIP > > > > > > I have created this issue to track this work > > > https://issues.apache.org/jira/browse/KAFKA-12458 > > > > > > Are there any sample implementations for HDFS/S3 that I can reference > to > > > get started? > > > > > > When you have a moment, please share. > > > > > > Thanks. > > > > > >
