Hi Christophe, We highly encourage the community to try Tiered Storage in their staging environments and report any deficiencies they might encounter.
That being said, at Aiven to develop our S3 and GCS plugin [1] we did some extensive testing and we will be enabling it to our service offering on the upcoming days. At the moment I'm not aware of a creation of a repository of plugins. But it might be worth having. [1]: https://github.com/Aiven-Open/tiered-storage-for-apache-kafka/ Thanks for your interest in Kafka and Tiered Storage. Disclaimer, I'm employed at Aiven. Best, ——— Josep Prat Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e: josep.p...@aiven.io On Tue, Oct 17, 2023, 16:39 Christophe Kalenzaga < christophe.kalenz...@gmail.com> wrote: > Hi, > > Congratulation for the release of kafka 3.6 that contains a feature I was > waiting for many years! > > Speaking of the devil, the tiered storage is currently in early access. > When do you expect it to be production ready? I know it's not an easy > question since the early access was just released, but it's just to get an > order of magnitude (Is it a couple of months? A year? Multiple years?). > > Another question regarding this feature: the current version doesn't > provide a RemoteStorageManager implementation. According to the KIP-405 > "HDFS and S3 implementation are planned to be hosted in external repos and > these will not be part of Apache Kafka repo". Do you plan to list somewhere > the implementations vetted by the Kafka community so that users can select > a safe implementation? > > Best regards, > Christophe >
