morningman commented on issue #65793: URL: https://github.com/apache/doris/issues/65793#issuecomment-5248423189
Thanks for the detailed write-up, and for the work already put into the three PRs. Before we bring another storage SDK into the codebase, we'd like to first re-examine our existing storage interfaces. On the FE side the abstraction is already reasonably clear after the fe-filesystem-* SPI refactoring. The BE side, however, still needs work — the object storage / filesystem interfaces there have grown organically over time, and they are not yet in a shape where a new backend can be plugged in cleanly. Layering a native OSS stack on top of the interfaces as they stand today would very likely mean reworking it again shortly afterwards, which is not a good outcome for either side. We are aiming to finish this BE-side interface cleanup around October. Until that is done, we would prefer not to merge a new storage SDK, so #61329, #65794 and #65795 will stay open rather than being merged for now. To be clear, this is not a rejection of the feature. The credential gaps you described — ECS RAM role, STS AssumeRole, and RRSA — are real, and we do want to close them. Once the BE interfaces are settled, we expect the native OSS integration to be a much smaller and cleaner change, and we would be glad to work with you on landing it then. We will keep this issue open as the tracking issue and post an update here when the BE refactoring is ready. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
