AW: tiered storage - remote data to topic binding

2023-11-08 Thread philipp lehmann
2023 21:07 An: dev@kafka.apache.org Betreff: Re: tiered storage - remote data to topic binding I am assuming that you are referring to the RSM.fetchLogSegment() API call. The RemoteLogSegmentMetadata object passed to it contains RemoteLogSegmentId which contains information about Topic and the

Re: tiered storage - remote data to topic binding

2023-11-08 Thread Divij Vaidya
I am assuming that you are referring to the RSM.fetchLogSegment() API call. The RemoteLogSegmentMetadata object passed to it contains RemoteLogSegmentId which contains information about Topic and the Partition for this segment. Isn't that information sufficient for your use case? If not, RemoteLogS

tiered storage - remote data to topic binding

2023-11-08 Thread philipp lehmann
Hello, If I understand tiered storage correctly, the RemoteStorageManager doesn't know to which topic the data it receives belongs. In some environments that offer access-pattern-based storage, this is disadvantageous. If the corresponding topics were part of the storage request, the RemoteStor