Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi Xiangying I think this is a very good optimization solution, it solves the problem that users have a lot of aborted transactions. Thanks! Bo Yubiao Feng 于2022年8月16日周二 11:33写道： > > Hi Xiangying > > >> Can the sequence id generation strategy be added to the proposal？ > > > think it's an imple

Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi Xiangying >> Can the sequence id generation strategy be added to the proposal？ > think it's an implementation detail that shouldn't be exposed to the user at all. OK. Thanks Yubiao Feng On Mon, Aug 15, 2022 at 8:11 PM Xiangying Meng wrote: > Hi, yubiao, > I think it's an implementation d

Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi, yubiao, I think it's an implementation detail that shouldn't be exposed to the user at all. Yours sincerely, Xiangying Meng On Mon, Aug 15, 2022 at 8:02 PM Yubiao Feng wrote: > Hi Xiangying > > Thank you for your reply. Sorry, I have one more question: > > > If these operations are failed at

Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi Xiangying Thank you for your reply. Sorry, I have one more question: > If these operations are failed at operation 2, the old snapshots will be covered by the new large snapshot when compact due to they have the same sequence ID. Can the sequence id generation strategy be added to the doc？ O

Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi, yubiao, First of all, thanks for the attention and questions. Then for your three questions: 1. > Does the merge take place in memory or in BK? The snapshot will merge in BK. For specific details, you can see detailed instructions in the* ### Merge snapshot section.* 2. >How do we ensure the a

Re: [DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi Xiangying I think Multiple-snapshots for TB is a good idea. And I have these questions: > The number of the transactions in a snapshot can be configured, and we hope it is small, then we can merge the small snapshots into a large snapshot when it reaches a configured number. Does the merge t

[DISCUSSION] PiP196 TransactionBuffer Multiple-snapshots

Hi, Pulsar community, I`d like to start a discussion about transaction multiple-snapshot. In order to get rid of the capacity limitation of the bookkeeper entry, we plan to use multiple snapshots. More details can be found here . Yours sincerely, Xian