Re: Scanning the list of entries present on a bookie

2018-04-21 Thread Venkateswara Rao Jujjuri
Apparently, there is an assumption in this computation that the bookie sees entries in sequence. When ES>WQ bookie won't see them in sequence. I guess I need to understand what you are trying to do with in-memory cursor at the bookie. In our protocol, only the client(writer) will have the complete

Re: Scanning the list of entries present on a bookie

2018-04-21 Thread Enrico Olivelli
Il sab 21 apr 2018, 09:11 Venkateswara Rao Jujjuri ha scritto: > Sorry, maxEntryId can't be used for LAC. Let me review the patch and > respond tomorrow. :) > I was mostly thinking of sync-on-close which is my use case. Intermittent > syncs will need a more robust way to define the LAC. > Than

Re: Scanning the list of entries present on a bookie

2018-04-21 Thread Venkateswara Rao Jujjuri
Sorry, maxEntryId can't be used for LAC. Let me review the patch and respond tomorrow. :) I was mostly thinking of sync-on-close which is my use case. Intermittent syncs will need a more robust way to define the LAC. On Sat, Apr 21, 2018 at 12:00 AM, Venkateswara Rao Jujjuri < jujj...@gmail.com>

Re: Scanning the list of entries present on a bookie

2018-04-21 Thread Venkateswara Rao Jujjuri
@Enrico I thought I had a pretty simple view on this. 1. No ensemble changes allowed on a ledger in this mode. 2. A sync is sent to all bookies on the ensemble and it is required that the sync must be successful to proceed forward. 3. Sync and Write are serialized. or sync can return maxEntryId. 4.

Re: Scanning the list of entries present on a bookie

2018-04-18 Thread Enrico Olivelli
Any other suggestion? JV, Sijie? My current idea for bp14 is to have a client driven scan. Enrico Il ven 13 apr 2018, 10:22 Enrico Olivelli ha scritto: > > > Il gio 12 apr 2018, 19:59 Sam Just ha scritto: > >> IIRC, InterleavedLedgerStorage has for each ledger an index file >> mapping the en

Re: Scanning the list of entries present on a bookie

2018-04-13 Thread Enrico Olivelli
Il gio 12 apr 2018, 19:59 Sam Just ha scritto: > IIRC, InterleavedLedgerStorage has for each ledger an index file > mapping the entries to entry logger offsets, you could probably scan > that directly (particularly if you included a lower bound -- probably > the client's current idea of the LAC).

Re: Scanning the list of entries present on a bookie

2018-04-12 Thread Sam Just
IIRC, InterleavedLedgerStorage has for each ledger an index file mapping the entries to entry logger offsets, you could probably scan that directly (particularly if you included a lower bound -- probably the client's current idea of the LAC). -Sam On Thu, Apr 12, 2018 at 12:31 AM, Enrico Olivelli

Scanning the list of entries present on a bookie

2018-04-12 Thread Enrico Olivelli
Hi BookKeepers, during implementation of BP-14 I am facing a problem so I am asking for suggestions. My need is to be able to know the list of all entries stored on a LedgerStorage given a ledgerId. Scanning from 0 to LedgerStorage#getLastAddConfirmed() does not seem to work because we have to de