On Fri, Feb 2, 2018 at 8:54 AM Venkateswara Rao Jujjuri <jujj...@gmail.com> wrote:
> Thanks for pushing this Sijie. I had a quick glance at it and looks like > this is a stand-alone/place-holder code, and not connected yet to kick > tires. You don’t need to connect. All the metadata stuffs are loaded with reflection. So no code needs to be changed in main repo. That is also what I said, there can be multiple metadata store used. No logic is actually tied to a specific metadata store. > I was under the impression you did have something we can hook up and play > with. I could be wrong. :) > Not that its a big deal to build that connection and start playing with, > just checking. > When you originally developed did you u actually played with etcd as MDS ? > any testing? The original branch was done one year and half ago, it was planned to show my team how we can integrate etcd as meta store, and it was based on Twitter branch. It was only halfway through. I didn’t really test it because at that moment, we don’t have any interfaces on service discovery. Now Jia have defined a clean service discovery interface, we can entirely replace zookeeper with etcd. > > Again thanks a lot for pushing your work. This can be a great start. > > On Fri, Feb 2, 2018 at 3:52 AM, Sijie Guo <guosi...@gmail.com> wrote: > > > Hi all, > > > > JV and me had a chat today about metadata storage. As we discussed, I am > > raising a BP for exploring using Etcd as the metadata store and pushing a > > prototype change (which I did that one year and half ago). > > > > The prototype branch was just for showing how the metadata interfaces can > > be implemented using jetcd api. It only implements some of operations > that > > required attentions, such as how do we do service discovery, ledger id > > generation, cas update/delete and iteration / get a list of bookies. > > > > I would like someone from the community (maybe from salesforce) can > pickup > > the prototype and push it forward. so he can play closer with etcd api > and > > know better how ectd will perform as a metadata store comparing to > > zookeeper. > > > > Please take a look and comments are welcome. > > > > BP: https://github.com/apache/bookkeeper/pull/1113 > > Prototype: https://github.com/apache/bookkeeper/pull/1114 > > > > - Sijie > > > > > > -- > Jvrao > --- > First they ignore you, then they laugh at you, then they fight you, then > you win. - Mahatma Gandhi >
