Hello Yiming We have done bunch of work in this area. Many of the things I mentioned in my Jiras are fixed. I know bunch of work we have done internally Charan generated pull requests. Charan can you comment? I and Charan will discuss tomorrow and respond back to the thread in detail.
Thanks, JV On Thu, Mar 23, 2017 at 10:45 AM, Yiming Zang <yz...@twitter.com> wrote: > Hi JV, > > I noticed that you're doing a bunch of work to improve BK compaction in > https://issues.apache.org/jira/browse/BOOKKEEPER-944 and > https://issues.apache.org/jira/browse/BOOKKEEPER-949. > > Earlier, I mentioned that we were also doing some work to make compaction > use a separate log file and add improve the error handling logic to reduce > the chance of duplicated data being generated. By doing this, it can also > address a few other issues. Here's the ticket https://issues.apache. > org/jira/browse/BOOKKEEPER-1014 > > So I just want to quickly check with you to see if there's any conflict / > overlap in these compaction related changes, if there is, let's discuss how > to resolve them and cooperate with each other. For example, I think the > issue in https://issues.apache.org/jira/browse/BOOKKEEPER-949 can also be > addressed once we have a separate log for compaction and a different > allocation rule for compaction log. > > Thanks, > Yiming > > > -- Jvrao --- First they ignore you, then they laugh at you, then they fight you, then you win. - Mahatma Gandhi