We have been backporting Todd's HDFS-3077 branch changes on top of
branch-2 for a while now, and testing the result in small clusters
(5-10 nodes). Although we certainly have not had the test coverage
Todd describes below that is their internal testing, we can add the
datapoint that the QJM, in bla
On Thu, Sep 20, 2012 at 1:38 PM, Suresh Srinivas wrote:
> I need a week or so to go over the design and review the code changes. I
> will post my comments to the jira directly. Meanwhile any updates made to
> the design document would help.
The latest rev on the design doc is fully up to date as
I need a week or so to go over the design and review the code changes. I
will post my comments to the jira directly. Meanwhile any updates made to
the design document would help.
Regards,
Suresh
On Wed, Sep 19, 2012 at 12:53 PM, Todd Lipcon wrote:
> Hi all,
>
> Work has been progressing steadil
Hi Konstantin,
I'd be open to that. I know that we plan to ship it as a recommended
option for CDH, but if the community feels it's better suited to
compile as a separate module, either inside or outside of Hadoop, I'm
open to discussing that. You're absolutely correct that it is meant to
"stand a
Hi Todd,
I was wondering if you considered to make QuorumJournal a separate
project or subproject.
Given that
- it is 6600 lines of code
- the code is all new
- well separated in a separate package
- implements reliable journaling, which can have alternative
approaches (say Bookeeper)
Taking all
Hi all,
Work has been progressing steadily for the last several months on the
HDFS-3077 (QuorumJournalManager) branch. The branch is now "feature
complete", and I believe ready for a merge soon now. Here is a brief
overview of some salient points:
* The QJM can be configured to act as a shared jo
