There's also the DataNode data directory layout. FS edit logs should also
be included if we're including the fsimage.
Historically we've bumped these in minor and major releases, though I'm not
sure whether precedent supports the practice. It means you can't downgrade,
and features that need metad
On 7 Sep 2017, at 19:13, Daniel Templeton
mailto:dan...@cloudera.com>> wrote:
Good point. I think it would be valuable to enumerate the policies around the
versioned state stores. We have the three you listed. We should probably
include the HDFS fsimage in that list. Any others?
S3Guard n
Good point. I think it would be valuable to enumerate the policies
around the versioned state stores. We have the three you listed. We
should probably include the HDFS fsimage in that list. Any others?
I also want to add a section that clarifies when it's OK to change the
visibility or audi
Thanks for starting this Daniel.
I think we should also add a section for store compatibility (all state
stores including RM, NM, Federation etc.). Essentially an explicit policy
detailing when is it ok to change the major and minor versions and how it
should relate to the hadoop release version.
Good idea. I should have thought of that. :) Done.
Daniel
On 9/5/17 10:33 AM, Anu Engineer wrote:
Could you please attach the PDFs to the JIRA. I think the mailer is stripping
them off from the mail.
Thanks
Anu
On 9/5/17, 9:44 AM, "Daniel Templeton" wrote:
Resending with a broader a
Could you please attach the PDFs to the JIRA. I think the mailer is stripping
them off from the mail.
Thanks
Anu
On 9/5/17, 9:44 AM, "Daniel Templeton" wrote:
>Resending with a broader audience, and reattaching the PDFs.
>
>Daniel
>
>On 9/4/17 9:01 AM, Daniel Templeton wrote:
>> All, in pr
Resending with a broader audience, and reattaching the PDFs.
Daniel
On 9/4/17 9:01 AM, Daniel Templeton wrote:
All, in prep for Hadoop 3 beta 1 I've been working on updating the
compatibility guidelines on HADOOP-13714. I think the initial doc is
more or less complete, so I'd like to open the
All, in prep for Hadoop 3 beta 1 I've been working on updating the
compatibility guidelines on HADOOP-13714. I think the initial doc is
more or less complete, so I'd like to open the discussion up to the
broader Hadoop community.
In the new guidelines, I have drawn some lines in the sand rega
