Re: FSImage size issue

2020-12-01 Thread Jason Wen
, 4:43 PM, "Wei-Chiu Chuang" wrote: Possibly snapshots. Also possible if each of your files has lots of xattr or ACLs. On Tue, Dec 1, 2020 at 3:52 PM Jason Wen wrote: > Hi, > > We are encountering some odd FSImage size issue in one o

Re: FSImage size issue

2020-12-01 Thread Jason Wen
les has lots of xattr or ACLs. On Tue, Dec 1, 2020 at 3:52 PM Jason Wen wrote: > Hi, > > We are encountering some odd FSImage size issue in one of our Hadoop > clusters. The Namenode only has about 3M files/blocks, but the FSImage size > is about 55GB.

Re: FSImage size issue

2020-12-01 Thread Wei-Chiu Chuang
Possibly snapshots. Also possible if each of your files has lots of xattr or ACLs. On Tue, Dec 1, 2020 at 3:52 PM Jason Wen wrote: > Hi, > > We are encountering some odd FSImage size issue in one of our Hadoop > clusters. The Namenode only has about 3M files/blocks, but the FSIma

FSImage size issue

2020-12-01 Thread Jason Wen
Hi, We are encountering some odd FSImage size issue in one of our Hadoop clusters. The Namenode only has about 3M files/blocks, but the FSImage size is about 55GB. We have never seen this kind of gap between number of files/blocks vs FSImage size. As a comparison, we have another similar