Thanks Aaron and Ravi for stepping in.
We are working on that direction to go to the bottom. The recent fixes may take
care of this.
We will update if we find anything.
Regards,Mohammad
On Wednesday, September 16, 2015 12:59 PM, Aaron T. Myers
<[email protected]> wrote:
Hey Mohammad,
Ravi's suggestion of getting a heap dump would almost certainly let you get to
the bottom of this, but I'll just throw out there that it sounds like you may
have been hitting https://issues.apache.org/jira/browse/HDFS-8965, which indeed
can be triggered by use of inotify. That's fixed now, and in addition to
HDFS-8964 should fully address that issue.
--
Aaron T. MyersSoftware Engineer, Cloudera
On Wed, Sep 16, 2015 at 12:41 PM, Ravi Prakash <[email protected]> wrote:
Hi Mohammad!
Thanks for reporting the issue. Could you please take a heap dump of the NN and
analyze it to see where the memory is being spent?
ThanksRavi
On Tuesday, September 15, 2015 11:53 AM, Mohammad Islam
<[email protected]> wrote:
Hi,We were using INotify feature in one of our internal service. Looks like it
creates a lot of memory pressure on NN. Memory usage goes very high and remains
the same causing expensive GC.
Did anyone use this feature in any service? Is there any con to setup? We are
using latest CDH.
Regards,Mohammad
