Re: libhdfs with FileSystem cache issue can causes to memory leak ?

2009-10-13 Thread Huy Phan
bug of my extension or somewhere else. Regards, Huy Phan Brian Bockelman wrote: Hey Huy, Heres what we do: 1) include hdfsJniHelper.h 2) Do the following when you're done with the filesystem: if (NULL != fs) { //Get the JNIEnv* corresponding to current thread JNIEnv*

Re: libhdfs with FileSystem cache issue can causes to memory leak ?

2009-10-13 Thread Huy Phan
Hi Eli, You're right that the problem is resolved in 0.20 with function newInstance(), unfortunately my system's running on Hadoop 0.18.3 and i'm still looking for a way to patch this version without affecting the current system. Regards, Huy Phan Eli Collins wrote:

libhdfs with FileSystem cache issue can causes to memory leak ?

2009-10-13 Thread Huy Phan
Hi All, I'm writing a multi-thread application using libhdfs in C, a known issue of HDFS is that the FileSystem API caches FileSystem handles and always returned the same FileSystem handle when called from different threads. It means even though I called hdfsConnect for many times, I should not