Re: where distributed cache start working

2010-08-22 Thread Jeff Zhang
Do you debug it using LocalJobRunner ? In local mode, TaskRunner won't been called. In local mode, mapper task runs in thread rather than forked jvm. The TaskRunner only been called in distributed mode. 2010/8/22 Gang Luo : > Thanks Jeff. > > However, are you sure TaskRunner.run() is also used

Re: where distributed cache start working

2010-08-22 Thread Arun C Murthy
Moving to mapreduce-user@, bcc common-...@. Please use the project specific lists. DistributedCache.purgeCache isn't a public api. You shouldn't be calling it from the task. A simple way of doing what you want is to change the mtime of the cache files on HDFS. Arun On Aug 22, 2010, at

Re: where distributed cache start working

2010-08-22 Thread Gang Luo
Thanks Jeff. However, are you sure TaskRunner.run() is also used in the new API? I use btrace to trace the function call but didn't find this function had been called anywhere. One more question about distributed cache. After I call DistributedCache.purgeCache, I think the local cached fil