Available of Intermediate data generated by mappers

Hi, all I'm not sure which mail list I should send my question to, sorry for any inconvenience I brought I'm interested in that how hadoop handles the lost of intermediate data generated by map tasks currently, as some papers suggest, for the situation that the data needed by reducers are lost

Where is the log files when I use mumak

Hi, all I'm studying the implementation of mumak , My question is that the log file generated by mumak only contains the result of the logging statement in mumak source codes, but the information specified in the Jobtracker.java as the parent class of SimulatorJobTracker is lost, where is this in

Mumak's Speculative Execution

Hi, all I'm a student in University of Nebraska, Lincoln, I'm interested in the project of mumak and I truly need a simulator of hadoop for my work I read the source code of hadoop-mapred as well as the mumak itself, I find that in the slides in http://www.slideshare.net/hadoopusergroup/mumak, i

Re: Available of Intermediate data generated by mappers

local.dir, so from i knew, if the > intermediate data lost , only redo can fix it. > > if i wrong, please correct me. > > 2010/9/27 Nan Zhu > > > Hi, all > > > > I'm not sure which mail list I should send my question to, sorry for any > > inconvenie

Re: Hadoop's deafult FIFO scheduler

Hi, Chen I think it's due to the disk/network performance, I mean the speed of reading the content on disk/network into the local memory if job3 hasn't complete data to start mappers, but job4 does, the scheduler would select the tasks of job4 from the list to run firstly, I think the so called

Mumak is still active?

Hi, all I'm working with Mumak recently, but I found that the code hasn't been updated for a long while, I would like to know that if the Mumak is still active? Thank you Nan

Re: Mumak is still active?

sometimes even post partial > patches) along the way. Sometimes your solution may not be aligned with the > general design principle of the whole project, or some assumptions you make > may no longer hold in future versions. Keep the community involved helps > avoid such costly mistakes.

ivy failed to resolve dependencies?

Hi, all I'm trapping in a strange problem in this evening, I have been working on hadoop for several months, including modify the source code and re-compile it, I have never met any problem, but when I re-compile the hadoop this evening, it shows that the ivy cannot resolve the dependencies, the

Re: ivy failed to resolve dependencies?

es file to ivy-2.2.0 and > it worked for me . If you are behind a proxy , then it might create > these problems (as said by steve). You can try this .. > > Thanks > > Bharath.V > 4th year undergraduate, > IIIT Hyderabad. > > On Tue, Nov 2, 2010 at 8:47 AM, Nan Zhu wr

Re: ivy failed to resolve dependencies?

, I believe. Downgrade the version to 1.1.1 and > everything > should be fine. > > On Tue, Nov 02, 2010 at 11:56AM, Nan Zhu wrote: > > Hi, Bharath > > > > Thank you for the reply > > > > I removed the entire cache of ivy and change the library.properties fil

Re: ivy failed to resolve dependencies?

Tue, Nov 2, 2010 at 1:25 PM, Nan Zhu wrote: > I checked the library.properties file, the version of my commons-logging is > 1.1.1, > > I'm still trapped at that point... > > Nan > > On Tue, Nov 2, 2010 at 1:16 PM, Konstantin Boudnik wrote: > >> Your issue is lik

Re: Configure hadoop in eclipse

attachment missed? Nan On Thu, Nov 4, 2010 at 11:35 PM, Rafael Braga wrote: > Hi everybody, > > I follow the tutorial: > http://wiki.apache.org/hadoop/EclipseEnvironment and > saw the screencast: http://vimeo.com/4193623. The buld's.xml ran whitout > problems > but after I turn on "Project

Re: modification to Hadoop Jobtracker

h files should I look at, and after the above mentioned > modification, how to collect the statistics? > > Thanks, > Bikash > -- Nan Zhu School of Software,5501 Shanghai Jiao Tong University 800,Dongchuan Road,Shanghai,China E-Mail: zhunans...@gmail.com

How HDFS decides where to put the block

st of the materials don't involve this issue, but just introduce the data replica where talking about blocks in HDFS, can anyone give me some instructions? Thanks Nan -- Nan Zhu School of Software,5501 Shanghai Jiao Tong University 800,Dongchuan Road,Shanghai,China E-Mail: zhunans...@gmail.com

Re: How HDFS decides where to put the block

Yes, that's it Thanks Nan On Mon, Apr 18, 2011 at 10:16 PM, Harsh J wrote: > Hello, > > On Mon, Apr 18, 2011 at 7:16 PM, Nan Zhu wrote: > > Hi, all > > > > I'm confused by a question that "how does the HDFS decide where to put > the > > data

Re: Any related paper on how to resolve hadoop SPOF issue?

ering > Tel: +30 210 772 2546 > Mobile: +30 6939354121 > Fax: +30 210 772 2569 > Email: gkous...@mail.ntua.gr > Site: http://users.ntua.gr/gkousiou/ > > National Technical University of Athens > 9 Heroon Polytechniou str., 157 73 Zografou, Athens, Greece > > -- Nan Zhu