The other problem is that the slowness of the TT heartbeats will make the job latency worse.
On 2/21/10 7:49 AM, "Jeff Zhang" <zjf...@gmail.com> wrote: > Hi , > > I am curious to know what is the biggest problem of extremely large hadoop > cluster. What I can imagine now is the memory cost of meta data of hdfs in > name node. One solution I can think about now is to use other storage > implementation such as database to store the metadata, although it has > performance cost. Is there any other solutions or any problems of extremely > large hadoop cluster ? > >
