Re: Any thoughts making Submarine a separate Apache project?

+1， This is Jeff Zhang from Zeppelin community. Thanks Xun for bring this up. Submarine has been integrated into Zeppelin several months ago, and I already see some early adoption of that in China. AI is fast growing area, I believe moving into a separate project would be helpful for Submarine to

Re: About the indexing of HDFS

e me some advice？ >  Thanks a lot! > -- Best Regards Jeff Zhang

Re: Debug HDFS

You can debug MiniDFSCluster which is for unit test of HDFS. On Mon, Jul 5, 2010 at 8:53 AM, Alberich de megres wrote: > Hello again! > > A quick question: > - How you debug hdfs? > > I'm using eclipse, but which class do i need to run? > thanks! > -- Best Regards Jeff Zhang

[jira] Created: (HDFS-1278) Add more documents about command "daemonlog"

umentation Reporter: Jeff Zhang In the current document, it does not explain the argument "name" means. People without java knowledge would think it as process name, such as NameNode or DataNode, but actually it is class name. So I suggest to add more document about the &q

[jira] Created: (HDFS-1276) Put the failed volumes in the report of HDFS status

Reporter: Jeff Zhang Fix For: 0.21.0 Currently, users do not know which volumes are failed unless he looks into the logs, this way is not convenient for users. I plan to put the failed volumes in the report of HDFS. Then hdfs administers can use command "bin/h

[jira] Created: (HDFS-1273) Handle disk failure when writing new blocks on datanode

: data-node Affects Versions: 0.21.0 Reporter: Jeff Zhang Fix For: 0.21.0 This issues relates to HDFS-457, in the patch of HDFS-457 only disk failure when reading is handled. This jira is to handle the disk failure when writing new blocks on data node. -- This message

Source Code Question about blockReport

always returns DatanodeCommand.FINALIZE or null. it makes me confused here. Could anybody help me understand what's the meaning of the code here ? And how does the NameNode tell DataNode which block should be delete ? Thanks for your help. -- Best Regards Jeff Zhang

Is it safe enough to write edit log in buffer before writing to disk ?

necessary to let users do configuration in the conf file to decide whether use buffer or not? Thanks. -- Best Regards Jeff Zhang

Re: HDFS Source Code

ebody help me out understanding > it. I have read the documentation present on hdfs architecture. > > Thanks, > Vidur > > -- > This message has been scanned for viruses and > dangerous content by MailScanner, and is > believed to be clean. > > -- Best Regards Jeff Zhang

[jira] Created: (HDFS-1191) SecondaryNameNode give the loopback address (127.0.0.1) to NameNode under some condition

Project: Hadoop HDFS Issue Type: Bug Reporter: Jeff Zhang This issue is because of JDK's bug (although this won't been fixed ) http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4665037 In the method putFSImage of SecondaryNameNode.java, InetAddress.ge

What is the biggest problem of extremely large hadoop cluster ?

performance cost. Is there any other solutions or any problems of extremely large hadoop cluster ? -- Best Regards Jeff Zhang

[jira] Created: (HDFS-789) Add conf to classpath in start_thrift_server.sh

/thriftfs Affects Versions: 0.22.0 Reporter: Jeff Zhang Fix For: 0.22.0 In the current script start_thrift_server.sh, the conf folder is not in classpath, so when user start the thrift server, it actually use the local file system. So I create this issue to put the hdfs

How can I get the permission to contribute to hadoop ?

Hi all, I'd like to contribute the hadoop, and I'd like to get started with fixing bugs. But I found in the jira, it says that I have no permission to work on the jira item. So how can I get the permission to contribute to hadoop ? Thank you. Jeff Zhang

MiniDFSCluster in trunk can not run in windows platform ?

notice there's code changes comparing to hadoop 0.20 Does anyone know whether this is bug? If so ,I can put it in JIRA, and help fix it. Best Regards, Jeff zhang