Sorry for the late answear
But thanks for the tips guys!!!
Now the hard work i think would be try to understand HDFS wire
protocol on ipc package.
thanks!!
On Tue, Apr 6, 2010 at 4:50 PM, Brian Bockelman wrote:
> Hey Jay,
>
> I think, if you're experienced in implementing transfer protocols, i
Hey Jay,
I think, if you're experienced in implementing transfer protocols, it is not
difficult to implement the HDFS wire protocol. As you point out, they are
subject to change between releases (especially between 0.20, 0.21, and 0.22)
and basically documented in fragments in the java source
A pure C library to communicate with HDFS?
Certainly possible, but it would be a lot of work, and the HDFS wire
protocols are ad hoc, only somewhat documented and subject to change between
releases right now so you'd be chasing a moving target. I'd try to think of
another way to accomplish what y
Thanks!
I'm already using eclipse to browse the code.
In this scenario, i could understand that java serializes the object
through the network and its parameters. is that ok?
For example, if i want to make a pure C library (with no JNI
interfaces).. is it possible/feasible? or it will be like to
If you look at the getProxy code it passes an "Invoker" (or something
like that) which the proxy code uses to delegate calls TO. The
Invoker will call another class "Client" which has sub-classes like
Call, and Connection which wrap the actual java IO. This all lives in
the org.apache.hadoop.ipc
Hi again!
Anyone could help me?
I could not understand how RPC class works. For me, only tries to
instantiates a single interfaces with no declaration for some methods
like blockreport. But then it uses rpc.getproxy to get new class wich
send messages with name node.
I'm sorry for this silly ques
Hi Jay!
thanks for the answear but i'm asking for what it works it sends?
blockreport is an interface in DatanodeProtocol that has no
declaration.
thanks!
On Thu, Apr 1, 2010 at 5:50 PM, Jay Booth wrote:
> In DataNode:
> public DatanodeProtocol namenode
>
> It's not a reference to an actual n
In DataNode:
public DatanodeProtocol namenode
It's not a reference to an actual namenode, it's a wrapper for a network
protocol created by that RPC.waitForProxy call -- so when it calls
namenode.blockReport, it's sending that information over RPC to the namenode
instance over the network
On Thu,
Hi everyone!
sailing throught the hdfs source code that comes with hadoop 0.20.2, i
could not understand how hdfs sends blockreport to nameNode.
As i can see, in
src/hdfs/org/apache/hadoop/hdfs/server/datanode/DataNode.java we
create this.namenode interface with RPC.waitForProxy call (wich i
coul
