common-dev@hadoop.apache.org

2010-08-12 Thread Jothi Padmanabhan

Intro / Ideas for contribution

2010-08-12 Thread Bern Hassmo
Hi list, I'd like to start contributing to hadoop. I've spend the last couple of days reading through documentation / guidelines, setting up my development environment etc. Now I was thinking the best way to get started would probably be to start fixing some bug reports, preferably something ligh

[jira] Created: (HADOOP-6914) IPC Client Connection close does not protect against partially Connection objects

2010-08-12 Thread Richard Lackey (JIRA)
IPC Client Connection close does not protect against partially Connection objects - Key: HADOOP-6914 URL: https://issues.apache.org/jira/browse/HADOOP-6914 Project: Hadoo

[jira] Created: (HADOOP-6915) Add daemon restart option

2010-08-12 Thread Nicolas Spiegelberg (JIRA)
Add daemon restart option - Key: HADOOP-6915 URL: https://issues.apache.org/jira/browse/HADOOP-6915 Project: Hadoop Common Issue Type: Improvement Components: scripts Reporter: Nicolas Spiegelber

Use of RPC Server and Client...

2010-08-12 Thread Ahmad Shahzad
Hi ALL, Can anyone tell me the purpose for RPC server and RPC client that is used in hadoop. As far as logs tell, they are used by JobTracker and TaskTracker, as well as namenode and datanode. Can anyone tell me that for what purpose RPC server and client are used by each of them. Ahma

Re: Use of RPC Server and Client...

2010-08-12 Thread momina khan
hi the periodic heartbeat call that task trackers make to the jobtracker is thru RPC same for namenode and data nodes. momina On Fri, Aug 13, 2010 at 5:39 AM, Ahmad Shahzad wrote: > Hi ALL, >Can anyone tell me the purpose for RPC server and RPC client > that is used in hadoop.

Re: Intro / Ideas for contribution

2010-08-12 Thread Arun C Murthy
Bern, Welcome! Some documentation to help get started - http://wiki.apache.org/hadoop/HowToContribute Arun On Aug 12, 2010, at 5:59 AM, Bern Hassmo wrote: Hi list, I'd like to start contributing to hadoop. I've spend the last couple of days reading through documentation / guidelines, set

SOCKET FACTORIES problem.... HELP!!

2010-08-12 Thread Ahmad Shahzad
Hi ALL, Does hadoop uses socket factories given in org/apache/hadoop/net folder for creating every socket it uses??? I was looking at the code of RPC Server in ipc directory. It creates a ServerSocket with the help of socketchannel( the NIO package). Also RPC client creates a few socke

Re: Use of RPC Server and Client...

2010-08-12 Thread Ahmad Shahzad
Hi Momina, Is that all that RPC Server and Client is used for ??? What about the rest of the communication that happens between Jobtracker and Tasktracker?? how the rest of the communication is done?? Ahmad

Re: Use of RPC Server and Client...

2010-08-12 Thread momina khan
all communication regarding health of task tracker and tasks assigned to TT from JT, info on failed tasks, completed all is communicated through heartbeat ... what other communication are you talking about? hadoop uses the regular heartbeat and all other info piggy backs on it ... from TT to JT on

Re: Use of RPC Server and Client...

2010-08-12 Thread Ahmad Shahzad
Hi Momina, Thanks for replying. I wanted to know that JT and TT interact with each other through this RPC Server and Client model, What about the http Server Jetty what is it used for ?? Secondly, i would like to ask a related question, how does JT and TT communicates with n

Jira task 6891

2010-08-12 Thread Hotmail Email Address
> Hi Folks, > Just following up on this JIRA task since I did not hear back from anyone: > > 1) Where do I need to commit my code to for this, is it in Trunk or 0.20.2, > also FYI the trunk branch doesn't have any examples or tests for those > examples so I'd need to introduce new packages for

Re: Jira task 6891

2010-08-12 Thread Amareshwari Sri Ramadasu
Examples are present in org.apache.hadoop.examples package in MapReduce project. See http://hadoop.apache.org/mapreduce/version_control.html for checking out MapReduce project. You can go through http://wiki.apache.org/hadoop/HowToContribute to know how to contribute. Generate patch against MapR

Re: Jira task 6891

2010-08-12 Thread Hotmail Email Address
Thank you Amareshawari. I'll proceed based on this. Sent from my iPad On Aug 12, 2010, at 9:50 PM, Amareshwari Sri Ramadasu wrote: > Examples are present in org.apache.hadoop.examples package in MapReduce > project. See http://hadoop.apache.org/mapreduce/version_control.html for > checking