Re: Building Hadoop...

The last question has shifted from the subject of the email chain. Mind sending a new email with proper subject ? On Mon, Jul 29, 2013 at 8:52 AM, James Carman wrote: > Okay, thanks for the tip. Just trying to find my way around the code > at this point. Wanting to contribute. Any suggestions

Re: Building Hadoop...

Okay, thanks for the tip. Just trying to find my way around the code at this point. Wanting to contribute. Any suggestions on good areas to start contributing? On Mon, Jul 29, 2013 at 11:47 AM, Ted Yu wrote: > To my knowledge, attaching patch on the JIRA is the standard way of > contributing t

Re: Building Hadoop...

To my knowledge, attaching patch on the JIRA is the standard way of contributing to Hadoop. BTW there is a small lag between checkin of SVN and the propagation to GIT. Cheers On Mon, Jul 29, 2013 at 8:20 AM, James Carman wrote: > What is the "preferred" way you guys want to receive patches? Wo

Re: Building Hadoop...

What is the "preferred" way you guys want to receive patches? Would you rather I fork your Git repo and provide pull requests or do you want patches attached to JIRAs? I can do either one, no big deal. On Mon, Jul 29, 2013 at 10:47 AM, Tsuyoshi OZAWA wrote: > The master repository is SVN, and G

Re: Building Hadoop...

The master repository is SVN, and Git one is mirror of that. Both of them are official. You can find these information at: http://wiki.apache.org/hadoop/HowToContribute Thanks, - Tsuyoshi On Mon, Jul 29, 2013 at 8:29 PM, James Carman wrote: > Is the "official" source repository Git or SVN for th

Re: Building Hadoop...

Is the "official" source repository Git or SVN for this project? On Sun, Jul 28, 2013 at 11:22 PM, Ted Yu wrote: > Thanks for sharing, Chris. > > The following command would produce tar ball, skipping javadoc: > > mvn clean package -Dtar -Pdist -DskipTests=true -Dmaven.javadoc.skip=true > > Chee

Re: Building Hadoop...

Thanks for sharing, Chris. The following command would produce tar ball, skipping javadoc: mvn clean package -Dtar -Pdist -DskipTests=true -Dmaven.javadoc.skip=true Cheers On Sun, Jul 28, 2013 at 8:13 PM, Chris Mildebrandt wrote: > I put together a small doc for myself while I was building Ha

Re: Building Hadoop...

I put together a small doc for myself while I was building Hadoop on OSX that may help: https://docs.google.com/document/d/13Lh4fS7ZIE2SyVLQxtqgbqLxn_lYdgOQY8oR3tZj4XU Didn't really create it for public consumption, so it's not well formatted, etc. -Chris On Sun, Jul 28, 2013 at 2:00 PM, James

Re: Building Hadoop...

To help other folks who might be having the same troubles as me, this gist helped me downgrade protobuf: https://gist.github.com/gcatlin/1847248 On Sun, Jul 28, 2013 at 5:00 PM, James Carman wrote: > Okay, cool. That's what I figured. I'll try to figure out how to > install specific versions

Re: Building Hadoop...

Okay, cool. That's what I figured. I'll try to figure out how to install specific versions using homebrew and move on down the road. Thanks! On Sun, Jul 28, 2013 at 4:22 PM, Ted Yu wrote: > Protobuf 2.5 isn't compatible with 2.4.1 which is the standard used by Hadoop > 2.0 > > On Jul 28, 2013,

Re: Building Hadoop...

Protobuf 2.5 isn't compatible with 2.4.1 which is the standard used by Hadoop 2.0 On Jul 28, 2013, at 1:13 PM, James Carman wrote: > I am on Mac OS X. I've installed protobuf 2.5.0 using homebrew. > However, I'm getting errors like this: > > [ERROR] Failed to execute goal > org.apache.maven.p

Re: Building Hadoop...

I am on Mac OS X. I've installed protobuf 2.5.0 using homebrew. However, I'm getting errors like this: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project hadoop-common: Compilation failure: Compilation failure: [ERROR] /Users/

Re: Building Hadoop...

You should be using libprotoc 2.4.1 Cheers On Sun, Jul 28, 2013 at 7:08 AM, James Carman wrote: > Is there anything special I have to do to get the build working on my > local machine? I have installed protocol buffers and I of course have > Maven/JDK. I am getting compiler errors relating to

Re: Building Hadoop from source code

<3m.mustaq...@gmail.com> To: common-dev , Date: 04/09/2013 08:40 AM Subject: Re: Building Hadoop from source code @Amir, how to compile this?? The process will be same as using "mvn package -Pdist -Dtar -DskipTests" or something else?? On Tue, Apr 9, 2013 at 7

Re: Building Hadoop from source code

Mohammad, Once you've executed a build for a tarball via "mvn package -Pdist -DskipTests -Dtar", then the prepared composite, distributable tarball can be found under the directory hadoop-dist/target/. I'd oppose basing new work on a 1.x branch, as the difference between that one (~3 years old no

Re: Building Hadoop from source code

mad > Mustaqeem ---04/09/2013 08:18:02 AM---@Ling, i am very new. I was about > to ask you the same. > > From: Mohammad Mustaqeem <3m.mustaq...@gmail.com> > To: common-dev , > Date: 04/09/2013 08:18 AM > Subject: Re: Building Hadoop from source code > --

Re: Building Hadoop from source code

08:18 AM Subject: Re: Building Hadoop from source code @Ling, i am very new. I was about to ask you the same. Which version is easy to handle? I want to change something in HDFS. Please, suggest. On Tue, Apr 9, 2013 at 6:29 PM, Ling Kun wrote: > @Mohammad > >Sorry, sin

Re: Building Hadoop from source code

@Ling, i am very new. I was about to ask you the same. Which version is easy to handle? I want to change something in HDFS. Please, suggest. On Tue, Apr 9, 2013 at 6:29 PM, Ling Kun wrote: > @Mohammad > >Sorry, since the internet connection rate I am using is tooo low, It > takes me a l

Re: Building Hadoop from source code

@Mohammad Sorry, since the internet connection rate I am using is tooo low, It takes me a long time to download the tar file you showed above. however, here is some of my opinion based on my local develop env, and i am also a fresh hadooper here. 1. what you have download from t

Re: Building Hadoop from source code

@Ling, Is it the same file as we download from http://apache.techartifact.com/mirror/hadoop/common/ ?? But the tree structure of the build tar file is not same as downloaded from the site. @Ling plz guide me. I have been stuck at this state from 1 month . I didn't find link that explain in detail.

Re: Building Hadoop from source code

@Mohammad: 1. have you successfully run the command Steve suggested? "mvn package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true" 2. If yes, and then you can use the command " find . -name "*tar*" " to find the tar file, which is in the path "./hadoop-dist/target/hadoop-3.0.0-SNAPSHOT.tar.

Re: Building Hadoop from source code

@maisnam, I am using ubuntu and after running svn I get hadoop folder as given in screenshot. I didn't finf any build folder On Tue, Apr 9, 2013 at 5:22 PM, maisnam ns wrote: > @@Mohammad Mustaqeem please ignore the earlier mail as the screenshots > where not copied in the mail I have attached

Re: Building Hadoop from source code

@Mohammad Mustaqeem please follow the screenshots one by one cd build you will find Now cd hadoop-0.20.3-dev you will find the below screenshot Now the bin contains all the scripts you may need to start hadoop 1. Go to that bin directory and format your namenode 2. configure you site-xmls 3.

Re: Building Hadoop from source code

Please, anyone tell me where is the build hadoop?? that can be used to install the hadoop cluster. On Tue, Apr 9, 2013 at 2:32 PM, Mohammad Mustaqeem <3m.mustaq...@gmail.com>wrote: > @Ling, you mean to say to run "find -name *tar*"?? > I run but don't know which file will be used to install Hado

Re: Building Hadoop from source code

@Ling, you mean to say to run "find -name *tar*"?? I run but don't know which file will be used to install Hadoop. @Niranjan I haven't changed anything I just executed "svn checkout http://svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk" to get the Hadoop source code in the "hadoop-trun

Re: Building Hadoop from source code

@Mohammad Mustaqeem - Once you create the patch as given in the 'How to contribute to Hadoop' and apply the patch. The changes will be reflected in the files you have modified. 1.Now you trigger the build ant or maven. I tried with ant so the ant command I gave is ant clean compile bin-package.

Re: Building Hadoop from source code

HI Mohammad, how about using "find" command to find it. Ling Kun On Tue, Apr 9, 2013 at 4:08 PM, Mohammad Mustaqeem <3m.mustaq...@gmail.com>wrote: > @Steve > I am new to Hadoop developement. > Can you please tell me, whats is the location of tar file?? > > > On Tue, Apr 9, 2013 at 12:09 AM,

Re: Building Hadoop from source code

@Steve I am new to Hadoop developement. Can you please tell me, whats is the location of tar file?? On Tue, Apr 9, 2013 at 12:09 AM, Steve Loughran wrote: > On 8 April 2013 16:08, Mohammad Mustaqeem <3m.mustaq...@gmail.com> wrote: > > > Please, tell what I am doing wrong?? > > Whats the problem?

Re: Building Hadoop from source code

On 8 April 2013 16:08, Mohammad Mustaqeem <3m.mustaq...@gmail.com> wrote: > Please, tell what I am doing wrong?? > Whats the problem?? > a lot of these seem to be network-related tests. You can turn off all the tests; look in BUILDING.TXT at the root of the source tree for the various operations,

Re: Building Hadoop from source code

Last lines are - [INFO] BUILD FAILURE [INFO] [INFO] Total time: 33:26.460s [INFO] Finished at: Tue Oct 08 20:37:45 IST 2013 [INFO] Final Memory: 28M/133M [INFO]

Re: Building Hadoop from source code

Please, tell what I am doing wrong?? Whats the problem?? On Mon, Apr 8, 2013 at 8:36 PM, Mohammad Mustaqeem <3m.mustaq...@gmail.com>wrote: > Hi, > I have followed all the steps of > http://wiki.apache.org/hadoop/HowToContribute > and run following command - >

Re: building hadoop under windows

Dne 19.11.2012 18:21, Giridharan Kesavan napsal(a): saveVersion.py is made available with https://issues.apache.org/jira/browse/HADOOP-8924 what are merge plans for trunk? Using jython to run it from maven?

Re: building hadoop under windows

saveVersion.py is made available with https://issues.apache.org/jira/browse/HADOOP-8924 -Giri -- Forwarded message -- From: Radim Kolar Date: Mon, Nov 19, 2012 at 7:44 AM Subject: building hadoop under windows To: common-dev@hadoop.apache.org saveVersion.sh prevents hadoop fro

Re: Building Hadoop UI

Hi Harsh, thanks for your feedback, I'm really interested in the new HUE branch. Our clients are always looking for something customized, which is difficult to achieve sometimes if we don't have something that we can re-use. Our goal is to create a sort of template structure and build our app on

Re: Building Hadoop UI

You might want to get involved in Apache Ambari: http://incubator.apache.org/ambari/ Ambari aims to provide install, configuration and management (including dashboards etc.). For what you are looking for, Ambari uses metrics from various projects in Hadoop ecosystem (hadoop, hbase etc.) to draw

Re: Building Hadoop UI

Hi Fabio, Hue is OSS and ASL-ed, and you can re-use the thrift bindings it uses to communicate with the various daemons via plugins, and then feed information into its UIs. I do think you can easily separate out the desktop UI and the backend (thrift binding) parts, and plug in your own UI layers

Re: building hadoop

On 18/11/11 11:02, mohmmadanis moulavi wrote: I want to build it offline anyway yes, and what everyone is saying is "to do this you need to have cached locally every artifact that the ivy-based build process downloads". This can be done by -doing an online build -getting someone else t

Re: building hadoop

I want to build it offline anyway   Thanks & Regards, Mohmmadanis Moulavi From: Prashant Sharma To: common-dev@hadoop.apache.org; mohmmadanis moulavi Sent: Friday, 18 November 2011 4:10 PM Subject: Re: building hadoop Bypassing dependency resolve

Re: building hadoop

>> >> Mohmmadanis Moulavi >> >> >> >> >> From: Prashant Sharma >> To: common-dev@hadoop.apache.org; mohmmadanis moulavi < >> anis_moul...@yahoo.co.in> >> Sent: Friday, 18 November 2011 12:

Re: building hadoop

Thanks & Regards, > > Mohmmadanis Moulavi > > > > > From: Prashant Sharma > To: common-dev@hadoop.apache.org; mohmmadanis moulavi < > anis_moul...@yahoo.co.in> > Sent: Friday, 18 November 2011 12:34 PM > Subject: Re: building hadoop > > I think y

Re: building hadoop

12:34 PM Subject: Re: building hadoop I think you should build it online for first time. On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi < anis_moul...@yahoo.co.in> wrote: > Friends, > > > > I have modified the source program of hadoop 0.20.2, and i want to build &

Re: building hadoop

I think you should build it online for first time. On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi < anis_moul...@yahoo.co.in> wrote: > Friends, > > > > I have modified the source program of hadoop 0.20.2, and i want to build > it using "ant" but it's not working . > > > > I use the follo

Re: Building hadoop-common, hadoop-hdfs, hadoop-mapreduce from source, without using the hadoop Ivy / Maven repositories

Check http://wiki.apache.org/hadoop/HowToContribute look for "Changes that span projects" section On Thu, May 20, 2010 at 07:28AM, Andrei Dragomir wrote: > I have some issues with compiling hadoop-common, hdfs and mapreduce from > source. > > Right now, the hdfs and mapreduce builds are broken