RE: Writing output in multiple files in Hadoop

2011-12-27 Thread Devaraj K
Can you check the MultipleOutputs class. http://hadoop.apache.org/common/docs/r0.20.205.0/api/org/apache/hadoop/mapre d/lib/MultipleOutputs.html Devaraj K -Original Message- From: Bhavesh Shah [mailto:bhavesh25s...@gmail.com] Sent: Tuesday, December 27, 2011 3:29 PM To: hadoop

RE: Help a newbie on patch submission

2012-04-03 Thread Devaraj k
I tried applying your patches in my environment, It works fine. The issue with Hadoop QA may be because of having -M (^M) characters in the patch file. Can you try by removing the -M (^M) chars in the patch. Thanks Devaraj From: Mostafa Elhemali [mosta

RE: Reduce side join - Hadoop default - error in combiner

2012-04-17 Thread Devaraj k
Hi Lopez, You need to have default constructor for TaggedWritable because while deserializing it creates instance using default constructor and calls the readFields() on it. Thanks Devaraj From: LopezGG [lopezgilsi...@gmail.com] Sent: Wednesday, Apr

RE: Error related Hadoop

2012-04-26 Thread Devaraj k
This can be due to any of these reasons, 1. No DataNode instances being up and running. 2. The DataNode instances cannot talk to the server, through networking or Hadoop configuration problems. 3. Your DataNode instances have no hard disk space in their configured data directories. 4. Your Da

RE: contributing as student

2012-05-29 Thread Devaraj k
Good to hear Hasan. Welcome to the Hadoop community. You can find more details in the below link for how to contribute. http://wiki.apache.org/hadoop/HowToContribute Thanks Devaraj From: Hasan Gürcan [hasan.guer...@googlemail.com] Sent: Tuesday, May 2

Re: Hadoop latest code not working in Eclipse

2013-06-17 Thread Devaraj k
And also you need to run the command >mvn eclipse:eclipse You can go through this page http://wiki.apache.org/hadoop/EclipseEnvironment Thanks Devaraj K On 6/17/13, Chandrashekhar Kotekar wrote: > Hi, > > Just now I checked out latest hadoop code from SVN and imported all the &

RE: Heads up: branch-2.1-beta

2013-06-19 Thread Devaraj k
Hi Arun, Is there any possibility of including YARN-41 in this release. Thanks Devaraj K -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: 19 June 2013 12:29 To: mapreduce-...@hadoop.apache.org; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org

RE: [VOTE] Release Apache Hadoop 0.23.9

2013-07-08 Thread Devaraj k
+1, downloaded the release, verified signs, ran examples and succeeded. Thanks Devaraj k -Original Message- From: Thomas Graves [mailto:tgra...@yahoo-inc.com] Sent: 01 July 2013 22:50 To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org

RE: [VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

2013-08-21 Thread Devaraj k
+1 I downloaded and ran some examples, It works fine. Thanks Devaraj k -Original Message- From: Konstantin Boudnik [mailto:c...@apache.org] Sent: 16 August 2013 11:00 To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; yarn

RE: New dev. environment issue

2013-09-03 Thread Devaraj k
You could also refer this for the build steps. http://svn.apache.org/repos/asf/hadoop/common/trunk/BUILDING.txt Thanks Devaraj k From: Matt Fellows [mailto:matt.fell...@bespokesoftware.com] Sent: 03 September 2013 12:40 To: common-dev@hadoop.apache.org Subject: Re: New dev. environment issue

RE: [VOTE] Release Apache Hadoop 2.2.0

2013-10-09 Thread Devaraj k
+1 (non-binding) I verified by running some mapreduce examples, it works fine. Thanks Devaraj k -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: 07 October 2013 12:31 To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Devaraj K
+1 Thanks Devaraj K On Tue, Jun 24, 2014 at 2:23 PM, Arun C Murthy wrote: > Folks, > > As discussed, I'd like to call a vote on changing our by-laws to change > release votes from 7 days to 5. > > I've attached the change to by-laws I'm proposing. > >

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-24 Thread Devaraj K
tp://svn.apache.org/viewvc/hadoop/common/tags/release-0.23.11-rc0/ > > The maven artifacts are available via repository.apache.org. > > Please try the release and vote; the vote will run for the usual 7 days > til June 26th. > > I am +1 (binding). > > thanks, > Tom Graves > > > > > -- Thanks Devaraj K

Re: [VOTE] Migration from subversion to git for version control

2014-08-10 Thread Devaraj K
ould be a "Adoption of New Codebase" kind of > vote and will be Lazy 2/3 majority of PMC members. > -- Thanks Devaraj K

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-02 Thread Devaraj K
+1 Thanks Wangda for the proposal. I would like to participate in this project, Please add me also to the project. Regards Devaraj K On Mon, Sep 2, 2019 at 8:50 PM zac yuan wrote: > +1 > > Submarine will be a complete solution for AI service development. It can > take advantage

Re: [VOTE] Release Apache Hadoop 2.7.1 RC0

2015-06-29 Thread Devaraj K
t;>> *http://people.apache.org/~vinodkv/hadoop-2.7.1-RC0/ > >>>>>> <http://people.apache.org/~vinodkv/hadoop-2.7.1-RC0/>* > >>>>>> > >>>>>> The RC tag in git is: release-2.7.1-RC0 > >>>>>> > >>>>>> The maven artifacts are available via repository.apache.org at > >>>>>> * > >>>>> > >>>>> > https://repository.apache.org/content/repositories/orgapachehadoop-101 > >>>>>9/ > >>>>>> < > >>>>> > >>>>> > https://repository.apache.org/content/repositories/orgapachehadoop-101 > >>>>>9/ > >>>>> * > >>>>>> > >>>>>> Please try the release and vote; the vote will run for the usual 5 > >>>> days. > >>>>>> > >>>>>> Thanks, > >>>>>> Vinod > >>>>>> > >>>>>> PS: It took 2 months instead of the planned [1] 2 weeks in getting > >>>>>>this > >>>>>> release out: post-mortem in a separate thread. > >>>>>> > >>>>>> [1]: A 2.7.1 release to follow up 2.7.0 > >>>>>> http://markmail.org/thread/zwzze6cqqgwq4rmw > >>>>> > >>>>> > >>>> > >> > >> > >> > >> -- > >> Lei (Eddy) Xu > >> Software Engineer, Cloudera > >> > > > > > > -- Thanks Devaraj K

Re: IMPORTANT: automatic changelog creation

2015-07-03 Thread Devaraj K
>> > >> > >> > >> On Thursday, April 2, 2015 12:57 PM, Allen Wittenauer < > >> > >> a...@altiscale.com > wrote: > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> On Apr 2, 2015, at 12:40 PM, Vinod Kumar Vavilapalli < > >> > >> vino...@hortonworks.com > wrote: > >> > >> > >> > >> > > >> > >> > We'd then doing two commits for every patch. Let's simply not > remove > >> > >> CHANGES.txt from trunk, keep the existing dev workflow, but doc the > >> > >>release > >> > >> process to remove CHANGES.txt in trunk at the time of a release > going > >> > >>out > >> > >> of trunk. > >> > >> > >> > >> > >> > >> > >> > >> Might as well copy branch-2¹s changes.txt into trunk then. (or > 2.7¹s. > >> > >> Last I looked, people updated branch-2 and not 2.7¹s or vice versa > for > >> > >>some > >> > >> patches that went into both branches.) So that folks who are > >> > >>committing to > >> > >> both branches and want to cherry pick all changes can. > >> > >> > >> > >> I mean, trunk¹s is very very very wrong. Right now. Today. > Borderline > >> > >> useless. See HADOOP-11718 (which I will now close out as won¹t > fix)Š > >> and > >> > >> that jira is only what is miscategorized, not what is missing. > >> > >> > >> > >> > >> > >> > >> > >> > >> > > >> > > >> > >> -- > >> Mobile > >> > > -- Thanks Devaraj K

[jira] [Created] (HADOOP-8438) hadoop-validate-setup.sh refers to examples jar file which doesn't exist

2012-05-25 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-8438: - Summary: hadoop-validate-setup.sh refers to examples jar file which doesn't exist Key: HADOOP-8438 URL: https://issues.apache.org/jira/browse/HADOOP-8438 Project: H

[jira] [Created] (HADOOP-8439) Update hadoop-setup-conf.sh to support yarn configurations

2012-05-25 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-8439: - Summary: Update hadoop-setup-conf.sh to support yarn configurations Key: HADOOP-8439 URL: https://issues.apache.org/jira/browse/HADOOP-8439 Project: Hadoop Common

[jira] [Created] (HADOOP-8578) Provide a mechanism for cleaning config items from LocalDirAllocator which will not be used anymore

2012-07-08 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-8578: - Summary: Provide a mechanism for cleaning config items from LocalDirAllocator which will not be used anymore Key: HADOOP-8578 URL: https://issues.apache.org/jira/browse/HADOOP-8578

[jira] Created: (HADOOP-7086) Retrying socket connection failure times can be made as configurable

2011-01-05 Thread Devaraj K (JIRA)
Type: Improvement Components: conf Affects Versions: 0.21.0 Environment: NA Reporter: Devaraj K Priority: Minor Fix For: 0.22.0 Retrying socket connection failure times are hard coded as 45 and it is giving the retryring message for 45

[jira] Created: (HADOOP-7130) Map Reduce Tasks are continously failing, when one among the several harddisks available on the TaskTracker fails.

2011-02-03 Thread Devaraj K (JIRA)
://issues.apache.org/jira/browse/HADOOP-7130 Project: Hadoop Common Issue Type: Bug Components: fs Affects Versions: 0.20.2 Reporter: Devaraj K 1. Pull out one hard disk from Task tracker node (out of 10 disks pull one). Now it is noted that some jobs

[jira] Created: (HADOOP-7194) Potential Resource leak in IOUtils.java

2011-03-16 Thread Devaraj K (JIRA)
: 0.23.0 Reporter: Devaraj K {code:title=IOUtils.java|borderStyle=solid} try { copyBytes(in, out, buffSize); } finally { if(close) { out.close(); in.close(); } } {code} In the above code if any exception throws from the out.close() statement

[jira] [Created] (HADOOP-7618) start-dfs.sh and stop-dfs.sh are not working properly

2011-09-09 Thread Devaraj K (JIRA)
: scripts Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K Fix For: 0.24.0 When we execute start-dfs.sh, it is gving the below error. {code:xml} linux124:/home/devaraj/NextGenMR/Hadoop-0.24-09082011/hadoop-hdfs-0.24.0-SNAPSHOT/sbin

[jira] [Resolved] (HADOOP-9794) dsdfyy

2013-07-29 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved HADOOP-9794. --- Resolution: Invalid If you find any bug in Hadoop, please raise JIRA. > dsd

[jira] [Created] (HADOOP-15935) [JDK 11] Update maven.plugin-tools.version to 3.6.0

2018-11-14 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-15935: -- Summary: [JDK 11] Update maven.plugin-tools.version to 3.6.0 Key: HADOOP-15935 URL: https://issues.apache.org/jira/browse/HADOOP-15935 Project: Hadoop Common

[jira] [Created] (HADOOP-15936) [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier

2018-11-14 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-15936: -- Summary: [JDK 11] MiniDFSClusterManager & MiniHadoopClusterManager compilation fails due to the usage of '_' as identifier Key: HADOOP-15936 URL: https://issues.a

[jira] [Created] (HADOOP-15937) [JDK 11] Update maven-shade-plugin.version to 3.2.1

2018-11-14 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-15937: -- Summary: [JDK 11] Update maven-shade-plugin.version to 3.2.1 Key: HADOOP-15937 URL: https://issues.apache.org/jira/browse/HADOOP-15937 Project: Hadoop Common

[jira] [Created] (HADOOP-15938) [JDK 11] hadoop-annotations build fails with 'Failed to check signatures'

2018-11-15 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-15938: -- Summary: [JDK 11] hadoop-annotations build fails with 'Failed to check signatures' Key: HADOOP-15938 URL: https://issues.apache.org/jira/browse/HADOOP-15938

[jira] [Created] (HADOOP-16046) [JDK 11] hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/hamlet classes make compilation fail

2019-01-11 Thread Devaraj K (JIRA)
Devaraj K created HADOOP-16046: -- Summary: [JDK 11] hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/webapp/hamlet classes make compilation fail Key: HADOOP-16046 URL: https

[jira] [Resolved] (HADOOP-4160) Job tracker browser log shows "XML Parsing Error" when job runs with 0 map and 0 reduce

2012-01-28 Thread Devaraj K (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-4160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved HADOOP-4160. --- Resolution: Duplicate Duplicate of MAPREDUCE-2903. > Job tracker browser log sh

[jira] [Created] (HADOOP-8004) Multiple SLF4J binding message in .out file for all daemons

2012-01-30 Thread Devaraj K (Created) (JIRA)
Components: build Affects Versions: 0.24.0, 0.23.1 Reporter: Devaraj K {code:xml} SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/hadoop/install/hadoop-0.23.1-SNAPSHOT/share/hadoop/common/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl

[jira] [Created] (HADOOP-8177) MBeans shouldn't try to register when it fails to create MBeanName

2012-03-15 Thread Devaraj K (Created) (JIRA)
Type: Bug Components: metrics Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K {code:title=MBeans.java|borderStyle=solid} static public ObjectName register(String serviceName, String nameName, Object the

[jira] [Created] (HADOOP-8282) start-all.sh refers incorrectly start-dfs.sh existence for starting start-yarn.sh

2012-04-16 Thread Devaraj K (Created) (JIRA)
: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 2.0.0, 3.0.0 Reporter: Devaraj K Assignee: Devaraj K Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please

[jira] [Created] (HADOOP-7685) Issues with hadoop-common-project\hadoop-common\src\main\packages\hadoop-setup-conf.sh file

2011-09-27 Thread Devaraj K (Created) (JIRA)
Project: Hadoop Common Issue Type: Bug Components: scripts Affects Versions: 0.24.0 Reporter: Devaraj K Assignee: Devaraj K hadoop-common-project\hadoop-common\src\main\packages\hadoop-setup-conf.sh has following issues 1. check_permission