RE: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Bikas Saha
+1 (binding). Ran it with Apache Tez. I agree with Suresh about including only critical regressions/bugs at this point. The less code we change the less new bugs we bring in at the last moment. Bikas -Original Message- From: Jonathan Eagles [mailto:jeag...@gmail.com] Sent: Monday, April

RE: Force reducer to execute on a specific host

2013-11-25 Thread Bikas Saha
I would suggest using the AMRMClient/AMRMClientAsync libraries for this kind of work. They take care of all the nuances like these. Please also file a jira for the RM crash. That should not be happening. Thanks! Bikas -Original Message- From: Grandl Robert [mailto:rgra...@yahoo.com] Sent

RE: Combiner Execution

2013-10-22 Thread Bikas Saha
+1. A node level or rack level or any level intermediate combiner is fairly straightforward to add in Tez. Please carry over your question to the Apache Tez dev mailing list d...@tez.incubator.apache.org if you are interested in following that path. Bikas -Original Message- From: go...@ho

RE: [VOTE] Release Apache Hadoop 2.2.0

2013-10-10 Thread Bikas Saha
+1 (non binding) -Original Message- From: Arpit Gupta [mailto:ar...@hortonworks.com] Sent: Thursday, October 10, 2013 10:06 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Had

RE: windows support in trunk?

2013-09-25 Thread Bikas Saha
Windows > SDK and build from an SDK command prompt. This is documented in > BUILDING.txt. > Please feel free to email the dev list if you get stuck at any step. > > > On Tue, Sep 24, 2013 at 10:31 PM, Bikas Saha > wrote: > > > BUILDING.txt in the source code has a se

RE: windows support in trunk?

2013-09-24 Thread Bikas Saha
BUILDING.txt in the source code has a section for building on Windows. Bikas -Original Message- From: Andrey Klochkov [mailto:akloch...@griddynamics.com] Sent: Tuesday, September 24, 2013 5:11 PM To: common-dev Subject: Re: windows support in trunk? Great, thanks! One more question on W

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-22 Thread Bikas Saha
+1 (non-binding) Bikas -Original Message- From: Hitesh Shah [mailto:hit...@apache.org] Sent: Wednesday, August 21, 2013 4:25 PM To: yarn-...@hadoop.apache.org; Arun Murthy Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Rel

RE: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-31 Thread Bikas Saha
+1. Using it locally for Tez. Bikas -Original Message- From: Arun C Murthy [mailto:a...@hortonworks.com] Sent: Tuesday, July 30, 2013 6:30 AM To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: [VOTE] Release

RE: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Bikas Saha
I am +1 to the proposal because it maintains the original cadence a bunch of us committers/contributors have been working with. Windows related changes have been made in a conservative manner so as not to destabilize the code base. The changes are being extensively tested and validated by communit

RE: Building branch-1-win, Starting Datanode on Windows

2013-03-04 Thread Bikas Saha
I don't think you need to manually set permissions on Hadoop directories. Did you build the native windows executable in your build? Do you see any exceptions mentioning winutils? Bikas -Original Message- From: Daniel Jones [mailto:daniel.jo...@opencredo.com] Sent: Monday, March 04, 2013

RE: [Vote] Merge branch-trunk-win to trunk

2013-03-01 Thread Bikas Saha
ck, including scale tests. This is made possible only with the contribution from many many folks in the community. Following people contributed to this work: Ivan Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli,

RE: [Vote] Merge branch-trunk-win to trunk

2013-02-26 Thread Bikas Saha
Mitic, Chuan Liu, Ramya Sunil, Bikas Saha, Kanna Karanam, John Gordon, Brandon Li, Chris Nauroth, David Lao, Sumadhur Reddy Bolli, Arpit Agarwal, Ahmed El Baz, Mike Liddell, Jing Zhao, Thejas Nair, Steve Maine, Ganeshan Iyer, Raja Aluri, Giridharan Kesavan, Ramya Bharathi Nimmagadda, Daryn Sharp, Arun

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-29 Thread Bikas Saha
+1, +1, +1 (non-binding) We have had promising results for 1 and 2 when porting to Windows. 3 would allow us to remove platform dependencies from test code. Agree that there might be some nuanced operations that require OS specific environments but this would lead to keeping them at a minimum. Bi

[jira] [Created] (HADOOP-8879) TestUserGroupInformation fails on Windows when runas Administrator

2012-10-03 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8879: -- Summary: TestUserGroupInformation fails on Windows when runas Administrator Key: HADOOP-8879 URL: https://issues.apache.org/jira/browse/HADOOP-8879 Project: Hadoop

[jira] [Created] (HADOOP-8847) Change untar to use Java API instead of spawning tar process

2012-09-25 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8847: -- Summary: Change untar to use Java API instead of spawning tar process Key: HADOOP-8847 URL: https://issues.apache.org/jira/browse/HADOOP-8847 Project: Hadoop Common

[jira] [Created] (HADOOP-8836) UGI should throw exception in case winutils.exe cannot be loaded

2012-09-24 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8836: -- Summary: UGI should throw exception in case winutils.exe cannot be loaded Key: HADOOP-8836 URL: https://issues.apache.org/jira/browse/HADOOP-8836 Project: Hadoop Common

[jira] [Resolved] (HADOOP-8250) Investigate uses of FileUtil and functional correctness based on current use cases

2012-09-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved HADOOP-8250. Resolution: Won't Fix Multiple other jiras have superceded this. > Inv

[jira] [Resolved] (HADOOP-8536) Problem with -Dproperty=value option on windows hadoop

2012-09-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved HADOOP-8536. Resolution: Duplicate Dup of HADOOP-8739 > Problem with -Dproperty=value opt

[jira] [Created] (HADOOP-8739) Cmd scripts for Windows have issues in argument parsing

2012-08-27 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8739: -- Summary: Cmd scripts for Windows have issues in argument parsing Key: HADOOP-8739 URL: https://issues.apache.org/jira/browse/HADOOP-8739 Project: Hadoop Common

[jira] [Created] (HADOOP-8664) hadoop streaming job need the full path to commands even when they are in the path

2012-08-08 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8664: -- Summary: hadoop streaming job need the full path to commands even when they are in the path Key: HADOOP-8664 URL: https://issues.apache.org/jira/browse/HADOOP-8664

[jira] [Created] (HADOOP-8657) TestCLI fails on Windows because it uses hardcoded file length of test files committed to the source code

2012-08-06 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8657: -- Summary: TestCLI fails on Windows because it uses hardcoded file length of test files committed to the source code Key: HADOOP-8657 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Created] (HADOOP-8646) Avoid logging "Cannot run program getconf" on Windows

2012-08-02 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8646: -- Summary: Avoid logging "Cannot run program getconf" on Windows Key: HADOOP-8646 URL: https://issues.apache.org/jira/browse/HADOOP-8646 Project: Had

[jira] [Created] (HADOOP-8645) Stabilize branch-1-win

2012-08-02 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8645: -- Summary: Stabilize branch-1-win Key: HADOOP-8645 URL: https://issues.apache.org/jira/browse/HADOOP-8645 Project: Hadoop Common Issue Type: Task

[jira] [Created] (HADOOP-8618) Windows build failing after 1.0.3 got merged into branch-1-win

2012-07-24 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8618: -- Summary: Windows build failing after 1.0.3 got merged into branch-1-win Key: HADOOP-8618 URL: https://issues.apache.org/jira/browse/HADOOP-8618 Project: Hadoop Common

[jira] [Created] (HADOOP-8562) Enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments

2012-07-05 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8562: -- Summary: Enhancements to Hadoop for Windows Server and Windows Azure development and runtime environments Key: HADOOP-8562 URL: https://issues.apache.org/jira/browse/HADOOP-8562

[jira] [Resolved] (HADOOP-8486) Resource leak - Close the open resource handles (File handles) before throwing the exception from the SequenceFile constructor

2012-06-26 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved HADOOP-8486. Resolution: Fixed > Resource leak - Close the open resource handles (File handles) bef

Branch for Hadoop on Windows

2012-06-21 Thread Bikas Saha
Hi, branch-1-win was created to stage the work needed to make Hadoop run natively on Windows. There has been great progress on it that all of us can try out. As that work nears completion, I would like have a corresponding branch-trunk-win created to port the work to trunk. Thanks Bikas

[jira] [Resolved] (HADOOP-8409) Fix TestCommandLineJobSubmission and TestGenericOptionsParser to work for windows

2012-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved HADOOP-8409. Resolution: Fixed > Fix TestCommandLineJobSubmission and TestGenericOptionsParser to work

[jira] [Reopened] (HADOOP-8486) Resource leak - Close the open resource handles (File handles) before throwing the exception from the SequenceFile constructor

2012-06-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha reopened HADOOP-8486: This has caused build failure because Path.getUriPath is no longer available. [javac] c:\Users

[jira] [Created] (HADOOP-8492) Rename ProcessTree.isSetsidAvailable

2012-06-07 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8492: -- Summary: Rename ProcessTree.isSetsidAvailable Key: HADOOP-8492 URL: https://issues.apache.org/jira/browse/HADOOP-8492 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8424) Web UI broken on Windows because classpath not setup correctly

2012-05-22 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8424: -- Summary: Web UI broken on Windows because classpath not setup correctly Key: HADOOP-8424 URL: https://issues.apache.org/jira/browse/HADOOP-8424 Project: Hadoop Common

[jira] [Created] (HADOOP-8421) Verify and fix build of c++ targets in Hadoop on Windows

2012-05-21 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8421: -- Summary: Verify and fix build of c++ targets in Hadoop on Windows Key: HADOOP-8421 URL: https://issues.apache.org/jira/browse/HADOOP-8421 Project: Hadoop Common

[jira] [Created] (HADOOP-8420) saveVersions.sh not working on Windows

2012-05-21 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8420: -- Summary: saveVersions.sh not working on Windows Key: HADOOP-8420 URL: https://issues.apache.org/jira/browse/HADOOP-8420 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8401) Investigate use of JobObject to spawn tasks on Windows

2012-05-15 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8401: -- Summary: Investigate use of JobObject to spawn tasks on Windows Key: HADOOP-8401 URL: https://issues.apache.org/jira/browse/HADOOP-8401 Project: Hadoop Common

[jira] [Created] (HADOOP-8374) Improve support for hard link manipulation on Windows

2012-05-09 Thread Bikas Saha (JIRA)
Bikas Saha created HADOOP-8374: -- Summary: Improve support for hard link manipulation on Windows Key: HADOOP-8374 URL: https://issues.apache.org/jira/browse/HADOOP-8374 Project: Hadoop Common

[jira] [Created] (HADOOP-8250) Investigate compatibility of symlink usage

2012-04-05 Thread Bikas Saha (Created) (JIRA)
Affects Versions: 1.1.0 Reporter: Bikas Saha Assignee: Bikas Saha Fix For: 1.1.0 The current Windows patch replaces symlink with copy. This jira tracks understanding the implications of this on expected functionality. -- This message is automatically generated by

[jira] [Created] (HADOOP-8235) Support file permissions and ownership on Windows for RawLocalFileSystem

2012-03-30 Thread Bikas Saha (Created) (JIRA)
Issue Type: Sub-task Components: native Affects Versions: 1.1.0 Reporter: Bikas Saha Assignee: Bikas Saha The initial patch submitted on HADOOP-8223 does not have ability to set file permissions on Windows. This is causing tests to fail. Jira tracks adding

[jira] [Created] (HADOOP-8234) Enable user group mappings on Windows

2012-03-30 Thread Bikas Saha (Created) (JIRA)
Versions: 1.0.0 Reporter: Bikas Saha Assignee: Bikas Saha The initial patch submitted is missing mapping of users to groups. A number of test failures are related to this. The jira tracks adding this support. -- This message is automatically generated by JIRA. If you think it