Re: [DISCUSS] Removing the archiac master branch

2020-06-19 Thread Matt Foley
+1 Thanks Owen. —Matt — Open Source Technologies @  `This is not a contribution.` On Jun 19, 2020, at 10:19 AM, Owen O'Malley wrote: We unfortunately have a lot of master/slave and whitelist/blacklist terminology usage in Hadoop. It will take a while to fix them all, but one is easy to

Re: [Discuss] Hadoop-Ozone repository mailing list configurations

2019-10-23 Thread Matt Foley
Definitely yes on ‘ozone-issues’. Whether we want to keep ozone-dev and hdfs-dev together or separate, I’m neutral. Thanks, —Matt On Oct 23, 2019, at 2:11 PM, Elek, Marton wrote: Thanks to report this problem Rohith, Yes, it seems to be configured with the wrong mailing list. I think the rig

Re: Compile 64bit native Hadoop 3.2.0 binaries for AIX 7.1

2019-09-17 Thread Matt Foley
Hi Candy, It’s possible that you’ve already tried the below, but one can’t tell from your message, so here goes: 1. Presumably you’ve read https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/NativeLibraries.html Admittedly it doesn’t answer your question, but it does point ou

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Matt Foley
Sorry I won’t be able to come today; a work meeting interferes. —Matt On Sep 4, 2019, at 9:10 AM, Wei-Chiu Chuang wrote: It's a short week so I didn't set up a predefined topic to discuss. What should we be discussing? How about Erasure Coding? I'm starting to see tricky EC bug reports coming i

Re: Hadoop storage community online sync

2019-08-22 Thread Matt Foley
+1 for publishing notes. Thanks! On Aug 21, 2019, at 4:16 PM, Aaron Fabbri wrote: Thank you Wei-Chiu for organizing this and sending out notes! On Wed, Aug 21, 2019 at 1:10 PM Wei-Chiu Chuang mailto:weic...@apache.org>> wrote: > We had a great turnout today, thanks to Konstantin for leading t

Re: Hadoop Community Sync Up Schedule

2019-08-22 Thread Matt Foley
Wangda and Eric, We can express the intent, I think, by scheduling two recurring meetings: - monthly, on the 2nd Wednesday, and - monthly, on the 4th Wednesday. This is pretty easy to understand, and not too onerous to maintain. But I’m okay with simple bi-weekly too. I’m neutral on 10 vs 11am, P

Re: Hadoop Community Sync Up Schedule

2019-08-20 Thread Matt Foley
Hi Wangda, thanks for this. A question about the schedule correction: > > 1) In the proposal, repeats are not properly. (I used bi-weekly instead of > 2nd/4th week as repeat frequency). I'd like to fix the frequency on Thu and > it will take effect starting next week. I understand that “bi-weekly

[jira] [Resolved] (HADOOP-16166) TestRawLocalFileSystemContract fails with build Docker container running on Mac

2019-03-13 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-16166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-16166. - Resolution: Fixed > TestRawLocalFileSystemContract fails with build Docker container runn

[jira] [Created] (HADOOP-16166) TestRawLocalFileSystemContract fails with build Docker container running on Mac

2019-03-04 Thread Matt Foley (JIRA)
Matt Foley created HADOOP-16166: --- Summary: TestRawLocalFileSystemContract fails with build Docker container running on Mac Key: HADOOP-16166 URL: https://issues.apache.org/jira/browse/HADOOP-16166

[jira] [Resolved] (HADOOP-7809) Backport HADOOP-5839 to 0.20-security - fixes to ec2 scripts to allow remote job submission

2019-01-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-7809. Resolution: Won't Do Aged out. > Backport HADOOP-5839 to 0.20-security - fixes to ec2 sc

[jira] [Resolved] (HADOOP-9359) Add Windows build and unit test to test-patch pre-commit testing

2019-01-03 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-9359. Resolution: Won't Fix Closed due to evident insufficient interest. > Add Windows build

[jira] [Created] (HADOOP-13382) remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects

2016-07-15 Thread Matt Foley (JIRA)
Matt Foley created HADOOP-13382: --- Summary: remove unneeded commons-httpclient dependencies from POM files in Hadoop and sub-projects Key: HADOOP-13382 URL: https://issues.apache.org/jira/browse/HADOOP-13382

[jira] [Resolved] (HADOOP-12617) SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal

2015-12-08 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-12617. - Resolution: Fixed Fix Version/s: 2.8.0 > SPNEGO authentication request to non-defa

[jira] [Created] (HADOOP-12617) SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal

2015-12-06 Thread Matt Foley (JIRA)
Matt Foley created HADOOP-12617: --- Summary: SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal Key: HADOOP-12617 URL: https://issues.apache.org/jira/browse

Re: Dropping support for JDK6 in Apache Hadoop

2014-08-19 Thread Matt Foley
Yes, in terms of forward compatibility, my company has been certifying the current Hadoop-related stack on JDK7 (both Oracle and OpenJDK) for some time. No problems there, in our experience. For stopping supporting JDK6 in the near future, and enabling JDK7 feature usage, +1. --Matt On Tue, Au

Re: [ANNOUNCE] Hadoop version 1.2.1 (stable) released

2013-08-05 Thread Matt Foley
t. too > bad there isn't some 'stable' link that itself is updated to the actual > stable release. > > we do this now with all of the cascading artifacts. it prevents automated > things from breaking immediately. > > http://files.cascading.org/sdk/2.1/latest.txt &

Re: [ANNOUNCE] Hadoop version 1.2.1 (stable) released

2013-08-05 Thread Matt Foley
ty, 1.2.1 will of course remain as the "stable" version. --Matt On Mon, Aug 5, 2013 at 9:43 AM, Chris K Wensel wrote: > any particular reason the 1.1.2 releases were pulled from the mirrors (so > quickly)? > > On Aug 4, 2013, at 2:08 PM, Matt Foley wrote: > > > I&

Re: [ANNOUNCE] Hadoop version 1.2.1 (stable) released

2013-08-04 Thread Matt Foley
>> which will include Windows native compatibility. My apologies, this was incorrect. Windows has only been integrated to trunk and branch-2.1. Thanks, --Matt On Sun, Aug 4, 2013 at 2:08 PM, Matt Foley wrote: > I'm happy to announce that Hadoop version 1.2.1 has passed its

[ANNOUNCE] Hadoop version 1.2.1 (stable) released

2013-08-04 Thread Matt Foley
I'm happy to announce that Hadoop version 1.2.1 has passed its release vote and is now available. It has 18 bug fixes and patches over the previous 1.2.0 release; please see Hadoop 1.2.1 Release Notesfor details. This release of Hadoop-1.2 i

Re: [VOTE] Hadoop 1.2.1 release candidate 0 -- stable release

2013-08-01 Thread Matt Foley
al node cluster. > > > On Wed, Jul 24, 2013 at 2:08 PM, Matt Foley wrote: > >> Colleagues, >> This is a stabilization release of the Hadoop-1.2 codeline. It has 18 >> patches over the 1.2.0 release, which may be seen in the Release >> Notes< >> http://peopl

[VOTE] Hadoop 1.2.1 release candidate 0 -- stable release

2013-07-24 Thread Matt Foley
Colleagues, This is a stabilization release of the Hadoop-1.2 codeline. It has 18 patches over the 1.2.0 release, which may be seen in the Release Notes. Please vote on two items: a) accepting this as an Apache Hadoop relea

status of Hadoop release candidate 1.2.1-rc0

2013-07-22 Thread Matt Foley
The proposed RC-0 for Hadoop 1.2.1 has been tagged, and performs satisfactorily wrt Unit Tests. However, my build environment has been bolluxed up by changes in hardware, and I am still having problems building the native-build po

[jira] [Resolved] (HADOOP-9730) fix hadoop.spec to add task-log4j.properties

2013-07-15 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-9730. Resolution: Fixed Fix Version/s: 1.2.1 +1. Thanks, Giri, that fixed the problem

[jira] [Resolved] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-07-06 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-9504. Resolution: Fixed Target Version/s: 0.23.8, 2.1.0-beta, 1.2.1 (was: 2.1.0-beta, 0.23.8

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Matt Foley
Hi Cos, I would also request that you renumber the release candidate to just three-numbers, hence "2.0.5-alpha". Arun, are you willing to start the 2.1.x name-space for your next release, so that 2.0.x-alpha can become an intermediate stabilization branch as Cos and Konst want? I just think that

[RELEASE PLAN] Hadoop 1.2.1 stabilization RC on about 6/7

2013-05-30 Thread Matt Foley
Colleagues, Next weekend, starting the evening of Friday 7 June, a week from tomorrow, I plan to cut a hadoop-1.2.1-rc0 from the branch-1.2 branch. This is intended to be a stabilization release of 1.2. I request that major new back-ports, or any change with significant risk, be put in branch-1 f

[VOTE Results] change in bylaws to remove Release Plan vote

2013-05-29 Thread Matt Foley
The vote closed last night, with very positive results: +1 binding: 14 +1 non-binding: 12 -1 or 0: none I'll work with Chris to get the Bylaws doc changed, but the change is effective as of 7:05pm PDT May 28, 2013. Many thanks, --Matt On Wed, May 22, 2013 at 2:04 AM, Matt Foley

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-22 Thread Matt Foley
Hi Jagane, My response to your concerns is that I hope the PMC will have enough wisdom not to pass votes for a confusing number of releases -- if only to avoid the kind of fragmentation you point out could happen. To date, however, this does not seem to have been a major problem in our community.

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-22 Thread Matt Foley
ranches and forks. > > I like the second change defining the role of RM. > Very well formulated, thanks Matt. > > --Konstantin > > > On Tue, May 21, 2013 at 7:01 PM, Matt Foley wrote: > >> Ok, if no one complains I will phrase the vote to include +1's

Re: [VOTE] change in bylaws to remove Release Plan vote

2013-05-22 Thread Matt Foley
Forgot to say: Vote will close one week after it started, at 7:05pm PDT on Tuesday 28 May. Thanks, --Matt On Tue, May 21, 2013 at 7:03 PM, Matt Foley wrote: > This was previously discussed in the thread "[PROPOSAL] change in bylaws > to remove Release Plan vote". 13 people exp

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Matt Foley
Hi Jagane, since you did not explicitly cast a -1 or other numerical vote, please if you wish go ahead and cast a vote in the VOTE thread. Best regards, --Matt On Tue, May 21, 2013 at 3:47 PM, Jagane Sundar wrote: > I see one significant benefit to having Release Plan votes: Fewer releases > wi

[VOTE] change in bylaws to remove Release Plan vote

2013-05-21 Thread Matt Foley
This was previously discussed in the thread "[PROPOSAL] change in bylaws to remove Release Plan vote". 13 people explicitly cast "+1"s in that thread. Absent objection I will count those as votes without requiring them to (re-)respond to this VOTE thread. The following change is proposed in the

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Matt Foley
> On May 21, 2013, at 6:58 PM, "Matt Foley" wrote: > > > 13/14 +1's. I think that constitutes consensus. Moving this to a VOTE > > thread. Please repeat your +1s :-) > > Cheers, > > --Matt > > > > > > On Tue, May 21, 2013 at 5:33 PM, M

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Matt Foley
wrote: > > +1 (non-binding) > > > > > > On Tue, May 21, 2013 at 4:13 PM, Jitendra Pandey > > wrote: > > > >> +1 > >> > >> > >> On Tue, May 21, 2013 at 4:02 PM, Eli Collins wrote: > >> > >> > +1 thanks Matt. &g

Re: [VOTE] - Release 2.0.5-beta

2013-05-21 Thread Matt Foley
I've now started a separate discussion thread in common-dev@, titled "[PROPOSAL] change in bylaws to remove Release Plan vote". If it achieves consensus, I'll put it to a vote to so change the bylaws. Best, --Matt On Sat, May 18, 2013 at 4:22 PM, Chris Douglas wrote: > The "release plan" vote

[PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-21 Thread Matt Foley
Hi all, This has been a side topic in several email threads recently. Currently we have an ambiguity. We have a tradition in the dev community that any committer can create a branch, and propose release candidates from it. Yet the Hadoop bylaws say that releases have to be planned in advance, th

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Matt Foley
I'm actually drafting such a proposal. Will open the discussion as a [PROPOSAL] in general@ --Matt On Wed, May 15, 2013 at 4:44 PM, Arun C Murthy wrote: > > On May 15, 2013, at 3:27 PM, Chris Douglas wrote: > > > +1 (binding) on the proposal. > > > > However, the value we get from these "relea

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Matt Foley
Roman, what is your model for how test results from Bigtop should feed back into Hadoop-2 development? With the understanding that (a) software does have bugs, and (b) you're not going to get an SLA on community-sponsored software, what are your ideas for how to close the loop better? Would "CI" r

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Matt Foley
>> lets fork this thread into the appropriate ML and discuss the practical, achievable >> steps that can be included into the release criteria of Hadoop 2.0.5-beta Seems to me common-dev is the appropriate ML, and Arun has invited Jiras to include. Open a Jira with your suggested list, and we carr

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Matt Foley
>> Arun, not sure whether your "Yes to all" already covered this, but I'd like >> to throw in support for the compatibility guidelines being a blocker. +1 to that. Definitely an overriding concern for me. On Wed, May 15, 2013 at 1:25 PM, Sandy Ryza wrote: > +1 (non-binding) > > Agreed with Bi

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Matt Foley
+1 (binding). I think it's important to maintain the release continuity, otherwise we could end up with the 0.20.2 / 0.20.200 problem all over again (parallel "stable" dev tracks without a parent-child relationship to each other, ie with disjoint subsets of functionality). I consider achieving a

[jira] [Reopened] (HADOOP-9504) MetricsDynamicMBeanBase has concurrency issues in createMBeanInfo

2013-05-13 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HADOOP-9504: Reopened for submission to branch-1.2, per email from [~jlowe] on common-dev@, Sun, May 12, 2013 at

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-13 Thread Matt Foley
t; > On Mon, May 13, 2013 at 5:35 PM, Matt Foley > wrote: > > Thanks for the reference. > > > > Roy's email clearly says that the thing to be voted on should be source > > only. This email is in the context of a discussion about a release > > candidate th

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-13 Thread Matt Foley
PMC is allowed to approve. Elsewhere, > there's clarification that the prohibition is against binaries for > which we don't also distribute source, so (AFAICT) distributing > third-party jars is also not kosher. I'll ask for clarification. -C > > On Mon, May 13, 2013 at 2

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-13 Thread Matt Foley
le to > modify what we distribute. I can try to track down a reference, but > I'm pretty sure on this one... source-only is OK. Some have argued > it's the only acceptable form. -C > > On Mon, May 13, 2013 at 1:36 PM, Matt Foley wrote: > > The vote passed and we hav

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-13 Thread Matt Foley
n Mon, May 13, 2013 at 1:32 PM, Matt Foley wrote: > Hi Chris, > Unless I screwed up my build, hadoop-1.2.0.tar.gz includes the built > artifacts as well as full buildable source and docs. > Hadoop-1.2.0-bin.tar.gz is intended to contain only the built artifacts > ("binaries")

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-13 Thread Matt Foley
> > but hadoop-1.2.0-bin.tar.gz is missing the source code and can't be built. > -C > > On Mon, May 6, 2013 at 11:11 AM, Matt Foley wrote: > > Hi all, > > I have posted the signed tarballs for Hadoop 1.2.0-rc1 at > > http://people.apache.org/~mattf/hadoop-1.2.0-rc1

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-11 Thread Matt Foley
PM, Jason Lowe wrote: > Matt, would you consider adding HADOOP-9504 to the release? Some groups > using HBase have been bitten by this bug and would like to see it in a 1.x > release. > > Jason > > > On 05/10/2013 11:44 AM, Matt Foley wrote: > >> Hi all, >&g

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-10 Thread Matt Foley
Hi all, just a reminder this vote is underway and will close Monday 11:30am. Please review and vote! Thanks, --Matt On Mon, May 6, 2013 at 11:36 AM, Matt Foley wrote: > Friends, > Nexus issues are resolved, and the Nexus staging repository for Hadoop > 1.2.0-rc1 properly uploaded. T

Re: [VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-06 Thread Matt Foley
Friends, Nexus issues are resolved, and the Nexus staging repository for Hadoop 1.2.0-rc1 properly uploaded. Thanks for your patience. --Matt On Mon, May 6, 2013 at 11:11 AM, Matt Foley wrote: > Hi all, > I have posted the signed tarballs for Hadoop 1.2.0-rc1 at > http://people.a

[VOTE] Hadoop release candidate 1.2.0-rc1

2013-05-06 Thread Matt Foley
Hi all, I have posted the signed tarballs for Hadoop 1.2.0-rc1 at http://people.apache.org/~mattf/hadoop-1.2.0-rc1/ Release notes are at: releasenotes_1.2.0-rc1.html I'm having a little trouble with Nexus (it seems to ha

[jira] [Resolved] (HADOOP-9375) Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation failure

2013-05-05 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-9375. Resolution: Fixed > Port HADOOP-7290 to branch-1 to fix TestUserGroupInformation fail

Re: [VOTE] Plan to create release candidate Monday 3/18

2013-03-20 Thread Matt Foley
On Fri, Mar 15, 2013 at 9:53 PM, Robert Evans wrote: > > > +1 > > > > On 3/10/13 10:38 PM, "Matt Foley" wrote: > > > > >Hi all, > > >I have created branch-1.2 from branch-1, and propose to cut the first > > >release candidate for 1.2.

[VOTE] Plan to create release candidate Monday 3/18

2013-03-10 Thread Matt Foley
Hi all, I have created branch-1.2 from branch-1, and propose to cut the first release candidate for 1.2.0 on Monday 3/18 (a week from tomorrow), or as soon thereafter as I can achieve a stable build. Between 1.1.2 and the current 1.2.0, there are 176 patches!! Draft release notes are available at

Re: [PROPOSAL] Hadoop branch-1.2

2013-03-09 Thread Matt Foley
e know if this is correct. In meantime, I'm going to make the branch. We'll just have to commit to both branch-1 and branch-1.2. Thanks, --Matt On Thu, Mar 7, 2013 at 1:29 AM, Steve Loughran wrote: > On 6 March 2013 23:17, Matt Foley wrote: > > > Hi, I got stuck in other work

Re: [PROPOSAL] Hadoop branch-1.2

2013-03-06 Thread Matt Foley
dir,dir/subdir) can lose all data in the source > directory > > https://issues.apache.org/jira/browse/HADOOP-9261 > > I think that should be one to pick up -it and the extended test are still > be reviewed > > On 4 February 2013 12:39, Matt Foley wrote: > > > H

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
Added to the Jira to modify http://wiki.apache.org/hadoop/HowToContribute to document this decision. On Mon, Mar 4, 2013 at 5:42 PM, Harsh J wrote: > Thanks Suresh. Regarding where; we can state it on > http://wiki.apache.org/hadoop/HowToContribute in the test-patch > section perhaps. > > +1 on

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
e. > > I am glad we agreed. > Having Jira to track the CI effort is a good idea. > > Thanks, > --Konstantin > > On Mon, Mar 4, 2013 at 3:29 PM, Matt Foley wrote: > > Thanks. I agree Windows -1's in test-patch should not block commits. > > > >

[jira] [Created] (HADOOP-9359) Add Windows build and unit test to test-patch pre-commit testing

2013-03-04 Thread Matt Foley (JIRA)
Matt Foley created HADOOP-9359: -- Summary: Add Windows build and unit test to test-patch pre-commit testing Key: HADOOP-9359 URL: https://issues.apache.org/jira/browse/HADOOP-9359 Project: Hadoop Common

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
Thanks. I agree Windows -1's in test-patch should not block commits. --Matt On Mon, Mar 4, 2013 at 2:30 PM, Konstantin Shvachko wrote: > On Mon, Mar 4, 2013 at 12:22 PM, Matt Foley > wrote: > > Konstantine, you have voted -1, and stated some requirements before > you

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Matt Foley
sed work sounds like it will satisfy the requirements. Thank you, --Matt On Sun, Mar 3, 2013 at 12:16 PM, Konstantin Shvachko wrote: > Didn't I explain in details what I am asking for? > > Thanks, > --Konst > > On Sun, Mar 3, 2013 at 11:08 AM, Matt Foley > wrote: > > H

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-03 Thread Matt Foley
7:32 PM, Konstantin Shvachko wrote: > Hi Matt, > > On Sat, Mar 2, 2013 at 12:32 PM, Matt Foley > wrote: > > Konstantin, > > I would like to explore what it would take to remove this perceived > > impediment -- > > Glad you decided to explore. Thank you. > >

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-02 Thread Matt Foley
Konstantin, I would like to explore what it would take to remove this perceived impediment -- although I reserve the right to argue that this is not pre-requisite to merging the cross-platform support patch. If we implemented full "test-patch" support for Windows on trunk, would that fulfill both

Fwd: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Matt Foley
+1 (binding) Apache is supposed to be about the community. We have here a community of developers, who have actively and openly worked to add a major improvement to Hadoop: the ability to work cross-platform. Furthermore, the size of the substantive part of the needed patch is only about 1500 li

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-15 Thread Matt Foley
, Arun C Murthy wrote: > +1 (binding) > > Downloaded bits, verified sigs and ran examples on a single-node cluster. > > Arun > > On Feb 14, 2013, at 2:57 PM, Matt Foley wrote: > > > REMINDER: VOTING CLOSES TONIGHT AT 10PM. > > Happy St. Valentine's Day :-)

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-14 Thread Matt Foley
REMINDER: VOTING CLOSES TONIGHT AT 10PM. Happy St. Valentine's Day :-) --Matt On Thu, Feb 14, 2013 at 2:56 PM, Matt Foley wrote: > Hi, I peeled open the non-binary tarball (http://people.apache.org/~ > mattf/hadoop-1.1.2-rc5/hadoop-1.1.2.tar.gz), and besides the complete > src/

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-14 Thread Matt Foley
dir to be complete so you can build from > there. Or, we should have another SRC TARBALL as we do have in Hadoop2 > which is nothing but the whole (buildable) source. > > Cheers > > > On Fri, Feb 8, 2013 at 1:46 PM, Matt Foley wrote: > > > >> official release artifact

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-08 Thread Matt Foley
t; > source tarball. It's useful to have these artifacts available, but > > technically we're supposed to be approving source code, not builds... > > -C > > > > On Thu, Jan 31, 2013 at 7:13 PM, Matt Foley wrote: > > > (resending with modified Subject

Re: [VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-02-07 Thread Matt Foley
it worked. Since that change touched > checkpointing, I also verified that the 2NN could complete a successful > checkpoint. > > I'll also verify the PGP signature once I track down the public key that > was used for signing. > > Thank you, > --Chris >

[PROPOSAL] Hadoop branch-1.2

2013-02-04 Thread Matt Foley
Hi, this weekend I propose to create a branch-1.2 from current branch-1, and create a first release candidate. There's a ton of new stuff since 1.1, and it will probably need stabilization, but that is best done in the context of a release candidate. Any objections? Any must-have items for 1.2 t

[VOTE] Hadoop 1.1.2-rc5 release candidate vote

2013-01-31 Thread Matt Foley
Feb, at 3:00pm PST. Thanks, --Matt On Tue, Jan 29, 2013 at 9:47 PM, Chris Nauroth wrote: HDFS-4423 has been committed to branch-1. Thank you, Matt. > > --Chris > > > On Tue, Jan 29, 2013 at 11:57 AM, Matt Foley > wrote: > > > Hi Chris, > > Okay, please get it

Re: [VOTE] Hadoop 1.1.2-rc4 release candidate vote

2013-01-31 Thread Matt Foley
Sorry, should have changed the subject line to "rc5". Please do not respond to this thread. See the next message. --Matt On Thu, Jan 31, 2013 at 2:55 PM, Matt Foley wrote: > Hadoop-1.1.2-rc4 is withdrawn. > > Hadoop-1.1.2-rc5 is available at > http://people.apache.org/~

Re: [VOTE] Hadoop 1.1.2-rc4 release candidate vote

2013-01-31 Thread Matt Foley
, Jan 29, 2013 at 9:47 PM, Chris Nauroth wrote: > HDFS-4423 has been committed to branch-1. Thank you, Matt. > > --Chris > > > On Tue, Jan 29, 2013 at 11:57 AM, Matt Foley > wrote: > > > Hi Chris, > > Okay, please get it in as soon as possible, and I'll respi

[jira] [Resolved] (HADOOP-8418) Fix UGI for IBM JDK running on Windows

2013-01-31 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-8418. Resolution: Fixed > Fix UGI for IBM JDK running on Wind

Re: [VOTE] Hadoop 1.1.2-rc4 release candidate vote

2013-01-29 Thread Matt Foley
ckpoint exception causes fatal damage to fsimage? I have uploaded a > patch, and I expect to receive a code review in the next day or two. > > Thank you, > --Chris > > > On Mon, Jan 28, 2013 at 3:32 PM, Matt Foley > wrote: > > > A new build of Hadoop-1.1.2 is avail

[VOTE] Hadoop 1.1.2-rc4 release candidate vote

2013-01-28 Thread Matt Foley
A new build of Hadoop-1.1.2 is available at http://people.apache.org/~mattf/hadoop-1.1.2-rc4/ or in SVN at http://svn.apache.org/viewvc/hadoop/common/tags/release-1.1.2-rc4/ or in the Maven repo. This candidate for a stabilization release of the Hadoop-1.1 branch has 23 patches and several cleanup

[jira] [Reopened] (HADOOP-8418) Fix UGI for IBM JDK running on Windows

2013-01-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HADOOP-8418: Since successfully committed to branch-1.1, changed fixVersion from 1.2.0 to 1.1.2. However, re

[jira] [Reopened] (HADOOP-8419) GzipCodec NPE upon reset with IBM JDK

2013-01-27 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HADOOP-8419: > GzipCodec NPE upon reset with IBM

[jira] [Resolved] (HADOOP-9132) Contradictory information on Hadoop releases webpage

2012-12-12 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley resolved HADOOP-9132. Resolution: Fixed > Contradictory information on Hadoop releases webp

Re: [VOTE] Hadoop Release 1.1.1

2012-12-05 Thread Matt Foley
Wed, Nov 28, 2012 at 3:02 PM, Andy Isaacson wrote: > > > >> On Wed, Nov 28, 2012 at 2:52 PM, Matt Foley wrote: > >> > Andy, please commit MAPREDUCE-2374 to branch-1 and branch-1.1. That > way > >> it > >> > will be picked up by anyone who takes s

Preparing 1.1.2-rc0, due to HADOOP-9115

2012-12-05 Thread Matt Foley
Hi, sorry for the thrash, but further testing in a whole-stack situation with Hive over Hadoop-1.1.1, exposed bug HADOOP-9115, "Deadlock in configuration when writing configuration to hdfs". This bug did not previously manifest during Hadoop-1.1.1

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-04 Thread Matt Foley
if cmake works in windows, i assume hadoop-8887 would be almost there. > > this would leave the tar stitching, which is done as script to handle SO > symlinks. though i have and idea on how we could take care of it. > > i'll be creating a jira momentarily. > > thx >

[jira] [Reopened] (HADOOP-8924) Hadoop Common creating package-info.java must not depend on sh

2012-12-04 Thread Matt Foley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley reopened HADOOP-8924: After discussion in common-dev@, the community consensus rejected use of Python. (see references in

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-04 Thread Matt Foley
Please close HADOOP-9073 as "will not fix", citing this discussion. I'm -1 on groovy in maven. That's worse, not better. Let it sit for a while and let people propose simplifications of the script situation. Thanks, --Matt On Tue, Dec 4, 2012 at 11:41 AM, Radim Kolar wrote: > result of vote

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-04 Thread Matt Foley
scripts have different rules than other kinds of > software, but I don't yet see the rationale for such a change. > > Doug > > On Mon, Dec 3, 2012 at 5:22 PM, Matt Foley wrote: > > No, but it speaks to whether the Hadoop bylaws can extend the Apache > voting > > p

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-03 Thread Matt Foley
rm-specific languages for no reason. --Matt On Mon, Dec 3, 2012 at 3:57 PM, Doug Cutting wrote: > On Mon, Dec 3, 2012 at 2:08 PM, Matt Foley wrote: > > The apache voting process contradicts the Hadoop bylaws: > > http://www.apache.org/foundation/voting.html says that only PMC members

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-03 Thread Matt Foley
mean the Hadoop bylaws have to change? Thanks, --Matt On Mon, Dec 3, 2012 at 11:37 AM, Doug Cutting wrote: > On Mon, Dec 3, 2012 at 11:21 AM, Matt Foley > wrote: > > It is intended to be a "technical discussion", in the sense of the bylaws > > statement (in section

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-03 Thread Matt Foley
I do not agree that such issues are "code changes"; it relates to the tools we depend on to make code changes, which is clearly qualitatively different. --Matt On Mon, Dec 3, 2012 at 10:37 AM, Doug Cutting wrote: > On Sat, Nov 24, 2012 at 12:13 PM, Matt Foley wrote: > > Vot

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-29 Thread Matt Foley
ore voting. > > > > * Phyton as runtime requirement. Are you planing to migrate all BASH > > scripts provided by Hadoop (or dynamically created -ie launcher scripts) > > to Phyton? > > * What else in the current build, besides saveVersion.sh, you see as > > candidate to

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-29 Thread Matt Foley
reated -ie launcher scripts) > to Phyton? > * What else in the current build, besides saveVersion.sh, you see as > candidate to be migrated to Phyton? > * How are you planning to define what Phyton modules can be used? Will > developers have to install them manually? > > Cheer

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-29 Thread Matt Foley
t at the moment, and if it comes it > would be in the form of an AM, which I'd argue it should leave outside of > Hadoop) > > Thx > > > On Mon, Nov 26, 2012 at 1:16 PM, Giridharan Kesavan < > gkesa...@hortonworks.com> wrote: > > > +1, +1, +1 > > > &

Re: [VOTE] Hadoop Release 1.1.1

2012-11-28 Thread Matt Foley
and trunk with the fixes, intensively, > since they were merged and have seen no problems. > > Sorry for not noticing this earlier in the VOTE. > > -andy > > On Tue, Nov 27, 2012 at 9:45 AM, Matt Foley > wrote: > > Thanks for noticing these, Tom. > > --Matt > &

Re: [VOTE] Hadoop Release 1.1.1

2012-11-27 Thread Matt Foley
DOOP-9098. > > Cheers, > Tom > > On Tue, Nov 20, 2012 at 10:07 PM, Matt Foley wrote: > > Hello, > > Hadoop-1.1.1-rc0 is now available for evaluation and vote: > > http://people.apache.org/~mattf/hadoop-1.1.1-rc0/ > > or in the Nexus repository. > &g

Re: [VOTE] Hadoop Release 1.1.1

2012-11-26 Thread Matt Foley
Hey all, Please vote! Voting is supposed to close tomorrow afternoon. Thanks, --Matt On Tue, Nov 20, 2012 at 2:07 PM, Matt Foley wrote: > Hello, > Hadoop-1.1.1-rc0 is now available for evaluation and vote: > http://people.apache.org/~mattf/hadoop-1.1.1-rc0/ > or in the Nexu

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-24 Thread Matt Foley
Please see new [VOTE] thread. On Fri, Nov 23, 2012 at 3:40 PM, Radim Kolar wrote: > discussion seems to ended, lets start vote. >

[VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-24 Thread Matt Foley
For discussion, please see previous thread "[PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack". This vote consists of three separate items: 1. Contributors shall be allowed to use Python as a platform-independent scripting language for build-

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Matt Foley
en-plugin to do that? > > > > Colin already has something to simplify all the cmake calls from the > builds > > using a maven-plugin (https://issues.apache.org/jira/browse/HADOOP-8887) > > > > We could do the same with protoc, thus simplifying the POMs. > > &g

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Matt Foley
Hi Alejandro, For build-time issues in branch-2 and beyond, this may make sense (although I'm concerned about obscuring functionality in a way that only maven experts will be able to understand). In the particular case of saveVersion.sh, I'd be happy to see it done automatically by the build tools

[jira] [Created] (HADOOP-9082) Select and document a platform-independent scripting language for use in Hadoop environment

2012-11-21 Thread Matt Foley (JIRA)
Matt Foley created HADOOP-9082: -- Summary: Select and document a platform-independent scripting language for use in Hadoop environment Key: HADOOP-9082 URL: https://issues.apache.org/jira/browse/HADOOP-9082

[PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Matt Foley
This discussion started in HADOOP-8924 , where it was proposed to replace the build-time utility "saveVersion.sh" with a python script. This would require Python as a build-time dependency. Here's the background: Those of us involved in the bran

  1   2   3   >