Re: HADOOP Mounting HDFS

2012-01-14 Thread Roman Shaposhnik
On Fri, Jan 13, 2012 at 5:48 PM, Nikolaos Hatzopoulos wrote: > After a lot of search if someone want's to compile hadoop with libhdfs > this script should work FYI: in general, Bigtop is pretty good at tracking how to build all of the projects it packages in the most complete way possible. The bu

Re: Apache Jenkins is down

2012-02-12 Thread Roman Shaposhnik
On Sun, Feb 12, 2012 at 12:33 PM, Mikhail Bautin wrote: > Hello Everyone, > > Does anyone know why Apache Jenkins has been down for about a day? We rely > on the continuous integration server extensively to test HBase patches. Any > help with this would be appreciated. For issues like these it al

Re: [VOTE] Hadoop-1.0.1 Release Candidate 1

2012-02-21 Thread Roman Shaposhnik
On Tue, Feb 14, 2012 at 2:29 PM, Matt Foley wrote: > Hi all, > Hadoop-1.0.1-rc1 is now available at >    http://people.apache.org/~mattf/hadoop-1.0.1-rc1/ > Please download it, test it, and vote on whether to accept it as Release > 1.0.1. > Voting will close at 2:30pm PST on Tuesday 21 February.

Re: Developing and deploying hadoop

2012-02-29 Thread Roman Shaposhnik
Hi! One way to deploy Hadoop in a more formal environment is to do it via the Bigtop distribution. Bigtop provides packages and puppet deployment code for most Linux distributions. We try to make the experience of deploying Hadoop as seamless as possible, since our goal can be summarized as "tryin

Re: [VOTE] Hadoop-1.0.2-rc1

2012-03-22 Thread Roman Shaposhnik
On Thu, Mar 22, 2012 at 11:12 PM, Matt Foley wrote: > Sorry for lack of clarity; I have now commented in the jira.  I believe > this bug caused Snappy to not be built correctly, which in turn causes MR > jobs to fail if Snappy compression is configured on. Not for this release, obviously, but in

Re: cmake

2012-05-23 Thread Roman Shaposhnik
On Wed, May 23, 2012 at 8:58 AM, Owen O'Malley wrote: > After a quick look at cmake, it seems reasonable. Please use feature tests > rather than OS tests. (By that I mean that if Solaris needs "foobar.h" and > RHEL needs "sys/foobar.h" to get the definition for foobar, the code should > ifdef whet

Re: Doubt regarding use of HTTP during Shuffle phase

2012-06-27 Thread Roman Shaposhnik
On Wed, Jun 27, 2012 at 9:44 AM, Pavan Kulkarni wrote: > Yes you are correct, but we can use Lustre FS and it does scale right? > I am new to this so please excuse if I am wrong in some assumptions. You can use hybrid approaches, but you'd be venturing into the unknown. Take a look at these proje

Re: Modification of wiki page "Distributions and Commercial Support"

2012-06-28 Thread Roman Shaposhnik
On Thu, Jun 28, 2012 at 3:27 AM, Olivier Lamy wrote: > Hi, > What is the process to modify the page > http://wiki.apache.org/hadoop/Distributions%20and%20Commercial%20Support > ? On a related note, I would like to add Apache Bigtop (incubating) Hadoop distribution to that wiki page. Can anybody

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-27 Thread Roman Shaposhnik
On Sat, Nov 24, 2012 at 12:13 PM, Matt Foley wrote: > For discussion, please see previous thread "[PROPOSAL] introduce Python as > build-time and run-time dependency for Hadoop and throughout Hadoop stack". Perhaps I'm missing something, but I can't possibly imagine how a vote on a common-dev@had

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-12 Thread Roman Shaposhnik
On Fri, Apr 12, 2013 at 12:32 PM, Andrew Purtell wrote: > I find that branch-2.0.4-alpha won't compile for me. > o.a.h.yarn.server.resourcemanager.schduler.fifo.TestFifoScheduler is > missing an import for ResourceRequest or ResourceRequest is not available > on the branch. Hm. RC1 as posted by A

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-12 Thread Roman Shaposhnik
On Fri, Apr 12, 2013 at 2:09 PM, Arun C Murthy wrote: > Sigh! You are right Andrew - I'll need to back out a patch from > branch-2.0.4-alpha and re-generate the release. RC2 needed now. Can you elaborate please? Are you saying there was a patch in branch-2.0.4 that wasn't pulled into the RC1? I

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-18 Thread Roman Shaposhnik
On Fri, Apr 12, 2013 at 2:56 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would > like to release. > > The RC is available at: > http://people.apache.org/~acmurthy/hadoop-2.0.4-alpha-rc2/ > The RC tag in svn is here: > http://svn.apa

[DISCUSS] Getting to Hadoop 2.X beta

2013-04-23 Thread Roman Shaposhnik
Hi! Now that Hadoop 2.0.4-alpha is released I'd like to open up a discussion on what practical steps would it take for us as a community to get Hadoop 2.X from alpha to beta? There's quite a few preconditions to be met for a piece of software to reach beta status. Quite a few of them are now be

Re: [DISCUSS] Getting to Hadoop 2.X beta

2013-04-24 Thread Roman Shaposhnik
On Wed, Apr 24, 2013 at 9:42 AM, Steve Loughran wrote: >> There's quite a few preconditions to be met for a piece of >> software to reach beta status. Quite a few of them are now >> being discussed in a neighboring thread 'Compatibility in >> Apache Hadoop' ( http://s.apache.org/VE1 ) but I'd like

Re: Heads up - 2.0.5-beta

2013-04-25 Thread Roman Shaposhnik
On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy wrote: > Gang, > > With hadoop-2.0.4-alpha released, I'd like 2.0.4 to be the final of our > hadoop-2.x alphas. > We have made lots of progress on hadoop-2.x and I believe we are nearly > there, exciting times! Indeed! > As we have discussed pre

Re: Heads up - 2.0.5-beta

2013-04-29 Thread Roman Shaposhnik
On Fri, Apr 26, 2013 at 11:15 AM, Arun C Murthy wrote: > > On Apr 25, 2013, at 7:31 PM, Roman Shaposhnik wrote: > >> On Thu, Apr 25, 2013 at 6:34 PM, Arun C Murthy wrote: >> >>> With that in mind, I really want to make a serious push to lock down APIs >>&

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Roman Shaposhnik
On Wed, May 15, 2013 at 10:57 AM, Arun C Murthy wrote: > I propose we continue the original plan and make a 2.0.5-beta release by May > end with the following content: I have a very basic question: what are the steps that we, as a community, are willing to undertake to ensure that our aggressive

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Roman Shaposhnik
On Wed, May 15, 2013 at 1:36 PM, Matt Foley wrote: >>> lets fork this thread into the appropriate ML and discuss the practical, > achievable >>> steps that can be included into the release criteria of Hadoop 2.0.5-beta > > Seems to me common-dev is the appropriate ML, Thanks. I'll stick to this t

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Roman Shaposhnik
On Wed, May 15, 2013 at 2:14 PM, Vinod Kumar Vavilapalli wrote: > Please list down all the issues that BigTop ran into *because of* new > features. Whether the bug is *because of* new feature or not is a red herring for my argument. Please lets drop this distinction. I never used it. > You cont

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Roman Shaposhnik
curity related feature request from you. >>> - MAPREDUCE-3916 was because of new proxy-server added. >>> >>> I am not arguing that new features *may* destabilize the branch, but you've >>> repeatedly stated this as if that were a fact. >>> >

Re: Bugfix release 2.0.4.1

2013-05-16 Thread Roman Shaposhnik
On Wed, May 15, 2013 at 11:09 PM, Vinod Kumar Vavilapalli wrote: > > It's a little dirty, but Mark and Jarek (presumably from BigTop) ran a > patched version with my change at MAPREDUCE-5240. I've just updated the patch to apply cleanly on branch-2.0.4 (had to refactor quite a bit of unit tests)

Re: [VOTE] - Release 2.0.5-beta

2013-05-17 Thread Roman Shaposhnik
Apologies for a bunch of delayed responses (and as such adding even more emails to this thread). On Wed, May 15, 2013 at 4:47 PM, Arun C Murthy wrote: >> My reading of your response is that while you appreciate the feedback >> Bigtop is providing you're not of an opinion that investigating the le

Re: [VOTE] - Release 2.0.5-beta

2013-05-17 Thread Roman Shaposhnik
Guys, this is a pretty long email with all the details I can think of on how Bigtop can help stabilization efforts of Hadoop 2.x. A lot of this information is required background. I really, really encourage everyone who's thinking of contributing to this effort to read it up. Once again, I do apolo

Re: [PROPOSAL] change in bylaws to remove Release Plan vote

2013-05-22 Thread Roman Shaposhnik
+1 (non-binding) On Wed, May 22, 2013 at 10:00 AM, Chris Nauroth wrote: > +1 (non-binding) > > Chris Nauroth > Hortonworks > http://hortonworks.com/ > > > > On Wed, May 22, 2013 at 7:58 AM, Tom White wrote: > >> +1 >> >> Cheers, >> Tom >> >> On Tue, May 21, 2013 at 10:10 PM, Matt Foley wrote: >

Re: [DISCUSS] Ensuring Consistent Behavior for Alternative Hadoop FileSystems + Workshop

2013-05-29 Thread Roman Shaposhnik
On Fri, May 24, 2013 at 5:08 PM, Konstantin Shvachko wrote: > Makes sense, Steve. > There are a couple of guys here at WANdisco who will be interested in > joining. Bigtop will also be interested in participating. Please keep us posted. Thanks, Roman.

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Roman Shaposhnik
On Fri, May 24, 2013 at 8:48 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc0) for hadoop-2.0.4.1-alpha that I would > like to release. > > This is a stabilization release that includes fixed for a couple a of issues > discovered in the testing with BigTop 0.6.0 rel

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-31 Thread Roman Shaposhnik
On Thu, May 30, 2013 at 10:50 PM, Konstantin Boudnik wrote: > Thanks Alejandro, > > that's what my plan for the morning. Thanks for putting together the > check-list - would be easier for me not to miss anything. I am aiming to have > the bits out by noon or so. Appreciate the help! Let me know i

Re: [DISCUSS] Ensuring Consistent Behavior for Alternative Hadoop FileSystems + Workshop

2013-05-31 Thread Roman Shaposhnik
On Fri, May 31, 2013 at 1:00 PM, Stephen Watt wrote: > What is the protocol for organizing the logistics and collaborating? I am > loathe to flood common-dev with "does this time work for you?" emails from > the interested parties. Do we create a high level JIRA ticket and collaborate > and pos

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-01 Thread Roman Shaposhnik
On Fri, May 31, 2013 at 4:04 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc0) for hadoop-2.0.5-alpha that I would > like to release. > > This is a stabilization release that includes fixed for a couple a of issues > discovered in the testing with BigTop 0.6.0 relea

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc1)

2013-06-03 Thread Roman Shaposhnik
NOTE: for consistency I'm moving my vote to the RC1 thread. On Fri, May 31, 2013 at 9:27 PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would > like to release. > > This is a stabilization release that includes fixed for a couple a

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)

2013-06-03 Thread Roman Shaposhnik
On Mon, Jun 3, 2013 at 12:51 PM, Konstantin Boudnik wrote: > I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. > > The difference between rc1 and rc2 is the "optimistic release date" is set for > 06/06/2013 in the CHANGES.txt files. > > The binary artifact is the same - there's no

Re: Heads up: branch-2.1-beta

2013-06-05 Thread Roman Shaposhnik
On Tue, Jun 4, 2013 at 8:32 AM, Arun C Murthy wrote: > Folks, > > The vast majority of of the planned features and API work is complete, > thanks to everyone who contributed! > > I've created a branch-2.1-beta branch from which I anticipate I can make the > first of our beta releases very shor

Re: Heads up: branch-2.1-beta

2013-06-10 Thread Roman Shaposhnik
On Thu, Jun 6, 2013 at 4:48 AM, Arun C Murthy wrote: > > On Jun 5, 2013, at 11:04 AM, Roman Shaposhnik wrote >> >> On the Bigtop side of things, once we have stable Bigtop 0.6.0 platform >> based on Hadoop 2.0.x codeline we plan to start running the same battery >&g

Re: Heads up: branch-2.1-beta

2013-06-10 Thread Roman Shaposhnik
On Mon, Jun 10, 2013 at 9:35 AM, Ramya Sunil wrote: > We had some minor hiccups with some of our e2e tests breaking due to > additional setsid info being logged by the bin scripts and errors while > building with snappy turned on. Any chance some (all?) of these tests can be donated to Bigtop so

Re: Heads up: branch-2.1-beta

2013-06-14 Thread Roman Shaposhnik
On Thu, Jun 6, 2013 at 4:48 AM, Arun C Murthy wrote: > > On Jun 5, 2013, at 11:04 AM, Roman Shaposhnik wrote >> >> On the Bigtop side of things, once we have stable Bigtop 0.6.0 platform >> based on Hadoop 2.0.x codeline we plan to start running the same battery >&g

Re: Heads up: branch-2.1-beta

2013-06-16 Thread Roman Shaposhnik
On Sat, Jun 15, 2013 at 8:19 AM, Alejandro Abdelnur wrote: > If the intention is to get the release out in time for the Hadoop Summit we > have a very tight schedule. > > Because the release vote runs for 7 days, we should have an RC latest > Monday afternoon, and we should encourage folks to veri

Re: [ANNOUNCEMENT] Hadoop 0.20.205.0 release

2011-10-21 Thread Roman Shaposhnik
On Fri, Oct 21, 2011 at 3:40 PM, Matt Foley wrote: > Hello Roman, > HDFS-1943 is a resolved bug which was opened only against 0.22 and 0.23.  No > one in the community (including you) saw fit to raise it as a concern for > 0.20-security, despite multiple public invitations to propose jiras for > i

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Roman Shaposhnik
Hi Matt, quick question: any reason we are ignoring multifilewc from hadoop examples? https://issues.apache.org/jira/browse/MAPREDUCE-3319 would be nice to fix it for 1.0 of Hadoop. Or at least disable. Thanks, Roman. On Wed, Nov 23, 2011 at 2:56 PM, Matt Foley wrote: > I really want this i

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Roman Shaposhnik
On Wed, Nov 23, 2011 at 5:40 PM, Arun C Murthy wrote: > Also, another way to get the RM's attention is to mark the 'Target Version' > along with the patch. Would be happy to do so. Wasn't sure what the proper protocol is. Sorry about that. As for the patch -- I'll add JIRA comments. Thanks, Rom

Re: Need to know steps of installation of Hadoop 0.23

2011-12-06 Thread Roman Shaposhnik
Hi Ulhas, On Tue, Dec 6, 2011 at 12:20 AM, Ulhas Shringare wrote: > Hello, > I need to know steps to install Hadoop 0.23 , every where there are steps > to install hadoop 0.20. > And there are bit difference between them.Like conf/hadoop-env config file > is not there. > Please provide me suitabl

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
On Thu, Dec 8, 2011 at 11:57 AM, Matt Foley wrote: > Hello all, > I have posted a release candidate for Hadoop 1.0.0 at >    http://people.apache.org/~mattf/hadoop-1.0.0-rc2/ > > Please download, evaluate, and vote on this list. Pulled into Bigtop, built and running integrations tests today. Qui

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
On Fri, Dec 9, 2011 at 3:26 PM, Matt Foley wrote: > Hi Roman, > regarding MAPREDUCE-3319 I'm confused too.  Your comment in the bug as > of 28/Nov/11 21:49 seems to indicate that it is fixed, but clearly it wasn't > fixed the same way as Subroto's patch (which came in on Dec 6). What is the tag c

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
On Fri, Dec 9, 2011 at 4:30 PM, Matt Foley wrote: > Roman, the 1.0.0-rc2 is built from branch-1.0@1211738, which contains > c1207581. Thanks. This is useful to know. Wish I had that info earlier :-( > Is the problem consistently reproducible in 1.0.0-rc2?  Perhaps you're > seeing  some intermitt

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
+Carl (the only person from Hive project I know ;-)) On Thu, Dec 8, 2011 at 11:57 AM, Matt Foley wrote: > Hello all, > I have posted a release candidate for Hadoop 1.0.0 at >    http://people.apache.org/~mattf/hadoop-1.0.0-rc2/ Ok, my test run is now past HBase (horray! that works). That's the

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
On Fri, Dec 9, 2011 at 6:29 PM, Ashutosh Chauhan wrote: > Hey Roman, > > That problem is at Hive end. You can try out the patch at > https://issues.apache.org/jira/browse/HIVE-2631 to unblock your testing. Sure. As I said -- the fix is pretty simple. However, releasing this would break every sing

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-09 Thread Roman Shaposhnik
On Thu, Dec 8, 2011 at 11:57 AM, Matt Foley wrote: > Hello all, > I have posted a release candidate for Hadoop 1.0.0 at >    http://people.apache.org/~mattf/hadoop-1.0.0-rc2/ > > Please download, evaluate, and vote on this list. > The artifacts will be posted to the maven repo shortly. > The vote

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-10 Thread Roman Shaposhnik
On Fri, Dec 9, 2011 at 6:29 PM, Ashutosh Chauhan wrote: > Hey Roman, > > That problem is at Hive end. You can try out the patch at > https://issues.apache.org/jira/browse/HIVE-2631 to unblock your testing. Btw, I think it is very instructive to take a look at how Linux community has dealt with ve

Re: [VOTE] Hadoop-1.0.0 release candidate 2

2011-12-12 Thread Roman Shaposhnik
On Sat, Dec 10, 2011 at 12:24 PM, Matt Foley wrote: >>> Btw, I think it is very instructive to take a look at how > Linux community has dealt >>> with version transition between 2.X -> 3.X. > > You mean you want us to not call it 1.0.0?  As I remember the vote was > overwhelmingly > in favor of ca

Re: [VOTE] Hadoop-1.0.0 release candidate 3

2011-12-20 Thread Roman Shaposhnik
On Sun, Dec 18, 2011 at 11:18 PM, Matt Foley wrote: > Okay guys, obviously I can't add.  Something about a carry bit... :-) > Let's try: >    The vote will close at 12:30pm PST on Friday 23 Dec. Pulled the RC into Bigtop build and constructed a stack with Hadoop 1.0, HBase 0.92 RC1 and Zookeeper

Re: [VOTE] Hadoop-1.0.0 release candidate 3

2011-12-20 Thread Roman Shaposhnik
Try the following maven version: 1.0.0rc3 Those artifacts are available. Thanks, Roman. On Tue, Dec 20, 2011 at 11:05 AM, Chris K Wensel wrote: > Which maven repo was updated? > > Not seeing anything new in the staging repo > https://repository.apache.org/content/repositories/staging/org/apach

FOSDEM 2016 - take action by 4th of December 2015

2015-11-30 Thread Roman Shaposhnik
As most of you probably know FOSDEM 2016 (the biggest, 100% free open source developer conference) is right around the corner: https://fosdem.org/2016/ We hope to have an ASF booth and we would love to see as many ASF projects as possible present at various tracks (AKA Developer rooms): htt

Re: Release numbering for 3.x leading up to GA

2016-05-02 Thread Roman Shaposhnik
On Mon, May 2, 2016 at 1:50 PM, Andrew Wang wrote: > Hi all, > > I wanted to confirm my version numbering plan for Hadoop 3.x. We had a > related thread on this topic about a year ago, mostly focusing on the > branch-2 maintenance releases: > > http://mail-archives.apache.org/mod_mbox/hadoop-commo

Re: Release numbering for 3.x leading up to GA

2016-05-03 Thread Roman Shaposhnik
On Tue, May 3, 2016 at 8:18 AM, Karthik Kambatla wrote: > The naming scheme sounds good. Since we want to start out sooner, I am > assuming we are not limiting ourselves to two alphas as the email might > indicate. > > Also, as the release manager, can you elaborate on your definitions of > alpha

Re: Heads up: branch-2.1-beta

2013-06-17 Thread Roman Shaposhnik
Hi Arun, thanks for chiming in! On Sun, Jun 16, 2013 at 4:50 PM, Arun C Murthy wrote: >> But there's a bit of bad news too (or at least the news that need to >> be triaged). At >> this point I don't know whether the Hadoop code is to blame or the >> tests/components >> themselves -- all I know i

Re: Heads up: branch-2.1-beta

2013-06-17 Thread Roman Shaposhnik
On Sun, Jun 16, 2013 at 5:14 PM, Arun C Murthy wrote: > Roman, > > Is there a chance you can run the tests with the full stack built against > branch-2.1-beta and help us know where we are? I will try to kick off the full build today. And deploy/test tomorrow. It is all pretty automated, but ta

Re: Heads up: branch-2.1-beta

2013-06-19 Thread Roman Shaposhnik
On Tue, Jun 18, 2013 at 11:58 PM, Arun C Murthy wrote: > Ping. Any luck? The full bigtop build failed because of Giraph: http://bigtop01.cloudera.org:8080/view/Upstream-tests/job/Hadoop-2.1.0/label=centos5/4/console Now, I'm pretty sure that's an issue with Giraph itself (or more precisely

Re: Heads up: branch-2.1-beta

2013-06-19 Thread Roman Shaposhnik
On Tue, Jun 18, 2013 at 11:58 PM, Arun C Murthy wrote: > Ping. Any luck? Unfortunately I've ran into: https://issues.apache.org/jira/browse/HADOOP-9654 which was caused by the unrelated memory pressure on the NN, but it had an unfortunate side effect of making the rest of the testing stuck.

Re: Fostering a Hadoop security dev community

2013-06-20 Thread Roman Shaposhnik
On Thu, Jun 20, 2013 at 10:54 AM, Larry McCay wrote: > Yes, sorry for not explicitly stating it in my previous reply - this should > be a community built from representatives across the entire ecosystem. > My previous email was speaking to how we reach out to them. Do you see any role Apache Bigt

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-06-28 Thread Roman Shaposhnik
I think it would very useful if somebody more familiar with HDFS (Suresh?) could take a look at: https://issues.apache.org/jira/browse/HDFS-4940 Suresh was very helpful in unblocking the client side of things, but even after I followed his recommendations on the heap size, etc. The NN still O

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-01 Thread Roman Shaposhnik
Hi Arun! On Fri, Jun 28, 2013 at 2:05 PM, Arun C Murthy wrote: > Thanks Hitesh & Roman, I'll roll RC1 once these are fixed. Here's the latest update. I've incorporated Collin's patch for HADOOP-9676 and re-ran the tests. A few subtests of TestCLI still fail, but quite a few pass and on top of th

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-30 Thread Roman Shaposhnik
On Mon, Jul 29, 2013 at 3:00 PM, Arun C Murthy wrote: > Ok, I think we are close to rc1 now - the last of blockers should be > committed later today… I'll try and spin RC1 tonight. Great news! I'm back from my vacation (man, those were good 3 weeks! ;-)) and I'll try to pull the RC into Bigtop a

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-01 Thread Roman Shaposhnik
On Wed, Jun 26, 2013 at 1:17 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.0-beta that I would > like to get released. > > This release represents a *huge* amount of work done by the community (639 > fixes) which > includes several major advances inc

Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845

2013-08-09 Thread Roman Shaposhnik
On Fri, Aug 9, 2013 at 1:15 PM, Alejandro Abdelnur wrote: > pinging again, I need help from somebody with sudo access to the hadoop > jenkins boxes to do this or to get sudo access for a couple of hours to set > up myself. Speaking of which -- I'd be totally willing to volunteer as a back up for

Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845

2013-08-09 Thread Roman Shaposhnik
On Fri, Aug 9, 2013 at 2:28 PM, Doug Cutting wrote: > On Fri, Aug 9, 2013 at 1:15 PM, Alejandro Abdelnur wrote: >> pinging again, I need help from somebody with sudo access to the hadoop >> jenkins boxes to do this or to get sudo access for a couple of hours to set >> up myself. > > Have you aske

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Roman Shaposhnik
What are the downsides of getting this fix into the 2.1? It appears that the fix is pretty isolated and well understood. Thoughts? Thanks, Roman. On Fri, Aug 16, 2013 at 3:04 PM, Kihwal Lee wrote: > I've changed the target version of HADOOP-9880 to 2.1.1. Please change it > back, if you feel

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-19 Thread Roman Shaposhnik
On Mon, Aug 19, 2013 at 2:49 PM, Vinod Kumar Vavilapalli wrote: > > Thanks for the clarification Daryn. That is what I was asking before when I > said "From my limited understanding, this doesn't seem like a API or a > compatibility issue. Can we not fix it in subsequent bug-fix releases? " > > No

Re: FW: Coverity Scan (MAPREDUCE-5032)

2013-08-26 Thread Roman Shaposhnik
On Mon, Aug 26, 2013 at 8:21 AM, Jon Jarboe wrote: > I've been working with DataStax on their use of Coverity with Cassandra, and > decided to give the Hadoop 1.2.1 source tarball a run through our analyzer. > I found some interesting issues, and noticed that some of them are integer > overflo

Re: Coverity Scan (MAPREDUCE-5032)

2013-08-26 Thread Roman Shaposhnik
On Mon, Aug 26, 2013 at 10:43 AM, Vinod Kumar Vavilapalli wrote: > > Can you file a JIRA and attach the report there? That is the best way to move > this forward. Last time I was involved in a Coverity scan was when they scanned another project I'm committer on (FFmpeg). The lesson there was tha

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Roman Shaposhnik
On Mon, Sep 16, 2013 at 11:38 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would > like to get > released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as > a result of significant amounts of testing. > > If things

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-18 Thread Roman Shaposhnik
On Tue, Sep 17, 2013 at 9:58 PM, Roman Shaposhnik wrote: > I'm also running the tests on fully distributed clusters in Bigtop -- > will report the findings tomorrow. The first result of my test run is this: https://issues.apache.org/jira/browse/HDFS-5225 Not sure it it qua

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-22 Thread Roman Shaposhnik
On Mon, Sep 16, 2013 at 11:38 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would > like to get > released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as > a result of significant amounts of testing. > > If things

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Roman Shaposhnik
On Tue, Sep 24, 2013 at 1:39 PM, Arun C Murthy wrote: > Rather than spin another RC, let's get this out and follow up with the next > release - especially since it's not clear how long it will take for the > symlink stuff to sort itself out. > > Getting this out will help downstream projects, eve

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-02 Thread Roman Shaposhnik
On Tue, Oct 1, 2013 at 5:15 PM, Vinod Kumar Vavilapalli wrote: > +1. We should get an RC as soon as possible so that we can get all the > downstream components to sign off. > The earlier the better. On this very note -- would there be any interest in joining efforts with the Bigtop integration a

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-07 Thread Roman Shaposhnik
On Mon, Oct 7, 2013 at 12:00 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to > get released - this release > fixes a small number of bugs and some protocol/api issues which should ensure > they are now stable and will not change

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-09 Thread Roman Shaposhnik
On Mon, Oct 7, 2013 at 12:00 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.2.0 that I would like to > get > released - this release fixes a small number of bugs and some protocol/api > issues > which should ensure they are now stable and will not chang

Re: Managing docs with hadoop-1 & hadoop-2

2013-10-18 Thread Roman Shaposhnik
On Fri, Oct 18, 2013 at 2:10 PM, Arun C Murthy wrote: > Folks, > > Currently http://hadoop.apache.org/docs/stable/ points to hadoop-1. With > hadoop-2 going GA, should we just point that to hadoop-2? > > Couple of options: > # Have stable1/stable2 links: >http://hadoop.apache.org/docs/stab

Re: Question on hadoop dependencies.

2013-10-30 Thread Roman Shaposhnik
On Wed, Oct 30, 2013 at 1:07 PM, Steve Loughran wrote: > On 30 October 2013 13:07, Petar Tahchiev wrote: >> So spring-data-solr (1.1.SNAPSHOT) uses solr 4.5.1 (just came out a few >> days ago), which uses Hadoop 2.0.5-alpha. >> I would be glad if we can clean up the poms a bit and leave only the

Re: test-patch failing with OOM errors in javah

2013-10-30 Thread Roman Shaposhnik
I can take a look sometime later today. Meantime I can only say that I've been running into 1Gb limit in a few builds as of late. These days -- I just go with 2G by default. Thanks, Roman. On Wed, Oct 30, 2013 at 3:33 PM, Alejandro Abdelnur wrote: > The following is happening in builds for MAPRE

Re: Apache jenkins job to build release artifacts (WAS: Issue with my username on my company provided dev box?)

2014-01-30 Thread Roman Shaposhnik
On Thu, Jan 30, 2014 at 4:43 PM, Alejandro Abdelnur wrote: > We could improve this script further to deploy the built JARs to the Maven > repo. I don't know how to do this, so it would be great if somebody that > know how jumps on that. Maybe a s a follow up JIRA, so we have something > going. If

Re: Apache jenkins job to build release artifacts (WAS: Issue with my username on my company provided dev box?)

2014-01-30 Thread Roman Shaposhnik
On Thu, Jan 30, 2014 at 5:05 PM, Alejandro Abdelnur wrote: > I agree on not auto-signing (the script does not do it, on purpose). > > I was referring to deploying release artifact JARs. Right. And my answer then would be -- please don't do that. > OK, then we are done then. Sounds like it. Tha

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-11 Thread Roman Shaposhnik
Very nice! I'll take it for the usual round of testing in Bigtop. Should take a few days, but I'll keep you guys posted! Thanks, Roman. On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to > get released

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-17 Thread Roman Shaposhnik
On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to > get released. > > The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.3.0-rc0 > The RC tag in svn is here: > https://svn.apache.org/re

Re: hadoop 2.x debian packaging

2014-04-21 Thread Roman Shaposhnik
On Mon, Apr 21, 2014 at 9:47 AM, MrAsanjar . wrote: > Hi all, > Does anyone have any recommendation/instruction on how to build hadoop 2.x > into a .deb package? > I have been unsuccessful building deb package using MavenBuilder (below > error), any suggestion would be greatly appreciated: > > [IN

Re: Dropping support for JDK6 in Apache Hadoop

2014-08-19 Thread Roman Shaposhnik
FWIW: in Bigtop we've made the switch to JDK7 for the Bigtop 0.8.0 release across the board. No major issues so far. Thanks, Roman. On Tue, Aug 19, 2014 at 10:52 AM, Arun C Murthy wrote: > [Apologies for the wide distribution.] > > Dear HBase/Hive/Pig/Oozie communities, > > We, over at Hadoop a

Re: Alexander sent you a new message

2017-12-18 Thread Roman Shaposhnik
saging_digest-header-23-home-null-4dk68%7Ejbc2m1vb%7Ebc-null-neptune%2Ffeed&lipi=urn%3Ali%3Apage%3Aemail_email_type_messaging_digest%3BIE%2BfL1PwT9Cs73BzCc6WaQ%3D%3D> > Roman > Shaposhnik > <https://www.linkedin.com/comm/in/shaposhnik?midToken=AQErypO31OTqsw&trk=

Re: [DISCUSS] Official Docker Image at release time

2016-07-19 Thread Roman Shaposhnik
On Tue, Jul 19, 2016 at 8:12 AM, Sean Busbey wrote: > FWIW, there is a "blessed" apache area on docker hub now, and it's > just an INFRA request to point out the needed Dockerfile in the repo. > > PMCs can also request write access to bintray hosting of docker images > for PMC members. > > Info on

Re: Multiple node Hadoop cluster on Docker for test and debugging

2016-11-09 Thread Roman Shaposhnik
On Wed, Nov 9, 2016 at 9:30 AM, Zhe Zhang wrote: > Nice work Kai! Quick comment: have you considered Bigtop? It allows > creating a multi-node docker cluster too. But I'm not sure if Bigtop takes > a custom built Hadoop (from the instructions I read, it builds from a > certain git branch; I'm not

Re: Fun with git log

2014-09-28 Thread Roman Shaposhnik
And this illustrates what exactly? Thanks, Roman. On Sun, Sep 28, 2014 at 2:01 PM, Allen Wittenauer wrote: > > Here’s the date of the last commit by email address (or, at least, what git > thinks is the email address…) and the commit hash. People-wise, there are > some obvious dupes here but

Re: Fun with git log

2014-09-28 Thread Roman Shaposhnik
On Sun, Sep 28, 2014 at 2:17 PM, Allen Wittenauer wrote: > > No illustration, as it isn't an image. And I suppose it has no point either, then. So perhaps it doesn't belong to the public mailing list? Thanks, Roman.

Re: Hadoop without HDFS

2014-12-10 Thread Roman Shaposhnik
On Wed, Dec 10, 2014 at 12:20 PM, Ari King wrote: > Hi, > > I'm doing a research paper on Hadoop -- specifically relating to its > dependency on HDFS. I need to determine if and how HDFS can be replaced. As > I understand it, there are a number of organizations that have produced > HDFS alternativ

Re: Hadoop on Solaris: an introduction

2015-05-17 Thread Roman Shaposhnik
Hi! quick question: when you say Solaris, what do you *really* mean? Thanks, Roman. On Sun, May 17, 2015 at 4:58 AM, Alan Burlison wrote: > You may have noticed this notification: > > HADOOP-11985 Improve Solaris support in Hadoop > > So I thought it might be helpful if I gave a bit of backgrou

Re: Protocol Buffers version

2015-06-15 Thread Roman Shaposhnik
On Mon, Jun 15, 2015 at 8:57 AM, Andrew Purtell wrote: > I can't answer the original question but can point out the protostuff ( > https://github.com/protostuff/protostuff) folks have been responsive and > friendly in the past when we (HBase) were curious about swapping in their > stuff. Two signi

Re: Local repo sharing for maven builds

2015-09-18 Thread Roman Shaposhnik
On Fri, Sep 18, 2015 at 2:42 PM, Allen Wittenauer wrote: > As far as Yetus goes, we've got a JIRA open to provide for per-instance > caches when > using the docker container code. I've got it in my head how I think we can do > it, but just > haven't had a chance to code it. So once that gets wr

[jira] [Created] (HADOOP-8332) make default container-executor.conf.dir be a path relative to the container-executor binary

2012-04-30 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-8332: Summary: make default container-executor.conf.dir be a path relative to the container-executor binary Key: HADOOP-8332 URL: https://issues.apache.org/jira/browse/HADOOP

[jira] [Created] (HADOOP-8353) hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop

2012-05-03 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-8353: Summary: hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop Key: HADOOP-8353 URL: https://issues.apache.org/jira/browse/HADOOP-8353 Project

[jira] [Created] (HADOOP-8796) commands_manual.html link is broken

2012-09-12 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-8796: Summary: commands_manual.html link is broken Key: HADOOP-8796 URL: https://issues.apache.org/jira/browse/HADOOP-8796 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-9299) kerberos resolution is kicking in even when kerberos is not configured

2013-02-12 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-9299: Summary: kerberos resolution is kicking in even when kerberos is not configured Key: HADOOP-9299 URL: https://issues.apache.org/jira/browse/HADOOP-9299

[jira] [Created] (HADOOP-9301) hadoop client servlet/jsp/jetty/tomcat JARs creating conflicts in Oozie & HttpFS

2013-02-12 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-9301: Summary: hadoop client servlet/jsp/jetty/tomcat JARs creating conflicts in Oozie & HttpFS Key: HADOOP-9301 URL: https://issues.apache.org/jira/browse/HADOOP-

[jira] [Created] (HADOOP-9409) Oozie gets a bizarre exception while submitting a job: Message missing required fields: renewer

2013-03-15 Thread Roman Shaposhnik (JIRA)
Roman Shaposhnik created HADOOP-9409: Summary: Oozie gets a bizarre exception while submitting a job: Message missing required fields: renewer Key: HADOOP-9409 URL: https://issues.apache.org/jira/browse

[jira] [Reopened] (HADOOP-9399) protoc maven plugin doesn't work on mvn 3.0.2

2013-03-22 Thread Roman Shaposhnik (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik reopened HADOOP-9399: -- Assignee: Konstantin Boudnik (was: Todd Lipcon) Cos, can we, please, backport it

  1   2   >