Re: Professional Hiring: Architect and Developer in Hadoop Area ( Beijing, China )

2012-04-09 Thread Konstantin Boudnik
TLDR :/ Besides, it isn't a job list Cos On Mon, Apr 09, 2012 at 10:59PM, Bing Li wrote: > 国际著名大型IT企业(排名前3位)开发中心招聘Hadoop技术专家(北京)-非猎头 > > 职位描述: > Hadoop系统和平台开发(架构师,资深开发人员) > > > 职位要求: > > 1.有设计开发大型分布式系统的经验(工作年限3年以上,架构师5年以上),hadoop大型实际应用经验优先 > > 2.良好的编程和调试经验(java or c++/c),扎实的计算机理论基础,快速的学习能力

Re: About Herriot

2012-04-27 Thread Konstantin Boudnik
Yeah, this is pretty much everything you need to know. A coupla additional points: - Herriot hasn't been integrated to current trunk - the mavenization is still due - you apparently need to create instrumented bits of your cluster before you can use Herriot Cos On Fri, Apr 27, 2012

Re: [VOTE] Hadoop-1.0.3-rc1

2012-05-14 Thread Konstantin Boudnik
Can we include HADOOP-8399 that takes care about annoyance of Java5 need? Cos On Mon, May 14, 2012 at 07:11PM, Tsz Wo (Nicholas), Sze wrote: > Hi, > > > I have verified all signatures and message digests.═ I also have > - tested WebHDFS with curl; > - run pi with 3 maps and 100 samples per

Re: [VOTE - RELEASE PLAN] create branch-1.1 and make release candidate 1.1.0

2012-05-17 Thread Konstantin Boudnik
+1 On Thu, May 17, 2012 at 06:52PM, Matt Foley wrote: > Hi all, > I would like to branch "branch-1.1" from the current HEAD of branch-1, > and proceed to make a release candidate for hadoop-1.1.0 from it. > I'm also hereby offering to be Release Manager for branch-1.1, as I have > been > for branc

Re: Modification of wiki page "Distributions and Commercial Support"

2012-06-28 Thread Konstantin Boudnik
I will, I have the access. Cos On Thu, Jun 28, 2012 at 09:52AM, Roman Shaposhnik wrote: > On Thu, Jun 28, 2012 at 3:27 AM, Olivier Lamy wrote: > > Hi, > > What is the process to modify the page > > http://wiki.apache.org/hadoop/Distributions%20and%20Commercial%20Support > > ? > > On a related n

Re: Modification of wiki page "Distributions and Commercial Support"

2012-06-28 Thread Konstantin Boudnik
Sorry, did what? The page doesn't have any references to the BigTop as of now. Cos On Thu, Jun 28, 2012 at 07:11PM, Olivier Lamy wrote: > Thanks! > Note: Harsh J did it and give me karma to modify the page. > > -- > Olivier > > > 2012/6/28 Konstantin Boudnik :

Re: [ANNOUNCE] Hadoop branch-1.1 and Release Plan for Hadoop-1.1.0

2012-07-03 Thread Konstantin Boudnik
Hi Matt. I am picking up the hat of BigTop's maintainer for Hadoop 1.x line. And I wanted to sync up with about the Hadoop 1.1 release outlook, progress, what help you might need, etc. I see a few jiras left open in the release http://is.gd/OyuaNQ Is this the correct representation of the cu

Re: [ANNOUNCE] Hadoop branch-1.1 and Release Plan for Hadoop-1.1.0

2012-07-07 Thread Konstantin Boudnik
tted. > I am planning to defer those two to 1.1.1. > > Beyond that, I'm going to cut 1.1.0-rc0 from the current state of > branch-1.1. > I'm planning to do that this weekend. This is obviously delayed from the > previous plan, for which I apologize. > > Comments

Re: [ANNOUNCE] Hadoop branch-1.1 and Release Plan for Hadoop-1.1.0

2012-07-07 Thread Konstantin Boudnik
Also, I have updated HADOOP-8417 against 1.1.0 and we need to include it. Otherwise, 1.1 will have the same issues for the downstream projects as 1.0.3 had. Cos On Sat, Jul 07, 2012 at 05:52PM, Konstantin Boudnik wrote: > Matt, > > Thanks for the update. > > HADOOP-8399 would be

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Konstantin Boudnik
I like Alejandro's idea about Maven for a few of reasons: - bringing in a scripting environment which is known for its inter-version idiosyncrasies just because Windows can't handle trivial shell scripting looks like an overkill to me - relative to above, there's a chance that Python's

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Konstantin Boudnik
On Wed, Nov 21, 2012 at 09:46PM, Radim Kolar wrote: > > >Why not do a maven-plugin to do that? > maven plugins are difficult to maintain. its better to use inline > scripts, with something like this: > > http://docs.codehaus.org/display/GMAVEN/Home;jsessionid=E29093B96230BBB4461F02A1718A6B71 Exa

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Konstantin Boudnik
Ditto... On Wed, Nov 21, 2012 at 01:14PM, Matt Foley wrote: > Cos, > Please see in-line. > > On Wed, Nov 21, 2012 at 12:00 PM, Konstantin Boudnik wrote: > > > I like Alejandro's idea about Maven for a few of reasons: > > - bringing in a scripting en

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Konstantin Boudnik
On Thu, Nov 22, 2012 at 12:58AM, Radim Kolar wrote: > I know that Python compatibility can be worked around. I used Python > for few years and wrote about 70k LOC in it until it started to > irritate me that every new version has incompatibilities such as 2.4 > vs 2.3 vs 2.5 and it makes maintainin

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-24 Thread Konstantin Boudnik
If we decide to go with Maven then there's no point to complicate the picture with jython. This time I will keep the offensive about *yton to myself ;) Cos On Sat, Nov 24, 2012 at 10:26PM, Radim Kolar wrote: > we have not discussed advantages of stand alone python vs > jython-in-maven pom > > ht

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-26 Thread Konstantin Boudnik
-1, +1, -1 Thanks On Sat, Nov 24, 2012 at 12:13PM, Matt Foley wrote: > For discussion, please see previous thread "[PROPOSAL] introduce Python as > build-time and run-time dependency for Hadoop and throughout Hadoop stack". > > This vote consists of three separate items: > > 1. Contributors sha

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-12 Thread Konstantin Boudnik
On Sat, Dec 01, 2012 at 10:44AM, Steve Loughran wrote: > On 1 December 2012 01:08, Eli Collins wrote: > > > -1, 0, -1 > > > > IIUC the only platform we plan to add support for that we can't easily > > support today (w/o an emulation layer like cygwin) is Windows, and it > > seems like making the

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-12 Thread Konstantin Boudnik
On Sat, Dec 01, 2012 at 10:07PM, Eric Yang wrote: > -1, +1, -1 > > Python has fairly inconsistent support across all major OS vendors. It is > hard to get it right unless the scripts are all designed to make use of > Python 2.4. However, Python 2.4 doesn't have necessary OS features to make > Py

Re: Hadoop build slaves software

2013-01-04 Thread Konstantin Boudnik
Do I hear puppet? :) Cos On Fri, Jan 04, 2013 at 11:08AM, Todd Lipcon wrote: > I agree -- I'd like to see us have a shell script of some sort which, > given a prefix, downloads and installs the needed toolchain > dependencies. > > We could then download that script onto the build machines and in

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-08 Thread Konstantin Boudnik
The issue with the configuration is raised (and adressed) in https://issues.apache.org/jira/browse/BIGTOP-841 Cos On Fri, Feb 08, 2013 at 04:25PM, Aaron T. Myers wrote: > +1 (binding) > > I downloaded the src tar ball, built it with the native bits enabled, > started up a little cluster, and

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-12 Thread Konstantin Boudnik
We've created BigTop stack with 2.0.3 as the base. Ran YCSB, slive, and some other loads on up to 20 nodes clusters as a part of the release validation. Two issues were noted: - due to the known issue with Jetty we are seeing MR jobs hanging here and there - without properly configured capacity-

Re: [VOTE] Release hadoop-2.0.3-alpha

2013-02-12 Thread Konstantin Boudnik
On Tue, Feb 12, 2013 at 07:44PM, Konstantin Boudnik wrote: > We've created BigTop stack with 2.0.3 as the base. Ran YCSB, slive, and some > other loads on up to 20 nodes clusters as a part of the release validation. > Two issues were noted: > > - due to the known issue with Je

Re: ANNOUNCEMENT: Project Rhino: Enhanced Data Protection for the Apache Hadoop Ecosystem

2013-02-25 Thread Konstantin Boudnik
[yanking away most of the cross-posts...] An interesting cross component project Avik. Any plans to incubate it in Apache? Cos On Mon, Feb 25, 2013 at 11:46PM, Dey, Avik wrote: > Project Rhino > > As the Apache Hadoop ecosystem extends into new markets and sees new use > cases with security and

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread Konstantin Boudnik
On Thu, Feb 28, 2013 at 03:08PM, sanjay Radia wrote: > +1 > Java has done the bulk of the work in making Hadoop multi-platform. > Windows specific code is a tiny percentage of the code. > Jeninks support for windows is going help us keep the platform portable going > forward. > I expect that the v

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-01 Thread Konstantin Boudnik
It seems that with the HW in place, the matter of setting at least nightly build is trivial for anyone with up to date Windows knowledge. I wish I could help. Going without a validation is a recipe for a disaster IMO. -1 until some reasonable solution is implemented. Cos On Fri, Mar 01, 2013 at

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-01 Thread Konstantin Boudnik
Suresh, I appreciate all the troubles you're going through wrt syncing up the huge patch for a long time - I really do. I am not asking to have full test-patch process in place. But I think it is a real good idea to have a way to run the full test suite once in a while - or as Konstantin proposing

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-04 Thread Konstantin Boudnik
t; > Making two builds is less than 2 days work, imho, given that there is > > a Windows node available and that mvn targets are in place. Correct me > > if I missed any complications in the process. > > On Fri, Mar 1, 2013 at 3:47 PM, Konstantin Boudnik wrote: > > It seems t

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-25 Thread Konstantin Boudnik
It doesn't look like any progress has been done on the ticket below in the last 3 weeks. And now branch-2 can't be compiled because of hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSShell.java:[895,15] WINDOWS is not public in org.apache.hadoop.fs.Path; cannot be acce

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-25 Thread Konstantin Boudnik
ache.org/jira/browse/HDFS-4615?focusedCommentId=13612650&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13612650 > > Regards, > Suresh > > > On Mon, Mar 25, 2013 at 1:17 PM, Konstantin Boudnik wrote: > > > It doesn't look like any progress

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-25 Thread Konstantin Boudnik
Here's a daily build for hadoop-2 branch https://builds.apache.org/job/Hadoop-branch2 It just builds the full Hadoop project without running any tests (for now). Can be easily extended to do test runs/artifact deployment, if needed. Cos On Mon, Mar 25, 2013 at 07:14PM, Konstantin Bo

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-18 Thread Konstantin Boudnik
-0 the release is missing HADOOP-9704 that has critical effect on downstream projects e.g. build are affected. The issue has been raised for the first time back in 4/10/13 http://is.gd/OGb3GG and never been even sneezed upon. Cos On Sat, Apr 13, 2013 at 03:26AM, Arun C Murthy wrote: > Folks, >

Re: [DISCUSS] Getting to Hadoop 2.X beta

2013-04-24 Thread Konstantin Boudnik
To add to it, here's what have been experiences as a disconnect during the release cycle of 2.0.4-alpha using BigTop 0.6.6 as the integration platform and management stack of choice: 1. Need for improved feedback from the downstream projects 2. Need for improved feedback from the DevOps W

Bugfix release 2.0.4.1

2013-05-14 Thread Konstantin Boudnik
I'd like to spin-off a bugfix release for 2.0.4-alpha containing fix for MAPREDUCE-5240 Vinod has the fix on branch-2 already, so it seems like a no-brainer backport. However, the issue is blocking Bigtop 0.6.0 from being released on top of 2.0.4-alpha. I am planning to backport the fix into 2.0

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Konstantin Boudnik
Indeed. I think the root of the issue is deeper. ASF software practices are great to deal with isolated, relatively contained projects like httpd, libreoffice, trac, etc. However, Hadoop based stack - essentially, software aimed at enterprises with bigger scale operations - is a different animal, t

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Konstantin Boudnik
Guys, I guess what you're missing is that Bigtop isn't a testing framework for Hadoop. It is stack framework that verifies that components are dealing with each other nicely. Every single stack is different: Bigtop 0.5.0 differs from 0.6.0, and so on. Bigtop - as any other ASF project - has its re

Re: [VOTE] - Release 2.0.5-beta

2013-05-15 Thread Konstantin Boudnik
On Wed, May 15, 2013 at 10:52PM, Suresh Srinivas wrote: > > Assuming that you are talking about HDFS features when you say > > > > "features going into a beta on a very short short timetable" and > > > "laundry list" etc, > > > > > > > No, that would not be a correct assumption. > > > > So these f

Re: Bugfix release 2.0.4.1

2013-05-20 Thread Konstantin Boudnik
I have ran the full set of unit tests on the patched version and I see 3 failures in HDFS HA stress tests, which are clearly not related to fix in question. I will commit it shortly. Cos On Thu, May 16, 2013 at 12:03AM, Roman Shaposhnik wrote: > On Wed, May 15, 2013 at 11:09 PM, Vinod Kumar Vavil

Re: Bugfix release 2.0.4.1

2013-05-20 Thread Konstantin Boudnik
The build is over, all unit tests have passed. Roman, the 2.0.4.1 tarballs are available from https://builds.apache.org/job/Hadoop-branch-2.0.4/47/ For Bigtop to use as the base. Cos On Mon, May 20, 2013 at 12:15PM, Konstantin Boudnik wrote: > I have ran the full set of unit tests on

Re: Bugfix release 2.0.4.1

2013-05-24 Thread Konstantin Boudnik
Forwarded message -- > From: Konstantin Boudnik > Date: Mon, May 20, 2013 at 9:03 PM > Subject: Re: Bugfix release 2.0.4.1 > To:═common-dev@hadoop.apache.org > > > The build is over, all unit tests have passed. > Roman, the 2.0.4.1 tarballs are available from > https://

[VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-24 Thread Konstantin Boudnik
All, I have created a release candidate (rc0) for hadoop-2.0.4.1-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/h

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
re very confusing. Some of them never been concluded, the branches are moved and artifact versions seem to be colliding. 2.0.4.x seems to work well for the stabilization purposes and it will allow to unblock downstream and integration projects quickly. Cos > Arun > > On May 24, 2013, at 8:48 P

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
is the first time we are seeing a four-numbered scheme in > > Hadoop. Why not call this 2.0.5-alpha? > > Good point. Since it contains only backports from branch-2, it would > make sense for it to be an intermediate release. > > I shouldn't have to say this, but I&

Re: Cannot update "PoweredBy" wiki page

2013-05-30 Thread Konstantin Boudnik
Someone with proper karma needs to add you into ACL for this page. On Thu, May 30, 2013 at 11:14PM, Adam Kawa wrote: > Hi, > > When uploading new content (and information about my company), I got the > exception > "Sorry, can not save page because "rubbelloselotto.de" is not allowed in > this wik

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
On Thu, May 30, 2013 at 03:18PM, Chris Douglas wrote: > On Thu, May 30, 2013 at 2:39 PM, Konstantin Boudnik wrote: > > There's no misunderstanding Chris - this release is to unblock downstream. > > > > As for your question: I don't have a crystal ball; I wish thou

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
that's standard > usage. Whoever makes the 2.0.5 release (or any "next" release) is expected > to update the parent branch's SNAPSHOT default versioning, per > HowToReleasePostMavenization#Branching<https://wiki.apache.org/hadoop/HowToReleasePostMavenization#Branching&

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
tml > > 0.17.2 was missing some native libs so 0.17.2.1 was released to fix > that critical issue instead of calling it .3 Exactly the point - the _bigfix_ release. Thanks for pointing out the similarities. Cos > > J-D > > On Thu, May 30, 2013 at 3:52 PM, Konstantin Boudnik

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
On Thu, May 30, 2013 at 05:30PM, Chris Douglas wrote: > On Thu, May 30, 2013 at 3:25 PM, Konstantin Boudnik wrote: > > There's no plans to release anything else at this point - this is a bug-fix > > release, as I pointed out on a numerous occasions. There's no new fe

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-30 Thread Konstantin Boudnik
urrent 2.0.5 version in JIRA to 2.1.0, create a new 2.0.5 > version, change the fix version of the 2 JIRAs that make the RC > > Thanks. > > > On Thu, May 30, 2013 at 6:18 PM, Chris Douglas wrote: > > > On Thu, May 30, 2013 at 5:51 PM, Konstantin Boudnik > > wr

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-05-31 Thread Konstantin Boudnik
o 2.0.5-alpha versions > in jira for HADOOP, HDFS, YARN & MAPREDUCE. > > Please take care of the rest. > > Also, in branch-2, the version should be 2.1.0-SNAPSHOT. > > thanks, > Arun > > > > > Thanks. > > > > > > On Thu, May 30, 20

Heads up: moving from 2.0.4.1-alpha to 2.0.5-alpha

2013-05-31 Thread Konstantin Boudnik
Guys, I will be performing some changes wrt to moving 2.0.4.1 release candidate to 2.0.5 space. As outline below by Alejandro: 1. I will create new 2.0.5-alpha branch from the current head of 2.0.4-alpha that contains 2.0.4.1 changes 2. consequently, set the artifacts version on the new branch to

Re: Heads up: moving from 2.0.4.1-alpha to 2.0.5-alpha

2013-05-31 Thread Konstantin Boudnik
, 2013 at 12:45 PM, Konstantin Boudnik wrote: > > > Guys, > > > > I will be performing some changes wrt to moving 2.0.4.1 release candidate > > to > > 2.0.5 space. As outline below by Alejandro: > > > > 1. I will create new 2.0.5-alpha branch from the current

[VOTE] Release Apache Hadoop 2.0.5-alpha

2013-05-31 Thread Konstantin Boudnik
All, I have created a release candidate (rc0) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/had

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-05-31 Thread Konstantin Boudnik
oes not have the 2.0.5-alpha section (it should > be there empty). > > Cos, can you please look at these 2 things and explain/fix? > > Thanks. > > > > On Fri, May 31, 2013 at 4:04 PM, Konstantin Boudnik wrote: > > > All, > > > > I have create

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-05-31 Thread Konstantin Boudnik
that you guys have noted earlier and will be re-spinning RC1 in a few. Cos On Fri, May 31, 2013 at 08:07PM, Konstantin Boudnik wrote: > Alejandro, > > thanks for looking into this. Indeed - I missed the 2.0.5-alpha section in > YARN CHANGES.txt. Added now. As for HDFS-4646: appare

[VOTE] Release Apache Hadoop 2.0.5-alpha (rc1)

2013-05-31 Thread Konstantin Boudnik
All, I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues discovered in the testing with BigTop 0.6.0 release candidate. The RC is available at: http://people.apache.org/~cos/had

Re: [VOTE] Release Apache Hadoop 2.0.4.1-alpha

2013-06-01 Thread Konstantin Boudnik
Chris, with 2.0.5-alpha (rc1) out, would you please take a look at the release bits? I assume the four-digit numbering scheme issue has been resolved now. Regards, Cos On Thu, May 30, 2013 at 06:18PM, Chris Douglas wrote: > On Thu, May 30, 2013 at 5:51 PM, Konstantin Boudnik wrote: &g

Re: Heads up: moving from 2.0.4.1-alpha to 2.0.5-alpha

2013-06-01 Thread Konstantin Boudnik
I changes are completed, I have updated branch-2 and trunk CHANGES.txt files as planned. Version of the branch-2 is set to 2.1.0-beta; 2.0.5-alpha release artifacts are deployed to the staging area. Thanks for your patience, guys! Cos On Fri, May 31, 2013 at 12:45PM, Konstantin Boudnik wrote

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Konstantin Boudnik
ttp://people.apache.org/~cos/hadoop-2.0.5-alpha-rc1/ > > looks good to me. > > +1 (non-binding) > > > > Thanks, > > > > Joep > > > > > > On Fri, May 31, 2013 at 8:25 PM, Konstantin Boudnik > > wrote: > > > > > Ok, WRT HDFS-

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Konstantin Boudnik
asy way to solve it it would be > using as release date the date the vote ends. Anyway, not a big deal if we > are not cutting a new rc for other reason > > +1 on rc1 > > Thx > > On Jun 2, 2013, at 12:04 AM, Konstantin Boudnik wrote: > > > Alejandro, > &

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Konstantin Boudnik
hes, ie branch-2 and trunk. Am I correct? Thanks, Cos > hth, > Arun > > On Jun 2, 2013, at 12:33 PM, Konstantin Boudnik wrote: > > > This is my first Hadoop release, so I am all ears ;) I looked at how Arun > > was > > cutting the previous 2.0.x and followed

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-02 Thread Konstantin Boudnik
out it I will alter the CHANGES.txt files thanks, Cos > Arun > > On Jun 2, 2013, at 6:41 PM, Konstantin Boudnik wrote: > > > On Sun, Jun 02, 2013 at 03:04PM, Arun C Murthy wrote: > >> I record the 'release date' as the one on which the build is crea

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha

2013-06-03 Thread Konstantin Boudnik
Ok, if this the consensus on the issue, then tonight I will cut rc2 with only CHANGES.txt release dates update. After that I will extend the vote once again. Sorry for the hassle to all who did voted before. Cos On Mon, Jun 03, 2013 at 12:18AM, Doug Cutting wrote: > On Sun, Jun 2, 2013 at 9:01

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)

2013-06-03 Thread Konstantin Boudnik
te before 06/06/2013 5pm PDT. Thanks for your patience! Cos On Fri, May 31, 2013 at 09:27PM, Konstantin Boudnik wrote: > All, > > I have created a release candidate (rc1) for hadoop-2.0.5-alpha that I would > like to release. > > This is a stabilization release that i

Re: [VOTE] Release Apache Hadoop 2.0.5-alpha (rc2)

2013-06-04 Thread Konstantin Boudnik
signatures, built, ran > single node cluster. > > Thanks, > Tom > > > > On 6/3/13 2:51 PM, "Konstantin Boudnik" wrote: > > >I have rolled out release candidate (rc2) for hadoop-2.0.5-alpha. > > > >The difference between rc1 and rc2 is th

[VOTE RESULT] Release Apache Hadoop 2.0.5-alpha (rc2)

2013-06-06 Thread Konstantin Boudnik
I am clearly +1 (non-binding) on the release. With 8 +1s (3 binding), no -1s or 0s the vote passes. Thanks to all who verified the bits, I'll push them out shortly. Thanks, Cos On Mon, Jun 03, 2013 at 12:51PM, Konstantin Boudnik wrote: > I have rolled out release candidate (rc2) fo

Re: [jira] Commented: (HADOOP-6120) Add support for Avro types in hadoop

2009-07-01 Thread Konstantin Boudnik
Thunderbird and Mutt are at least two which does thread JIRA's threads properly. The way they do so is by using Message-ID and In-Reply-To fields of a RFC-822 header. Cos On 6/29/09 11:31 PM, Sharad Agarwal (JIRA) wrote: [ https://issues.apache.org/jira/browse/HADOOP-6120?page=com.atlas

Re: [jira] Commented: (HADOOP-6120) Add support for Avro types in hadoop

2009-07-01 Thread Konstantin Boudnik
Sorry, please disregard this message - I've sent it to the wrong lists. On 7/1/09 1:04 PM, Konstantin Boudnik wrote: Thunderbird and Mutt are at least two which does thread JIRA's threads properly. The way they do so is by using Message-ID and In-Reply-To fields of a RFC-822 header.

Re: [VOTE] Push back code freeze for 0.21

2009-07-24 Thread Konstantin Boudnik
4 September to give the file append more time to be finished well. Clearly, I'm +1. -- Owen -- With best regards, Konstantin Boudnik (aka Cos) Yahoo! Grid Computing +1 (408) 349-4049 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 Attention! Streams of consciousness are disallowed

Re: [VOTE] Push back code freeze for 0.21

2009-07-24 Thread Konstantin Boudnik
code freeze back to 4 September to give the file append more time to be finished well. Clearly, I'm +1. -- Owen -- With best regards, Konstantin Boudnik (aka Cos) Yahoo! Grid Computing +1 (408) 349-4049 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 Attention!

Re: Contributing a New FileSystem Implementation - Questions About Process

2009-08-11 Thread Konstantin Boudnik
Jonathan, in case you need to take a look at a common testplan template you can find one in HDFS-265 or more generic in HADOOP-5587 Cos On 8/11/09 8:32 AM, Steve Loughran wrote: Jonathan Seidman wrote: Thanks for the replies. We'll create a patch for trunk and then include a 0.18 compatible

Re: running hadoop pipes locally (debugging / unit testing / gdb / c++)

2009-11-13 Thread Konstantin Boudnik
I'd suggest you start from http://wiki.apache.org/hadoop/HowToContribute -- Take care, Cos On 11/12/09 15:24 , Erez Katz wrote: Greetings, I have written a simple yet pretty handy framework for debugging hadoop pipes programs locally. It is called GaDooB ... combination of GDB and Hadoop :

Re: Hadoop coding style guideline

2009-11-20 Thread Konstantin Boudnik
> So, IMO, the goal should be the examples on 10-24 or 31-36. +1 I agree with Todd: the highlighted snippets are most appropriate as Java coding style. On 11/20/09 10:54 , Todd Lipcon wrote: My opinions on the groups of line numbers from that pastebin: 1-3: Definitely not - no reason for ) o

Re: HDFS-758 in Hadoop-21 , Updates to Namenode health page

2009-11-30 Thread Konstantin Boudnik
Looking it the patch it isn't obvious that this port should create any extra verification effort from the quality standpoint. Thus, it won't delay 0.21 release, IMO. +1 to back port it. -- With best regards, Konstantin Boudnik (aka Cos) Yahoo! Grid Computing

Re: adding functionality to retrieve file name from a block

2009-12-08 Thread Konstantin Boudnik
Another way is to go through the ReplicaInfo class which has package private File getBlockFile() method Cos On 12/8/09 17:12 , Suresh Srinivas wrote: There is no need to store file name in the block. Given block you can get BlockInfo, which has INodeFile. From this you can get the correspondi

Re: How to get a commit access?

2009-12-14 Thread Konstantin Boudnik
Please check Developer Documentation section of http://wiki.apache.org/hadoop/ In Particular: http://wiki.apache.org/hadoop/HowToContribute -- With best regards, Konstantin Boudnik (aka Cos) Yahoo! Grid Computing +1 (408) 349-4049 2CAC 8312 4870 D885 8616 6115 220F

Re: How to get a commit access?

2009-12-15 Thread Konstantin Boudnik
tached another patch file for this issue. Thanks! Xiao On Tue, Dec 15, 2009 at 11:37 AM, Konstantin Boudnik wrote: Please check Developer Documentation section of http://wiki.apache.org/hadoop/ In Particular: http://wiki.apache.org/hadoop/HowToContribute -- With best regards, Konstan

Re: hadoop-core via maven or ivy?

2009-12-17 Thread Konstantin Boudnik
All hadoop related snapshots are posted to Apache's repository https://repository.apache.org/content/repositories/snapshots/org/apache/hadoop/ Hope it help On 12/14/09 17:51 , sam rash wrote: Hi, If I have a project that I want to depend on a version of hadoop-core via maven (or even ivy) w

Re: How to get a commit access?

2010-01-06 Thread Konstantin Boudnik
JIRA system to properly mark this ticket. Cos On 12/15/09 09:10 , Konstantin Boudnik wrote: Oh, I see. Then someone need to 'merge' it back in 0.19. I'll try to do this by the end of the week. Cos On 12/15/09 02:45 , xiao yang wrote: It's a bug that has been fixed for

Re: JIRA Edits?

2010-01-26 Thread Konstantin Boudnik
I think it has been lost around the point of projects split, if I'm not mistaken... It is apparently a sad fact, although having firefox on-fly spell checking helps a lot :-) On Tue, Jan 26, 2010 at 05:13PM, Allen Wittenauer wrote: > [I'm sending this to common-dev@ cuz I don't think there is a g

Re: Rolling a Hadoop 0.20.2

2010-01-26 Thread Konstantin Boudnik
+1 On Tue, Jan 26, 2010 at 09:56AM, Owen O'Malley wrote: > I'm planning on rolling a Hadoop 0.20.2 today. Are there any blockers > that can't wait? > > -- Owen

Re: [paper] deconstruct HDFS

2010-02-26 Thread Konstantin Boudnik
Somewhat changing the topic: email isn't really a good way of storing documents. Just to make your life easier and since you're using google services anyway you might consider putting this paper to Google Docs and share it with everyone - that'd be an easier that 'email sharing' :) On Fri, Feb 26

Re: Map Reduce in heterogeneous environ..

2010-03-11 Thread Konstantin Boudnik
Another more dynamic way (what I did sometimes back at Sun) is to use JINI auto-discovery/registry capabilities to keep a central controller with up-to-date information about registered services configurations. Worked great. And I agree: pushing configs is messy and error-prone. Cos On Thu, Mar

Re: Should the Hadoop Common artifacts be called hadoop-common-{version}[-sources|javadoc].jar or hadoop-core-{version}[-sources|javadoc].jar?

2010-03-23 Thread Konstantin Boudnik
I believe they are commonly called '-core*' :) On Tue, Mar 23, 2010 at 07:07AM, Paolo Castagna wrote: > Hi, > how should the Hadoop Common artifacts be called: > > - hadoop-core-{version}.jar > - hadoop-core-{version}-sources.jar > - hadoop-core-{version}-javadoc.jar > > or: > > - hadoo

Re: Should the Hadoop Common artifacts be called hadoop-common-{version}[-sources|javadoc].jar or hadoop-core-{version}[-sources|javadoc].jar?

2010-03-23 Thread Konstantin Boudnik
On Tue, Mar 23, 2010 at 07:34AM, Paolo Castagna wrote: > Konstantin Boudnik wrote: > > I believe they are commonly called '-core*' :) > > Should they continue to be called '-core*' even if they belong to the > Hadoop Common project? Last I checked they

Re: [DISCUSSION] Release process

2010-03-26 Thread Konstantin Boudnik
On Wed, Mar 24, 2010 at 01:27PM, Brian Bockelman wrote: > a) Have a stable/unstable series (0.19.x is unstable, 0.20.x is stable, > 0.21.x is unstable). For the unstable releases, lower the bar for code > acceptance for less-risky patches. I can see how the different criteria of patch acceptanc

[DISCUSSION]: Integrating SureLogic into Hadoop

2010-05-05 Thread Konstantin Boudnik
Hello. As some of you might know we have the license for great concurrency analysis software from SureLogic. SureLogic engineers gave some run for HDFS, MR, and Zookeeper code at the end of last year. The tools seem very promising and supposedly bring us the value (linked from the page below). P

Re: [DISCUSSION]: Integrating SureLogic into Hadoop

2010-05-10 Thread Konstantin Boudnik
s and verifying that > they've fixed them. > > Thanks > -Todd > > > 2010/5/5 Konstantin Boudnik > > > Hello. > > > > As some of you might know we have the license for great concurrency > > analysis > > software from SureLogic. > > > &

Re: [DISCUSSION]: Integrating SureLogic into Hadoop

2010-05-14 Thread Konstantin Boudnik
hand, I got the word that CLI interfaces for their tools are in the testing phase right now, so we should be able to try them out shortly. Do we have any other concerns at this point? Cos On Mon, May 10, 2010 at 04:37PM, Konstantin Boudnik wrote: > This is very valid concern Todd. I am talking

Re: [DISCUSSION]: Integrating SureLogic into Hadoop

2010-05-19 Thread Konstantin Boudnik
ecting synchronization issues. > > Good that the licensing issues are cleared out. > > Thanks, Cos. > > --Konstantin > > > > > > > > On 5/14/2010 12:59 PM, Konstantin Boudnik wrote: > > > >> Here's an update from SureLogic on the licensi

Re: Building hadoop-common, hadoop-hdfs, hadoop-mapreduce from source, without using the hadoop Ivy / Maven repositories

2010-05-20 Thread Konstantin Boudnik
Check http://wiki.apache.org/hadoop/HowToContribute look for "Changes that span projects" section On Thu, May 20, 2010 at 07:28AM, Andrei Dragomir wrote: > I have some issues with compiling hadoop-common, hdfs and mapreduce from > source. > > Right now, the hdfs and mapreduce builds are broken

Re: Hadoop native libs as maven artifacts?

2010-07-07 Thread Konstantin Boudnik
I don't think they are actually missing. They rather were never published there. The main reason, I think, is that none of core functionality from upstream projects has a dependency on it. Cos On Wed, Jul 07, 2010 at 08:01AM, Andrzej Bialecki wrote: > Hi, > > Per subject - are these available fr

Re: Hadoop native libs as maven artifacts?

2010-07-08 Thread Konstantin Boudnik
Clearly it would take someone to work on the build changes for maven deployment of this new artifact ;) On Thu, Jul 08, 2010 at 06:30AM, Andrzej Bialecki wrote: > On 2010-07-08 04:14, Konstantin Boudnik wrote: > > I don't think they are actually missing. They rather were never publi

Re: compiline hadoop offline

2010-07-12 Thread Konstantin Boudnik
On Mon, Jul 12, 2010 at 08:28AM, Ahmad Shahzad wrote: > Hi ALL, >Is it possible to compile hadoop using ANT without being > connected to internet. Because whenever i compile hadoop, it checks for some > ivy dependencies online. If it is possible than what should i change to > compile ha

[DISCUSSION]: Future of Hadoop system testing

2010-10-08 Thread Konstantin Boudnik
earning curve for potential contributors who might want to join Hadoop community and helps us to make Hadoop even better product. -- With best regards, Konstantin Boudnik (aka Cos) A212 4206 7EC6 F8BF 20E6 7C37 32A5 E27E 4C03 A1A1 Attention! Streams of consciousness are disallowed Cos' pubkey: http://people.apache.org/~cos/cos.asc

Re: [DISCUSSION]: Future of Hadoop system testing

2010-10-14 Thread Konstantin Boudnik
On Thu, Oct 14, 2010 at 03:44PM, Steve Loughran wrote: > >On the other hand, there's a fairly large number of cases where no > >introspection into daemons' internals is required. These can be carried by > >a simple communication via Hadoop CLI. To name a few: testing ACL refreshes, > >basic file op

Re: ivy failed to resolve dependencies?

2010-11-01 Thread Konstantin Boudnik
Your issue is likely to be caused by commons-logging 1.1.2 - they have a corrupted pom file, I believe. Downgrade the version to 1.1.1 and everything should be fine. On Tue, Nov 02, 2010 at 11:56AM, Nan Zhu wrote: > Hi, Bharath > > Thank you for the reply > > I removed the entire cache of ivy an

Re: Hadoop Hudson builds updated

2010-11-24 Thread Konstantin Boudnik
On Tue, Nov 23, 2010 at 11:51PM, Nigel Daley wrote: > FYI, I've updated most Apache Hadoop builds on Hudson: > https://hudson.apache.org/hudson/view/G-L/view/Hadoop/ > > 1) updated email notification of build failure to include test failures and > less console log > 2) added common, MR, and HDFS

Re: Review Request: Add copyBytes method to Text and BytesWritable to improve usability

2010-12-16 Thread Konstantin Boudnik
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/182/#review73 --- Ship it! - Konstantin On 2010-12-16 05:35:58, Owen O'Malley wrote: >

Re: How to write test cases for ensuing stream's/socket's closure either in catch block or finally block

2011-01-17 Thread Konstantin Boudnik
Moving hdfs-dev@ and mapreduce-dev@ to Bcc: to avoid cross-postings. >From what I understand you want to have a test case which demonstrates that whatever socket/stream connections were opened are properly closed in case of IOException? I guess one of many possibilities would be to check if a conn

Re: debugging hadoop

2011-01-26 Thread Konstantin Boudnik
Another way is to use Java remove debugging feature, which allows you to keep your IDE and source code locally and run a Hadoop daemon with a couple extra JVM flags to bring up debug server within the process. On Wed, Jan 26, 2011 at 09:22, Steve Loughran wrote: > On 23/01/11 06:31, Zinab Ahmed M

Re: debugging hadoop

2011-01-26 Thread Konstantin Boudnik
ess my minds were remote when I was typing... > On Wed, Jan 26, 2011 at 12:27 PM, Konstantin Boudnik wrote: > >> Another way is to use Java remove debugging feature, which allows you >> to keep your IDE and source code locally and run a Hadoop daemon with >> a couple extra JVM flags to bring up debug server within the process. >> >

  1   2   3   >