[jira] [Resolved] (HADOOP-9578) Fails to build with protobuf 2.5.0

2013-05-18 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar resolved HADOOP-9578. - Resolution: Duplicate > Fails to build with protobuf 2.

[jira] [Created] (HADOOP-9578) Fails to build with protobuf 2.5.0

2013-05-18 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9578: --- Summary: Fails to build with protobuf 2.5.0 Key: HADOOP-9578 URL: https://issues.apache.org/jira/browse/HADOOP-9578 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-9539) Unit tests failing on FreeBSD

2013-05-01 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9539: --- Summary: Unit tests failing on FreeBSD Key: HADOOP-9539 URL: https://issues.apache.org/jira/browse/HADOOP-9539 Project: Hadoop Common Issue Type: Bug

Re: need patch reviews

2012-12-16 Thread Radim Kolar
https://issues.apache.org/jira/browse/YARN-223 https://issues.apache.org/jira/browse/YARN-210 https://issues.apache.org/jira/browse/YARN-211 https://issues.apache.org/jira/browse/MAPREDUCE-4839 https://issues.apache.org/jira/browse/HADOOP-9088 https://issues.apache.org/jira/browse/MAPREDUCE-4827

Re: need patch reviews

2012-12-13 Thread Radim Kolar
HADOOP-8698 too

need patch reviews

2012-12-13 Thread Radim Kolar
https://issues.apache.org/jira/browse/YARN-223 https://issues.apache.org/jira/browse/YARN-210 https://issues.apache.org/jira/browse/YARN-211 https://issues.apache.org/jira/browse/MAPREDUCE-4839 https://issues.apache.org/jira/browse/HADOOP-9088 https://issues.apache.org/jira/browse/MAPREDUCE-4827 h

Re: [DISCUSS] create a hadoop-build subproject (a follow up on the thread 'introduce Python as build-time...')

2012-12-11 Thread Radim Kolar
what is proposed build workflow? Its enough to do mvn install to get custom plugins available to maven in build phase or you must setup own mvn repo and do mvn deploy?

Re: [DISCUSS] create a hadoop-build subproject (a follow up on the thread 'introduce Python as build-time...')

2012-12-07 Thread Radim Kolar
1. cmake and protoc maven plugins already exists. why you want to write a new ones? 2. Groovy accepts java syntax. Just rewrite saveVersion.sh to java (its done already in JIRA) and put it in pom.xml - no overhaul of build infrastructure needed.

[jira] [Created] (HADOOP-9122) Add powermock library for writing better unit tests

2012-12-06 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9122: --- Summary: Add powermock library for writing better unit tests Key: HADOOP-9122 URL: https://issues.apache.org/jira/browse/HADOOP-9122 Project: Hadoop Common

[jira] [Resolved] (HADOOP-9076) Fix QA bot in YARN project

2012-12-06 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar resolved HADOOP-9076. - Resolution: Incomplete not need this one anymore > Fix QA bot in YARN proj

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-12-04 Thread Radim Kolar
result of vote is to close https://issues.apache.org/jira/browse/HADOOP-9073 and write groovy in pom.xml variant (option number 2)?

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-30 Thread Radim Kolar
inline ant scripts =0. Ant's versioning is stricter; you can pull down the exact Jar versions, and some of us in the Ant team worked very hard to get it going everywhere. You don't gain anything by going to .py there are sh scripts inside maven ant plugin stuff

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-29 Thread Radim Kolar
* What else in the current build, besides saveVersion.sh, you see as candidate to be migrated to Phyton? inline ant scripts

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-26 Thread Radim Kolar
In the PROPOSAL thread you indicated this was for Hadoop1 because it is ANT based. And the main reason was to remove saveVersion.sh. Your #3 was not discussed in the proposal, was it? it was part of original proposal but not discussed much because language war was more attractive option. You

Re: commit access to hadoop

2012-11-26 Thread Radim Kolar
The main "feature" is that when you get the +1 vote you yourself get to deal with the grunge work of apply patches to one or more svn branches, resyncing that with the git branches you inevitably do your own work on. no, main feature is major speed advantage. It takes forever to get something

Re: trailing whitespace

2012-11-26 Thread Radim Kolar
I've never understood why folks get worked up over a little trailing whitespace here and there, since you can't see it and it doesn't affect correctness. Spurious whitespace changes that make a review harder - those are annoying. Trailing whitespace inadvertently left on lines where legitimate cha

Re: [VOTE] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-26 Thread Radim Kolar
-1, +1, -1

trailing whitespace

2012-11-25 Thread Radim Kolar
I propose addition to QA bot - check for trailing whitespace in patches. Probably checking for tabs in Java files would be also good idea.

[jira] [Created] (HADOOP-9088) Add Murmur3 hash

2012-11-24 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9088: --- Summary: Add Murmur3 hash Key: HADOOP-9088 URL: https://issues.apache.org/jira/browse/HADOOP-9088 Project: Hadoop Common Issue Type: Improvement

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-24 Thread Radim Kolar
we have not discussed advantages of stand alone python vs jython-in-maven pom http://code.google.com/p/jy-maven-plugin/ language is about same, and it does not needs to have installed, which is advantage on windows.

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-23 Thread Radim Kolar
discussion seems to ended, lets start vote.

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-22 Thread Radim Kolar
We'd still need to preserve whatever permissions are present in the Jetty distribution. in jetty distribution there is just one shell startup script and you can even run jetty without it using autostartable jar. Requirement to preserve permissions is overkill. at most you need just to chmod +

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
pretty much all of the j* in JSR223 land is abomination of one sort or another, actually :) jruby is good because you can run rails application on standard Java infrastructure which is way easier to maintain, then obscure Ruby application servers.

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
Dne 22.11.2012 1:14, Chris Nauroth napsal(a): The trickiest maintenance issue is hadoop-hdfs-httpfs, where we unpack and repack a Tomcat. why its not possible to just ship WAR file? Its seems to be special purpose app and they needs hand security setup anyway and intergration with existing fir

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
/Ignore Python 3 for the time being, it's a completely different language with incompatible syntax and semantics that doesn't support several currently-important platforms. Maybe in a few years sane people can consider moving to it, but for now it's best to just stick with the compatible subset

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
Dne 21.11.2012 22:44, Chris Nauroth napsal(a): Sorry, to clarify my point a little more, Ant does allow you to make declarations to explicitly set the desired file permissions via the fileMode attribute of a tarfileset. there are just 2 directories /bin and /sbin with executable files. Its proba

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
Dne 21.11.2012 22:03, Chris Nauroth napsal(a): For creation of the distribution tarballs, the Maven Ant Plugin (and actually the underlying Ant tool) cannot preserve file permissions or symlinks. maven assembly plugin can deal with file permissions. not sure about symlinks. I do not remember dis

Re: [PROPOSAL] introduce Python as build-time and run-time dependency for Hadoop and throughout Hadoop stack

2012-11-21 Thread Radim Kolar
Why not do a maven-plugin to do that? maven plugins are difficult to maintain. its better to use inline scripts, with something like this: http://docs.codehaus.org/display/GMAVEN/Home;jsessionid=E29093B96230BBB4461F02A1718A6B71

[jira] [Created] (HADOOP-9076) Fix QA bot in YARN project

2012-11-21 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9076: --- Summary: Fix QA bot in YARN project Key: HADOOP-9076 URL: https://issues.apache.org/jira/browse/HADOOP-9076 Project: Hadoop Common Issue Type: Task

commit access to hadoop

2012-11-21 Thread Radim Kolar
what it takes to gain commit access to hadoop?

[jira] [Created] (HADOOP-9073) Migrate saveVersion.sh script to python

2012-11-20 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9073: --- Summary: Migrate saveVersion.sh script to python Key: HADOOP-9073 URL: https://issues.apache.org/jira/browse/HADOOP-9073 Project: Hadoop Common Issue Type

lifecycle support for Partitioner and RawComparator

2012-11-20 Thread Radim Kolar
I would like to have lifesupport in partitioner and comparator see: https://issues.apache.org/jira/browse/MAPREDUCE-4594 my proposed change is to make both classes, not interfaces.

Re: building hadoop under windows

2012-11-19 Thread Radim Kolar
Dne 19.11.2012 18:21, Giridharan Kesavan napsal(a): saveVersion.py is made available with https://issues.apache.org/jira/browse/HADOOP-8924 what are merge plans for trunk? Using jython to run it from maven?

building hadoop under windows

2012-11-19 Thread Radim Kolar
saveVersion.sh prevents hadoop from building on windows what about to rewrite this script into groovy and run it with maven groovy plugin?

[jira] [Created] (HADOOP-9041) FileSystem inicialization can go into infinite looop

2012-11-14 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-9041: --- Summary: FileSystem inicialization can go into infinite looop Key: HADOOP-9041 URL: https://issues.apache.org/jira/browse/HADOOP-9041 Project: Hadoop Common

circular problem during reading from jar on hdfs

2012-11-05 Thread Radim Kolar
can be FileSystem.loadFileSystems() turned into static init to avoid infinite loop? Exception in thread "main" java.lang.StackOverflowError at java.net.URLStreamHandler.parseURL(URLStreamHandler.java:127) at sun.net.www.protocol.file.Handler.parseURL(Handler.java:67) at j

[jira] [Reopened] (HADOOP-8901) GZip and Snappy support may not work without unversioned libraries

2012-10-23 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar reopened HADOOP-8901: - > GZip and Snappy support may not work without unversioned librar

[jira] [Created] (HADOOP-8811) Compile hadoop native library in FreeBSD

2012-09-14 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8811: --- Summary: Compile hadoop native library in FreeBSD Key: HADOOP-8811 URL: https://issues.apache.org/jira/browse/HADOOP-8811 Project: Hadoop Common Issue Type

YARN jobs takes too long to start

2012-09-10 Thread Radim Kolar
I noticed that after some update on branch 0.23 yarn jobs are about 4 minutes in PREP stage. I tried to track source of problem at it seems that chmod 0700 is called on every class file unpacked from job JAR. Can you point me to code which is doing it, hadoop also supports recursive chmod whic

Re: Fwd: QA BOT

2012-09-04 Thread Radim Kolar
There is really QA bot set for YARN but it does not seems to pickup new jobs from JIRA. Can you look at it? https://builds.apache.org/view/Hadoop/job/PreCommit-YARN-Build/

Fwd: QA BOT

2012-09-03 Thread Radim Kolar
QA bot do not works for YARN project? My submitted patch to https://issues.apache.org/jira/browse/YARN-57 didnt get usual qa bot check.

[jira] [Created] (HADOOP-8698) Do not call unneceseary setConf(null) in Configured constructor

2012-08-14 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8698: --- Summary: Do not call unneceseary setConf(null) in Configured constructor Key: HADOOP-8698 URL: https://issues.apache.org/jira/browse/HADOOP-8698 Project: Hadoop Common

serializable writables - HADOOP-8619

2012-08-09 Thread Radim Kolar
I really needs writables to be serializable for using cache on top of writables. https://issues.apache.org/jira/browse/HADOOP-8619 can someone review this ticket and close it (as fixed or wont fix), i need to know final decision.

Re: More descriptive patch application failed from preCommit build system

2012-08-03 Thread Radim Kolar
Dne 3.8.2012 13:34, Radim Kolar napsal(a): Dne 3.8.2012 13:18, Radim Kolar napsal(a): can be auto build script changed a bit to send output from patch to stdout instead of eating it? You also need to increase patch's fuzz factor, diff from MAPREDUCE-4275 was not applied because i

[jira] [Resolved] (HADOOP-8441) Build bot timeout is too small

2012-08-03 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar resolved HADOOP-8441. - Resolution: Not A Problem it seems to work fine these days. > Build

Re: More descriptive patch application failed from preCommit build system

2012-08-03 Thread Radim Kolar
Dne 3.8.2012 13:18, Radim Kolar napsal(a): can be auto build script changed a bit to send output from patch to stdout instead of eating it? looking at pre commit build failures: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/ its common problem and without more detailed information

More descriptive patch application failed from preCommit build system

2012-08-03 Thread Radim Kolar
can be auto build script changed a bit to send output from patch to stdout instead of eating it? i need idea why patch failed to apply https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/2702/console

Re: MultithreadedMapper

2012-07-26 Thread Radim Kolar
But I found that synchronization is needed for record reading(read the input Key and Value) and result output. I use Spring Batch for that. it has io buffering builtin and it is very easy to use and well documented.

[jira] [Created] (HADOOP-8619) WritableComparator must implement no-arg constructor

2012-07-24 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8619: --- Summary: WritableComparator must implement no-arg constructor Key: HADOOP-8619 URL: https://issues.apache.org/jira/browse/HADOOP-8619 Project: Hadoop Common

Re: Shifting to Java 7 . Is it good choice?

2012-07-17 Thread Radim Kolar
I have to tweak a few classes and for this I needed few packages which are only present in Java 7 like "java.nio.file" , So I was wondering If I can shift my development environment of Hadoop to Java 7? Would this break anything ? openjdk 7 works, but nio async file access is slower then tra

[jira] [Reopened] (HADOOP-8543) Invalid pom.xml files on 0.23 branch

2012-07-03 Thread Radim Kolar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Radim Kolar reopened HADOOP-8543: - > Invalid pom.xml files on 0.23 bra

[jira] [Created] (HADOOP-8543) Invalid pom.xml files on 0.23 branch

2012-06-29 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8543: --- Summary: Invalid pom.xml files on 0.23 branch Key: HADOOP-8543 URL: https://issues.apache.org/jira/browse/HADOOP-8543 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8527) Dont use JDK6 tools as dependency

2012-06-25 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8527: --- Summary: Dont use JDK6 tools as dependency Key: HADOOP-8527 URL: https://issues.apache.org/jira/browse/HADOOP-8527 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8501) Gridmix fails to compile on OpenJDK7u4

2012-06-09 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8501: --- Summary: Gridmix fails to compile on OpenJDK7u4 Key: HADOOP-8501 URL: https://issues.apache.org/jira/browse/HADOOP-8501 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-8441) Build bot timeout is too small

2012-05-26 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8441: --- Summary: Build bot timeout is too small Key: HADOOP-8441 URL: https://issues.apache.org/jira/browse/HADOOP-8441 Project: Hadoop Common Issue Type: Bug

Re: cmake

2012-05-22 Thread Radim Kolar
i have better experience with scons instead of cmake

pom.xml validation

2012-05-17 Thread Radim Kolar
Dne 5.5.2012 17:11, Radim Kolar napsal(a): I really need to get this committed. Its simple, trivial fix and it is show stopper for me. Need to do automated static testing of hadoop builds with my patches. https://issues.apache.org/jira/browse/HADOOP-8268 i made patch for POM files. In addition

HADOOP-8268

2012-05-05 Thread Radim Kolar
I really need to get this committed. Its simple, trivial fix and it is show stopper for me. Need to do automated static testing of hadoop builds with my patches. https://issues.apache.org/jira/browse/HADOOP-8268

[jira] [Created] (HADOOP-8360) empty-configuration.xml fails xml validation

2012-05-04 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8360: --- Summary: empty-configuration.xml fails xml validation Key: HADOOP-8360 URL: https://issues.apache.org/jira/browse/HADOOP-8360 Project: Hadoop Common Issue

Re: Supporting cross-project Jenkins builds

2012-04-27 Thread Radim Kolar
Dne 18.4.2012 0:17, Giridharan Kesavan napsal(a): I agree with Aaron. Its going increase the test patch build timings significantly which may not be very helpful There are 9 build machines dedicated to hadoop. I would like that automatic checking can finally test my patches like MAPREDUCE-4116 <

[jira] [Created] (HADOOP-8317) Update maven-assembly-plugin to 2.3 - fix build on FreeBSD

2012-04-25 Thread Radim Kolar (JIRA)
Radim Kolar created HADOOP-8317: --- Summary: Update maven-assembly-plugin to 2.3 - fix build on FreeBSD Key: HADOOP-8317 URL: https://issues.apache.org/jira/browse/HADOOP-8317 Project: Hadoop Common

HADOOP-8268

2012-04-12 Thread Radim Kolar
can somebody take a peek on patch attached to ticked and enlighten me why it does not apply?

[jira] [Created] (HADOOP-8268) hadoop-project-dist/pom.xml fails XML validation

2012-04-11 Thread Radim Kolar (Created) (JIRA)
Affects Versions: 0.23.0 Environment: FreeBSD 8.2 / AMD64 Reporter: Radim Kolar Attachments: hadoop-pom.txt In this pom file are embedded ant commands which contains '>' - redirection. This makes XML file invalid and this POM file can not be deployed int