Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
It's not an issue with hdfs/hadoop JARs itself, but the POMs -and the same problem exists with the hadoop core JAR - too much stuff you don't need client side. We can address this -without changing the packaging into an hdfs-client.jar (and so complicating everything related to HDFS code). All we

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
On 3 April 2014 00:02, Haohui Mai wrote: > The rpc and the web client can stay in one jar for the first cut. Indeed it > might introduce some extra dependency, but the downstream projects always > have the option to implement the webhdfs protocol themselves if they really > need to avoid the depe

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
to follow up with an example, JIRA on updating dependencies and tuning the POMs https://issues.apache.org/jira/browse/HADOOP-9991 here's a JIRA on dropping ZK from the hadoop-client POM https://issues.apache.org/jira/browse/HADOOP-9905 ​ And there's an mr-client POM where we've been slowly cut

[jira] [Created] (HDFS-6189) Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon.

2014-04-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-6189: --- Summary: Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. Key: HDFS-6189 URL: https://issues.apache.org/jira/browse/HDFS-6189

[jira] [Created] (HDFS-6190) minor textual fixes in DFSClient

2014-04-03 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6190: -- Summary: minor textual fixes in DFSClient Key: HDFS-6190 URL: https://issues.apache.org/jira/browse/HDFS-6190 Project: Hadoop HDFS Issue Type: Improvement

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Alejandro Abdelnur
Haouhi's suggestion of a hdfs-client JAR with client dependencies only, would be IMO the 'correct' way of doing things, we should have a hdfs-server and hdfs-client JARs. Doing this is practice is not trivial as classes are not properly segregated. So, Steven's suggestion of an hdfs-client seems

[jira] [Created] (HDFS-6191) Disable quota checks when replaying edit log.

2014-04-03 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6191: Summary: Disable quota checks when replaying edit log. Key: HDFS-6191 URL: https://issues.apache.org/jira/browse/HDFS-6191 Project: Hadoop HDFS Issue Type: Improveme

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Azuryy
Did you tested RM failover on Hive? There is bug. Sent from my iPhone5s > On 2014年4月4日, at 2:12, Xuan Gong wrote: > > +1 non-binding > > Built from source code, tested on a single node cluster. Successfully ran a > few MR sample jobs. > Tested RM failover while job is running. > > Thanks >

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Haohui Mai
HDFS-6180 seems to be a blocker of 2.4. I'll post a patch later today. ~Haohui On Thu, Apr 3, 2014 at 3:47 PM, Azuryy wrote: > Did you tested RM failover on Hive? There is bug. > > > Sent from my iPhone5s > > > On 2014年4月4日, at 2:12, Xuan Gong wrote: > > > > +1 non-binding > > > > Built from

[jira] [Created] (HDFS-6192) WebHdfs call for setting quotas

2014-04-03 Thread Romain Rigaux (JIRA)
Romain Rigaux created HDFS-6192: --- Summary: WebHdfs call for setting quotas Key: HDFS-6192 URL: https://issues.apache.org/jira/browse/HDFS-6192 Project: Hadoop HDFS Issue Type: Bug Com

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Azurry, can you file the RM-failover related bug as a JIRA? I'm going to reproduce it in my local. Thanks, - Tsuyoshi On Fri, Apr 4, 2014 at 7:47 AM, Azuryy wrote: > Did you tested RM failover on Hive? There is bug. > > > Sent from my iPhone5s > >> On 2014年4月4日, at 2:12, Xuan Gong wrote: >> >>

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Hi, Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) fail. The log of the test failure is as follows: https://gist.github.com/oza/9965197 Should we fix or disable the feature? Thanks, - Tsuyoshi On Mon, Mar 31, 2014 at 6:22 PM, Arun C Murthy wrote: > Folks, > > I've creat

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Hi, Updated a test result log based on the result of 2.4.0-rc0: https://gist.github.com/oza/9965197 IMO, there are some blockers to be fixed: * MAPREDUCE-5815(TestMRAppMaster failure) * YARN-1872(TestDistributedShell failure) * HDFS: TestSymlinkLocalFSFileSystem failure on Linux (I cannot find JI