[jira] [Created] (HDFS-5433) When reloading fsimage during checkpointing, we should clear existing snapshottable directories

2013-10-25 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5433: Summary: When reloading fsimage during checkpointing, we should clear existing snapshottable directories Key: HDFS-5433 URL: https://issues.apache.org/jira/browse/HDFS-5433

[jira] [Created] (HDFS-5432) TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost.

2013-10-25 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5432: --- Summary: TestDatanodeJsp fails on Windows due to assumption that loopback address resolves to host name localhost. Key: HDFS-5432 URL: https://issues.apache.org/jira/browse/HDFS-543

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-25 Thread Haohui Mai
Thanks for the reply, Luke. Here I just echo my response from the jira: bq. this client-side js only approach, which is less secure than a progressively enhanced hybrid approach used by YARN. The recent gmail XSS fiasco highlights the issue. I'm presenting an informal security analysis to compare

Re: [VOTE] Merge HDFS-4949 to trunk

2013-10-25 Thread Colin McCabe
On Fri, Oct 25, 2013 at 10:07 AM, Suresh Srinivas wrote: > I posted a comment in the other thread about feature branch merges. > > My preference is to make sure the requirements we have for regular patches > be applied to feature branch patch as well (3 +1s is the only exception). > Also > adding

[jira] [Created] (HDFS-5431) support cachepool-based quota management in path-based caching

2013-10-25 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5431: -- Summary: support cachepool-based quota management in path-based caching Key: HDFS-5431 URL: https://issues.apache.org/jira/browse/HDFS-5431 Project: Hadoo

[jira] [Created] (HDFS-5430) Support TTL on CacheBasedPathDirectives

2013-10-25 Thread Colin Patrick McCabe (JIRA)
Colin Patrick McCabe created HDFS-5430: -- Summary: Support TTL on CacheBasedPathDirectives Key: HDFS-5430 URL: https://issues.apache.org/jira/browse/HDFS-5430 Project: Hadoop HDFS Issue T

[jira] [Resolved] (HDFS-5424) Verify initializations of LocatedBlock/RecoveringBlock

2013-10-25 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5424. - Resolution: Duplicate Release Note: Jira seems to have created a duplicate. > Verify initial

[jira] [Created] (HDFS-5429) Deprecate FsDatasetSpi#getBlockReport

2013-10-25 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5429: --- Summary: Deprecate FsDatasetSpi#getBlockReport Key: HDFS-5429 URL: https://issues.apache.org/jira/browse/HDFS-5429 Project: Hadoop HDFS Issue Type: Sub-task

Re: Exception in mid of reading files.

2013-10-25 Thread Chris Nauroth
Hi Divya, The exceptions indicate that the HDFS client failed to establish a network connection to a datanode hosting a block that the client is trying to read. After too many of these failures (default 3, but configurable), the HDFS client aborts the read and this bubbles up to the caller with t

[jira] [Resolved] (HDFS-5417) Fix storage IDs in PBHelper and UpgradeUtilities

2013-10-25 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-5417. -- Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Ha

[jira] [Resolved] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved HDFS-5426. -- Resolution: Duplicate > Fix NPE in PBHelper > --- > > Key: HDFS-5426 >

Re: [VOTE] Merge HDFS-4949 to trunk

2013-10-25 Thread Suresh Srinivas
I posted a comment in the other thread about feature branch merges. My preference is to make sure the requirements we have for regular patches be applied to feature branch patch as well (3 +1s is the only exception). Also adding details about what functionality is missing (I posted a comment on HD

Re: Replacing the JSP web UIs to HTML 5 applications

2013-10-25 Thread Luke Lu
Echoing my comments on HDFS-3555: I have concerns with this client-side js only approach, which is less secure than a progressively enhanced hybrid approach used by YARN. The recent gmail XSS fiasco highlights the issue. I also have concerns that we commit these changes without matching unit tests

Re: [VOTE] Merge HDFS-4949 to trunk

2013-10-25 Thread Chris Nauroth
> Are there any other things we should do today prior to merging? Can we get the user documentation done soon (HDFS-5386)? I've given a round of feedback. If it helps, I can volunteer to upload a new patch that incorporates my feedback. Chris Nauroth Hortonworks http://hortonworks.com/ On Th

Build failed in Jenkins: Hadoop-Hdfs-trunk #1563

2013-10-25 Thread Apache Jenkins Server
See Changes: [brandonli] HDFS-5171. NFS should create input stream for a file and try to share it with multiple read requests. Contributed by Haohui Mai [sandy] YARN-1335. Move duplicate code from FSSchedulerApp and FiCaSchedulerApp

Exception in mid of reading files.

2013-10-25 Thread Divya R
Hi Guys, I'm indexing data (~50 -100GB per day) from hadoop. Hadoop is Running in cluster mode (having 2 dataNaodes currently). After every two or three hours I'm getting this exception. But both Data nodes are up and running. Can any one please guide me as to what I should do or If I'm doing

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #771

2013-10-25 Thread Apache Jenkins Server
See -- [...truncated 7678 lines...] [ERROR] symbol : class Parser [ERROR] location: package com.google.protobuf [ERROR]

Hadoop-Hdfs-0.23-Build - Build # 771 - Still Failing

2013-10-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/771/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7871 lines...] [ERROR] location: class com.google.pro

[jira] [Created] (HDFS-5427) not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart

2013-10-25 Thread Vinay (JIRA)
Vinay created HDFS-5427: --- Summary: not able to read deleted files from snapshot directly under snapshottable dir after checkpoint and NN restart Key: HDFS-5427 URL: https://issues.apache.org/jira/browse/HDFS-5427

[jira] [Created] (HDFS-5426) Fix NPE in PBHelper

2013-10-25 Thread Junping Du (JIRA)
Junping Du created HDFS-5426: Summary: Fix NPE in PBHelper Key: HDFS-5426 URL: https://issues.apache.org/jira/browse/HDFS-5426 Project: Hadoop HDFS Issue Type: Sub-task Affects Versions: Hete