[jira] [Created] (HDFS-3989) Remove duplicate Http server SSL code

Eli Collins created HDFS-3989: - Summary: Remove duplicate Http server SSL code Key: HDFS-3989 URL: https://issues.apache.org/jira/browse/HDFS-3989 Project: Hadoop HDFS Issue Type: Bug C

[jira] [Created] (HDFS-3988) HttpFS can't do GETDELEGATIONTOKEN without a prior authenticated request

Alejandro Abdelnur created HDFS-3988: Summary: HttpFS can't do GETDELEGATIONTOKEN without a prior authenticated request Key: HDFS-3988 URL: https://issues.apache.org/jira/browse/HDFS-3988 Project:

Re: Commits breaking compilation of MR 'classic' tests

If I recall correctly many of the tests where ported over and only the ones depending on JT/TT stuff were not, no? Thx On Thu, Sep 27, 2012 at 7:44 AM, Thomas Graves wrote: > So is someone signing up to do this port soon? Otherwise I don't see the > point in us spending time keeping tests that

[jira] [Created] (HDFS-3987) add support for encrypted webhdfs

Alejandro Abdelnur created HDFS-3987: Summary: add support for encrypted webhdfs Key: HDFS-3987 URL: https://issues.apache.org/jira/browse/HDFS-3987 Project: Hadoop HDFS Issue Type: New F

[jira] [Reopened] (HDFS-3373) FileContext HDFS implementation can leak socket caches

[ https://issues.apache.org/jira/browse/HDFS-3373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John George reopened HDFS-3373: --- Reopening for branch 23 > FileContext HDFS implementation can leak socket caches > --

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

Sorry for the slowness in response - I've been in bed with a fever the past couple days and only sporadically on email. I'll respond to a few different points made in the above thread here: Konst> We keep growing the HDFS umbrella with competing technologies Konst> (http/web HDFS as an example) wi

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

On Thu, Sep 27, 2012 at 2:06 AM, Konstantin Shvachko wrote: > The SPOF is in HDFS. This project is about shared storage > implementation, that could be replaced by NFS or BookKeeper or > something else. You cannot equate QJM to a solution that requires an NFS filer. A filer is just not possible

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

I am in favor of keeping QJM in HDFS. QJM is very specific to HDFS and is tightly coupled with HDFS code, essentially extending the current editlog functionality that writes to local disk to writing to a separate set of daemons. Clearly there is a need for this in HDFS. Konstantin, I see your poin

[jira] [Created] (HDFS-3986) Add findHangingTests.sh from HBase to find hanging tests

David S. Wang created HDFS-3986: --- Summary: Add findHangingTests.sh from HBase to find hanging tests Key: HDFS-3986 URL: https://issues.apache.org/jira/browse/HDFS-3986 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-3985) TestMulitipleNNDataBlockScanner may hang

Eli Collins created HDFS-3985: - Summary: TestMulitipleNNDataBlockScanner may hang Key: HDFS-3985 URL: https://issues.apache.org/jira/browse/HDFS-3985 Project: Hadoop HDFS Issue Type: Bug

Re: Commits breaking compilation of MR 'classic' tests

So is someone signing up to do this port soon? Otherwise I don't see the point in us spending time keeping tests that mostly don't apply working. I used to spend a lot of time on this when we still had to compile contrib stuff out of ant and the majority of it was just fixing it so it compiles aga

Hadoop-Hdfs-0.23-Build - Build # 387 - Still Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/387/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 19136 lines...] [INFO] [INFO] --- maven-javadoc-plug

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #387

See

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

It's true we can package and use HDFS and QJM, if it were separately distributed, because we supply our internal users with an Apache Hadoop distribution with our additional polish. Also, Cloudera or Hortonworks or others could package them together, but then what of the Apache Hadoop distribution

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

HA design assumes shared storage. QJM can be used as such, so as other things. If that was your question. --Konst On Thu, Sep 27, 2012 at 2:11 AM, Andrew Purtell wrote: > I don't follow. For example the QJM and HA NameNode configuration are > designed together to eliminate the SPOF in HDFS, withi

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

On Thu, Sep 27, 2012 at 1:50 AM, Andrew Purtell wrote: > Speaking as an Apache Hadoop user who must do something with the NameNode > single point of failure this year, I don't subscribe to the view that > moving that SPOF from the NameNode to a NFS filer is reasonable to ask of > those not already

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

I don't follow. For example the QJM and HA NameNode configuration are designed together to eliminate the SPOF in HDFS, within HDFS. I don't see how they make sense separately. On Thursday, September 27, 2012, Konstantin Shvachko wrote: > The SPOF is in HDFS. This project is about shared storage >

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

The SPOF is in HDFS. This project is about shared storage implementation, that could be replaced by NFS or BookKeeper or something else. Suppose failure happened because NFS failed. Where do you go? NetApp. Same if QJ failed. You go to the creators, which will be somewhat closer than NetApp, becaus

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

Speaking as an Apache Hadoop user who must do something with the NameNode single point of failure this year, I don't subscribe to the view that moving that SPOF from the NameNode to a NFS filer is reasonable to ask of those not already set up with NetApp or similar, or those running in a "cloud" en

Re: [VOTE] Merge HDFS-3077 (QuorumJournalManager) branch to trunk

On Wed, Sep 26, 2012 at 4:21 PM, Konstantin Shvachko wrote: > Don't understand your argument. Else where? You suggest users should download HDFS and then go to another project (or subproject) -- i.e. 'elsewhere' -- to get a fundamental, a fix for the SPOF. IMO, the SPOF-fix belongs in HDFS core.