[jira] [Reopened] (HDFS-257) Does a big delete starve other clients?

2014-07-20 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reopened HDFS-257: Yes, it does. Reopening. > Does a big delete starve other clie

RE: hdfs project separation

2013-10-11 Thread Milind Bhandarkar
11, 2013 at 9:14 AM, Milind Bhandarkar wrote: > If HDFS is released independently, with its own RPC and protocol versions, > features such as pluggable namespaces will not have to wait for the next > mega-release of the entire stack. The plan as I understand it is to eventually be able t

Re: hdfs project separation

2013-10-11 Thread Milind Bhandarkar
-release of the entire stack. Would love to hear what hdfs developers think about this. - milind Sent from my iPhone > On Oct 10, 2013, at 20:31, Milind Bhandarkar > wrote: > > ( this message is not intended for specific folks, by mistake, but for all > the hdfs-dev list, deliberate

hdfs project separation

2013-10-10 Thread Milind Bhandarkar
( this message is not intended for specific folks, by mistake, but for all the hdfs-dev list, deliberately;) Hello Folks, I do not want to scratch the already bleeding wounds, and want to resolve these issues amicably, without causing a big inter-vendor confrontation. So, these are the facts,

Re: SDP support for Hadoop RPC

2013-10-09 Thread Milind Bhandarkar
theories and employer bashing, adding details such as > this is what is useful to this forum! > > > On Wed, Oct 9, 2013 at 2:09 AM, Milind Bhandarkar > wrote: > >> No, Steve, I meant exactly what I wrote. One day, when you are here, Let's >> meet in the same ch

Re: SDP support for Hadoop RPC

2013-10-09 Thread Milind Bhandarkar
1:45, Steve Loughran wrote: > > On 9 October 2013 01:57, Milind Bhandarkar wrote: > >> Yes, we have. It works very well, but it is considered too niche by folks >> who insist on buying the least capable hardware for their test clusters, >> and therefore, recommend such und

Re: SDP support for Hadoop RPC

2013-10-08 Thread Milind Bhandarkar
o get there for Open Source Hadoop implementations, but believe me, every Hadoop vendor based off of open source Hadoop is incorporating new network architectures in their proprietary distro. We were there first. That's all. - milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858

Re: SDP support for Hadoop RPC

2013-10-08 Thread Milind Bhandarkar
Yes, we have. It works very well, but it is considered too niche by folks who insist on buying the least capable hardware for their test clusters, and therefore, recommend such underpowered clusters to customers as well. - milind > On Oct 8, 2013, at 16:49, Yasin Celik wrote: > > Hello, > >

Re: [Proposal] Pluggable Namespace

2013-10-08 Thread Milind Bhandarkar
Thanks for all the feedback, folks. I have created a jira: https://issues.apache.org/jira/browse/HDFS-5324. Let us continue detailed discussions there. - Milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858 (W) +1-408-666-8483 (C) On Mon, Oct 7, 2013 at 9:50 PM, sanjay Radia

[jira] [Created] (HDFS-5324) Make Namespace implementation pluggable in the namenode

2013-10-08 Thread Milind Bhandarkar (JIRA)
Milind Bhandarkar created HDFS-5324: --- Summary: Make Namespace implementation pluggable in the namenode Key: HDFS-5324 URL: https://issues.apache.org/jira/browse/HDFS-5324 Project: Hadoop HDFS

Re: [Proposal] Pluggable Namespace

2013-10-07 Thread Milind Bhandarkar
Getting back to the technical discussion: based on this proposal email that I sent, I came to know, from Sanjay Radia, of a summer intern project at Hortonworks that implemented namespace using LevelDB. We discussed it on personal email today, and agreed that these two efforts were still orthogo

Re: [Proposal] Pluggable Namespace

2013-10-07 Thread Milind Bhandarkar
had Vinod's name in it, I checked again to see that in my address book, Vinod's email is entered as hdfs-dev automatically), and I realized that today after I checked hdfs-dev list. I apologize for the mishap. Let's keep the discussions technical here. - milind --- Milind B

Re: [Proposal] Pluggable Namespace

2013-10-07 Thread Milind Bhandarkar
, and co-exist with it. - Milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858 (W) +1-408-666-8483 (C) On Mon, Oct 7, 2013 at 8:52 AM, Bobby Evans wrote: > Putting all conspiracy theories aside :). Any way we decided to scale the > name node is going to have limit

Re: [Proposal] Pluggable Namespace

2013-10-07 Thread Milind Bhandarkar
to how best to handle switching from one NS implementation to another. The NS interfaces are currently private. However, we can make them as LimitedPrivate with "extensions" as the project. Thoughts ? - Milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858 (W) +1-408-6

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
Vinod On Oct 6, 2013, at 9:35 AM, Milind Bhandarkar wrote: > Federation is orthogonal with Pluggable Namespaces. That is, one can > use Federation if needed, even while a distributed K-V store is used > on the backend. > > Limitations of Federated namenode for scaling namespace are

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
x27;t that the same as this effortt? Thanks, +Vinod On Oct 6, 2013, at 9:35 AM, Milind Bhandarkar wrote: > Federation is orthogonal with Pluggable Namespaces. That is, one can > use Federation if needed, even while a distributed K-V store is used > on the backend. > > Limitations o

RE: [Proposal] Pluggable Namespace

2013-10-06 Thread Milind Bhandarkar
:18 AM, "Milind Bhandarkar" wrote: > Hi All, > > Exec Summary: For the last couple of months, we, at Pivotal, along > with a couple of folks in the community have been working on making > Namespace implementation in the namenode pluggable. We have > demonstrated that

RE: [Proposal] Pluggable Namespace

2013-10-05 Thread Milind Bhandarkar
separately. - Milind -Original Message- From: Andrew Purtell [mailto:apurt...@apache.org] Sent: Saturday, October 05, 2013 11:23 AM To: hdfs-dev@hadoop.apache.org Subject: Re: [Proposal] Pluggable Namespace On Thu, Oct 3, 2013 at 12:17 PM, Milind Bhandarkar < mbhandar...@gopivotal.com>

[Proposal] Pluggable Namespace

2013-10-03 Thread Milind Bhandarkar
. We aim to propose a change in such interfaces into which FSNameSystem is tightly coupled. - Milind --- Milind Bhandarkar Chief Scientist Pivotal

Re: A list of some HDFS benchmarks

2013-09-05 Thread Milind Bhandarkar
, - milind --- Milind Bhandarkar Chief Scientist Pivotal +1-650-523-3858 (W) +1-408-666-8483 (C) On Wed, Sep 4, 2013 at 2:27 PM, Erik Paulson wrote: > Hello all - > > As part of a side project, I've been interested in HDFS benchmarking, > particularly of the Namenode. To get

Re: That append patch in 0.20

2011-01-28 Thread Milind Bhandarkar
ning messages in the > documentation on when people should be using it.. but at least they could get > a regular build > and run it. > > so.. the question to the experts.. can the append patch be made into a > configuration option such that if people don't have it enabled it

[jira] Created: (HDFS-1135) Please sort the various options alphabetically in the output of "hadoop fs -help"

2010-05-07 Thread Milind Bhandarkar (JIRA)
ct: Hadoop HDFS Issue Type: Improvement Components: scripts Affects Versions: 0.20.2 Environment: All Reporter: Milind Bhandarkar Assignee: Robert Chansler Priority: Minor Fix For: 0.20.3 The help message printed by &

[jira] Created: (HDFS-1113) Allow users with write access to a directory to change ownership of its subdirectories/files

2010-04-27 Thread Milind Bhandarkar (JIRA)
Project: Hadoop HDFS Issue Type: New Feature Components: name-node Environment: All Reporter: Milind Bhandarkar Assignee: Sanjay Radia owner and group of a file/directory, and namespace/diskspace quota for a directory are mutable