Re: [VOTE] Merging branch HDFS-7240 to trunk

2018-03-16 Thread sanjay Radia
> On Mar 5, 2018, at 4:08 PM, Andrew Wang wrote: > > - NN on top HDSL where the NN uses the new block layer (Both Daryn and Owen > acknowledge the benefit of the new block layer). We have two choices here > ** a) Evolve NN so that it can interact with both old and new block layer, > ** b) F

Re: [VOTE] Merging branch HDFS-7240 to trunk

2018-03-09 Thread sanjay Radia
Joep, You raise a number of points: (1) Ozone vs and object stores. “Some users would choose Ozone as that layer, some might use S3, others GCS, or Azure, or something else”. (2) How HDSL/Ozone fits into Hadoop and whether it is necessary. (3) You raise the release issue which we will respond in

Re: [VOTE] Merging branch HDFS-7240 to trunk

2018-03-05 Thread sanjay Radia
ge Layer (HDSL), which >> is >>> a distributed, replicated block layer. >>>The old HDFS namespace and NN can be connected to this new block >> layer >>> as we have described in HDFS-10419. >>>We also introduce a key-value namespace called Ozone built on HDSL. &g

Re: [VOTE] Merging branch HDFS-7240 to trunk

2018-02-28 Thread sanjay Radia
>>>We also introduce a key-value namespace called Ozone built on HDSL. >>> >>>The code is in a separate module and is turned off by default. In a >>> secure setup, HDSL and Ozone daemons cannot be started. >>> >>

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2018-02-20 Thread sanjay Radia
Konstantine Thanks for your feedback and comments over the last few months. Have we addressed all your issues and concerns? sanjay > On Feb 13, 2018, at 6:28 PM, sanjay Radia wrote: > > Sorry the formatting got messed by my email client. Here it is again > >

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2018-02-13 Thread sanjay Radia
Sorry the formatting got messed by my email client. Here it is again Dear Hadoop Community Members, We had multiple community discussions, a few meetings in smaller groups and also jira discussions with respect to this thread. We express our gratitude for participation and valuable commen

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2018-02-13 Thread sanjay Radia
Dear Hadoop Community Members, We had multiple community discussions, a few meetings in smaller groups and also jira discussions with respect to this thread. We express our gratitude for participation and valuable comments. The key questions raised were following How the new block storage l

Re: [DISCUSSION] Merging HDFS-7240 Object Store (Ozone) to trunk

2017-11-03 Thread sanjay Radia
Konstantine, Thanks for your comments, questions and feedback. I have attached a document to the HDFS-7240 jira that explains a design for scaling HDFS and how Ozone paves the way towards the full solution. https://issues.apache.org/jira/secure/attachment/12895963/HDFS%20Scalability%20and%2

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-23 Thread sanjay Radia
corners of S3, everyone who tested in (including our QA team), Sanjay Radia, > & others. > > I've already done a couple of iterations of fixing checksyles & code reviews, > so I think it is ready. I also have a branch-2 patch based on earlier work by > Mingliang, for

Re: LinkedIn Dynamometer Tool (was About 2.7.4 Release)

2017-07-21 Thread sanjay Radia
Erik Great stuff. BTW did you build on top of the “simulated data nodes” in HDFS which has a way to storing only the length of data (but not real data)? That work allowed supplementing with a matching editsLog for the NN. Your approach of using a real image has the advantage of being able to

Re: Looking to a Hadoop 3 release

2015-03-09 Thread sanjay Radia
> On Mar 5, 2015, at 3:21 PM, Siddharth Seth wrote: > > 2) Simplification of configs - potentially separating client side configs > and those used by daemons. This is another source of perpetual confusion > for users. + 1 on this. sanjay

Re: Looking to a Hadoop 3 release

2015-03-03 Thread sanjay Radia
> On Mar 3, 2015, at 9:36 AM, Karthik Kambatla wrote: > > If we preserve API compat and try to preserve wire compat, I don't see the > harm in bumping the major release. If we preserve compatibility, then there is no need to bump major number. > It allows us to include several > fixes/features

Re: Looking to a Hadoop 3 release

2015-03-02 Thread sanjay Radia
Andrew Thanks for bringing up the issue of moving to Java8. Java8 is important However, I am not seeing a strong motivation for changing the major number. We can go to Java8 in the 2.series. The classpath issue for Hadoop-11656 is too minor to force a major number change (no pun intended). L

Re: [VOTE] Merge fs-encryption branch to trunk

2014-08-15 Thread sanjay Radia
transparent encryption in a 2.x release for pubic consumption, let us at least complete item 1 (ie distcp and cp) and the flag to turn this feature on/of. This is a great work; thanks team for contributing this important feature. sanjay On Aug 14, 2014, at 1:05 AM, sanjay Radia wrote: > Whil

Re: [VOTE] Migration from subversion to git for version control

2014-08-14 Thread sanjay Radia
+1 sanjay > > On Fri, Aug 8, 2014 at 7:57 PM, Karthik Kambatla wrote: >> I have put together this proposal based on recent discussion on this topic. >> >> Please vote on the proposal. The vote runs for 7 days. >> >> 1. Migrate from subversion to git for version control. >> 2. Force-push to

Re: [VOTE] Merge fs-encryption branch to trunk

2014-08-14 Thread sanjay Radia
While I was originally skeptical of transparent encryption, I like the value proposition of transparent encryption. HDFS has several layers, protocols and tools. While the HDFS core part seems to be well done in the Jira, inserting the matching transparency in the other tools or protocols need

Re: Meetup invitation: Consensus based replication in Hadoop

2014-07-15 Thread sanjay Radia
I am at the meeting via the phone but can barely follow the audio. Also looks like the google plus hangout posted in the invite not been enabled - I am the only person on the hangout. sanjay On Jul 2, 2014, at 6:37 PM, Konstantin Boudnik wrote: > We'd like to invite you to the >Consens

Re: Moving to JDK7, JDK8 and new major releases

2014-06-24 Thread sanjay Radia
Andrew thanks for writing the proposal. In the proposal you mention: "Dropping support for a JDK in a minor release is incompatible, so this would require a change to our compatibility guidelines." Why is dropping a JDK incompatible? sanjay On Jun 24, 2014, at 11:17 AM, Andrew Wang wro

Re: Plans of moving towards JDK7 in trunk

2014-06-23 Thread sanjay Radia
On Jun 21, 2014, at 8:01 AM, Andrew Wang wrote: > This is why I'd like to keep my original proposal on the table: keep going > with branch-2 in the near term, while working towards a JDK8-based Hadoop 3 > by April next year. It doesn't need to be a big bang release either. I'd be > delighted if

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-08 Thread sanjay Radia
+1 binding Verified binaries, ran from binary on single node cluster. Tested some HDFS clis and wordcount. sanjay On Apr 7, 2014, at 9:52 AM, Suresh Srinivas wrote: > +1 (binding) > > Verified the signatures and hashes for both src and binary tars. Built from > the source, the binary distrib

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-07 Thread Sanjay Radia
On Thu, Apr 3, 2014 at 4:55 PM, Tsuyoshi OZAWA wrote: > Hi, > > Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) > fail. The log of the test failure is as follows: > > https://gist.github.com/oza/9965197 > > Should we fix or disable the feature? > Symlinks is still not compl

[jira] [Created] (HADOOP-10044) Improve the javadoc of rpc code

2013-10-11 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-10044: - Summary: Improve the javadoc of rpc code Key: HADOOP-10044 URL: https://issues.apache.org/jira/browse/HADOOP-10044 Project: Hadoop Common Issue Type

Re: symlink support in Hadoop 2 GA

2013-10-03 Thread sanjay Radia
There are a number of issues (some minor, some more than minor). GA is close and we are are still in discussion on the some of them; while I believe we will close on these very very shortly, code change like this so close to GA is dangerous. I suggest we do the following: 1) Disable Symlinks in

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread sanjay Radia
+1 for naming the new branch 2.2.0 sanjay On Oct 1, 2013, at 4:55 PM, Suresh Srinivas wrote: > (This time copying all the lists) > > I am +1 for naming the new branch 2.2.0. > > > On Tue, Oct 1, 2013 at 4:15 PM, Arun C Murthy wrote: > >> Guys, >> >> I took a look at the content in 2.1.2-bet

[jira] [Created] (HADOOP-9671) Improve Hadoop security - master jira

2013-06-25 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9671: Summary: Improve Hadoop security - master jira Key: HADOOP-9671 URL: https://issues.apache.org/jira/browse/HADOOP-9671 Project: Hadoop Common Issue Type

Re: [DISCUSS] Ensuring Consistent Behavior for Alternative Hadoop FileSystems + Workshop

2013-06-07 Thread sanjay Radia
I plan to attend. A 9:30 time is a little better for me. sanjay On Jun 5, 2013, at 8:14 PM, Stephen Watt wrote: > Hi Folks > > Per Roman's recommendation I've created a Wiki Page for organizing the work > and managing the logistics - https://wiki.apache.org/hadoop/HCFS/Progress > > I'd like t

[jira] [Created] (HADOOP-9619) Mark stability of .proto files

2013-06-04 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9619: Summary: Mark stability of .proto files Key: HADOOP-9619 URL: https://issues.apache.org/jira/browse/HADOOP-9619 Project: Hadoop Common Issue Type: Sub-task

Re: [VOTE] - Release 2.0.5-beta

2013-05-20 Thread sanjay Radia
+1 on 2.0.5 defined in this thread with the new features. But I am supportive of an earlier release that has ALL the compatibility changes, without the features. sanjay On May 15, 2013, at 10:57 AM, Arun C Murthy wrote: > Folks, > > ... > > I propose we continue the original plan and make a

[jira] [Created] (HADOOP-9425) Add error codes to rpc-response

2013-03-21 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9425: Summary: Add error codes to rpc-response Key: HADOOP-9425 URL: https://issues.apache.org/jira/browse/HADOOP-9425 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-9421) Add full length to SASL response to allow non-blocking readers

2013-03-20 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9421: Summary: Add full length to SASL response to allow non-blocking readers Key: HADOOP-9421 URL: https://issues.apache.org/jira/browse/HADOOP-9421 Project: Hadoop

[jira] [Created] (HADOOP-9380) Add totalLength to rpc response

2013-03-07 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9380: Summary: Add totalLength to rpc response Key: HADOOP-9380 URL: https://issues.apache.org/jira/browse/HADOOP-9380 Project: Hadoop Common Issue Type: Sub-task

Re: [Vote] Merge branch-trunk-win to trunk

2013-03-01 Thread sanjay Radia
On Mar 1, 2013, at 1:57 PM, Konstantin Shvachko wrote: > Commitment is a good thing. > I think the two builds that I proposed are a prerequisite for Win support. > If we commit windows patch people will start breaking it the next day. > Which we wont know without the nightly build and wont be abl

Re: [Vote] Merge branch-trunk-win to trunk

2013-02-28 Thread sanjay Radia
+1 Java has done the bulk of the work in making Hadoop multi-platform. Windows specific code is a tiny percentage of the code. Jeninks support for windows is going help us keep the platform portable going forward. I expect that the vast majority of new commits have no problems. I propose that we

[jira] [Created] (HADOOP-9218) Document the Rpc-wrappers used internally

2013-01-15 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9218: Summary: Document the Rpc-wrappers used internally Key: HADOOP-9218 URL: https://issues.apache.org/jira/browse/HADOOP-9218 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-9163) The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy

2012-12-20 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9163: Summary: The rpc msg in ProtobufRpcEngine.proto should be moved out to avoid an extra copy Key: HADOOP-9163 URL: https://issues.apache.org/jira/browse/HADOOP-9163

[jira] [Created] (HADOOP-9151) Include RPC error info in RpcResponseHeader instead of sending it separately

2012-12-17 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9151: Summary: Include RPC error info in RpcResponseHeader instead of sending it separately Key: HADOOP-9151 URL: https://issues.apache.org/jira/browse/HADOOP-9151 Project

[jira] [Created] (HADOOP-9140) Cleanup rpc PB protos

2012-12-13 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-9140: Summary: Cleanup rpc PB protos Key: HADOOP-9140 URL: https://issues.apache.org/jira/browse/HADOOP-9140 Project: Hadoop Common Issue Type: Improvement

[jira] [Resolved] (HADOOP-7347) IPC Wire Compatibility

2012-12-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7347. -- Resolution: Fixed Fix Version/s: 2.0.0-alpha Hadoop Flags: Incompatible change

[jira] [Resolved] (HADOOP-8544) Move an assertion location in 'winutils chmod'

2012-07-12 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8544. -- Resolution: Fixed Committed to branch-1 windows; thanks Chuan. > Move

[jira] [Resolved] (HADOOP-8414) Address problems related to localhost resolving to 127.0.0.1 on Windows

2012-07-05 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8414. -- Resolution: Fixed Thanks Ivan, committed to branch-1 windows. > Addr

[jira] [Resolved] (HADOOP-8534) Some tests leave a config file open causing failure on windows

2012-07-02 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8534. -- Resolution: Fixed Committed to Hadoop-1 windows branch. Thanks Ivan. > S

[jira] [Resolved] (HADOOP-8454) Fix the ‘chmod =[perm]’ bug in winutils

2012-06-20 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8454. -- Resolution: Fixed Reviewed and committed patch to Hadoop-1 windows branch. Thanks Chuan Lin

[jira] [Resolved] (HADOOP-8101) Access Control support for Non-secure deployment of Hadoop on Windows

2012-06-04 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8101. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0, 0.24.0

[jira] [Resolved] (HADOOP-8234) Enable user group mappings on Windows

2012-05-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8234. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0, 0.24.0

[jira] [Resolved] (HADOOP-8223) Initial patch for branch-1-win

2012-05-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8223. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows > Initial patch for bra

[jira] [Resolved] (HADOOP-8374) Improve support for hard link manipulation on Windows

2012-05-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8374. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed to

[jira] [Resolved] (HADOOP-8440) HarFileSystem.decodeHarURI fails for URIs whose host contains numbers

2012-05-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8440. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed to the

[jira] [Resolved] (HADOOP-8411) TestStorageDirecotyFailure, TestTaskLogsTruncater, TestWebHdfsUrl and TestSecurityUtil fail on Windows

2012-05-31 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-8411. -- Resolution: Fixed Target Version/s: HADOOP-1-Windows (was: 1.1.0) Committed patch

[jira] [Created] (HADOOP-8367) ProtoBufRpcEngine's rpc request header does not need declaringClass name

2012-05-07 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-8367: Summary: ProtoBufRpcEngine's rpc request header does not need declaringClass name Key: HADOOP-8367 URL: https://issues.apache.org/jira/browse/HADOOP-8367 Pr

[jira] [Resolved] (HADOOP-7775) RPC Layer improvements to support protocol compatibility

2012-05-07 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7775. -- Resolution: Fixed All subtasks done. > RPC Layer improvements to supp

[jira] [Created] (HADOOP-8366) Use ProtoBuf for RpcResponseHeader

2012-05-07 Thread Sanjay Radia (JIRA)
Sanjay Radia created HADOOP-8366: Summary: Use ProtoBuf for RpcResponseHeader Key: HADOOP-8366 URL: https://issues.apache.org/jira/browse/HADOOP-8366 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-16 Thread Sanjay Radia (Created) (JIRA)
Use ProtoBuf for RpcPayLoadHeader - Key: HADOOP-8285 URL: https://issues.apache.org/jira/browse/HADOOP-8285 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-8223) Initial patch for branch-1-win

2012-03-29 Thread Sanjay Radia (Created) (JIRA)
Initial patch for branch-1-win -- Key: HADOOP-8223 URL: https://issues.apache.org/jira/browse/HADOOP-8223 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia -- This message is

[jira] [Created] (HADOOP-8184) ProtoBuf RPC engine does not need it own reply packet - it can use the IPC layer reply packet.

2012-03-19 Thread Sanjay Radia (Created) (JIRA)
Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-8161) Support for Azure Storage

2012-03-12 Thread Sanjay Radia (Created) (JIRA)
Support for Azure Storage - Key: HADOOP-8161 URL: https://issues.apache.org/jira/browse/HADOOP-8161 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia -- This message is automatically

[jira] [Created] (HADOOP-8120) Refactor IPC client and server so shared parts in separate class

2012-02-28 Thread Sanjay Radia (Created) (JIRA)
: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure

[jira] [Created] (HADOOP-8103) Hadoop-bin commands for windows

2012-02-22 Thread Sanjay Radia (Created) (JIRA)
Hadoop-bin commands for windows --- Key: HADOOP-8103 URL: https://issues.apache.org/jira/browse/HADOOP-8103 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia -- This message is

[jira] [Created] (HADOOP-8102) General Util Changes for Hadoop for Windows

2012-02-22 Thread Sanjay Radia (Created) (JIRA)
General Util Changes for Hadoop for Windows Key: HADOOP-8102 URL: https://issues.apache.org/jira/browse/HADOOP-8102 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia

[jira] [Created] (HADOOP-8101) Security changes for Hadoop for Windows

2012-02-22 Thread Sanjay Radia (Created) (JIRA)
Security changes for Hadoop for Windows --- Key: HADOOP-8101 URL: https://issues.apache.org/jira/browse/HADOOP-8101 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7913) Fix bug in ProtoBufRpcEngine -

2011-12-12 Thread Sanjay Radia (Created) (JIRA)
Fix bug in ProtoBufRpcEngine - --- Key: HADOOP-7913 URL: https://issues.apache.org/jira/browse/HADOOP-7913 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee

[jira] [Created] (HADOOP-7862) Move the support for multiple protocols to lower layer so that Writable, PB and Avro can all use it

2011-11-25 Thread Sanjay Radia (Created) (JIRA)
/HADOOP-7862 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-7776) Make the Ipc-Header in a RPC-Payload an explicit header

2011-10-26 Thread Sanjay Radia (Created) (JIRA)
Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see

[jira] [Created] (HADOOP-7775) RPC Layer improvements to support protocol compatibility

2011-10-26 Thread Sanjay Radia (Created) (JIRA)
Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA

[jira] [Created] (HADOOP-7719) On protocol version mismatch, return the list of valid versions for the requested protocol

2011-10-03 Thread Sanjay Radia (Created) (JIRA)
Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira

[jira] [Created] (HADOOP-7716) Multiple protocol does not log the protocol name only the class which may not be the same

2011-10-03 Thread Sanjay Radia (Created) (JIRA)
Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https

[jira] [Created] (HADOOP-7687) Make getProtocolSignature public

2011-09-27 Thread Sanjay Radia (Created) (JIRA)
Make getProtocolSignature public - Key: HADOOP-7687 URL: https://issues.apache.org/jira/browse/HADOOP-7687 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Resolved] (HADOOP-7119) add Kerberos HTTP SPNEGO authentication support to Hadoop JT/NN/DN/TT web-consoles

2011-09-11 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7119. -- Resolution: Fixed committed to branch-0.20-security to go into 20.205 > add Kerberos H

Re: [VOTE] Should we release 0.20.204.0-rc3?

2011-09-01 Thread sanjay Radia
+1 downloaded, ran tests, ran job on 1 node cluster on my machine. sanjay On Aug 25, 2011, at 5:12 PM, Owen O'Malley wrote: > All, > I've fixed the issues that Allen observed in the previous rc for 0.20.204 > and rolled the new bundled up in > http://people.apache.org/~omalley/hadoop-0.20.

[jira] [Created] (HADOOP-7557) Make IPC and RPC headers be extensible

2011-08-19 Thread Sanjay Radia (JIRA)
Make IPC and RPC headers be extensible --- Key: HADOOP-7557 URL: https://issues.apache.org/jira/browse/HADOOP-7557 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7524) Change RPC to allow multiple protocols including multuple versions of the same protocol

2011-08-07 Thread Sanjay Radia (JIRA)
Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HADOOP-7479) Separate data types

2011-07-20 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-7479. -- Resolution: Duplicate > Separate data types > --- > >

[jira] [Created] (HADOOP-7479) Sperate data types

2011-07-20 Thread Sanjay Radia (JIRA)
Sperate data types -- Key: HADOOP-7479 URL: https://issues.apache.org/jira/browse/HADOOP-7479 Project: Hadoop Common Issue Type: Sub-task Reporter: Sanjay Radia Assignee: Sanjay Radia -- This

Re: Developer meetup after the Hadoop Summit - Friday July 1st

2011-06-28 Thread Sanjay Radia
I have updated meetup: http://www.meetup.com/Hadoop-Contributors/events/23890191/ sanjay On Jun 28, 2011, at 4:27 PM, Sanjay Radia wrote: On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote: We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's sunnyvale campus. Will updat

Re: Developer meetup after the Hadoop Summit - Friday July 1st

2011-06-28 Thread Sanjay Radia
On Jun 28, 2011, at 11:17 AM, Sanjay Radia wrote: We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's sunnyvale campus. Will update the meetup page shortly so that folks can register. Given that this is the friday before a long weekend, a number of folks have asked f

Re: Developer meetup after the Hadoop Summit - Friday July 1st

2011-06-28 Thread Sanjay Radia
We have a room confirmed from 10-3pm on Friday July 1st at Yahoo's sunnyvale campus. Will update the meetup page shortly so that folks can register. sanjay On Jun 7, 2011, at 11:21 AM, Owen O'Malley wrote: All, We are planning to have a Hadoop developer meetup in Sunnyvale during the d

[jira] [Created] (HADOOP-7426) User Guide for how to use viewfs with federation

2011-06-24 Thread Sanjay Radia (JIRA)
: Sanjay Radia Assignee: Sanjay Radia Priority: Minor -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-7391) Copy the interrface classification documentation of HADOOP-5073 into javadoc

2011-06-14 Thread Sanjay Radia (JIRA)
Issue Type: Bug Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 The documentation for interface classification in Jira Hadoop-5073 was not copied to the Javadoc of the classification. -- This message is automatically generated by JIRA

[jira] [Created] (HADOOP-7375) Add resolvePath method to FileContext

2011-06-09 Thread Sanjay Radia (JIRA)
Add resolvePath method to FileContext - Key: HADOOP-7375 URL: https://issues.apache.org/jira/browse/HADOOP-7375 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7347) HDFS Wire compatibility

2011-05-31 Thread Sanjay Radia (JIRA)
HDFS Wire compatibility --- Key: HADOOP-7347 URL: https://issues.apache.org/jira/browse/HADOOP-7347 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: Sanjay Radia

[jira] [Created] (HADOOP-7310) Trash location needs to be revisited

2011-05-19 Thread Sanjay Radia (JIRA)
Trash location needs to be revisited Key: HADOOP-7310 URL: https://issues.apache.org/jira/browse/HADOOP-7310 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia

[jira] [Created] (HADOOP-7284) Trash and shell's rm does not work for viewfs

2011-05-12 Thread Sanjay Radia (JIRA)
Trash and shell's rm does not work for viewfs - Key: HADOOP-7284 URL: https://issues.apache.org/jira/browse/HADOOP-7284 Project: Hadoop Common Issue Type: Bug Reporter: Sanjay

[jira] Created: (HADOOP-7054) Change NN LoadGenerator to use the new FileContext api

2010-11-29 Thread Sanjay Radia (JIRA)
Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-7037) Add NN LoadGenerator as a Multi-threaded test for Hadoop File systems

2010-11-15 Thread Sanjay Radia (JIRA)
Type: Test Reporter: Sanjay Radia -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-7018) FileContext's list operation should return local names in the status object rather then the full path.

2010-11-03 Thread Sanjay Radia (JIRA)
/jira/browse/HADOOP-7018 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.

[jira] Created: (HADOOP-7015) RawLocalFileSystem#listStatus does not deal with a directory whose entries are changing ( e.g. in a multi-thread or multi-process environment)

2010-11-01 Thread Sanjay Radia (JIRA)
) --- Key: HADOOP-7015 URL: https://issues.apache.org/jira/browse/HADOOP-7015 Project: Hadoop Common Issue Type: Bug Affects Versions: 0.21.0 Reporter: Sanjay Radia Fix For: 0.22.0 -- This message is automatically generated

[jira] Created: (HADOOP-6903) Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs

2010-08-06 Thread Sanjay Radia (JIRA)
https://issues.apache.org/jira/browse/HADOOP-6903 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Make AbstractFileSystem's methods public to allow filter-Fs like implementions in a differnt package than fs -- This message is automatically generat

[jira] Created: (HADOOP-6899) FileSystem#setWorkingDir() does not work for relative names

2010-08-04 Thread Sanjay Radia (JIRA)
Affects Versions: 0.20.2 Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 FileSystem#setWorkingDir() does not work for relative names -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue

[jira] Created: (HADOOP-6775) Update Hadoop Common Site's

2010-05-19 Thread Sanjay Radia (JIRA)
Update Hadoop Common Site's Key: HADOOP-6775 URL: https://issues.apache.org/jira/browse/HADOOP-6775 Project: Hadoop Common Issue Type: Improvement Reporter: Sanjay Radia Assignee: S

[jira] Resolved: (HADOOP-6421) Symbolic links

2010-02-16 Thread Sanjay Radia (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Radia resolved HADOOP-6421. -- Resolution: Fixed Release Note: Adds Symbolic links to FileContext, AbstractFileSystem

Re: HDFS-758 in Hadoop-21 , Updates to Namenode health page

2009-12-07 Thread Sanjay Radia
On Nov 25, 2009, at 12:46 PM, Allen Wittenauer wrote: Then you'll have no issues patching other things in 0.21 that are actual bug fixes that also meet this criteria, right? Or does this only apply to things that Yahoo! is hitting/deemed worthy? Allen raises a good point that the

Re: Private, LimitedPrivate and contrib modules

2009-11-05 Thread Sanjay Radia
entorsOfInteface" or something like that. (like the tag for limited-private). sanjay thanks, dhruba On Thu, Nov 5, 2009 at 11:05 AM, Sanjay Radia wrote: > > Sorry for the late reply .. I missed in in my inbox. > > On Sep 18, 2009, at 1:29 PM, Tom White wrote: > >

Re: Private, LimitedPrivate and contrib modules

2009-11-05 Thread Sanjay Radia
Sorry for the late reply .. I missed in in my inbox. On Sep 18, 2009, at 1:29 PM, Tom White wrote: I'm trying to better understand the meaning of the annotations defined in org.apache.hadoop.classification.InterfaceAudience. 1. Private is documented as being "Intended for use only within Hado

[jira] Created: (HADOOP-6356) Add a Cache for AbstractFileSystem in the new FileContext/AbstractFileSystem framework.

2009-11-02 Thread Sanjay Radia (JIRA)
Project: Hadoop Common Issue Type: Improvement Affects Versions: 0.22.0 Reporter: Sanjay Radia Assignee: Sanjay Radia Fix For: 0.22.0 The new filesystem framework, FileContext and AbstractFileSystem does not implement a cache for

[jira] Created: (HADOOP-6327) Fix build error for one of the FileContext errors

2009-10-22 Thread Sanjay Radia (JIRA)
Fix build error for one of the FileContext errors - Key: HADOOP-6327 URL: https://issues.apache.org/jira/browse/HADOOP-6327 Project: Hadoop Common Issue Type: Bug Reporter: Sanjay

Re: Changes to HDFS configuration keys for 21 release

2009-09-28 Thread Sanjay Radia
On Sep 25, 2009, at 5:31 PM, Jitendra Nath Pandey wrote: Hi, The changes to configuration keys in HDFS for 21 release are scheduled to be checked in along with the append changes. This change was delayed because configuration changes are too many and merging append code on top of them woul

Re: Towards Hadoop 1.0: Stronger API Compatibility from 0.21 onwards

2009-09-28 Thread Sanjay Radia
On Sep 28, 2009, at 3:15 AM, Steve Loughran wrote: Dhruba Borthakur wrote: > It is really nice to have wire-compatibility between clients and servers > running different versions of hadoop. The reason we would like this is > because we can allow the same client (Hive, etc) submit jobs to t

Re: [VOTE] Should we freeze the public stable APIs after 0.21.0?

2009-09-28 Thread Sanjay Radia
+1 On Sep 25, 2009, at 10:16 AM, Owen O'Malley wrote: We are getting closer to being able to release a Common/HDFS/MapReduce 1.0. I'd hope that we'll get the last set of things in to 0.22 that mean that it would be labelled 1.0. Toward that end, I'd like to start locking down the APIs that we'

Re: [VOTE] Should we freeze the public stable APIs after 0.21.0?

2009-09-25 Thread Sanjay Radia
Just posted updated proposed classification of interfaces. https://issues.apache.org/jira/browse/HADOOP-5073?focusedCommentId=12759723&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel #action_12759723

Re: Towards Hadoop 1.0: Stronger API Compatibility from 0.21 onwards

2009-09-25 Thread Sanjay Radia
On Sep 25, 2009, at 12:03 PM, Allen Wittenauer wrote: On 9/25/09 10:13 AM, "Dhruba Borthakur" wrote: > It is really nice to have wire-compatibility between clients and servers > running different versions of hadoop. The reason we would like this is > because we can allow the same client (

Re: [VOTE] Should we freeze the public stable APIs after 0.21.0?

2009-09-25 Thread Sanjay Radia
On Sep 25, 2009, at 10:36 AM, Philip Zeyliger wrote: I did a quick grep, and--perhaps I'm missing something--no interfaces are currently marked as InterfaceStability.Stable. FileContext is the only interface that uses the org.apache.hadoop.classification package. (Well, QueueManagerTestUt

  1   2   >