[jira] [Created] (HADOOP-17779) Lock File System Creator Semaphore Uninterruptibly

2021-06-29 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17779: --- Summary: Lock File System Creator Semaphore Uninterruptibly Key: HADOOP-17779 URL: https://issues.apache.org/jira/browse/HADOOP-17779 Project: Hadoop Common

Re: [ANNOUNCE] Apache Hadoop 3.3.1 release

2021-06-15 Thread David
Thank you Wei-Chiu! Hopefully we can now move Hive forward! On Tue, Jun 15, 2021, 10:30 PM Wei-Chiu Chuang wrote: > Hi All, > > It gives me great pleasure to announce that the Apache Hadoop community has > voted to release Apache Hadoop 3.3.1. > > This is the first stable release of Apache Hado

[jira] [Created] (HADOOP-17681) Received "Permission denied" error while copying files through NFS Gateway

2021-05-04 Thread David (Jira)
David created HADOOP-17681: -- Summary: Received "Permission denied" error while copying files through NFS Gateway Key: HADOOP-17681 URL: https://issues.apache.org/jira/browse/HADOOP-17681 Proje

Re: [DISCUSS] Hadoop 3.3.1 release

2021-03-10 Thread David
Hello, Still hoping for help here: https://issues.apache.org/jira/browse/HDFS-15790 Looks like it has been worked on, not sure how to best move it forward. On Wed, Mar 10, 2021, 12:21 PM Steve Loughran wrote: > I'm going to argue its too late to do IPv6 support close to a release, as > it's b

Hadoop Thirdparty

2021-02-05 Thread David
Hello Gang, I'm not sure I understand that "Hadoop Thirdparty" project. I mean, I understand that it's a collection of shaded third party libraries, but the way it is setup currently seems self-defeating. What if I have multiple versions of the Hadoop Thirdparty library on my classpath? It seem

Re: [DISCUSS] Hadoop 3.3.1 release

2021-01-27 Thread David
Would be great for the Hive team to see this one as well: https://issues.apache.org/jira/browse/HDFS-15790 On Wed, Jan 27, 2021 at 8:28 PM Wei-Chiu Chuang wrote: > Hi all, > > Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated > more than 400 changes in the branch-3.3. A

Re: Protobuf update?

2021-01-25 Thread David
Hey Wei-Chiu, I hope you are well. Interesting timing on this question. I just filed this a few minutes ago. https://issues.apache.org/jira/browse/HDFS-15790 What is the benefit of moving to PB 3? PB 2 is not deprecated or anything and they are not completely backwards compatible. I questio

[jira] [Created] (HADOOP-17494) Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2 Co-Exist

2021-01-25 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17494: --- Summary: Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2 Co-Exist Key: HADOOP-17494 URL: https://issues.apache.org/jira/browse/HADOOP-17494 Project

[jira] [Created] (HADOOP-17482) Remove Commons Logger from FileSystem Class

2021-01-20 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17482: --- Summary: Remove Commons Logger from FileSystem Class Key: HADOOP-17482 URL: https://issues.apache.org/jira/browse/HADOOP-17482 Project: Hadoop Common

[jira] [Resolved] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor resolved HADOOP-17462. - Resolution: Not A Problem Thanks [~sjlee0] for pointing outing that the {{call

[jira] [Created] (HADOOP-17462) Hadoop Client getRpcResponse May Return Wrong Result

2021-01-08 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17462: --- Summary: Hadoop Client getRpcResponse May Return Wrong Result Key: HADOOP-17462 URL: https://issues.apache.org/jira/browse/HADOOP-17462 Project: Hadoop Common

ProtobufRpcEngine v.s. ProtobufRpcEngine2

2020-12-28 Thread David
Hello Gang, I'm trying to upgrade the Apache Hive project to use Hadoop 3.3.0 so that Hive can build/run with JDK 9/11. The current Hadoop dependency for Hive fails to run with JDK 9/11. However, I ran into an issue: ProtobufRpcEngine2 It looks like Hadoop commons updated the PB RPC Engine fro

[jira] [Created] (HADOOP-17443) Improve Hive Class Logging/Error Handling

2020-12-21 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17443: --- Summary: Improve Hive Class Logging/Error Handling Key: HADOOP-17443 URL: https://issues.apache.org/jira/browse/HADOOP-17443 Project: Hadoop Common

Re: ProtobufRpcEngine v.s. ProtobufRpcEngine2

2020-12-09 Thread David
ix it. org.apache.hadoop.thirdparty.protobuf.GeneratedMessageV3 On Wed, Dec 9, 2020 at 2:50 PM David wrote: > Hello, > > For additional context, the unit tests in Hive are using MiniDFSCluster. > I suspect that is what is loading the ProtobufRpcEngine2 class, while the > local code under test uses ProtobufRpcEngine. > &

Re: ProtobufRpcEngine v.s. ProtobufRpcEngine2

2020-12-09 Thread David
2:34 PM David wrote: > Hello Gang, > > There seems to be a new RpcEngine created as part of Hadoop 3.3. I'm > trying to upgrade Hive to use Hadoop 3.3 and it uses the RpcEngine > mechanism. However, tests are failing for Hive complaining about: > > "ReRegistration

ProtobufRpcEngine v.s. ProtobufRpcEngine2

2020-12-09 Thread David
Hello Gang, There seems to be a new RpcEngine created as part of Hadoop 3.3. I'm trying to upgrade Hive to use Hadoop 3.3 and it uses the RpcEngine mechanism. However, tests are failing for Hive complaining about: "ReRegistration of rpcKind" I believe this is because both classes register, sta

[jira] [Created] (HADOOP-17180) S3Guard: Include 500 DynamoDB system errors in exponential backoff retries

2020-08-03 Thread David Kats (Jira)
David Kats created HADOOP-17180: --- Summary: S3Guard: Include 500 DynamoDB system errors in exponential backoff retries Key: HADOOP-17180 URL: https://issues.apache.org/jira/browse/HADOOP-17180 Project

[jira] [Created] (HADOOP-17141) Add Capability To Get Text Length

2020-07-20 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17141: --- Summary: Add Capability To Get Text Length Key: HADOOP-17141 URL: https://issues.apache.org/jira/browse/HADOOP-17141 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-17128) double buffer memory size hard code

2020-07-14 Thread David Wei (Jira)
David Wei created HADOOP-17128: -- Summary: double buffer memory size hard code Key: HADOOP-17128 URL: https://issues.apache.org/jira/browse/HADOOP-17128 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-17009) Embrace Immutability of Java Collections

2020-04-22 Thread David Mollitor (Jira)
David Mollitor created HADOOP-17009: --- Summary: Embrace Immutability of Java Collections Key: HADOOP-17009 URL: https://issues.apache.org/jira/browse/HADOOP-17009 Project: Hadoop Common

[jira] [Created] (HADOOP-16951) Tidy Up Text and ByteWritables Class

2020-04-01 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16951: --- Summary: Tidy Up Text and ByteWritables Class Key: HADOOP-16951 URL: https://issues.apache.org/jira/browse/HADOOP-16951 Project: Hadoop Common Issue

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
And by "wow" I mean to say, "your input was awesome and generous," not "wow that's a lot of work." On Tue, Mar 10, 2020, 9:24 PM David Mollitor wrote: > Wow. Thanks for that started point. > > On Tue, Mar 10, 2020, 8:48 PM Owen O'Malley > wr

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
InputStream() > 5. loop until stream.read(buffer, offset, length) returns enough > bytes. > > .. Owen > > On Tue, Mar 10, 2020 at 3:57 PM David Mollitor wrote: > >> I just see a lot of overlap and doubling of effort here. Would be nice if >> we can all be w

Re: Hadoop File API v.s. Commons VFS

2020-03-10 Thread David Mollitor
erience with Apache VFS? > > On Fri, Feb 28, 2020 at 6:42 AM David Mollitor wrote: > >> Hello, >> >> I'm curious to know what the history of Hadoop File API is in relationship >> to VFS. Hadoop supports several file schemes and so does VFS. Why are >> there

Hadoop File API v.s. Commons VFS

2020-02-28 Thread David Mollitor
Hello, I'm curious to know what the history of Hadoop File API is in relationship to VFS. Hadoop supports several file schemes and so does VFS. Why are there two projects working on this same effort and what are the pros/cons of each? Thanks.

[jira] [Resolved] (HADOOP-16817) Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor resolved HADOOP-16817. - Resolution: Not A Problem I was able to build with the modified POM, but I do see that

[jira] [Created] (HADOOP-16817) Remove Superfluous Dependency on Zookeeper Recipes

2020-01-20 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16817: --- Summary: Remove Superfluous Dependency on Zookeeper Recipes Key: HADOOP-16817 URL: https://issues.apache.org/jira/browse/HADOOP-16817 Project: Hadoop Common

[jira] [Created] (HADOOP-16811) Use JUnit TemporaryFolder Rule in TestFileUtils

2020-01-17 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16811: --- Summary: Use JUnit TemporaryFolder Rule in TestFileUtils Key: HADOOP-16811 URL: https://issues.apache.org/jira/browse/HADOOP-16811 Project: Hadoop Common

[jira] [Created] (HADOOP-16807) Enable Filesystem caching to optionally include URI Path

2020-01-15 Thread David Dudley (Jira)
David Dudley created HADOOP-16807: - Summary: Enable Filesystem caching to optionally include URI Path Key: HADOOP-16807 URL: https://issues.apache.org/jira/browse/HADOOP-16807 Project: Hadoop Common

[jira] [Created] (HADOOP-16790) Add Write Convenience Methods

2020-01-03 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16790: --- Summary: Add Write Convenience Methods Key: HADOOP-16790 URL: https://issues.apache.org/jira/browse/HADOOP-16790 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16717) Remove GenericsUtil isLog4jLogger

2019-11-16 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16717: --- Summary: Remove GenericsUtil isLog4jLogger Key: HADOOP-16717 URL: https://issues.apache.org/jira/browse/HADOOP-16717 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16716) slf4j-log4j12 Should Not Be Included as Dependency

2019-11-16 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16716: --- Summary: slf4j-log4j12 Should Not Be Included as Dependency Key: HADOOP-16716 URL: https://issues.apache.org/jira/browse/HADOOP-16716 Project: Hadoop Common

[jira] [Created] (HADOOP-16715) Remove Compile Scope From POM

2019-11-16 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16715: --- Summary: Remove Compile Scope From POM Key: HADOOP-16715 URL: https://issues.apache.org/jira/browse/HADOOP-16715 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16694) Use Objects requireNull Where Appropriate

2019-11-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16694: --- Summary: Use Objects requireNull Where Appropriate Key: HADOOP-16694 URL: https://issues.apache.org/jira/browse/HADOOP-16694 Project: Hadoop Common

[jira] [Created] (HADOOP-16693) Review InterruptedException Handling

2019-11-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16693: --- Summary: Review InterruptedException Handling Key: HADOOP-16693 URL: https://issues.apache.org/jira/browse/HADOOP-16693 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16692) UserGroupInformation Treats kerberosMinSecondsBeforeRelogin, as Millis

2019-11-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16692: --- Summary: UserGroupInformation Treats kerberosMinSecondsBeforeRelogin, as Millis Key: HADOOP-16692 URL: https://issues.apache.org/jira/browse/HADOOP-16692

[jira] [Created] (HADOOP-16691) Unify Logging in UserGroupInformation

2019-11-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16691: --- Summary: Unify Logging in UserGroupInformation Key: HADOOP-16691 URL: https://issues.apache.org/jira/browse/HADOOP-16691 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-16686) Review Writable Classes

2019-11-05 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16686: --- Summary: Review Writable Classes Key: HADOOP-16686 URL: https://issues.apache.org/jira/browse/HADOOP-16686 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16678) Review of ArrayWritable

2019-11-01 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16678: --- Summary: Review of ArrayWritable Key: HADOOP-16678 URL: https://issues.apache.org/jira/browse/HADOOP-16678 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-16639) Use Relative URLS in Hadoop HDFS HTTP FS

2019-10-07 Thread David Mollitor (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Mollitor resolved HADOOP-16639. - Resolution: Won't Fix Belong in HDFS project > Use Relative URLS in Hadoop H

[jira] [Created] (HADOOP-16639) Use Relative URLS in Hadoop HDFS HTTP FS

2019-10-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16639: --- Summary: Use Relative URLS in Hadoop HDFS HTTP FS Key: HADOOP-16639 URL: https://issues.apache.org/jira/browse/HADOOP-16639 Project: Hadoop Common

[jira] [Created] (HADOOP-16638) Use Relative URLs in Hadoop KMS

2019-10-07 Thread David Mollitor (Jira)
David Mollitor created HADOOP-16638: --- Summary: Use Relative URLs in Hadoop KMS Key: HADOOP-16638 URL: https://issues.apache.org/jira/browse/HADOOP-16638 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16399) Add missing getFileBlockLocations overload to FilterFileSystem

2019-06-26 Thread David Phillips (JIRA)
David Phillips created HADOOP-16399: --- Summary: Add missing getFileBlockLocations overload to FilterFileSystem Key: HADOOP-16399 URL: https://issues.apache.org/jira/browse/HADOOP-16399 Project

[jira] [Created] (HADOOP-16307) Intern User Name and Group Name in FileStatus

2019-05-10 Thread David Mollitor (JIRA)
David Mollitor created HADOOP-16307: --- Summary: Intern User Name and Group Name in FileStatus Key: HADOOP-16307 URL: https://issues.apache.org/jira/browse/HADOOP-16307 Project: Hadoop Common

[jira] [Created] (HADOOP-16208) Do Not Log InterruptedException in Client

2019-03-26 Thread David Mollitor (JIRA)
David Mollitor created HADOOP-16208: --- Summary: Do Not Log InterruptedException in Client Key: HADOOP-16208 URL: https://issues.apache.org/jira/browse/HADOOP-16208 Project: Hadoop Common

[jira] [Created] (HADOOP-16196) Path Parameterize Comparable

2019-03-17 Thread David Mollitor (JIRA)
David Mollitor created HADOOP-16196: --- Summary: Path Parameterize Comparable Key: HADOOP-16196 URL: https://issues.apache.org/jira/browse/HADOOP-16196 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-16181) HadoopExecutors shutdown Cleanup

2019-03-12 Thread David Mollitor (JIRA)
David Mollitor created HADOOP-16181: --- Summary: HadoopExecutors shutdown Cleanup Key: HADOOP-16181 URL: https://issues.apache.org/jira/browse/HADOOP-16181 Project: Hadoop Common Issue Type

Re: [Urgent] Question about Nexus repo and Hadoop release

2019-01-21 Thread David Nalley
I wonder if it's because there are no signatures on your key. --David On Mon, Jan 21, 2019 at 11:57 AM Wangda Tan wrote: > > Hi Brian, > > Here're links to my key: > > http://pool.sks-keyservers.net:11371/key/0xB3FA653D57300D45 > > http://pgp.mit.edu/pks/looku

Re: [Urgent] Question about Nexus repo and Hadoop release

2019-01-12 Thread David Nalley
On Sat, Jan 12, 2019 at 9:09 PM Wangda Tan wrote: > > Hi Devs, > > I'm currently rolling Hadoop 3.1.2 release candidate, however, I saw an issue > when I try to close repo in Nexus. > > Logs of https://repository.apache.org/#stagingRepositories > (orgapachehadoop-1183) shows hundreds of lines of

[jira] [Resolved] (HADOOP-14362) Hadoop still will not Build with hard floats on Arm

2017-05-18 Thread David Tippett (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Tippett resolved HADOOP-14362. Resolution: Unresolved > Hadoop still will not Build with hard floats on

[jira] [Created] (HADOOP-14362) Hadoop still will not Build with hard floats on Arm

2017-04-28 Thread David Tippett (JIRA)
David Tippett created HADOOP-14362: -- Summary: Hadoop still will not Build with hard floats on Arm Key: HADOOP-14362 URL: https://issues.apache.org/jira/browse/HADOOP-14362 Project: Hadoop Common

[jira] [Created] (HADOOP-14089) Shaded Hadoop client runtime includes non-shaded classes

2017-02-16 Thread David Phillips (JIRA)
David Phillips created HADOOP-14089: --- Summary: Shaded Hadoop client runtime includes non-shaded classes Key: HADOOP-14089 URL: https://issues.apache.org/jira/browse/HADOOP-14089 Project: Hadoop

[jira] [Created] (HADOOP-14064) Native maven build fails for non-default zlib location

2017-02-06 Thread David James (JIRA)
David James created HADOOP-14064: Summary: Native maven build fails for non-default zlib location Key: HADOOP-14064 URL: https://issues.apache.org/jira/browse/HADOOP-14064 Project: Hadoop Common

[jira] [Created] (HADOOP-14005) 2.7.3 shipped without Snappy support

2017-01-20 Thread David Choppa (JIRA)
David Choppa created HADOOP-14005: - Summary: 2.7.3 shipped without Snappy support Key: HADOOP-14005 URL: https://issues.apache.org/jira/browse/HADOOP-14005 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-13510) "hadoop fs -getmerge" docs, .../dir does not work, .../dir/* works.

2016-08-17 Thread David Sidlo (JIRA)
David Sidlo created HADOOP-13510: Summary: "hadoop fs -getmerge" docs, .../dir does not work, .../dir/* works. Key: HADOOP-13510 URL: https://issues.apache.org/jira/browse/HADOOP-13510

[jira] [Created] (HADOOP-13509) "fs -getmerge" can fail in an HA NameNode env.

2016-08-17 Thread David Sidlo (JIRA)
David Sidlo created HADOOP-13509: Summary: "fs -getmerge" can fail in an HA NameNode env. Key: HADOOP-13509 URL: https://issues.apache.org/jira/browse/HADOOP-13509 Project: Had

[jira] [Created] (HADOOP-12531) Regroup of all Hadoop Ecosystem UIs

2015-10-30 Thread SERGENT David (JIRA)
SERGENT David created HADOOP-12531: -- Summary: Regroup of all Hadoop Ecosystem UIs Key: HADOOP-12531 URL: https://issues.apache.org/jira/browse/HADOOP-12531 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-12080) swiftfs ls fails with NPE for dirs with single file

2015-06-10 Thread David Dobbins (JIRA)
David Dobbins created HADOOP-12080: -- Summary: swiftfs ls fails with NPE for dirs with single file Key: HADOOP-12080 URL: https://issues.apache.org/jira/browse/HADOOP-12080 Project: Hadoop Common

[jira] [Created] (HADOOP-12062) Yarn Scheduler Load Simulator does not work

2015-06-04 Thread David Kjerrumgaard (JIRA)
David Kjerrumgaard created HADOOP-12062: --- Summary: Yarn Scheduler Load Simulator does not work Key: HADOOP-12062 URL: https://issues.apache.org/jira/browse/HADOOP-12062 Project: Hadoop Common

[jira] [Created] (HADOOP-12057) swiftfs rename on partitioned file attempts to consolidate partitions

2015-06-02 Thread David Dobbins (JIRA)
David Dobbins created HADOOP-12057: -- Summary: swiftfs rename on partitioned file attempts to consolidate partitions Key: HADOOP-12057 URL: https://issues.apache.org/jira/browse/HADOOP-12057 Project

[jira] [Reopened] (HADOOP-11972) hdfs dfs -copyFromLocal reports File Not Found instead of Permission Denied.

2015-05-18 Thread David Tucker (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Tucker reopened HADOOP-11972: --- I believe `.` just references $PWD (fwiw, I use bash). 1. No, this env is NOT kerberized. 2

[jira] [Created] (HADOOP-11972) hdfs dfs -copyFromLocal reports File Not Found instead of Permission Denied.

2015-05-14 Thread David Tucker (JIRA)
David Tucker created HADOOP-11972: - Summary: hdfs dfs -copyFromLocal reports File Not Found instead of Permission Denied. Key: HADOOP-11972 URL: https://issues.apache.org/jira/browse/HADOOP-11972

Re: Request to correct misinformation

2015-05-09 Thread David Nalley
Actually sending to the Hadoop list this time. On Sat, May 9, 2015 at 10:06 PM, David Nalley wrote: > Thanks for the report Kaori: > > Where did you find a link to http://apache.org/contact.html ? > > As for the typo, I've copied the Hadoop project. > > > > On S

[jira] [Resolved] (HADOOP-10677) ExportSnapshot fails on kerberized cluster using s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10677. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400

[jira] [Resolved] (HADOOP-10676) S3AOutputStream not reading new config knobs for multipart configs

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10676. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400

[jira] [Resolved] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-09-15 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang resolved HADOOP-10675. Resolution: Fixed Fix Version/s: 2.6.0 This was fixed as part of HADOOP-10400

[jira] [Created] (HADOOP-11091) Eliminate old configuration parameter names from s3a

2014-09-13 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11091: -- Summary: Eliminate old configuration parameter names from s3a Key: HADOOP-11091 URL: https://issues.apache.org/jira/browse/HADOOP-11091 Project: Hadoop Common

[jira] [Reopened] (HADOOP-10373) create tools/hadoop-amazon for aws/EMR support

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-10373: > create tools/hadoop-amazon for aws/EMR supp

[jira] [Reopened] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-11074: > Move s3-related FS connector code to hadoop-

[jira] [Reopened] (HADOOP-9540) Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit testing.

2014-09-11 Thread David S. Wang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David S. Wang reopened HADOOP-9540: --- > Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit > t

[jira] [Created] (HADOOP-11082) Resolve findbugs warnings in hadoop-aws module

2014-09-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11082: -- Summary: Resolve findbugs warnings in hadoop-aws module Key: HADOOP-11082 URL: https://issues.apache.org/jira/browse/HADOOP-11082 Project: Hadoop Common

[jira] [Created] (HADOOP-11074) Move s3-related FS connector code to hadoop-aws

2014-09-08 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-11074: -- Summary: Move s3-related FS connector code to hadoop-aws Key: HADOOP-11074 URL: https://issues.apache.org/jira/browse/HADOOP-11074 Project: Hadoop Common

[jira] [Created] (HADOOP-10962) Flags for posix_fadvise are not valid in some architectures

2014-08-12 Thread David Villegas (JIRA)
David Villegas created HADOOP-10962: --- Summary: Flags for posix_fadvise are not valid in some architectures Key: HADOOP-10962 URL: https://issues.apache.org/jira/browse/HADOOP-10962 Project: Hadoop

[jira] [Created] (HADOOP-10714) AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call

2014-06-17 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10714: -- Summary: AmazonS3Client.deleteObjects() need to be limited to 1000 entries per call Key: HADOOP-10714 URL: https://issues.apache.org/jira/browse/HADOOP-10714

[jira] [Created] (HADOOP-10677) ExportSnapshot fails on kerberized cluster using s3a

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10677: -- Summary: ExportSnapshot fails on kerberized cluster using s3a Key: HADOOP-10677 URL: https://issues.apache.org/jira/browse/HADOOP-10677 Project: Hadoop Common

[jira] [Created] (HADOOP-10676) S3AOutputStream not reading new config knobs for multipart configs

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10676: -- Summary: S3AOutputStream not reading new config knobs for multipart configs Key: HADOOP-10676 URL: https://issues.apache.org/jira/browse/HADOOP-10676 Project

[jira] [Created] (HADOOP-10675) Add server-side encryption functionality to s3a

2014-06-10 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10675: -- Summary: Add server-side encryption functionality to s3a Key: HADOOP-10675 URL: https://issues.apache.org/jira/browse/HADOOP-10675 Project: Hadoop Common

[jira] [Created] (HADOOP-10568) Add s3 server-side encryption

2014-05-02 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10568: -- Summary: Add s3 server-side encryption Key: HADOOP-10568 URL: https://issues.apache.org/jira/browse/HADOOP-10568 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-10195) swiftfs object list stops at 10000 objects

2013-12-30 Thread David Dobbins (JIRA)
David Dobbins created HADOOP-10195: -- Summary: swiftfs object list stops at 1 objects Key: HADOOP-10195 URL: https://issues.apache.org/jira/browse/HADOOP-10195 Project: Hadoop Common

[jira] [Created] (HADOOP-10176) swiftfs doesn't correctly handle object names starting with slash

2013-12-19 Thread David Dobbins (JIRA)
David Dobbins created HADOOP-10176: -- Summary: swiftfs doesn't correctly handle object names starting with slash Key: HADOOP-10176 URL: https://issues.apache.org/jira/browse/HADOOP-10176 Pr

[jira] [Created] (HADOOP-10135) writes to swift fs over partition size leave temp files and empty output file

2013-11-27 Thread David Dobbins (JIRA)
David Dobbins created HADOOP-10135: -- Summary: writes to swift fs over partition size leave temp files and empty output file Key: HADOOP-10135 URL: https://issues.apache.org/jira/browse/HADOOP-10135

[jira] [Created] (HADOOP-10046) Print a log message when SSL is enabled

2013-10-14 Thread David S. Wang (JIRA)
David S. Wang created HADOOP-10046: -- Summary: Print a log message when SSL is enabled Key: HADOOP-10046 URL: https://issues.apache.org/jira/browse/HADOOP-10046 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-10038) Improve JobTracker web UI

2013-10-09 Thread David Chen (JIRA)
David Chen created HADOOP-10038: --- Summary: Improve JobTracker web UI Key: HADOOP-10038 URL: https://issues.apache.org/jira/browse/HADOOP-10038 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-10037) s3n read truncated, but doesn't throw exception

2013-10-09 Thread David Rosenstrauch (JIRA)
David Rosenstrauch created HADOOP-10037: --- Summary: s3n read truncated, but doesn't throw exception Key: HADOOP-10037 URL: https://issues.apache.org/jira/browse/HADOOP-10037 Project: H

[jira] [Created] (HADOOP-9731) Uncaught NullPointerException in MiniDFSCluster.java

2013-07-15 Thread David Williams (JIRA)
David Williams created HADOOP-9731: -- Summary: Uncaught NullPointerException in MiniDFSCluster.java Key: HADOOP-9731 URL: https://issues.apache.org/jira/browse/HADOOP-9731 Project: Hadoop Common

[jira] [Created] (HADOOP-9295) AbstractMapWritable throws exception when calling readFields() multiple times when the maps contain different class types

2013-02-11 Thread David Parks (JIRA)
David Parks created HADOOP-9295: --- Summary: AbstractMapWritable throws exception when calling readFields() multiple times when the maps contain different class types Key: HADOOP-9295 URL: https://issues.apache.org

[jira] [Created] (HADOOP-9262) Allow jobs to override the input Key/Value read from a sequence file's headers

2013-01-29 Thread David Parks (JIRA)
David Parks created HADOOP-9262: --- Summary: Allow jobs to override the input Key/Value read from a sequence file's headers Key: HADOOP-9262 URL: https://issues.apache.org/jira/browse/HADOOP-9262 Pr

[jira] [Created] (HADOOP-9240) Making ArrayWritable typed

2013-01-24 Thread David Parks (JIRA)
David Parks created HADOOP-9240: --- Summary: Making ArrayWritable typed Key: HADOOP-9240 URL: https://issues.apache.org/jira/browse/HADOOP-9240 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-9066) Sorting for FileStatus[]

2012-11-20 Thread david king (JIRA)
david king created HADOOP-9066: -- Summary: Sorting for FileStatus[] Key: HADOOP-9066 URL: https://issues.apache.org/jira/browse/HADOOP-9066 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-8579) Websites for HDFS and MapReduce both send users to video training resource which is non-public

2012-07-09 Thread David L. Willson (JIRA)
David L. Willson created HADOOP-8579: Summary: Websites for HDFS and MapReduce both send users to video training resource which is non-public Key: HADOOP-8579 URL: https://issues.apache.org/jira/browse/HADOOP

Setting up Hadoop in Eclipse

2011-03-29 Thread David Saile
(FileSystem.java:1798) … Is it correct, to check-out the three components as different projects? Does anyone have a working configuration for separate projects? Help would really be appreciated! David

Re: Configuring Heap Size for Name Node

2010-12-03 Thread David B. Ritch
JVM command-line parameters such as this are generally set in the hadoop-env.sh file. dbr On 12/2/2010 1:11 AM, Philip Zeyliger wrote: > HADOOP_NAMENODE_OPTS="-Xmx500m" will set it to 500MB. The "OPTS" here > refers to JVM options. -Xmx is a common JVM option to set the maximum > heap. > > -- P

Hadoop Job Opportunity - NYC

2009-10-14 Thread David Moccia
Hello All- My name is David Moccia and I am with the HR department here at the Gilt Groupe. We are HUGE supporters of the open source community. We currently have contributors that are employed here. I have attached a job description of a position that we are looking to fill with someone