David Mollitor created HADOOP-17779:
---
Summary: Lock File System Creator Semaphore Uninterruptibly
Key: HADOOP-17779
URL: https://issues.apache.org/jira/browse/HADOOP-17779
Project: Hadoop Common
Thank you Wei-Chiu! Hopefully we can now move Hive forward!
On Tue, Jun 15, 2021, 10:30 PM Wei-Chiu Chuang wrote:
> Hi All,
>
> It gives me great pleasure to announce that the Apache Hadoop community has
> voted to release Apache Hadoop 3.3.1.
>
> This is the first stable release of Apache Hado
David created HADOOP-17681:
--
Summary: Received "Permission denied" error while copying files
through NFS Gateway
Key: HADOOP-17681
URL: https://issues.apache.org/jira/browse/HADOOP-17681
Proje
Hello,
Still hoping for help here:
https://issues.apache.org/jira/browse/HDFS-15790
Looks like it has been worked on, not sure how to best move it forward.
On Wed, Mar 10, 2021, 12:21 PM Steve Loughran
wrote:
> I'm going to argue its too late to do IPv6 support close to a release, as
> it's b
Hello Gang,
I'm not sure I understand that "Hadoop Thirdparty" project. I mean, I
understand that it's a collection of shaded third party libraries, but the
way it is setup currently seems self-defeating. What if I have multiple
versions of the Hadoop Thirdparty library on my classpath?
It seem
Would be great for the Hive team to see this one as well:
https://issues.apache.org/jira/browse/HDFS-15790
On Wed, Jan 27, 2021 at 8:28 PM Wei-Chiu Chuang wrote:
> Hi all,
>
> Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated
> more than 400 changes in the branch-3.3. A
Hey Wei-Chiu,
I hope you are well.
Interesting timing on this question. I just filed this a few minutes ago.
https://issues.apache.org/jira/browse/HDFS-15790
What is the benefit of moving to PB 3? PB 2 is not deprecated or anything
and they are not completely backwards compatible. I questio
David Mollitor created HADOOP-17494:
---
Summary: Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2
Co-Exist
Key: HADOOP-17494
URL: https://issues.apache.org/jira/browse/HADOOP-17494
Project
David Mollitor created HADOOP-17482:
---
Summary: Remove Commons Logger from FileSystem Class
Key: HADOOP-17482
URL: https://issues.apache.org/jira/browse/HADOOP-17482
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-17462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor resolved HADOOP-17462.
-
Resolution: Not A Problem
Thanks [~sjlee0] for pointing outing that the {{call
David Mollitor created HADOOP-17462:
---
Summary: Hadoop Client getRpcResponse May Return Wrong Result
Key: HADOOP-17462
URL: https://issues.apache.org/jira/browse/HADOOP-17462
Project: Hadoop Common
Hello Gang,
I'm trying to upgrade the Apache Hive project to use Hadoop 3.3.0 so that
Hive can build/run with JDK 9/11. The current Hadoop dependency for Hive
fails to run with JDK 9/11.
However, I ran into an issue:
ProtobufRpcEngine2
It looks like Hadoop commons updated the PB RPC Engine fro
David Mollitor created HADOOP-17443:
---
Summary: Improve Hive Class Logging/Error Handling
Key: HADOOP-17443
URL: https://issues.apache.org/jira/browse/HADOOP-17443
Project: Hadoop Common
ix it.
org.apache.hadoop.thirdparty.protobuf.GeneratedMessageV3
On Wed, Dec 9, 2020 at 2:50 PM David wrote:
> Hello,
>
> For additional context, the unit tests in Hive are using MiniDFSCluster.
> I suspect that is what is loading the ProtobufRpcEngine2 class, while the
> local code under test uses ProtobufRpcEngine.
>
&
2:34 PM David wrote:
> Hello Gang,
>
> There seems to be a new RpcEngine created as part of Hadoop 3.3. I'm
> trying to upgrade Hive to use Hadoop 3.3 and it uses the RpcEngine
> mechanism. However, tests are failing for Hive complaining about:
>
> "ReRegistration
Hello Gang,
There seems to be a new RpcEngine created as part of Hadoop 3.3. I'm
trying to upgrade Hive to use Hadoop 3.3 and it uses the RpcEngine
mechanism. However, tests are failing for Hive complaining about:
"ReRegistration of rpcKind"
I believe this is because both classes register, sta
David Kats created HADOOP-17180:
---
Summary: S3Guard: Include 500 DynamoDB system errors in
exponential backoff retries
Key: HADOOP-17180
URL: https://issues.apache.org/jira/browse/HADOOP-17180
Project
David Mollitor created HADOOP-17141:
---
Summary: Add Capability To Get Text Length
Key: HADOOP-17141
URL: https://issues.apache.org/jira/browse/HADOOP-17141
Project: Hadoop Common
Issue Type
David Wei created HADOOP-17128:
--
Summary: double buffer memory size hard code
Key: HADOOP-17128
URL: https://issues.apache.org/jira/browse/HADOOP-17128
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-17009:
---
Summary: Embrace Immutability of Java Collections
Key: HADOOP-17009
URL: https://issues.apache.org/jira/browse/HADOOP-17009
Project: Hadoop Common
David Mollitor created HADOOP-16951:
---
Summary: Tidy Up Text and ByteWritables Class
Key: HADOOP-16951
URL: https://issues.apache.org/jira/browse/HADOOP-16951
Project: Hadoop Common
Issue
And by "wow" I mean to say, "your input was awesome and generous," not "wow
that's a lot of work."
On Tue, Mar 10, 2020, 9:24 PM David Mollitor wrote:
> Wow. Thanks for that started point.
>
> On Tue, Mar 10, 2020, 8:48 PM Owen O'Malley
> wr
InputStream()
> 5. loop until stream.read(buffer, offset, length) returns enough
> bytes.
>
> .. Owen
>
> On Tue, Mar 10, 2020 at 3:57 PM David Mollitor wrote:
>
>> I just see a lot of overlap and doubling of effort here. Would be nice if
>> we can all be w
erience with Apache VFS?
>
> On Fri, Feb 28, 2020 at 6:42 AM David Mollitor wrote:
>
>> Hello,
>>
>> I'm curious to know what the history of Hadoop File API is in relationship
>> to VFS. Hadoop supports several file schemes and so does VFS. Why are
>> there
Hello,
I'm curious to know what the history of Hadoop File API is in relationship
to VFS. Hadoop supports several file schemes and so does VFS. Why are
there two projects working on this same effort and what are the pros/cons
of each?
Thanks.
[
https://issues.apache.org/jira/browse/HADOOP-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor resolved HADOOP-16817.
-
Resolution: Not A Problem
I was able to build with the modified POM, but I do see that
David Mollitor created HADOOP-16817:
---
Summary: Remove Superfluous Dependency on Zookeeper Recipes
Key: HADOOP-16817
URL: https://issues.apache.org/jira/browse/HADOOP-16817
Project: Hadoop Common
David Mollitor created HADOOP-16811:
---
Summary: Use JUnit TemporaryFolder Rule in TestFileUtils
Key: HADOOP-16811
URL: https://issues.apache.org/jira/browse/HADOOP-16811
Project: Hadoop Common
David Dudley created HADOOP-16807:
-
Summary: Enable Filesystem caching to optionally include URI Path
Key: HADOOP-16807
URL: https://issues.apache.org/jira/browse/HADOOP-16807
Project: Hadoop Common
David Mollitor created HADOOP-16790:
---
Summary: Add Write Convenience Methods
Key: HADOOP-16790
URL: https://issues.apache.org/jira/browse/HADOOP-16790
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-16717:
---
Summary: Remove GenericsUtil isLog4jLogger
Key: HADOOP-16717
URL: https://issues.apache.org/jira/browse/HADOOP-16717
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-16716:
---
Summary: slf4j-log4j12 Should Not Be Included as Dependency
Key: HADOOP-16716
URL: https://issues.apache.org/jira/browse/HADOOP-16716
Project: Hadoop Common
David Mollitor created HADOOP-16715:
---
Summary: Remove Compile Scope From POM
Key: HADOOP-16715
URL: https://issues.apache.org/jira/browse/HADOOP-16715
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-16694:
---
Summary: Use Objects requireNull Where Appropriate
Key: HADOOP-16694
URL: https://issues.apache.org/jira/browse/HADOOP-16694
Project: Hadoop Common
David Mollitor created HADOOP-16693:
---
Summary: Review InterruptedException Handling
Key: HADOOP-16693
URL: https://issues.apache.org/jira/browse/HADOOP-16693
Project: Hadoop Common
Issue
David Mollitor created HADOOP-16692:
---
Summary: UserGroupInformation Treats
kerberosMinSecondsBeforeRelogin, as Millis
Key: HADOOP-16692
URL: https://issues.apache.org/jira/browse/HADOOP-16692
David Mollitor created HADOOP-16691:
---
Summary: Unify Logging in UserGroupInformation
Key: HADOOP-16691
URL: https://issues.apache.org/jira/browse/HADOOP-16691
Project: Hadoop Common
Issue
David Mollitor created HADOOP-16686:
---
Summary: Review Writable Classes
Key: HADOOP-16686
URL: https://issues.apache.org/jira/browse/HADOOP-16686
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-16678:
---
Summary: Review of ArrayWritable
Key: HADOOP-16678
URL: https://issues.apache.org/jira/browse/HADOOP-16678
Project: Hadoop Common
Issue Type
[
https://issues.apache.org/jira/browse/HADOOP-16639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Mollitor resolved HADOOP-16639.
-
Resolution: Won't Fix
Belong in HDFS project
> Use Relative URLS in Hadoop H
David Mollitor created HADOOP-16639:
---
Summary: Use Relative URLS in Hadoop HDFS HTTP FS
Key: HADOOP-16639
URL: https://issues.apache.org/jira/browse/HADOOP-16639
Project: Hadoop Common
David Mollitor created HADOOP-16638:
---
Summary: Use Relative URLs in Hadoop KMS
Key: HADOOP-16638
URL: https://issues.apache.org/jira/browse/HADOOP-16638
Project: Hadoop Common
Issue Type
David Phillips created HADOOP-16399:
---
Summary: Add missing getFileBlockLocations overload to
FilterFileSystem
Key: HADOOP-16399
URL: https://issues.apache.org/jira/browse/HADOOP-16399
Project
David Mollitor created HADOOP-16307:
---
Summary: Intern User Name and Group Name in FileStatus
Key: HADOOP-16307
URL: https://issues.apache.org/jira/browse/HADOOP-16307
Project: Hadoop Common
David Mollitor created HADOOP-16208:
---
Summary: Do Not Log InterruptedException in Client
Key: HADOOP-16208
URL: https://issues.apache.org/jira/browse/HADOOP-16208
Project: Hadoop Common
David Mollitor created HADOOP-16196:
---
Summary: Path Parameterize Comparable
Key: HADOOP-16196
URL: https://issues.apache.org/jira/browse/HADOOP-16196
Project: Hadoop Common
Issue Type
David Mollitor created HADOOP-16181:
---
Summary: HadoopExecutors shutdown Cleanup
Key: HADOOP-16181
URL: https://issues.apache.org/jira/browse/HADOOP-16181
Project: Hadoop Common
Issue Type
I wonder if it's because there are no signatures on your key.
--David
On Mon, Jan 21, 2019 at 11:57 AM Wangda Tan wrote:
>
> Hi Brian,
>
> Here're links to my key:
>
> http://pool.sks-keyservers.net:11371/key/0xB3FA653D57300D45
>
> http://pgp.mit.edu/pks/looku
On Sat, Jan 12, 2019 at 9:09 PM Wangda Tan wrote:
>
> Hi Devs,
>
> I'm currently rolling Hadoop 3.1.2 release candidate, however, I saw an issue
> when I try to close repo in Nexus.
>
> Logs of https://repository.apache.org/#stagingRepositories
> (orgapachehadoop-1183) shows hundreds of lines of
[
https://issues.apache.org/jira/browse/HADOOP-14362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Tippett resolved HADOOP-14362.
Resolution: Unresolved
> Hadoop still will not Build with hard floats on
David Tippett created HADOOP-14362:
--
Summary: Hadoop still will not Build with hard floats on Arm
Key: HADOOP-14362
URL: https://issues.apache.org/jira/browse/HADOOP-14362
Project: Hadoop Common
David Phillips created HADOOP-14089:
---
Summary: Shaded Hadoop client runtime includes non-shaded classes
Key: HADOOP-14089
URL: https://issues.apache.org/jira/browse/HADOOP-14089
Project: Hadoop
David James created HADOOP-14064:
Summary: Native maven build fails for non-default zlib location
Key: HADOOP-14064
URL: https://issues.apache.org/jira/browse/HADOOP-14064
Project: Hadoop Common
David Choppa created HADOOP-14005:
-
Summary: 2.7.3 shipped without Snappy support
Key: HADOOP-14005
URL: https://issues.apache.org/jira/browse/HADOOP-14005
Project: Hadoop Common
Issue Type
David Sidlo created HADOOP-13510:
Summary: "hadoop fs -getmerge" docs, .../dir does not work,
.../dir/* works.
Key: HADOOP-13510
URL: https://issues.apache.org/jira/browse/HADOOP-13510
David Sidlo created HADOOP-13509:
Summary: "fs -getmerge" can fail in an HA NameNode env.
Key: HADOOP-13509
URL: https://issues.apache.org/jira/browse/HADOOP-13509
Project: Had
SERGENT David created HADOOP-12531:
--
Summary: Regroup of all Hadoop Ecosystem UIs
Key: HADOOP-12531
URL: https://issues.apache.org/jira/browse/HADOOP-12531
Project: Hadoop Common
Issue Type
David Dobbins created HADOOP-12080:
--
Summary: swiftfs ls fails with NPE for dirs with single file
Key: HADOOP-12080
URL: https://issues.apache.org/jira/browse/HADOOP-12080
Project: Hadoop Common
David Kjerrumgaard created HADOOP-12062:
---
Summary: Yarn Scheduler Load Simulator does not work
Key: HADOOP-12062
URL: https://issues.apache.org/jira/browse/HADOOP-12062
Project: Hadoop Common
David Dobbins created HADOOP-12057:
--
Summary: swiftfs rename on partitioned file attempts to
consolidate partitions
Key: HADOOP-12057
URL: https://issues.apache.org/jira/browse/HADOOP-12057
Project
[
https://issues.apache.org/jira/browse/HADOOP-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Tucker reopened HADOOP-11972:
---
I believe `.` just references $PWD (fwiw, I use bash).
1. No, this env is NOT kerberized.
2
David Tucker created HADOOP-11972:
-
Summary: hdfs dfs -copyFromLocal reports File Not Found instead of
Permission Denied.
Key: HADOOP-11972
URL: https://issues.apache.org/jira/browse/HADOOP-11972
Actually sending to the Hadoop list this time.
On Sat, May 9, 2015 at 10:06 PM, David Nalley wrote:
> Thanks for the report Kaori:
>
> Where did you find a link to http://apache.org/contact.html ?
>
> As for the typo, I've copied the Hadoop project.
>
>
>
> On S
[
https://issues.apache.org/jira/browse/HADOOP-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang resolved HADOOP-10677.
Resolution: Fixed
Fix Version/s: 2.6.0
This was fixed as part of HADOOP-10400
[
https://issues.apache.org/jira/browse/HADOOP-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang resolved HADOOP-10676.
Resolution: Fixed
Fix Version/s: 2.6.0
This was fixed as part of HADOOP-10400
[
https://issues.apache.org/jira/browse/HADOOP-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang resolved HADOOP-10675.
Resolution: Fixed
Fix Version/s: 2.6.0
This was fixed as part of HADOOP-10400
David S. Wang created HADOOP-11091:
--
Summary: Eliminate old configuration parameter names from s3a
Key: HADOOP-11091
URL: https://issues.apache.org/jira/browse/HADOOP-11091
Project: Hadoop Common
[
https://issues.apache.org/jira/browse/HADOOP-10373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang reopened HADOOP-10373:
> create tools/hadoop-amazon for aws/EMR supp
[
https://issues.apache.org/jira/browse/HADOOP-11074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang reopened HADOOP-11074:
> Move s3-related FS connector code to hadoop-
[
https://issues.apache.org/jira/browse/HADOOP-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David S. Wang reopened HADOOP-9540:
---
> Expose the InMemoryS3 and S3N FilesystemStores implementations for Unit
> t
David S. Wang created HADOOP-11082:
--
Summary: Resolve findbugs warnings in hadoop-aws module
Key: HADOOP-11082
URL: https://issues.apache.org/jira/browse/HADOOP-11082
Project: Hadoop Common
David S. Wang created HADOOP-11074:
--
Summary: Move s3-related FS connector code to hadoop-aws
Key: HADOOP-11074
URL: https://issues.apache.org/jira/browse/HADOOP-11074
Project: Hadoop Common
David Villegas created HADOOP-10962:
---
Summary: Flags for posix_fadvise are not valid in some
architectures
Key: HADOOP-10962
URL: https://issues.apache.org/jira/browse/HADOOP-10962
Project: Hadoop
David S. Wang created HADOOP-10714:
--
Summary: AmazonS3Client.deleteObjects() need to be limited to 1000
entries per call
Key: HADOOP-10714
URL: https://issues.apache.org/jira/browse/HADOOP-10714
David S. Wang created HADOOP-10677:
--
Summary: ExportSnapshot fails on kerberized cluster using s3a
Key: HADOOP-10677
URL: https://issues.apache.org/jira/browse/HADOOP-10677
Project: Hadoop Common
David S. Wang created HADOOP-10676:
--
Summary: S3AOutputStream not reading new config knobs for
multipart configs
Key: HADOOP-10676
URL: https://issues.apache.org/jira/browse/HADOOP-10676
Project
David S. Wang created HADOOP-10675:
--
Summary: Add server-side encryption functionality to s3a
Key: HADOOP-10675
URL: https://issues.apache.org/jira/browse/HADOOP-10675
Project: Hadoop Common
David S. Wang created HADOOP-10568:
--
Summary: Add s3 server-side encryption
Key: HADOOP-10568
URL: https://issues.apache.org/jira/browse/HADOOP-10568
Project: Hadoop Common
Issue Type: Bug
David Dobbins created HADOOP-10195:
--
Summary: swiftfs object list stops at 1 objects
Key: HADOOP-10195
URL: https://issues.apache.org/jira/browse/HADOOP-10195
Project: Hadoop Common
David Dobbins created HADOOP-10176:
--
Summary: swiftfs doesn't correctly handle object names starting
with slash
Key: HADOOP-10176
URL: https://issues.apache.org/jira/browse/HADOOP-10176
Pr
David Dobbins created HADOOP-10135:
--
Summary: writes to swift fs over partition size leave temp files
and empty output file
Key: HADOOP-10135
URL: https://issues.apache.org/jira/browse/HADOOP-10135
David S. Wang created HADOOP-10046:
--
Summary: Print a log message when SSL is enabled
Key: HADOOP-10046
URL: https://issues.apache.org/jira/browse/HADOOP-10046
Project: Hadoop Common
Issue
David Chen created HADOOP-10038:
---
Summary: Improve JobTracker web UI
Key: HADOOP-10038
URL: https://issues.apache.org/jira/browse/HADOOP-10038
Project: Hadoop Common
Issue Type: Improvement
David Rosenstrauch created HADOOP-10037:
---
Summary: s3n read truncated, but doesn't throw exception
Key: HADOOP-10037
URL: https://issues.apache.org/jira/browse/HADOOP-10037
Project: H
David Williams created HADOOP-9731:
--
Summary: Uncaught NullPointerException in MiniDFSCluster.java
Key: HADOOP-9731
URL: https://issues.apache.org/jira/browse/HADOOP-9731
Project: Hadoop Common
David Parks created HADOOP-9295:
---
Summary: AbstractMapWritable throws exception when calling
readFields() multiple times when the maps contain different class types
Key: HADOOP-9295
URL: https://issues.apache.org
David Parks created HADOOP-9262:
---
Summary: Allow jobs to override the input Key/Value read from a
sequence file's headers
Key: HADOOP-9262
URL: https://issues.apache.org/jira/browse/HADOOP-9262
Pr
David Parks created HADOOP-9240:
---
Summary: Making ArrayWritable typed
Key: HADOOP-9240
URL: https://issues.apache.org/jira/browse/HADOOP-9240
Project: Hadoop Common
Issue Type: Improvement
david king created HADOOP-9066:
--
Summary: Sorting for FileStatus[]
Key: HADOOP-9066
URL: https://issues.apache.org/jira/browse/HADOOP-9066
Project: Hadoop Common
Issue Type: Improvement
David L. Willson created HADOOP-8579:
Summary: Websites for HDFS and MapReduce both send users to video
training resource which is non-public
Key: HADOOP-8579
URL: https://issues.apache.org/jira/browse/HADOOP
(FileSystem.java:1798)
…
Is it correct, to check-out the three components as different projects?
Does anyone have a working configuration for separate projects?
Help would really be appreciated!
David
JVM command-line parameters such as this are generally set in the
hadoop-env.sh file.
dbr
On 12/2/2010 1:11 AM, Philip Zeyliger wrote:
> HADOOP_NAMENODE_OPTS="-Xmx500m" will set it to 500MB. The "OPTS" here
> refers to JVM options. -Xmx is a common JVM option to set the maximum
> heap.
>
> -- P
Hello All-
My name is David Moccia and I am with the HR department here at the Gilt
Groupe. We are HUGE supporters of the open source community. We
currently have contributors that are employed here. I have attached a
job description of a position that we are looking to fill with someone
93 matches
Mail list logo