Re: Institutions running kerberized Hadoop clusters

2022-04-12 Thread Santosh Marella
Thanks Wei-Chiu. Was looking mainly to get to know the institutions. At Twitter, we have been working on kerberizing our clusters and wanted to see who out there has already done it, any insights/best-practices that we can leverage than reinventing the wheel (especially when dealing with things at

Re: Institutions running kerberized Hadoop clusters

2022-04-12 Thread Wei-Chiu Chuang
Last time I checked (~2 years ago), there were thousands of Kerberized clusters among Cloudera customers. The largest ones had a few thousand nodes. What are you looking for? On Wed, Apr 13, 2022 at 7:22 AM Santosh Marella wrote: > Hey folks, > > Just curious if we have a list of institutions

Institutions running kerberized Hadoop clusters

2022-04-12 Thread Santosh Marella
Hey folks, Just curious if we have a list of institutions that are running *kerberized* Hadoop clusters? I noticed we have a PoweredBy Hadoop page that lists all the institutions running Hadoop, but couldn't find something similar f

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2022-04-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/837/ [Apr 11, 2022 7:54:00 AM] (noreply) HDFS-16516. Fix Fsshell wrong params (#4090). Contributed by GuoPhilipse. -1 overall The following subsystems voted -1: blanks pathlen xml The following

[ANNOUNCE] branch-3.3.3 created off 3.3.2; branch-3.3 hadoop.version is now 3.3.4-SNAPSHOT

2022-04-12 Thread Steve Loughran
There is now a branch-3.3.3 in the repo; this is forked off 3.3.2, *not* branch-3.3 branch-3.3 has its hadoop version now set to 3.3.4 I've renamed the release version 3.3.3 in JIRA to 3.3.4, so all fixed/target/affects references have been automatically updated. text references in JIRAs and PRs

[jira] [Reopened] (HADOOP-18155) Refactor tests in TestFileUtil

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18155: - > Refactor tests in TestFileUtil > -- > > Key:

[jira] [Reopened] (HADOOP-18125) Utility to identify git commit / Jira fixVersion discrepancies for RC preparation

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18125: - > Utility to identify git commit / Jira fixVersion discrepancies for RC > preparation > --

[jira] [Reopened] (HADOOP-18088) Replace log4j 1.x with reload4j

2022-04-12 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened HADOOP-18088: - > Replace log4j 1.x with reload4j > --- > > Key

Re: HADOOP-18198. Release Hadoop 3.3.3: hadoop-3.3.2 with CVE fixes

2022-04-12 Thread Steve Loughran
I should add that the CVEs in question are minor, unless you are running Hadoop on windows. given you have to compile the native binaries yourself for that, that is not something we know anyone actually does in production. The reload4j fix means that we can get out of the classpath the log4j vulne

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2022-04-12 Thread Apache Jenkins Server
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/629/ [Apr 11, 2022 6:20:43 AM] (Takanobu Asanuma) HADOOP-17116. Skip Retry INFO logging on first failover from a proxy [Apr 11, 2022 6:24:51 AM] (Takanobu Asanuma) HADOOP-18191. Log retry count whil

[jira] [Resolved] (HADOOP-18199) Fix ZStandardCompressor bytesRead meta when using BlockCompressorStream

2022-04-12 Thread chaoli (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chaoli resolved HADOOP-18199. - Resolution: Not A Bug > Fix ZStandardCompressor bytesRead meta when using BlockCompressorStream > -

[jira] [Created] (HADOOP-18199) Fix ZStandardCompressor bytesRead meta when using BlockCompressorStream

2022-04-12 Thread chaoli (Jira)
chaoli created HADOOP-18199: --- Summary: Fix ZStandardCompressor bytesRead meta when using BlockCompressorStream Key: HADOOP-18199 URL: https://issues.apache.org/jira/browse/HADOOP-18199 Project: Hadoop Commo