[jira] [Resolved] (HDFS-16069) Remove locally stored files (edit log) when NameNode becomes Standby

[JiangHua Zhu (Jira)]

 [ 
https://issues.apache.org/jira/browse/HDFS-16069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

JiangHua Zhu resolved HDFS-16069.
-
Resolution: Duplicate

> Remove locally stored files (edit log) when NameNode becomes Standby
> 
>
> Key: HDFS-16069
> URL: https://issues.apache.org/jira/browse/HDFS-16069
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Affects Versions: 2.9.2
>Reporter: JiangHua Zhu
>Priority: Minor
>
> When zkfc is working, one of the NameNode (Active) will become the Standby 
> state. Before the state change, this NameNode has saved some files (edit 
> log), these files are stored in the directory 
> (dfs.namenode.edits.dir/dfs.namenode.name.dir) , And will not disappear in 
> the short term until the status of this NameNode becomes Active again.
> These files (edit log) are of little significance to the cluster.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

[Apache Jenkins Server]

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/

No changes




-1 overall


The following subsystems voted -1:
asflicense hadolint mvnsite pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.fs.TestTrash 
   hadoop.fs.TestFileUtil 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   
hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker
 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.mapreduce.lib.input.TestLineRecordReader 
   hadoop.mapred.TestLineRecordReader 
   hadoop.yarn.sls.TestSLSRunner 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-compile-javac-root.txt
  [496K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-checkstyle-root.txt
  [14M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   mvnsite:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-mvnsite-root.txt
  [584K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-patch-pylint.txt
  [48K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-patch-shellcheck.txt
  [56K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/diff-patch-shelldocs.txt
  [48K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-javadoc-root.txt
  [32K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [236K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [424K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [12K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [40K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt
  [20K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [124K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [104K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [104K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/419/artifact/out/patch-unit-hadoop-tools_hadoop-azure.txt
  [20K]
   
https://ci-hadoop.apache.org/job/hadoop-q

[jira] [Resolved] (HDFS-16223) AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

[Xiaoqiao He (Jira)]

 [ 
https://issues.apache.org/jira/browse/HDFS-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiaoqiao He resolved HDFS-16223.

Fix Version/s: 3.4.0
 Hadoop Flags: Reviewed
   Resolution: Fixed

Committed to trunk. Thanks [~ayushtkn] for your works!

> AvailableSpaceRackFaultTolerantBlockPlacementPolicy should use 
> chooseRandomWithStorageTypeTwoTrial() for better performance.
> 
>
> Key: HDFS-16223
> URL: https://issues.apache.org/jira/browse/HDFS-16223
> Project: Hadoop HDFS
>  Issue Type: Improvement
>Reporter: Ayush Saxena
>Assignee: Ayush Saxena
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.4.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Use chooseRandomWithStorageTypeTwoTrial as AvailableSpaceBlockPlacementPolicy 
> does.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-16225) Fix typo for FederationTestUtils

[tomscut (Jira)]

tomscut created HDFS-16225:
--

 Summary: Fix typo for FederationTestUtils
 Key: HDFS-16225
 URL: https://issues.apache.org/jira/browse/HDFS-16225
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: tomscut
Assignee: tomscut


Fix typo for FederationTestUtils.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-16226) Generate locatedBlocks can use bi-search to find curBlk

[zhanghaobo (Jira)]

zhanghaobo created HDFS-16226:
-

 Summary: Generate locatedBlocks can use bi-search to find curBlk
 Key: HDFS-16226
 URL: https://issues.apache.org/jira/browse/HDFS-16226
 Project: Hadoop HDFS
  Issue Type: Wish
  Components: namenode
Affects Versions: 3.3.1
Reporter: zhanghaobo






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-16227) testMoverWithStripedFile fails intermittently

[Viraj Jasani (Jira)]

Viraj Jasani created HDFS-16227:
---

 Summary: testMoverWithStripedFile fails intermittently
 Key: HDFS-16227
 URL: https://issues.apache.org/jira/browse/HDFS-16227
 Project: Hadoop HDFS
  Issue Type: Sub-task
Reporter: Viraj Jasani
Assignee: Viraj Jasani


TestMover#testMoverWithStripedFile fails intermittently with stacktrace:
{code:java}
[ERROR] testMoverWithStripedFile(org.apache.hadoop.hdfs.server.mover.TestMover) 
 Time elapsed: 48.439 s  <<< FAILURE![ERROR] 
testMoverWithStripedFile(org.apache.hadoop.hdfs.server.mover.TestMover)  Time 
elapsed: 48.439 s  <<< FAILURE!java.lang.AssertionError: expected: but 
was: at org.junit.Assert.fail(Assert.java:89) at 
org.junit.Assert.failNotEquals(Assert.java:835) at 
org.junit.Assert.assertEquals(Assert.java:120) at 
org.junit.Assert.assertEquals(Assert.java:146) at 
org.apache.hadoop.hdfs.server.mover.TestMover.testMoverWithStripedFile(TestMover.java:965)
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) 
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498) at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
 at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
 at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
 at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
 at 
org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
java.lang.Thread.run(Thread.java:748)

{code}
e.g 
https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3386/6/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

[Apache Jenkins Server]

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/

No changes




-1 overall


The following subsystems voted -1:
blanks pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

Failed junit tests :

   hadoop.hdfs.TestViewDistributedFileSystemContract 
   hadoop.hdfs.server.namenode.ha.TestSeveralNameNodes 
   hadoop.fs.viewfs.TestViewFSOverloadSchemeWithMountTableConfigInHDFS 
   hadoop.hdfs.web.TestWebHdfsFileSystemContract 
   hadoop.hdfs.rbfbalance.TestRouterDistCpProcedure 
   hadoop.yarn.csi.client.TestCsiClient 
   hadoop.tools.dynamometer.TestDynamometerInfra 
   hadoop.tools.dynamometer.TestDynamometerInfra 
  

   cc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-compile-cc-root.txt
 [96K]

   javac:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-compile-javac-root.txt
 [364K]

   blanks:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/blanks-eol.txt
 [13M]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/blanks-tabs.txt
 [2.0M]

   checkstyle:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-checkstyle-root.txt
 [14M]

   pathlen:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-pathlen.txt
 [16K]

   pylint:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-pylint.txt
 [20K]

   shellcheck:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-shellcheck.txt
 [28K]

   xml:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/xml.txt
 [24K]

   javadoc:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/results-javadoc-javadoc-root.txt
 [408K]

   unit:

  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
 [800K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
 [104K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-csi.txt
 [24K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer_hadoop-dynamometer-infra.txt
 [12K]
  
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/626/artifact/out/patch-unit-hadoop-tools_hadoop-dynamometer.txt
 [24K]

Powered by Apache Yetus 0.14.0-SNAPSHOT   https://yetus.apache.org

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: Hadoop-3.2.3 Release Update

[Brahma Reddy Battula]

Hi All,

Waiting for the following jira to commit to hadoop-3.2.3 , mostly this can
be done by this week,then I will try to create the RC next if there is no
objection.

https://issues.apache.org/jira/browse/HDFS-15160



On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula 
wrote:

> @Akira Ajisaka   and @Masatake Iwasaki
> 
> Looks all are build related issues when you try with bigtop. We can
> discuss and prioritize this.. Will connect with you guys.
>
> On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki <
> iwasak...@oss.nttdata.co.jp> wrote:
>
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>>
>> I filed HADOOP-17849 for this.
>>
>> On 2021/08/16 12:02, Masatake Iwasaki wrote:
>> > Thanks for bringing this up, Akira. Let me explain some background.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >
>> > This is for building hadoop-3.2.2 against zookeeper-3.4.14.
>> > we do not see the issue usually since branch-3.2 uses zooekeper-3.4.13,
>> > while it would be harmless to add the exclusion even for
>> zooekeeper-3.4.13.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >
>> > These are relevant to directory structure used by Bigtop package.
>> > If the fix does not break the tarball dist,
>> > it would be nice to have these on Hadoop too.
>> >
>> >
>> >> -
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >
>> > This is for aarch64 and ppe64le lacking required phantomjs.
>> > It is only acceptable for Bigtop not running tests of YARN-UI2 on
>> packaging.
>> > Hadoop needs the phantomjs for testing YARN-UI2.
>> >
>> >
>> > On 2021/08/16 2:59, Brahma Reddy Battula wrote:
>> >> Thanks, I'll check them out.
>> >>
>> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka 
>> wrote:
>> >>
>> >>> Thanks Brahma for cutting branch-3.2.3.
>> >>>
>> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2.
>> >>>
>> >>>
>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop
>> >>>
>> >>> In these patches, how about backporting the following issues to
>> >>> branch-3.2 and branch-3.2.3?
>> >>> - HADOOP-14922
>> >>> - HADOOP-15939
>> >>> - HADOOP-17569
>> >>>
>> >>> In addition, there are some patches that don't have JIRA issue ID.
>> >>> Maybe we need to create JIRAs and fix those.
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff
>> >>> -
>> >>>
>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff
>> >>>
>> >>> Thanks and regards,
>> >>> Akira
>> >>>
>> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He 
>> >>> wrote:
>> 
>>  Thanks Brahma for initiating this and making hadoop-3.2.3 release
>> happen.
>> 
>>  I would like to validate the HBase project (both the latest release
>> and
>>  trunk branch).
>>  Chao Sun will validate the Spark Project (Got in touch with Chao
>> >>> already).
>>  once RC is out.
>> 
>>  Thanks and Regards,
>>  - He Xiaoqiao
>> 
>> 
>>  On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula <
>> bra...@apache.org>
>>  wrote:
>> 
>> > Hi All,
>> >
>> > I cut branch-3.2.3 and it is ready for release. Please commit to
>> > branch-3.2.3 if any critical/blocker issues need to go.
>> >
>> > *This time I am thinking of having downstream projects and
>> companies'
>> > voices,let's know how this can go. *
>> >
>> > - Planning to check with downstream projects like Spark,HBase
>> and
>> >>> Hive
>> > if they can help on validation(Or running their UT on this
>> branch)
>> > - Collecting info from Companies who are already deployed and
>> using
>> >>> the
>> > branch-3.2
>> >
>> >
>> > so that we can 

Re: [Conference] Uber's story on running Apache Hadoop deployment in Docker

[Brahma Reddy Battula]

Thanks all for attending the session, Hope we can have some more Good
sessions.. Please find the recordings.

https://drive.google.com/drive/u/1/folders/1mtIEUfnEUtil65U0nGGeJNAUYVsPpktt

On Wed, Sep 8, 2021 at 7:37 PM Brahma Reddy Battula 
wrote:

> Hi Sean,
>
> Pacific Time 9th, Sept 9:30 AM…..
>
> Please check the following link relevant time zone..
>
> Time zone :: https://t.co/JmTN6zK8Ga?amp=1
>
>
>
> On Wed, 8 Sep 2021 at 7:12 PM, Sean Busbey  wrote:
>
>> Hi Brahma!
>>
>> Thanks for organizing this. What’s the timezone for the 10p - midnight?
>> Pacific Time?
>>
>> > On Sep 8, 2021, at 1:17 AM, Brahma Reddy Battula 
>> wrote:
>> >
>> > Hi All,
>> >
>> > Updated the meeting to record the session.. Please use the following
>> link
>> > to attend the conference tomorrow.
>> >
>> >
>> > Uber's story on running Apache Hadoop deployment in Docker
>> > September 9, 2021, 10:00pm – September 10, 2021, 12:00am ·
>> > Google Meet joining info
>> > *Video call link: https://meet.google.com/few-wppc-xoa
>> > *
>> > Or dial: ‪(US) +1 443-424-3811‬ PIN: ‪384 713 518‬#
>> > More phone numbers: https://tel.meet/few-wppc-xoa?pin=7430296860915
>> >
>> > On Fri, Aug 27, 2021 at 12:43 PM Brahma Reddy Battula <
>> bra...@apache.org>
>> > wrote:
>> >
>> >> Hi All,
>> >>
>> >> Happy to announce the following conference. Block your calendar and
>> make
>> >> yourself available.
>> >> Thanks Mithun and team for accepting.
>> >>
>> >>
>> >> *Topic:*Uber's story on running Apache Hadoop deployment in Docker
>> >>
>> >> *Date : *Thu 2021-09-09 09:30 – 11:30 *Pacific Time*
>> >>
>> >> *Meeting Link :   *Google Meet joining info
>> >>   Video call link:
>> >> https://meet.google.com/akk-qmzy-qsu
>> >>
>> >> *  Note: *Created Teams meeting also as a
>> backup
>> >> [2].
>> >>
>> >> *High level Agenda: *
>> >>
>> >>   - Importance of Hadoop Cluster Management (3-5 min)
>> >>   - Introduction about problem space
>> >>   - Challenges in this space and why it is important to solve them
>> >>   - Evolution of Uber Hadoop Cluster Management (10-15 min)
>> >>   -  How our strategy evolved over time since Hadoop was set up at Uber
>> >>   -  Key learnings from the evolution over the years
>> >>   - Our current approach today (15-20min)
>> >>   -  Key learnings from this major overhaul
>> >>   -  Current challenges that we are working on
>> >>   - Q&A (20 min)
>> >>
>> >>
>> >> Aiming for 20 min Q&A assuming that there will be more questions based
>> on
>> >> the blog that was published(1) + presentation at the session.
>> >>
>> >>
>> >>
>> >>
>> >>
>> ---
>> >> 1) https://eng.uber.com/hadoop-container-blog/
>> >> <
>> https://www.google.com/url?q=https://eng.uber.com/hadoop-container-blog/&sa=D&source=calendar&usd=2&usg=AOvVaw3OutuZVQBQnkhUd4fxaM22
>> >
>> >> 2)
>> >>
>> >> *Join on your computer or mobile app*
>> >>
>> >> Click here to join the meeting
>> >> <
>> https://teams.microsoft.com/l/meetup-join/19%3ameeting_NmI2NTNhNGItMTRmZS00ZTJhLWFjNGYtMTg0M2M0ZGRkMGMz%40thread.v2/0?context=%7b%22Tid%22%3a%2238305e12-e15d-4ee8-88b9-c4db1c477d76%22%2c%22Oid%22%3a%229620d90d-11aa-4a4c-b54e-9f3efd907308%22%7d
>> >
>> >>
>> >> *Join with a video conferencing device*
>> >>
>> >> 967904...@t.plcm.vc
>> >>
>> >> Video Conference ID: 117 464 626 6
>> >>
>> >> Alternate VTC instructions
>> >> 
>> >>
>> >> *Or call in (audio only)*
>> >>
>> >> +1 213-204-8714,,273569658# <+12132048714,,273569658#>   United States,
>> >> Los Angeles
>> >>
>> >> (833) 827-4491,,273569658# <8338274491,,273569658#>   United States
>> >> (Toll-free)
>> >>
>> >> Phone Conference ID: 273 569 658#
>> >>
>> >> Find a local number
>> >> <
>> https://dialin.teams.microsoft.com/354a6938-11bf-45f7-97f9-0a77a564c966?id=273569658
>> >
>> >> | Reset PIN 
>> >>
>> >>
>> >>
>> >> -- Brahma Reddy Battula
>> >>
>> >
>> >
>> > --
>> >
>> >
>> >
>> > --Brahma Reddy Battula
>>
>>
>> --
>
>
>
> --Brahma Reddy Battula
>


-- 



--Brahma Reddy Battula