Re: Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

2019-06-25 Thread Weiwei Yang
Thanks Wangda. Will this event be recorded? It will be extremely helpful for people who are unable to join to catch up. Thanks Weiwei On Jun 26, 2019, 4:12 AM +0800, Wangda Tan , wrote: A friendly reminder, The meetup will take place tomorrow at 9:00 AM PDT to 4:00 PM PDT. The address is: 395 P

[jira] [Resolved] (HDDS-1727) Use generation of resourceName for locks in OzoneManagerLock

2019-06-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-1727. -- Resolution: Fixed Fix Version/s: 0.4.1 > Use generation of resourceName for locks

[jira] [Created] (HDFS-14610) HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized.

2019-06-25 Thread Paul Ward (JIRA)
Paul Ward created HDFS-14610: Summary: HashMap is not thread safe. Field storageMap is typically synchronized by storageMap. However, in one place, field storageMap is not protected with synchronized. Key: HDFS-14610

Re: Agenda & More Information about Hadoop Community Meetup @ Palo Alto, June 26

2019-06-25 Thread Wangda Tan
A friendly reminder, The meetup will take place tomorrow at 9:00 AM PDT to 4:00 PM PDT. The address is: 395 Page Mill Rd, Palo Alto, CA 94306 We’ll be in the Bigtop conference room on the 1st floor. Go left after coming through the main entrance, and it will be on the right. Zoom: https://cloude

[jira] [Created] (HDDS-1727) Use generation of resourceName for locks in OzoneManagerLock

2019-06-25 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-1727: Summary: Use generation of resourceName for locks in OzoneManagerLock Key: HDDS-1727 URL: https://issues.apache.org/jira/browse/HDDS-1727 Project: Hadoop Dist

[jira] [Created] (HDFS-14609) RBF: Security should use common AuthenticationFilter

2019-06-25 Thread CR Hota (JIRA)
CR Hota created HDFS-14609: -- Summary: RBF: Security should use common AuthenticationFilter Key: HDFS-14609 URL: https://issues.apache.org/jira/browse/HDFS-14609 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14608) DataNode$DataTransfer should be named

2019-06-25 Thread JIRA
Íñigo Goiri created HDFS-14608: -- Summary: DataNode$DataTransfer should be named Key: HDFS-14608 URL: https://issues.apache.org/jira/browse/HDFS-14608 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-14607) Support OpenTracing in WebHDFS

2019-06-25 Thread Nikhil Navadiya (JIRA)
Nikhil Navadiya created HDFS-14607: -- Summary: Support OpenTracing in WebHDFS Key: HDFS-14607 URL: https://issues.apache.org/jira/browse/HDFS-14607 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-14606) Support OpenTracing in HDFS

2019-06-25 Thread Nikhil Navadiya (JIRA)
Nikhil Navadiya created HDFS-14606: -- Summary: Support OpenTracing in HDFS Key: HDFS-14606 URL: https://issues.apache.org/jira/browse/HDFS-14606 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Reopened] (HDDS-1672) Improve locking in OzoneManager

2019-06-25 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reopened HDDS-1672: -- > Improve locking in OzoneManager > --- > > Key:

[jira] [Resolved] (HDDS-1672) Improve locking in OzoneManager

2019-06-25 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1672. Resolution: Fixed Fix Version/s: 0.4.1 [~bharatviswa] Thanks for the contribution. I have com

Re: Block capacity

2019-06-25 Thread Lars Francke
Thank you very much. That confirms my suspicions. On Tue, Jun 25, 2019 at 4:33 PM Kihwal Lee wrote: > It just means that hash collisions will be more frequent above the > capacity, causing more walks on hash chains. It is unclear at what level > you will see meaningful impact. In any case, it

Re: Block capacity

2019-06-25 Thread Kihwal Lee
It just means that hash collisions will be more frequent above the capacity, causing more walks on hash chains. It is unclear at what level you will see meaningful impact. In any case, it is not really a limit. Kihwal On Tue, Jun 25, 2019 at 2:17 AM Lars Francke wrote: > Hi, > > I stumbled upo

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-06-25 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/363/ No changes -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc check

[jira] [Created] (HDFS-14605) Note missing on expunge command description for encrypted zones

2019-06-25 Thread Srinivasu Majeti (JIRA)
Srinivasu Majeti created HDFS-14605: --- Summary: Note missing on expunge command description for encrypted zones Key: HDFS-14605 URL: https://issues.apache.org/jira/browse/HDFS-14605 Project: Hadoop H

[jira] [Resolved] (HDFS-13532) RBF: Adding security

2019-06-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-13532. - Resolution: Done > RBF: Adding security > > >

[jira] [Resolved] (HDFS-13655) RBF: Add missing ClientProtocol APIs to RBF

2019-06-25 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-13655. - Resolution: Done > RBF: Add missing ClientProtocol APIs to RBF >

[jira] [Resolved] (HDFS-14604) OEV tool fails to read edit xml file if OP_TRUNCATE has BLOCK tag

2019-06-25 Thread huowang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huowang resolved HDFS-14604. Resolution: Fixed > OEV tool fails to read edit xml file if OP_TRUNCATE has BLOCK tag > --

Block capacity

2019-06-25 Thread Lars Francke
Hi, I stumbled upon the "Block capacity" metric in HDFS and understand that it's the capacity of the internal block map and that it's somehow tied to the heap size (2%). I've looked at the code for LightWeightGSet (admittedly only briefly) and it says that it's using an array + linked lists for c

[jira] [Created] (HDFS-14604) OEV tool fails to read edit xml file if OP_TRUNCATE has BLOCK tag

2019-06-25 Thread huowang (JIRA)
huowang created HDFS-14604: -- Summary: OEV tool fails to read edit xml file if OP_TRUNCATE has BLOCK tag Key: HDFS-14604 URL: https://issues.apache.org/jira/browse/HDFS-14604 Project: Hadoop HDFS I