[jira] [Created] (HDDS-2088) Different components in MiniOzoneChaosCluster should log to different files

2019-09-04 Thread Mukul Kumar Singh (Jira)
Mukul Kumar Singh created HDDS-2088: --- Summary: Different components in MiniOzoneChaosCluster should log to different files Key: HDDS-2088 URL: https://issues.apache.org/jira/browse/HDDS-2088 Project

[jira] [Created] (HDFS-14824) [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results.

2019-09-04 Thread Soya Miyoshi (Jira)
Soya Miyoshi created HDFS-14824: --- Summary: [Dynamometer] Dynamometer in org.apache.hadoop.tools does not output the benchmark results. Key: HDFS-14824 URL: https://issues.apache.org/jira/browse/HDFS-14824

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-04 Thread Uma Maheswara Rao Gangumalla
+1 Regards, Uma On Sat, Aug 31, 2019, 10:19 PM Wangda Tan wrote: > Hi all, > > As we discussed in the previous thread [1], > > I just moved the spin-off proposal to CWIKI and completed all TODO parts. > > > https://cwiki.apache.org/confluence/display/HADOOP/Submarine+Project+Spin-Off+to+TLP+Pro

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-04 Thread Rohith Sharma K S
+1, Great to see Submarine progress. I am interested to participate in this project. Please include me as well in the project. -Rohith Sharma K S On Sun, 1 Sep 2019 at 10:49, Wangda Tan wrote: > Hi all, > > As we discussed in the previous thread [1], > > I just moved the spin-off proposal to CW

[jira] [Resolved] (HDDS-1577) Add default pipeline placement policy implementation

2019-09-04 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Cheng resolved HDDS-1577. Fix Version/s: 0.5.0 Resolution: Fixed > Add default pipeline placement policy implementation > -

[jira] [Created] (HDDS-2087) Remove the hard coded config key in ChunkManager

2019-09-04 Thread Anu Engineer (Jira)
Anu Engineer created HDDS-2087: -- Summary: Remove the hard coded config key in ChunkManager Key: HDDS-2087 URL: https://issues.apache.org/jira/browse/HDDS-2087 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDDS-1200) Ozone Data Scrubbing : Checksum verification for chunks

2019-09-04 Thread Anu Engineer (Jira)
[ https://issues.apache.org/jira/browse/HDDS-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDDS-1200. Fix Version/s: 0.5.0 Resolution: Fixed [~hgadre] Thank you for the contribution. I have commi

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-09-04 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/434/ [Sep 4, 2019 12:11:28 AM] (cliang) HDFS-13547. Add ingress port based sasl resolver. Contributed by Chen [Sep 4, 2019 12:11:28 AM] (cliang) HDFS-13566. Add configurable additional RPC listener to NameNod

[REMIND] YARN+MR APAC Sync Up today and welcome to join!

2019-09-04 Thread Wanqiang Ji
Hi Folks, Kindly remind that we have YARN+MR APAC Sync Up today, and you are welcome to join: Time and Date:Sep 5 1:00 pm (CST Time) Zoom link:Zoom | https://cloudera.zoom.us/j/880548968 Summary: https://docs.google.com/document/d/1GY55sXrekVd-aDyRY7uzaX0hMDPyh3T-AL1kUY2TI5M Thanks, Wanqia

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Wei-Chiu Chuang
Here it is: https://docs.google.com/document/d/1GfNpYKhNUERAEH7m3yx6OfleoF3MqoQk3nJ7xqHD9nY/edit?ts=5d609315#heading=h.xh4zfwj8ppmn I think I made a mistake: Storage: HDFS, Cloud connectors North America, EMEA, India English Every 2 weeks (even week) 10AM (GMT -8) Brahma Reddy Battula, APAC

[jira] [Created] (HDFS-14823) BlockReaderRemote#readNextPacket jitter

2019-09-04 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14823: -- Summary: BlockReaderRemote#readNextPacket jitter Key: HDFS-14823 URL: https://issues.apache.org/jira/browse/HDFS-14823 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-04 Thread Duo Zhang
Suggest to use org.xolstice.maven.plugins:protobuf-maven-plugin to generate the protobuf code. It will download the protoc binary from the maven central so we do not need to install protoc on the build machine any more. Zhenyu Zheng 于2019年9月4日周三 下午5:27写道: > BTW, I also noticed that the Hadoop-tr

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Aaron Fabbri
Hi Wei-Chiu, Can you share the calendar link again for this meeting? Thanks, Aaron On Wed, Sep 4, 2019 at 9:31 AM Matt Foley wrote: > Sorry I won’t be able to come today; a work meeting interferes. > —Matt > > On Sep 4, 2019, at 9:10 AM, Wei-Chiu Chuang wrote: > > It's a short week so I didn'

[jira] [Created] (HDDS-2086) ReconServer throws SQLException but path present for ozone.recon.db.dir in ozone-site

2019-09-04 Thread Shweta (Jira)
Shweta created HDDS-2086: Summary: ReconServer throws SQLException but path present for ozone.recon.db.dir in ozone-site Key: HDDS-2086 URL: https://issues.apache.org/jira/browse/HDDS-2086 Project: Hadoop Dis

Re: [DISCUSS] GitHub PRs without JIRA number

2019-09-04 Thread Sean Busbey
We should add a Pull Request Template that specifically calls out the expectation that folks need to have a JIRA associated with their PR for it to get reviewed. Expectations around time to response and how to go about getting attention when things lag would also be good to include. (e.g. are folks

Re: [DISCUSS] GitHub PRs without JIRA number

2019-09-04 Thread Wei-Chiu Chuang
+general@ On Wed, Aug 28, 2019 at 6:42 AM Wei-Chiu Chuang wrote: > I don't think our GitHub integration supports those commands. Ozone has > its own github integration that can test individual PRs though. > > > > On Tue, Aug 27, 2019 at 12:40 PM Iñigo Goiri wrote: > >> I wouldn't go for #3 and

[jira] [Created] (HDFS-14822) Revisit GlobalStateIdContext locking when getting server state id

2019-09-04 Thread Chen Liang (Jira)
Chen Liang created HDFS-14822: - Summary: Revisit GlobalStateIdContext locking when getting server state id Key: HDFS-14822 URL: https://issues.apache.org/jira/browse/HDFS-14822 Project: Hadoop HDFS

[jira] [Created] (HDFS-14821) Make HDFS-14617 (fsimage sub-sections) off by default

2019-09-04 Thread Stephen O'Donnell (Jira)
Stephen O'Donnell created HDFS-14821: Summary: Make HDFS-14617 (fsimage sub-sections) off by default Key: HDFS-14821 URL: https://issues.apache.org/jira/browse/HDFS-14821 Project: Hadoop HDFS

Re: Hadoop Storage online sync in an hour

2019-09-04 Thread Matt Foley
Sorry I won’t be able to come today; a work meeting interferes. —Matt On Sep 4, 2019, at 9:10 AM, Wei-Chiu Chuang wrote: It's a short week so I didn't set up a predefined topic to discuss. What should we be discussing? How about Erasure Coding? I'm starting to see tricky EC bug reports coming i

Hadoop Storage online sync in an hour

2019-09-04 Thread Wei-Chiu Chuang
It's a short week so I didn't set up a predefined topic to discuss. What should we be discussing? How about Erasure Coding? I'm starting to see tricky EC bug reports coming in lately, so looks like folks are using it in production. Should we be thinking about the next step for EC in addition to bu

RE: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-04 Thread Brahma Reddy Battula
+1, Thanks for Wangda's proposal. I am interested to participate in this project. Please include me -Original Message- From: Wanqiang Ji [mailto:wanqiang...@gmail.com] Sent: Wednesday, September 04, 2019 6:53 PM To: Wangda Tan Cc: submarine-dev ; yarn-dev ; Hdfs-dev ; mapreduce-dev ;

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-04 Thread Wanqiang Ji
+1 Thanks for Wangda's proposal. It is indeed amazing to see the growth and development of submarine. As the TLP will attract more developers to join. I will put more energy into it and contribute more feature. Look forward to the next change in submarine. Thanks, Wanqiang Ji On Wed, Sep 4, 201

[jira] [Created] (HDFS-14820) The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big

2019-09-04 Thread Lisheng Sun (Jira)
Lisheng Sun created HDFS-14820: -- Summary: The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big Key: HDFS-14820 URL: https://issues.apache.org/jira/browse/HDFS-14820

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-04 Thread Ayush Saxena
Thanx Vinay for the initiative, Makes sense to add support for different architectures. +1, for the branch idea. Good Luck!!! -Ayush > On 03-Sep-2019, at 6:19 AM, 张铎(Duo Zhang) wrote: > > For HBase, we purged all the protobuf related things from the public API, > and then upgraded to a shaded

[jira] [Created] (HDFS-14819) [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload.

2019-09-04 Thread Soya Miyoshi (Jira)
Soya Miyoshi created HDFS-14819: --- Summary: [Dynamometer] Cannot parse audit logs with ‘=‘ in unexpected places when starting a workload. Key: HDFS-14819 URL: https://issues.apache.org/jira/browse/HDFS-14819

[jira] [Created] (HDFS-14818) Check native pmdk lib by 'hadoop checknative' command

2019-09-04 Thread Feilong He (Jira)
Feilong He created HDFS-14818: - Summary: Check native pmdk lib by 'hadoop checknative' command Key: HDFS-14818 URL: https://issues.apache.org/jira/browse/HDFS-14818 Project: Hadoop HDFS Issue Typ

Hadoop 3.1.3 is ready to cut branch Re: [Release Plan] Hadoop-3.1.3 discussion

2019-09-04 Thread zhankun tang
Hi all, Thanks for everyone helping in resolving all the blockers targeting Hadoop 3.1.3[1]. We've cleaned all the blockers and moved out non-blockers issues to 3.1.4. I'll cut the branch today and call a release vote soon. Thanks! [1]. https://s.apache.org/5hj5i BR, Zhankun On Wed, 21 Aug 2

Re: [VOTE] Moving Submarine to a separate Apache project proposal

2019-09-04 Thread Bibin Chundatt
+1 Thank you for the proposal. I am interested in project. Please include me as well in the project. Thanks, Bibin On Tue, Sep 3, 2019 at 6:41 PM Ayush Saxena wrote: > +1 > Thanx for the proposal. > > I would even like to participate in the project. > Please add me as well. > > -Ayush > > > >