Re: [DISCUSS] making Ozone a separate Apache project

2020-05-14 Thread Tsuyoshi Ozawa
+1 Thanks - Tsuyoshi On Thu, May 14, 2020 at 19:42 Rakesh Radhakrishnan wrote: > +1 > > Thanks, > Rakesh > > On Wed, May 13, 2020 at 1:23 PM Elek, Marton wrote: > > > > > > > I would like to start a discussion to make a separate Apache project for > > Ozone > > > > > > > > ### HISTORY [1] > >

Re: [DISCUSS] hadoop-thirdparty 1.0.0 release

2020-02-22 Thread Tsuyoshi Ozawa
Thanks Viany for starting discussion. +1 hadoop-thirdparty's release is required for 3.3.0 release because the package includes shaded protobuf which 3.3.0 branch will depend on. The plan sounds reasonable to me. - Tsuyoshi On Sat, Feb 22, 2020 at 6:31 AM Ayush Saxena wrote: > > Thanx Vinay fo

[jira] [Created] (HADOOP-16866) Upgrade spotbugs' version

2020-02-17 Thread Tsuyoshi Ozawa (Jira)
Tsuyoshi Ozawa created HADOOP-16866: --- Summary: Upgrade spotbugs' version Key: HADOOP-16866 URL: https://issues.apache.org/jira/browse/HADOOP-16866 Project: Hadoop Common Issue Type:

Re: FW: About supporting upcoming java versions

2018-11-12 Thread Tsuyoshi Ozawa
elp, Ewan and Tsuyoshi. > > Based on the discussion in this thread, after the bug reported by Owen > and Tsuyoshi is resolved, I'll close the jiras of supporting JDK9/10 > and let's focus on supporting JDK 11 (and JDK 8). > > > > > > > on 2018/11/11 23:35,

Re: About supporting upcoming java versions

2018-11-11 Thread Tsuyoshi Ozawa
Thanks Takanobu for stating the discussion, and thanks Ewan for sharing the pointer. I reproduced the bug Owen said only with OpenJDK 11, so I filed it on ORC jira for now: https://jira.apache.org/jira/browse/ORC-436 I looked over the bug, but I cannot identify the root cause - only on OpenJDK 11

Re: [DISCUSS] Tracing in the Hadoop ecosystem

2018-08-21 Thread Tsuyoshi Ozawa
Thanks for starting discussion, Stack. The ZipKin seems to be coming to the Apache Incubator. As Andrew Purtell said on HADOOP-15566, it would be good option since there is no problem about licenses. https://wiki.apache.org/incubator/ZipkinProposal Stack, do you have any knowledge about differenc

[jira] [Resolved] (HADOOP-14284) Shade Guava everywhere

2017-09-11 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-14284. - Resolution: Invalid > Shade Guava everywh

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Tsuyoshi Ozawa
'version at compilation time by using syntax = "proto2""... - Tsuyoshi On Wed, Mar 29, 2017 at 9:13 AM, Tsuyoshi Ozawa wrote: >> Stack mentioned a compatibility mode that uses the proto2 semantics. > > We can define protobuf's version by using syntax = "proto2&quo

Re: Can we update protobuf's version on trunk?

2017-03-28 Thread Tsuyoshi Ozawa
> Stack mentioned a compatibility mode that uses the proto2 semantics. We can define protobuf's version by using syntax = "proto2" or syntax = "proto3" in proto files with proto3 compiler. I think this is what Stack mentioned as compatibility mode. https://github.com/golang/protobuf/blob/master/p

Re: Can we update protobuf's version on trunk?

2017-03-27 Thread Tsuyoshi Ozawa
Forwarding to common-dev, hdfs-dev, mapreduce-dev too. Thanks - Tsuyoshi 2017年3月27日(月) 21:16 Tsuyoshi Ozawa : > Dear Hadoop developers, > > After shaded client, introduced by HADOOP-11804, is merged, > we can more easily update some dependency with minimizing the impact &

Can we update protobuf's version on trunk?

2017-03-27 Thread Tsuyoshi Ozawa
Dear Hadoop developers, After shaded client, introduced by HADOOP-11804, is merged, we can more easily update some dependency with minimizing the impact of backward compatibility on trunk. (Thanks Sean and Sanjin for taking the issue!) Then, is it time to update protobuf's version to the latest o

[jira] [Created] (HADOOP-14238) [Umbrella] Rechecking Guava's object is not exposed to user-facing API

2017-03-24 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-14238: --- Summary: [Umbrella] Rechecking Guava's object is not exposed to user-facing API Key: HADOOP-14238 URL: https://issues.apache.org/jira/browse/HADOOP-

[jira] [Created] (HADOOP-14187) Update ZooKeeper dependency to 3.4.8 and Curator dependency to 2.12.0

2017-03-15 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-14187: --- Summary: Update ZooKeeper dependency to 3.4.8 and Curator dependency to 2.12.0 Key: HADOOP-14187 URL: https://issues.apache.org/jira/browse/HADOOP-14187

[jira] [Created] (HADOOP-13640) Fix findbugs warning in VersionInfoMojo.java

2016-09-22 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13640: --- Summary: Fix findbugs warning in VersionInfoMojo.java Key: HADOOP-13640 URL: https://issues.apache.org/jira/browse/HADOOP-13640 Project: Hadoop Common

[jira] [Resolved] (HADOOP-13594) findbugs warnings to block a build

2016-09-13 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-13594. - Resolution: Not A Bug > findbugs warnings to block a bu

[jira] [Created] (HADOOP-13602) Fix findbugs warning in hadoop-maven-plugin

2016-09-13 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13602: --- Summary: Fix findbugs warning in hadoop-maven-plugin Key: HADOOP-13602 URL: https://issues.apache.org/jira/browse/HADOOP-13602 Project: Hadoop Common

[jira] [Created] (HADOOP-13594) findbugs warnings to block a build

2016-09-12 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13594: --- Summary: findbugs warnings to block a build Key: HADOOP-13594 URL: https://issues.apache.org/jira/browse/HADOOP-13594 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-13592) Outputs errors and warnings by checkstyle at compile time

2016-09-12 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13592: --- Summary: Outputs errors and warnings by checkstyle at compile time Key: HADOOP-13592 URL: https://issues.apache.org/jira/browse/HADOOP-13592 Project: Hadoop

Re: About 2.6.5 and 2.7.4 release

2016-09-08 Thread Tsuyoshi Ozawa
> Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252. > Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7. complement: HADOOP-13579 fixes the problem of incompatibility by HADOOP-11252. Thanks, - Tsuyoshi On Fri, Sep 9, 2016 at 2:42 PM, Tsuyoshi Ozawa

About 2.6.5 and 2.7.4 release

2016-09-08 Thread Tsuyoshi Ozawa
Hi developers, Chiwan Park reported Hadoop incompatibility by the change of HADOOP-11252. Now, HADOOP-13579 is committed to branch-2.6 and branch-2.7. Should we release 2.6.5 and 2.7.4 soon? Thanks, - Tsuyoshi - To unsubscribe,

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-03 Thread Tsuyoshi Ozawa
ne regardless of configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env... does anyone hit same error? This was because of completely my wrong configuration. Please ignore this. Best, - Tsuyoshi On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawa wrote: > Thanks for making this forwar

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Tsuyoshi Ozawa
I'm sorry, very big typo I did... s/hardly/very hard/ Best - Tsuyoshi On Sat, Sep 3, 2016 at 1:53 AM, Tsuyoshi Ozawa wrote: > Thanks for making this forward hardly, Andrew! > > In fact, I hit an error similar to Eric's one regardless of > configuring yarn.ap

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-09-02 Thread Tsuyoshi Ozawa
Thanks for making this forward hardly, Andrew! In fact, I hit an error similar to Eric's one regardless of configuring yarn.app.mapreduce.am.env and mapreduce.admin.user.env... does anyone hit same error? 2016-09-02 16:49:35,223 INFO mapreduce.Job: The url to track the job: http://ip-172-31-7-12

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-27 Thread Tsuyoshi Ozawa
this problem is also pretty rare in practice, since users normally > upgrade to the highest maintenance release within a major/minor. Thus > they'll only hit this if their upgrade cycle is faster than it takes for a > change released in e.g. 2.6.x to then also be released in a 2.7.x

Re: [DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Tsuyoshi Ozawa
> Andrew: I bet many would assume it's the release date, like how Ubuntu releases are numbered. Good point. Maybe I confuse you because of lack of explanation. I assume that "branch-cut off timing" mean the timing of freezing branch like when starting the release vote. It's because that the relea

[DISCUSS] Release numbering semantics with concurrent (>2) releases [Was Setting JIRA fix versions for 3.0.0 releases]

2016-07-26 Thread Tsuyoshi Ozawa
Hi Vinod, Thanks all guys for starting discussion! My suggestion is adding the date when branch cut is done: like 3.0.0-alpha1-20160724, 2.8.0-20160730 or something. Pros:-) It's totally ordered. If we have a policy such as backporting to maintainance branches after the date, users can find that

[jira] [Created] (HADOOP-13413) Upgrading ZooKeeper version to 3.4.9

2016-07-24 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13413: --- Summary: Upgrading ZooKeeper version to 3.4.9 Key: HADOOP-13413 URL: https://issues.apache.org/jira/browse/HADOOP-13413 Project: Hadoop Common Issue

Re: [DISCUSS] Official Docker Image at release time

2016-07-21 Thread Tsuyoshi Ozawa
ncies. > This can be achieved by flexible Dockerfile which uses configuration > passed from environment variables. > > Thanks > > Kai Sasaki > > > On Jul 19, 2016, at 4:46 PM, Tsuyoshi Ozawa > wrote: > > Hi developers, > > Klaus mentioned the availability of an offic

Re: [DISCUSS] Official Docker Image at release time

2016-07-21 Thread Tsuyoshi Ozawa
sues.apache.org/jira/browse/HADOOP-13397 > > > Da (Klaus) Ma (马达), PMP® | Software Architect > IBM Spectrum, STG, IBM GCG > +86-10-8245 4084 | klaus1982...@gmail.com | http://k82.me > > On Jul 21, 2016, at 13:33, Tsuyoshi Ozawa wrote: > > Forwarding this discussion to Klaus.

[DISCUSS] The order of classpath isolation work and updating/shading dependencies on trunk

2016-07-21 Thread Tsuyoshi Ozawa
Hi developers, I'd like to discuss how to make an advance towards dependency management in Apache Hadoop trunk code since there has been lots work about updating dependencies in parallel. Summarizing recent works and activities as follows: 0) Currently, we have merged minimum update dependencies

Re: [DISCUSS] Official Docker Image at release time

2016-07-20 Thread Tsuyoshi Ozawa
Forwarding this discussion to Klaus. - Tsuyoshi On Tue, Jul 19, 2016 at 4:46 PM, Tsuyoshi Ozawa wrote: > Hi developers, > > Klaus mentioned the availability of an official docker image of Apache > Hadoop. Is it time that we start to distribute an official docker > image

[DISCUSS] Official Docker Image at release time

2016-07-19 Thread Tsuyoshi Ozawa
Hi developers, Klaus mentioned the availability of an official docker image of Apache Hadoop. Is it time that we start to distribute an official docker image at release time? http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629

[jira] [Created] (HADOOP-13369) [umbrella] Fix javadoc warnings by JDK8 on trunk

2016-07-12 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13369: --- Summary: [umbrella] Fix javadoc warnings by JDK8 on trunk Key: HADOOP-13369 URL: https://issues.apache.org/jira/browse/HADOOP-13369 Project: Hadoop Common

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-07-07 Thread Tsuyoshi Ozawa
u, Jun 30, 2016 at 12:03 PM, Tsuyoshi Ozawa wrote: >> >> Thanks, Andrew. >> >> Based on discussion here, I would like to merge it into *trunk* if >> there are no objection tomorrow. >> >> Thanks, >> - Tsuyoshi >> >> On Wed, Jun 29, 201

[jira] [Resolved] (HADOOP-13339) MetricsSourceAdapter#updateAttrCache may throw NPE due to NULL lastRecs

2016-07-04 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-13339. - Resolution: Duplicate Dup of HADOOP-11361. Closing this. > MetricsSourceAdap

[jira] [Created] (HADOOP-13337) Upgrading maven-enforcer-plugin to 1.4.1

2016-07-01 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-13337: --- Summary: Upgrading maven-enforcer-plugin to 1.4.1 Key: HADOOP-13337 URL: https://issues.apache.org/jira/browse/HADOOP-13337 Project: Hadoop Common

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-30 Thread Tsuyoshi Ozawa
n 29, 2016 at 12:27 PM, Tsuyoshi Ozawa wrote: >> >> I forgot to mention about importance point: it's a blocker issue to >> compile Hadoop with JDK8. Hence, we need to merge it on both client >> side and server slide anyway. >> >> Thanks, >> - Tsuy

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
I forgot to mention about importance point: it's a blocker issue to compile Hadoop with JDK8. Hence, we need to merge it on both client side and server slide anyway. Thanks, - Tsuyoshi On Wed, Jun 29, 2016 at 12:24 PM, Tsuyoshi Ozawa wrote: > Thanks Vinod, Sangjin, Sean for your

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
te: >> > My strong expectation is that we’ll have a version of classpath >> > isolation in our first release of 3.x. I’m planning to spending some cycles >> > right away on this. >> > >> > Assuming classpath isolation gets in, it is reasonable to bump

Re: [DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-29 Thread Tsuyoshi Ozawa
No objections here? - Tsuyoshi On Mon, Jun 27, 2016 at 6:01 AM, Tsuyoshi Ozawa wrote: > Hi developers, > > I will plan to upgrade Google Guice dependency on trunk. The change > also includes asm and cglib upgrade. > I checked following points: > > * Both HDFS and YARN U

[DICUSS] Upgrading Guice to 4.0(HADOOP-12064)

2016-06-27 Thread Tsuyoshi Ozawa
Hi developers, I will plan to upgrade Google Guice dependency on trunk. The change also includes asm and cglib upgrade. I checked following points: * Both HDFS and YARN UIs work well. * All webIU-related tests pass as described on HADOOP-12064. * Ran mapreduce job, and it works well. https://iss

Re: Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Tsuyoshi Ozawa
ink it is modified for security reasons. I too did not find any JIRA id > corresponding to this commit. > > Related discussion happened in the following JIRA. > https://issues.apache.org/jira/browse/MAPREDUCE-6704 > > > Thanks & Regards > Rohith Sharma K S > >

Failure to submit job on trunk hadoop cluster

2016-06-27 Thread Tsuyoshi Ozawa
Hi, Have anyone tried to submit jobs on trunk cluster? I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run. $ hadoop jar ./share/hadoop/mapreduce/h

[jira] [Reopened] (HADOOP-12893) Verify LICENSE.txt and NOTICE.txt

2016-06-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reopened HADOOP-12893: - > Verify LICENSE.txt and NOTICE.

Re: [DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

2016-06-20 Thread Tsuyoshi Ozawa
t; +1 for updating this in trunk. Thanks, Tsuyoshi Ozawa. >> >> cheers, >> Colin >> >> On Mon, May 9, 2016, at 12:12, Tsuyoshi Ozawa wrote: >> > Hi developers, >> > >> > We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's &

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

2016-05-19 Thread Tsuyoshi Ozawa
, 2.1, 3 Thanks, - Tsuyoshi On Thu, May 19, 2016 at 5:39 PM, Tsuyoshi Ozawa wrote: >> so I'm thinking this is not a problem. We need to update the patch to > address the above comments. Especially, we need to investigate what > dependency is in binary tarball or not. > > Th

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

2016-05-19 Thread Tsuyoshi Ozawa
need to check them. Thanks, - Tsuyoshi On Thu, May 19, 2016 at 5:36 PM, Tsuyoshi Ozawa wrote: > Quoting from offline discussion by Akira's comment: > > In HADOOP-12893, the LGPL2.1 dependencies are as follows: > >> Logback Core Module >> jdiff >> Javaassis

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

2016-05-19 Thread Tsuyoshi Ozawa
jackson-core-asl" in pom.xml. so I'm thinking this is not a problem. We need to update the patch to address the above comments. Especially, we need to investigate what dependency is in binary tarball or not. Best, Akira On Thu, May 19, 2016 at 5:34 PM, Tsuyoshi Ozawa wrote: >>

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

2016-05-19 Thread Tsuyoshi Ozawa
> We used to say "the src tarball is the only official release artifact, the > bin tarball and jars are only provided as a convenience", but I don't think > we're actually allowed to do that. Yes, I know it's not useful for end users. I'd like to clarify the problems we're facing here. Currently,

Re: Hadoop CI with alternate architectures.

2016-05-18 Thread Tsuyoshi Ozawa
Hi Asanjar, Thanks for your contribution! I'm ashamed to say, but I don't know how to change the build machine. Adding "to" Allen, who is a PMC of Yetus project. Hey Allen, do you know how to add Power based Jenkins slave(s) to Apache Hadoop CI? Thanks, - Tsuyoshi On Wed, May 18, 2016 at 11:18

Re: [DISCUSS] Release blocker HADOOP-12893 (LICENSE and NOTICE files)

2016-05-17 Thread Tsuyoshi Ozawa
Hi Andrew, Thank you for starting discussion. > We're thinking about a "fix-and-iterate" approach, just to get the currently > ongoing releases out the door. It's a good choice and I agree with you basically. My impression, however, is that we should stop *binary distribution* and we should onl

[jira] [Resolved] (HADOOP-13133) [JDK8] Upgrade asm to 5.0.3 or later and upgrade cglib to 3.2.0 or later

2016-05-11 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-13133. - Resolution: Duplicate > [JDK8] Upgrade asm to 5.0.3 or later and upgrade cglib to 3.

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-10 Thread Tsuyoshi Ozawa
> Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. Sounds good. To do so, we need to check the blockers of 3.0.0-alpha RC, especially upgrading all dependencies which use refractions at first. Thanks, - Tsuyoshi On Tue, May 10, 2016 at 8:32 AM, Akira AJISAKA wrote: > Hi de

[DISCUSS] Merge Jersey upgrade(HADOOP-9613) to trunk

2016-05-09 Thread Tsuyoshi Ozawa
Hi developers, We’ve worked on upgrading jersey(HADOOP-9613) for a years. It's essential change to support complication with JDK8. It’s almost there. One concern to merge this to trunk is incompatibility. After the release of Jersey 1.13, the root element whose content is empty collection is chan

Slack channel for Hadoop developers

2016-04-22 Thread Tsuyoshi Ozawa
Hi, I created slack channel for Hadoop community unofficially and experimentally: https://hadoopdev.slack.com/ I know that there is IRC channel and it's good to log. However, Slack is very also good tool to join easily and have a communication interactively. It will be also useful to join followi

[jira] [Created] (HADOOP-12912) Add LOG.isDebugEnabled() guard in Progress.set method

2016-03-10 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12912: --- Summary: Add LOG.isDebugEnabled() guard in Progress.set method Key: HADOOP-12912 URL: https://issues.apache.org/jira/browse/HADOOP-12912 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.4 RC0

2016-02-09 Thread Tsuyoshi Ozawa
+1(binding) - Verified signatures. - Ran tests for Apache Tez with the artifacts. All tests passed. - Ran local cluster and ran some examples on it. - Tsuyoshi On Wed, Feb 10, 2016 at 2:18 AM, Sunil Govind wrote: > +1 (non-binding) with one note, > > - Installed tar ball from source and brought

Re: [VOTE] Release Apache Hadoop 2.7.2 RC2

2016-01-20 Thread Tsuyoshi Ozawa
+1 (binding) - Verified checksum. - Built from source code. - Ran some tests and mr examples. Thanks, - Tsuyoshi On Fri, Jan 15, 2016 at 1:57 PM, Vinod Kumar Vavilapalli wrote: > Hi all, > > I've created an updated release candidate RC2 for Apache Hadoop 2.7.2. > > As discussed before, this is

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-23 Thread Tsuyoshi Ozawa
Hi Vinod, thank you for the clarification. > - Pull these 16 tickets into 2.7.2 and roll a new RC > > What do people think? Do folks expect “any fix in 2.6.3 to be there in all > > releases that get out after 2.6.3 release date (December 16th)”? I personally prefer to pull these tickets into 2

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Tsuyoshi Ozawa
Hi Chen, > Kindly ask a silly question, why we separate 2.6.x from 2.7.x? 2.6.x is the last release which supports JDK6. Thanks, - Tsuyoshi On Tue, Dec 22, 2015 at 9:25 AM, Chen He wrote: > +1 (non-binding) > > deploy to a 2-node cluster > run loadgen and wc without problem > > > Kindly ask a

Re: [VOTE] Release Apache Hadoop 2.7.2 RC1

2015-12-21 Thread Tsuyoshi Ozawa
+1 - downloaded src and bin tar balls and verified signatures. - built Tez and Spark with 2.7.2 artifacts and JDK7. - ran tests of Tez with 2.7.2 artifacts, it passed. FYI: YARN-4348, reported by Jian, is one of critical issues of 2.7.2 release.It's better to release 2.7.3 as soon as possible aft

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

2015-12-16 Thread Tsuyoshi Ozawa
Thanks Wangda for reporting issue. I'm also +1 for recreating a new branch-2.8 based on current branch-2.8 too. After that, we can revert 2.9.0-only patches on the branch. I will help you if necessary, so please let me know. Thanks, - Tsuyoshi On Thu, Dec 17, 2015 at 10:51 AM, Jing Zhao wrote: >

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-16 Thread Tsuyoshi Ozawa
+1 (binding) - verified checksums - built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran tests and all of them passed. Thanks, - Tsuyoshi On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee wrote: > +1 (non-binding) > > - downloaded source and binary and verified the signatures (although I

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

2015-12-12 Thread Tsuyoshi Ozawa
Hi Junping, Thank you for starting the voting. I cannot access the tar.gz file because of permission error. Could you check the permission to access the files? > Forbidden > You don't have permission to access > /~junping_du/hadoop-2.6.3-RC0/hadoop-2.6.3-RC0-src.tar.gz on this server. Thanks, -

[jira] [Created] (HADOOP-12591) TestDistributedShell times out

2015-11-23 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12591: --- Summary: TestDistributedShell times out Key: HADOOP-12591 URL: https://issues.apache.org/jira/browse/HADOOP-12591 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-12589) Fix intermittent test failure of TestCopyPreserveFlag

2015-11-22 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12589: --- Summary: Fix intermittent test failure of TestCopyPreserveFlag Key: HADOOP-12589 URL: https://issues.apache.org/jira/browse/HADOOP-12589 Project: Hadoop Common

[jira] [Created] (HADOOP-12588) TestGangliaMetrics fails by

2015-11-22 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12588: --- Summary: TestGangliaMetrics fails by Key: HADOOP-12588 URL: https://issues.apache.org/jira/browse/HADOOP-12588 Project: Hadoop Common Issue Type: Bug

[jira] [Reopened] (HADOOP-10406) TestIPC.testIpcWithReaderQueuing may fail

2015-11-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reopened HADOOP-10406: - Reopening this issue since this issue seems to happen after the fix.a {quote} Tests run

Re: Jenkins stability and patching

2015-11-22 Thread Tsuyoshi Ozawa
Thank you for starting discussion, Steve. It sounds good to me. I'll check the test failures. - Tsuyoshi On Sun, Nov 22, 2015 at 9:21 PM, Steve Loughran wrote: > > Jenkins is pretty much dead in the water these days; a test run that works is > a rare miracle rather than the default state. Whic

[jira] [Reopened] (HADOOP-12578) change from boot2docker to docker-machine

2015-11-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa reopened HADOOP-12578: - > change from boot2docker to docker-mach

[jira] [Resolved] (HADOOP-12578) change from boot2docker to docker-machine

2015-11-19 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-12578. - Resolution: Duplicate [~lewuathe] fixed this on HADOOP-12575. Thanks for reporting

[jira] [Created] (HADOOP-12586) Dockerfile cannot work correctly behind a proxy

2015-11-18 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12586: --- Summary: Dockerfile cannot work correctly behind a proxy Key: HADOOP-12586 URL: https://issues.apache.org/jira/browse/HADOOP-12586 Project: Hadoop Common

[jira] [Created] (HADOOP-12585) Removing deprecated methods in 3.0.0 release

2015-11-18 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12585: --- Summary: Removing deprecated methods in 3.0.0 release Key: HADOOP-12585 URL: https://issues.apache.org/jira/browse/HADOOP-12585 Project: Hadoop Common

[jira] [Created] (HADOOP-12582) Using BytesWritable's getLength() and getBytes() instead of get() and getSize()

2015-11-18 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12582: --- Summary: Using BytesWritable's getLength() and getBytes() instead of get() and getSize() Key: HADOOP-12582 URL: https://issues.apache.org/jira/browse/HADOOP-

Re: Update on potential Gerrit integration

2015-11-10 Thread Tsuyoshi Ozawa
Thanks, Zhe. It helps us to decide which tools we should use. - Tsuyoshi On Tuesday, 10 November 2015, Zhe Zhang wrote: > Hi, > > Per our earlier discussion on the "Github integration for Hadoop" thread, I > surveyed HBase, Flume, and HTrace about their interest on Gerrit. The > feedbacks have

Re: Github integration for Hadoop

2015-11-01 Thread Tsuyoshi Ozawa
Thank you for starting this discussion. It's good for us to rethink our workflow to grow community. However, at the moment, my concern is that we can put more pressure on Yetus community if we move the main workflows into github. Allen and Sean, what do you think? Is it good timing for Yetus commu

Re: Java 8 + Jersey updates

2015-10-30 Thread Tsuyoshi Ozawa
On Fri, Oct 30, 2015 at 11:16 PM, Steve Loughran wrote: > >> On 29 Oct 2015, at 15:40, Tsuyoshi Ozawa wrote: >> >> Steve, >> >>> If you exclude jax-rs 2 and try to stay @ jersey 1.9 for your client, all >>> the http clients: KMS, webhdfs, ATS, are

Re: Java 8 + Jersey updates

2015-10-29 Thread Tsuyoshi Ozawa
ehow wrap that client-side use of > jersey with enough introspection that at least the Hadoop REST clients can > use whichever jersey lib is on the classpath > > Any volunteers. > > >> On 27 Oct 2015, at 02:38, Tsuyoshi Ozawa wrote: >> >>> I assume you are targ

Re: 2.7.2 release plan

2015-10-28 Thread Tsuyoshi Ozawa
the support in Mapreduce for labels in >> MAPREDUCE-6304, >> >> Regards, >> + Naga >> >> From: Tsuyoshi Ozawa [oz...@apache.org] >> Sent: Wednesday, October 28, 2015 14:28 >> To: yarn-...@hadoop.apache.org >> Cc: hdfs-...@hadoop.apache.org; common-dev@

Re: 2.7.2 release plan

2015-10-28 Thread Tsuyoshi Ozawa
nk we need HDFS-8950 and HDFS-7725 in 2.7.2.It should be easy to > backport/cherry-pick HDFS-7725. For HDFS-8950, it will be nice if Ming can > chime in. > Kihwal > > From: Tsuyoshi Ozawa > To: "common-dev@hadoop.apache.org" > Cc: Chris Nauroth ; "yarn-.

Re: FYI: Major, long-standing Issue with trunk's test-patch

2015-10-28 Thread Tsuyoshi Ozawa
> So I’m going to turn on Yetus for *ALL* Hadoop precommit jobs later tonight. Thank you for sharing, Allen. I think this activity will make quality of Hadoop code better. Best - Tsuyoshi On Wed, Oct 28, 2015 at 11:44 AM, Allen Wittenauer wrote: > > Today I discovered that an old, o

Re: 2.7.2 release plan

2015-10-27 Thread Tsuyoshi Ozawa
same risk of regressions or > > incompatibilities as code changes. > > > > --Chris Nauroth > > > > > > > > > > On 7/16/15, 12:38 AM, "Tsuyoshi Ozawa" > > wrote: > > > >> Hi, > >> > >> thank you for startin

Re: Java 8 + Jersey updates

2015-10-26 Thread Tsuyoshi Ozawa
targetting this only at trunk / > 3.0 based on the "target version" and the incompatibility discussion? > > best, > Colin > > On Mon, Oct 26, 2015 at 7:07 AM, Tsuyoshi Ozawa wrote: > >> Hi Steve, >> >> Thanks for your help. >> >> >

[jira] [Created] (HADOOP-12516) jdiff fails with error 'duplicate comment id' about MetricsSystem.register_changed

2015-10-26 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12516: --- Summary: jdiff fails with error 'duplicate comment id' about MetricsSystem.register_changed Key: HADOOP-12516 URL: https://issues.apache.org/jira/browse/HA

Re: Java 8 + Jersey updates

2015-10-26 Thread Tsuyoshi Ozawa
Hi Steve, Thanks for your help. > 2. it's "significant" This change includes upgrading not only Jersey, but also its dependencies like grizzly, asm, and so on. > I'll try to rebuild a YARN app (slider) with the patch to see how it fares It helps us a lot. I'd like to suggest that the incompat

[jira] [Resolved] (HADOOP-12457) [JDK8] Fix compilation of common by javadoc

2015-10-23 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa resolved HADOOP-12457. - Resolution: Cannot Reproduce > [JDK8] Fix compilation of common by java

Re: Planning for Apache Hadoop 2.6.2

2015-10-21 Thread Tsuyoshi Ozawa
Done. - Tsuyoshi On Wed, Oct 21, 2015 at 8:53 PM, Tsuyoshi Ozawa wrote: > Thanks for your notification, Sangjin. I'll backport YARN-3798 soon. > > - Tsuyoshi > > On Wed, Oct 21, 2015 at 10:09 AM, Sangjin Lee wrote: >> If you have backported bugfixes to 2.7.2, please

Re: Planning for Apache Hadoop 2.6.2

2015-10-21 Thread Tsuyoshi Ozawa
Thanks for your notification, Sangjin. I'll backport YARN-3798 soon. - Tsuyoshi On Wed, Oct 21, 2015 at 10:09 AM, Sangjin Lee wrote: > If you have backported bugfixes to 2.7.2, please take a moment to consider > if it is relevant (and important) for 2.6.x too, and if so backport it to > branch-2

Re: hadoop wiki access

2015-10-17 Thread Tsuyoshi Ozawa
Thanks Steve! - Tsuyoshi On Sun, Oct 18, 2015 at 12:56 AM, Steve Loughran wrote: > try now >> On 17 Oct 2015, at 12:27, Tsuyoshi Ozawa wrote: >> >> tsuyoshiozawa >

Re: hadoop wiki access

2015-10-17 Thread Tsuyoshi Ozawa
Hi, Could you give me the permission to the wiki too? My account name is "tsuyoshiozawa". Thanks, - Tsuyoshi On Sat, Oct 17, 2015 at 7:22 PM, Steve Loughran wrote: > you and chris are now on >> On 17 Oct 2015, at 01:07, Sangjin Lee wrote: >> >> SangjinLee >

Re: [DISCUSS] About the details of JDK-8 support

2015-10-15 Thread Tsuyoshi Ozawa
> We should target source-level support of JDK 8 too, around which you outlined > a bunch of issues around dependencies. I also found a bunch of issues around > generating documentation, site etc. I propose that we track them under the > umbrella JIRA and make progress there first. OK. I will s

Re: [DISCUSS] About the details of JDK-8 support

2015-10-13 Thread Tsuyoshi Ozawa
the > sentiment that we should preserve the java 7 support on branch-2 (not not > move to java 8 source level) but can consider it for trunk. My 2 cents. > > Thanks, > Sangjin > > On Fri, Oct 9, 2015 at 10:43 AM, Steve Loughran > wrote: > >> >> > On 7 Oc

Re: [DISCUSS] About the details of JDK-8 support

2015-10-05 Thread Tsuyoshi Ozawa
Tue, Oct 6, 2015 at 9:35 AM, Tsuyoshi Ozawa wrote: > Hi commiters and users of Hadoop stack, > > I’ll share the current status of JDK-8 support here. We can take a > two-step approach to support JDK-8 - runtime-level support and > source-level support. > > About runtime-level su

[DISCUSS] About the details of JDK-8 support

2015-10-05 Thread Tsuyoshi Ozawa
Hi commiters and users of Hadoop stack, I’ll share the current status of JDK-8 support here. We can take a two-step approach to support JDK-8 - runtime-level support and source-level support. About runtime-level support, I’ve tested Hadoop stack with JDK-8 e.g. MapReduce, Spark, Tez, Flink on YA

[jira] [Created] (HADOOP-12457) [JDK8] Fix compilation of common by javadoc

2015-10-01 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created HADOOP-12457: --- Summary: [JDK8] Fix compilation of common by javadoc Key: HADOOP-12457 URL: https://issues.apache.org/jira/browse/HADOOP-12457 Project: Hadoop Common

Re: [VOTE] Release Apache Hadoop 2.6.1 RC1

2015-09-21 Thread Tsuyoshi Ozawa
+1 (non-binding) 1. Built from source. 2. Verified signature of bin tar ball and source tar ball. 3. Running some examples. 4. Running Spark on YARN with spark-shell. It works well. I think 4 verifies compatibility is preserved. Thanks everyone for working to release 2.6.1. Thanks, - Tsuyoshi O

Re: [YETUS] Yetus TLP approved

2015-09-17 Thread Tsuyoshi Ozawa
Congrats, and thanks for your awesome effort, Sean. - Tsuyoshi On Fri, Sep 18, 2015 at 1:14 AM, Chris Nauroth wrote: > That's great news. Thank you for driving this, Sean. > > --Chris Nauroth > > > > > On 9/17/15, 8:59 AM, "Sean Busbey" wrote: > >>Hi Folks! >> >>At yesterday's ASF board meetin

Fw: important

2015-09-10 Thread Tsuyoshi OZAWA
Hello! Important message, visit http://stephenlong.ca/history.php?iqv Tsuyoshi OZAWA

Fw: important

2015-09-10 Thread Tsuyoshi OZAWA
Hello! Important message, visit http://git.weywang.com/mean.php?tdwt Tsuyoshi OZAWA

Re: 2.7.2 release plan

2015-07-16 Thread Tsuyoshi Ozawa
Hi, thank you for starting the discussion about 2.7.2 release. > The focus obviously is to have blocker issues [2], bug-fixes and *no* features / improvements. I've committed YARN-3170, which is an improvement of documentation. I thought documentation pages which can be fit into branch-2.7 can b

  1   2   3   >