Re: Build time limit in PR builder

Thanks all. It's very helpful! - Kousuke On 2020/05/29 3:31, shane knapp ☠ wrote: https://github.com/apache/spark/pull/28666 On Thu, May 28, 2020 at 11:20 AM shane knapp ☠ mailto:skn...@berkeley.edu>> wrote: i'll get a PR put together now. On Thu, May 28, 2020 at 8:26 AM Hyukjin Kwon

Re: welcome a new batch of committers

Congratulations! - Kousuke On 2018/10/04 0:30, Gengliang wrote: Congratulations to all ! On Wed, Oct 3, 2018 at 10:06 PM Wenchen Fan mailto:cloud0...@gmail.com>> wrote: Congratulations! On Wed, Oct 3, 2018 at 9:24 PM Madhusudanan Kandasamy mailto:madhusuda...@in.ibm.com>> wrote:

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

+1 (non-binding) Tested on my cluster with three slave nodes. On 2016/07/23 10:25, Suresh Thalamati wrote: +1 (non-binding) Tested data source api , and jdbc data sources. On Jul 19, 2016, at 7:35 PM, Reynold Xin > wrote: Please vote on releasing the following c

Re: ERROR: java.net.UnknownHostException

Hi Miki, What version of Spark are you using? If the version is > 1.4, you might hit SPARK-11227. - Kousuke On 2016/07/28 18:34, Miki Shingo wrote: To whom who has knowledge? I have faced the following error try to use HA configuration. (java.net.UnknownHostException) below is the error fo

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: +1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida mailto:ricardo.alme...@actnowib.com>> wrote: +1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS /

Re: welcoming Xiao Li as a committer

Congratulations Xiao! - Kousuke On 2016/10/05 7:44, Bryan Cutler wrote: Congrats Xiao! On Tue, Oct 4, 2016 at 11:14 AM, Holden Karau > wrote: Congratulations :D :) Yay! On Tue, Oct 4, 2016 at 11:14 AM, Suresh Thalamati mailto:suresh.thalam...@gmail.c

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

+1 - Kousuke On 2016/10/28 2:07, vaquar khan wrote: +1 On Thu, Oct 27, 2016 at 11:56 AM, Davies Liu > wrote: +1 On Thu, Oct 27, 2016 at 12:18 AM, Reynold Xin mailto:r...@databricks.com>> wrote: > Greetings from Spark Summit Europe at Brussels.

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

+1 (non-binding) - Kousuke On 2016/11/03 9:40, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.3. The vote is open until Sat, Nov 5, 2016 at 18:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as A

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

+1 (non-binding) On 2016年11月08日 15:09, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 2.0.2. The vote is open until Thu, Nov 10, 2016 at 22:00 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as Apache S

Re: welcoming Burak and Holden as committers

Congrats, Burak and Holden! - Kousuke On 2017/01/25 6:36, Herman van Hövell tot Westerflier wrote: Congrats! On Tue, Jan 24, 2017 at 10:20 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: Congrats and welcome!! ---

Re: welcoming Takuya Ueshin as a new Apache Spark committer

Congratulations, Takuya! - Kousuke On 2017/02/14 7:38, Herman van Hövell tot Westerflier wrote: Congrats Takuya! On Mon, Feb 13, 2017 at 11:27 PM, Neelesh Salian mailto:neeleshssal...@gmail.com>> wrote: Congratulations, Takuya! On Mon, Feb 13, 2017 at 11:16 AM, Reynold Xin mailto:

Re: [VOTE] Designating maintainers for some Spark components

+1, It makes sense! - Kousuke (2014/11/05 17:31), Matei Zaharia wrote: Hi all, I wanted to share a discussion we've been having on the PMC list, as well as call for an official vote on it on a public list. Basically, as the Spark project scales up, we need to define a model to make sure ther

Re: [VOTE] Release Apache Spark 1.1.1 (RC1)

Now I've finished to revert for SPARK-4434 and opened PR. (2014/11/16 17:08), Josh Rosen wrote: -1 I found a potential regression in 1.1.1 related to spark-submit and cluster deploy mode: https://issues.apache.org/jira/browse/SPARK-4434 I think that this is worth fixing. On Fri, Nov 14, 2014

Re: Assembly jar file name does not match profile selection

Hi Alessandro, It's fixed by SPARK-3787 and will be applied to 1.2.1 and 1.3.0. https://issues.apache.org/jira/browse/SPARK-3787 - Kousuke (2014/12/27 11:15), Alessandro Baretta wrote: I am building spark with sbt off of branch 1.2. I'm using the following command: sbt/sbt -Pyarn -Phadoop-2.

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

+1 Built on Mac OS X with -Dhadoop.version=2.4.0 -Pyarn -Phive -Phive-thriftserver. Tested on YARN (cluster/client) on CentOS 7. Also WebUI incuding DAG and Timeline View work. On 2015/06/05 15:01, Burak Yavuz wrote: +1 Tested on Mac OS X Burak On Thu, Jun 4, 2015 at 6:35 PM, Calvin Jia

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non-binding) Tested some workloads using basic API and DataFrame API on my 4-nodes YARN cluster (1 master and 3 slaves). I also tested the Web UI. (I'm resending this mail just in case because it seems that I failed to send the mail to dev@) On 2015/12/13 2:39, Michael Armbrust wrote: Pl

Re: How do we convert a Dataset includes timestamp columns to RDD?

Hi Yu, I found it's because DateTimeUtils passed to StaticInvoke is not serializable. I think it's potential bug that StaticInvoke can receives non-Serializable objects. I opened a PR about this issue. https://github.com/apache/spark/pull/10357 - Kousuke On 2015/12/17 16:35, Yu Ishikawa wr

Re: [VOTE] Release Apache Spark 1.6.0 (RC3)

+1 On 2015/12/17 6:32, Michael Armbrust wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Saturday, December 19, 2015 at 18:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 2015/12/23 16:14, Jean-Baptiste Onofré wrote: +1 (non binding) Tested with samples on standalone and yarn. Regards JB On 12/22/2015 09:10 PM, Michael Armbrust wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Friday, December

Re: [VOTE] Release Apache Spark 1.6.1 (RC1)

+1 (non-binding) On 2016/03/09 4:28, Burak Yavuz wrote: +1 On Tue, Mar 8, 2016 at 10:59 AM, Andrew Or > wrote: +1 2016-03-08 10:59 GMT-08:00 Yin Huai mailto:yh...@databricks.com>>: +1 On Mon, Mar 7, 2016 at 12:39 PM, Reynold Xin

Spark 1.6.1 binary pre-built for Hadoop 2.6 may be broken

Hi all, I noticed the binary pre-build for Hadoop 2.6 which we can download from spark.apache.org/downloads.html (Direct Download) may be broken. I couldn't decompress at least following 4 tgzs with "tar xfzv" command and md5-checksum did't match. * spark-1.6.1-bin-hadoop2.6.tgz * spark-1.6.1-bin

Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?

Oh, I overlooked that. Thanks. Kousuke On 2016/04/04 22:58, Nicholas Chammas wrote: This is still an issue. The Spark 1.6.1 packages on S3 are corrupt. Is anyone looking into this issue? Is there anything contributors can do to help solve this problem? Nick On Sun, Mar 27, 2016 at 8:49 PM

Re: Spark 1.6.1 Hadoop 2.6 package on S3 corrupt?

Thanks. Of course, I verified checksum and it didn't matched. Kousuke On 2016/04/05 0:39, Jitendra Shelar wrote: We can think of using checksum for this kind of issues. On Mon, Apr 4, 2016 at 8:32 PM, Kousuke Saruta mailto:saru...@oss.nttdata.co.jp>> wrote: Oh, I over

Re: Welcoming Yanbo Liang as a committer

Congratulations Yanbo! - Kousuke On 2016/06/04 11:48, Matei Zaharia wrote: Hi all, The PMC recently voted to add Yanbo Liang as a committer. Yanbo has been a super active contributor in many areas of MLlib. Please join me in welcoming Yanbo! Matei --

Re: [VOTE] Release Apache Spark 1.6.2 (RC2)

+1 (non-binding) On 2016/06/23 4:53, Reynold Xin wrote: +1 myself On Wed, Jun 22, 2016 at 12:19 PM, Sean McNamara mailto:sean.mcnam...@webtrends.com>> wrote: +1 On Jun 22, 2016, at 1:14 PM, Michael Armbrust mailto:mich...@databricks.com>> wrote: +1 On Wed, Jun 22, 2

Invalid link for Spark 1.0.0 in Official Web Site

Hi, I found there is a invalid link in . The link for release note of Spark 1.0.0 indicates http://spark.apache.org/releases/spark-release-1.0.0.html but this link is invalid. I think that is mistake for

Miss-link for the document of Spark 1.0.1

Hi developpers Conguraturations on the release of Spark 1.0.1! I found a miss-link for the document of Spark 1.0.1. I checked out the overview from the link http://spark.apache.org/docs/latest/ but this link points to the page for 1.0.0. I also visited the link http://spark.apache.org/docs/late

Re: Miss-link for the document of Spark 1.0.1

Sorry, it may be my bad. Now I confirmed the link points to the page for 1.0.1. Thanks Kousuke (2014/07/12 7:22), Sean Owen wrote: It correctly points to 1.0.1 but you may need to refresh in your browser to see the update. On Jul 12, 2014 3:18 PM, "Kousuke Saruta" wrote: Hi d

Re: too many CancelledKeyException throwed from ConnectionManager

Hi Shengzhe I faced to same situation. I think, Connection and ConnectionManager have some race condition issues and the error you mentioned may be caused by the issues. Now I'm trying to resolve the issue in https://github.com/apache/spark/pull/2019. Please check it out. - Kousuke (2014/08/

Re: [VOTE] Release Apache Spark Connect Swift Client 0.3.0 (RC1)

+1 On 2025/06/24 06:56:57 Sakthi wrote: > +1 (non-binding) > > On Sun, Jun 22, 2025 at 4:52 PM Hyukjin Kwon wrote: > > > +1 > > > > On Sun, 8 Jun 2025 at 02:12, Jules Damji wrote: > > > >> + 1 (non-binding) > >> — > >> Sent from my iPhone > >> Pardon the dumb thumb typos :) > >> > >> > On Jun

Re: [VOTE] Release Spark 4.1.0-preview1 (RC1)

+1 2025年7月9日(水) 2:12 Rozov, Vlad : > +1 (non-binding) > > > > Thank you, > > > > Vlad > > > > *From: *Dongjoon Hyun > *Date: *Tuesday, July 8, 2025 at 8:09 AM > *To: *Hyukjin Kwon > *Cc: *"dev@spark.apache.org" > *Subject: *RE: [EXTERNAL] [VOTE] Release Spark 4.1.0-preview1 (RC1) > > > > +1 >