回复：Driver hung and happend out of memory while writing to console progress bar

the spark version is 2.1.0 --发件人：方孝健(玄弟) 发送时间：2017年2月10日(星期五) 12:35收件人：spark-dev ; spark-user 主　题：Driver hung and happend out of memory while writing to console progress bar [Stage 172:==>

Driver hung and happend out of memory while writing to console progress bar

[Stage 172:==> (10328 + 93) / 16144] [Stage 172:==> (10329 + 93) / 16144] [Stage 172:==> (10330 + 93) / 16144] [Stage 172:==>

Dynamic Allocation in Core vs YARN -- getDynamicAllocationInitialExecutors vs getInitialTargetExecutorNumber

Hi, I'm wondering why YARN computes the initial number of executors (in YarnSparkHadoopUtil.getInitialTargetExecutorNumber [1]) if Core's Utils.getDynamicAllocationInitialExecutors [2] could do? I'm to send a PR to remove the duplication as it's tricky enough to keep right in one place given all

Simple bug fix PR looking for love

Hi Guys, Can someone help move https://github.com/apache/spark/pull/16499 along in the review process? This PR fixes replicated off-heap storage. Thanks! Michael

Re: Java 9

Hi, Let me fill you in on the Quality Outreach. I send out email every 2-3 weeks depending on contents of the builds, example attached. I try to highlight significant changes in the builds, allowing you to decide if you might want to test with a particular build. We don't expect you to test ev

Re: Java 9

tl;dr: The critical internal APIs proposed to remain accessible in JDK 9 are: sun.misc.{Signal,SignalHandler} sun.misc.Unsafe (The functionality of many of the methods in this class is now available via variable handles (JEP 193).) sun.reflect.Reflection::getCallerClass(int) (The functionality

Re: Java 9

Excuse me, more detail of JDK 9 can be found here . http://openjdk.java.net/projects/jdk9/ The changes mentioned below were tracked in http://openjdk.java.net/jeps/260 If you want something digested, technical sessions in recent JavaOne would be quite helpful. There is a Quality Outreac

Re: Cannot find checkstyle.xml

Thanks Ted for trying. (see below for Ted's reply). Con somebody confirm that this is not an expected behaviour? Is there somebody else having same issue? Thanks! On Wed, Feb 8, 2017 at 11:42 PM, Ted Yu wrote: > Using your command, I got: > > Caused by: org.apache.maven.project.DependencyResolu