problem with spark.unsafe.offHeap & spark.sql.tungsten.enabled

2015-11-12 Thread tyronecai
Hi, all: I test spark-1.5.*-bin-hadoop2.6, and find this problem, it’s easy to reproduce. Environment: OS: CentOS release 6.5 (Final) 2.6.32-431.el6.x86_64 JVM: java version "1.7.0_60" Java(TM) SE Runtime Environment (build 1.7.0_60-b19) Java HotSpot(TM) 64-Bit Server VM (build 24.60-b09, mixed

Re: Performance degradation between spark 0.9.3 and 1.3.1

2015-05-22 Thread tyronecai
may because of snappy-java, https://issues.apache.org/jira/browse/SPARK-5081 On May 23, 2015, at 1:23 AM, Josh Rosen wrote: > I don't think that 0.9.3 has been released, so I'm assuming that you're > running on branch-0.9. > > There's been over 4000 commits between 0.9.3 and 1.3.1, so I'm afr