Hi All,
I built spark with *tags/v2.4.0-rc2* using
./build/mvn -DskipTests -Phadoop-2.7 -Dhadoop.version=3.1.0 clean install
Now from spark-shell when ever I call any static method residing in an
interface, it shows me error like :
:28: error: Static methods in interface require -target:jvm-1.8
https://jaceklaskowski.gitbooks.io/mastering-spark-sql/spark-sql-whole-stage-codegen.html#spark.sql.codegen.wholeStage
Sent from my iPhone
> On Oct 7, 2018, at 3:21 PM, 阎志涛 wrote:
>
> It is not data skewed issue. The executor running more than 8 hours and I
> have to kill the executor. I doub
It is not data skewed issue. The executor running more than 8 hours and I have
to kill the executor. I doubt the problem is caused by Spark codegen but it
sound spark.sql.codegen.wholeStage=false can not work. I met another problem
with codegen which cause my spark job failed with following stac
It seemed you had data skewed issue since shuffle read size for executor 4 is
almost 2 times than other executors and GC time 11s almost 15 to 20 times than
others.
Kathleen
Sent from my iPhone
> On Oct 7, 2018, at 5:24 AM, 阎志涛 wrote:
>
> Hi, All,
> I am running Spark 2.1 on Hadoop 2.7.2 wit
