Hi Franklyn,
I had the same problem like yours with vectors & Maps. I tried:
1) UDF --> cumbersome and difficult to maintain. One has to re-write /
re-implement UDFs + extensive docs should be provided for colleagues +
something weird may happen when you migrate to new Spark version
2) RDD / DataF
any suggestion from spark dev group?
From: Link Qian
Sent: Friday, June 23, 2017 9:58 AM
To: u...@spark.apache.org
Subject: Container exited with a non-zero exit code 1
Hello,
I submit a spark job to YARN cluster with spark-submit command. the environment
is
