I had this problem at my work.
I solved by increasing the unix ulimit, because spark is trying to open to
many files.
Em 29 de set de 2017 5:05 PM, "Anthony Thomas"
escreveu:
> Hi Spark Users,
>
> I recently compiled spark 2.2.0 from source on an EC2 m4.2xlarge instance
> (8 cores, 32G RAM) ru
Hi Spark Users,
I recently compiled spark 2.2.0 from source on an EC2 m4.2xlarge instance
(8 cores, 32G RAM) running Ubuntu 14.04. I'm using Oracle Java 1.8. I
compiled using the command:
export MAVEN_OPTS="-Xmx2g -XX:ReservedCodeCacheSize=512m"
./build/mvn -DskipTests -Pnetlib-lgpl clean package
