mission statement : unified

2020-10-18 Thread Hulio andres
  Apache Spark's  mission statement is  Apache Spark™ is a unified analytics engine for large-scale data processing.    To what is the word "unified" inferring ?             - To unsubscribe e-mail: user-unsubscr...@spark

Map Reduce -v- Parallelism

2020-10-14 Thread Hulio andres
Hi,   Is this guy a silly billy for comparing  Apache Flink with Apache Spark ?   https://www.youtube.com/watch?v=sYlbD_OoHhs Airbus makes more of the sky with Flink - Jesse Anderson & Hassene Ben Salem Does Apache Spark tomcat hadoop spark support distributed as well as map reduce and paral

Re: File not found exceptions on S3 while running spark jobs

2020-07-17 Thread Hulio andres
Most likely directory write permission not permission. The app user doesn't have permission to write files to that directory. > Sent: Friday, July 17, 2020 at 6:03 PM > From: "Nagendra Darla" > To: "Hulio andres" > Cc: user@spark.apache.org > Subject: R

Re: File not found exceptions on S3 while running spark jobs

2020-07-16 Thread Hulio andres
https://examples.javacodegeeks.com/java-io-filenotfoundexception-how-to-solve-file-not-found-exception/ Are you a programmer ? Regards, Hulio > Sent: Friday, July 17, 2020 at 2:41 AM > From: "Nagendra Darla" > To: user@spark.apache.org > Subject: File not found exceptions on S3 while runni

Re: “Pyspark.zip does not exist” using Spark in cluster mode with Yarn

2020-07-16 Thread Hulio andres
https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-10795 https://stackoverflow.com/questions/34632617/spark-python-submission-error-file-does-not-exist-pyspark-zip https://stackoverflow.com/questions/34632617/spark-python-submission-error-file-does-not-exist-pyspark-zip> Sent: