Re: Unable to see completed application in Spark 2 history web UI

Hi Guys, Any help here? On Wed, Aug 8, 2018 at 7:56 AM Fawze Abujaber wrote: > Hello Community, > > I'm using Spark 2.3 and Spark 1.6.0 in my cluster with Cloudera > distribution 5.13.0. > > Both are configured to run on Yarn, but i'm unable to see completed > application in Spark2 history serv

CVE-2018-11770: Apache Spark standalone master, Mesos REST APIs not controlled by authentication

Severity: Medium Vendor: The Apache Software Foundation Versions Affected: Spark versions from 1.3.0, running standalone master with REST API enabled, or running Mesos master with cluster mode enabled Description: >From version 1.3.0 onward, Spark's standalone master exposes a REST API for job s

Re: How to parallelize zip file processing?

Thanks for your reply. DataSet I am receiving from MainFrames system which I don't have control . Tried below things to move data to other executors but not succeeded 1. Called repartition method, data got re-partitioned but on same executor. Only one core is processing all these par