Hello, spark experts:
I am trying to figure out how to encrypt traffic when using spark on k8s.
>From the spark security doc, I learned how to do the RPC encryption between
spark driver and spark executors. But I do not understand how to do it
between spark driver and K8S API Server. (and/maybe be
roject_2.10-1.0.jar"))
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650p3655.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
List("target/scala-2.10/simple-project_2.10-1.0.jar"))
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650p3655.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
at 11:07 PM, yh18190 wrote:
> Its working under local mode..but not under cluster mode with 4 slaves
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650p3653.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
Its working under local mode..but not under cluster mode with 4 slaves
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650p3653.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
sInstanceOf[java.util.LinkedHashMap[String,Any]]
//Extract the retweet count from the given tweet line.
val retweets:Integer =
tweet_details_map.get("retweet_count").get.asInstanceOf[Integer]
https://bitbucket.org/smartmetersproject/twitterdatasets1/src/c379405f1437a9eb4fc7fa0f3f9a2834e766ad2d/src/main/scala/Utils.scala?at=master
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650p3652.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
a:219)
> at
>
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
> at
> scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
>
> scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
> at
> scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
> at
>
> scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Need-suggestions-tp3650.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
at
scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at
scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
scala.concurrent.forkjoin.ForkJoinWorkerThread.run(F
