unsubscribe

unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

unsubscribe

unsubscribe - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: SparkStraming job break with shuffle file not found

6_0.data.574b45e8-bafd-437d-8fbf-deb6e3a1d001 > (No such file or directory)* > > Thanks! > > -- *Lucas Kacher*Senior Engineer - vsco.co <https://www.vsco.co/> New York, NY 818.512.5239

Re: [Structured Streaming] Query Metrics to MetricsSink

It actually looks like I might have the answers via these following links: [Design] Metrics in Structured Streaming JIRA - Structured Streaming - Metrics

[Structured Streaming] Query Metrics to MetricsSink

I am looking to take the metrics exposed in the logs from MicroBatchExecution below and submit them as stats to implemented MetricsSinks. 2018-03-20 10:28:48 INFO MicroBatchExecution:54 - Streaming query made progress: { "id" : "42bb5c95-980d-480d-9dee-72e1baf6a5b3", "runId" : "d9209988-7715-

Spark Cassandra

Hello, I am trying to save data from spark to Cassandra. So I have an ScalaESRDD (because i take data from elasticsearch) that contains a lot of key/values like this : (AU16r4o_kbhIuSky3zFO , Map(@timestamp -> 2015-05-21T21:35:54.035Z, timestamp -> 2015-05-21 23:35:54,035, loglevel -> INFO, th

Spark with cassandra

Hello, I have an issue. I would like to save some data to Cassandra using Spark. Firstly i have load data from Elasticsearch to Spark then I obtain this : org.elasticsearch.spark.rdd.ScalaEsRDD which contains this kind of information (AU1rN9uN4PGB4YTCSXr7,Map(@timestamp -> 2015-05-19T08:08