I have already opened a JIRA about this. https://issues.apache.org/jira/browse/SPARK-8743
On Mon, Jul 6, 2015 at 1:02 AM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > I haven't been able to reproduce the error reliably, I will open a JIRA as > soon as I can > > Greetings, > > Juan > > 2015-06-23 21:57 GMT+02:00 Tathagata Das <t...@databricks.com>: > >> Aaah this could be potentially major issue as it may prevent metrics from >> restarted streaming context be not published. Can you make it a JIRA. >> >> TD >> >> On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá < >> juan.rodriguez.hort...@gmail.com> wrote: >> >>> Hi, >>> >>> I'm running a program in Spark 1.4 where several Spark Streaming >>> contexts are created from the same Spark context. As pointed in >>> https://spark.apache.org/docs/latest/streaming-programming-guide.html >>> each Spark Streaming context is stopped before creating the next Spark >>> Streaming context. The program works ok, but I get exceptions like the >>> following when a new Spark Streaming context is created >>> >>> 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered >>> java.lang.IllegalArgumentException: A metric named >>> local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime >>> already exists >>> at >>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91) >>> at >>> com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385) >>> at >>> com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85) >>> >>> >>> Is this something to be concerned, or just a minor nuisance? >>> >>> Thanks a lot in advance. >>> >>> Greetings, >>> >>> Juan Rodriguez Hortala >>> >> >> >
