If you don't care about the value that your map produced (because you're not already collecting or saving it), then is foreach more appropriate to what you're doing?
On Mon, Jan 12, 2015 at 4:08 AM, kevinkim <kevin...@apache.org> wrote: > Hi, answer from another Kevin. > > I think you may already know it, > 'transformation' in spark > ( > http://spark.apache.org/docs/latest/programming-guide.html#transformations > ) > will be done in 'lazy' way, when you trigger 'actions'. > (http://spark.apache.org/docs/latest/programming-guide.html#actions) > > So you can use > 'collect' - if you need result from memory > 'count' - if you need to count > 'saveAs ...' - if you need to persist transformed RDD > > Regards, > Kevin > > > On Mon Jan 12 2015 at 6:48:54 PM Kevin Jung [via Apache Spark User List] > <[hidden > email] <http:///user/SendEmail.jtp?type=node&node=21095&i=0>> wrote: > >> Hi all >> Is there efficient way to trigger RDD transformations? I'm now using >> count action to achieve this. >> >> Best regards >> Kevin >> >> ------------------------------ >> If you reply to this email, your message will be added to the >> discussion below: >> >> http://apache-spark-user-list.1001560.n3.nabble.com/Manually-trigger-RDD-map-function-without-action-tp21094.html >> To unsubscribe from Apache Spark User List, click here. >> NAML >> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> >> > > ------------------------------ > View this message in context: Re: Manually trigger RDD map function > without action > <http://apache-spark-user-list.1001560.n3.nabble.com/Manually-trigger-RDD-map-function-without-action-tp21094p21095.html> > > Sent from the Apache Spark User List mailing list archive > <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com. >
