[Spark API] - Dynamic precision for same BigDecimal value

2017-10-22 Thread Irina Stan
3bcfc/7958346027016861/2296698 945593142/5693253843748751/latest.html Hope the example is clear enough. I am waiting for your response. Thank you for your time, Irina Stan

Long-running job OOMs driver process

2016-11-17 Thread Irina Truong
We have an application that reads text files, converts them to dataframes, and saves them in Parquet format. The application runs fine when processing a few files, but we have several thousand produced every day. When running the job for all files, we have spark-submit killed on OOM: # # java.lang

Re: Akka "connection refused" when running standalone Scala app on Spark 0.9.2

2014-10-04 Thread Irina Fedulova
help! Irina On 04.10.14 00:17, Yana Kadiyska wrote: I don't think it's a red herring... (btw. spark.driver.host needs to be set to the IP or FQDN of the machine where you're running the program). I am running 0.9.2 on CDH4 and the beginning of my executor log looks like below (I&

Re: Akka "connection refused" when running standalone Scala app on Spark 0.9.2

2014-10-03 Thread Irina Fedulova
your executor log, this seems fairly likely: is host1/xxx.xx.xx.xx:45542 the machine where your driver is running? is that host/port reachable from the worker machines? On Fri, Oct 3, 2014 at 5:32 AM, Irina Fedulova mailto:fedul...@gmail.com>> wrote: Hi, I have set up Spark 0.9.2 standal

Re: Akka Connection refused - standalone cluster using spark-0.9.0

2014-10-03 Thread irina
Hi ssimanta, were you able to resolve the problem with failing standalone scala program, but spark repl working just fine? I am getting the same issue... Thanks, Irina -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Akka-Connection-refused-standalone

Akka "connection refused" when running standalone Scala app on Spark 0.9.2

2014-10-03 Thread Irina Fedulova
$$anon$2: Connection refused: host1/xxx.xx.xx.xx:45542 --- Thanks! Irina - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org