Re: serialization error

> - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Addition of Meetup Group - Sydney, Mebourne Australia

-Meetup/ Thanks -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: No space left on device when running graphx job

from the amount of data. > > This is how I submit the job: > > > > spark-submit --class "myclass" > > --master spark://hadoopmaster:7077 (I am using standalone) > > --executor-memory 2048M > > --driver-java-options "-XX:MaxPermSize=2G" > > --t

Re: Scala Limitation - Case Class definition with more than 22 arguments

case Class not allowing > more than 22 Arguments" > > As I need to define a schema of around 37 arguments > > Regards, > Satish Chandra > > On Wed, Sep 23, 2015 at 9:50 AM, Andy Huang > wrote: > >> Alternatively, I would suggest you looking at program

Re: How to get RDD from PairRDD in Java

y must be taken not to > have been sent or endorsed by that company or any of its related entities. > No warranty is made that the e-mail or attachments are free from computer > virus or other defect. -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: Scala Limitation - Case Class definition with more than 22 arguments

;*error: Implementation >> restriction: case classes cannot have more than 22 parameters.*" >> >> It would be a great help if any inputs on the same >> >> Regards, >> Satish Chandra >> >> >> > -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Parallel collection in driver programs

ot;("+qry+") a", pCol, lo, //lower bound hi, //upper bound part, //number of partitions prop //java.utils.Properties - key value pair ) //save to parquet jdbcDF.write.mode("overwrite").parquet(_STORE_DEFAULT+pair._1+".parquet") }) Thanks. -- Andy Huang | Managing Consultant | Servian Pty Ltd | t: 02 9376 0700 | f: 02 9376 0730| m: 0433221979

Re: 1.4.0 regression: out-of-memory errors on small data

e Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > > -- Andy Huang | Man