Re: conversion from java collection type to scala JavaRDD

The runtime attempts to serialize everything required by records, and also any lambdas/closures you use. Small, simple types are less likely to run into this problem. Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition (O'Reilly) Typesafe <

Re: conversion from java collection type to scala JavaRDD

You are right I have class called VendorRecord which is not serializable also this class object have many sub classed(may be 30 or more).Do I need to recursively serialize all? On 4 April 2015 at 18:14, Dean Wampler wrote: > Without the rest of your code, it's hard to know what might be > unse

Re: conversion from java collection type to scala JavaRDD

Without the rest of your code, it's hard to know what might be unserializable. Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition (O'Reilly) Typesafe @deanwampler http://polyglotprogra

Re: conversion from java collection type to scala JavaRDD

Hi I have tried with parallelize but i got the below exception java.io.NotSerializableException: pacific.dr.VendorRecord Here is my code List vendorRecords=blockingKeys.getMatchingRecordsWithscan(matchKeysOutput); JavaRDD lines = sc.parallelize(vendorRecords) On 2 April 2015 at 21:11, Dean Wam

Re: conversion from java collection type to scala JavaRDD

Use JavaSparkContext.parallelize. http://spark.apache.org/docs/latest/api/java/org/apache/spark/api/java/JavaSparkContext.html#parallelize(java.util.List) Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition (O'Reilly) Typesafe

conversion from java collection type to scala JavaRDD

Hi All Is there an way to make the JavaRDD from existing java collection type List? I know this can be done using scala , but i am looking how to do this using java. Regards Jeetendra