Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe]

2018-07-18 Thread Chethan
Hi Dev, I am streaming from mongoDB using Kafka with spark streaming, It returns me document [org.bson.document] . I wan to convert this rdd to dataframe to process with other data. Any suggestions will be helpful. Thanks, Chethan.

streaming from mongo

2018-07-12 Thread Chethan
​Hi Dev, I am receving data from mongoDB​ through spark streaming.It gives Dstream of org.bson.document. How to convert Dstream [Document] to dataframe? all my other operations are in dataframes. Thanks, Chethan.

is there a way to catch exceptions on executor level

2018-03-07 Thread Chethan Bhawarlal
lue my code fails and I am not able to catch the exceptions as these failures are occurring at executors. is there a way I can catch these exceptions and accumulate them and print to driver logs? any sample examples provided will be of great help. Thanks, Chethan. -- Collective[i] dramat