Re: SparkR + binary type + how to get value

2019-02-19 Thread Thijs Haarhuis
From: Felix Cheung Sent: Sunday, February 17, 2019 7:18 PM To: Thijs Haarhuis; user@spark.apache.org Subject: Re: SparkR + binary type + how to get value A byte buffer in R is the raw vector type, so seems like it is working as expected. What do you have in the raw

Re: SparkR + binary type + how to get value

2019-02-14 Thread Thijs Haarhuis
s it is a list. Any idea how to get the actual value, or how to process the individual bytes? Thanks Thijs ________ From: Felix Cheung Sent: Thursday, February 14, 2019 5:31 AM To: Thijs Haarhuis; user@spark.apache.org Subject: Re: SparkR + binary type + how to get

SparkR + binary type + how to get value

2019-02-13 Thread Thijs Haarhuis
Hi all, Does anybody have any experience in accessing the data from a column which has a binary type in a Spark Data Frame in R? I have a Spark Data Frame which has a column which is of a binary type. I want to access this data and process it. In my case I collect the spark data frame to a R dat

SocketTimeoutException with spark-r and using latest R version

2018-10-15 Thread Thijs Haarhuis
Hi all, I am running into a problem that once in a while my job is giving me the following exception(s): java.net.SocketTimeoutException: Accept timed out at java.net.PlainSocketImpl.socketAccept(Native Method) at java.net.AbstractPlainSocketImpl.accept(AbstractPl