Sent from my Verizon Wireless 4G LTE DROID
er to RDDs or Dataset
in the next stage of the pipeline.
Also, I'm not sure what the custom Java mappers are doing - could you use them
as UDFs within a DataFrame?
Xinh
On Fri, Jun 24, 2016 at 11:42 AM, Martin Serrano
mailto:mar...@attivio.com>> wrote:
Indeed. But I'm dea
Indeed. But I'm dealing with 1.6 for now unfortunately.
On 06/24/2016 02:30 PM, Ted Yu wrote:
In Spark 2.0, Dataset and DataFrame are unified.
Would this simplify your use case ?
On Fri, Jun 24, 2016 at 7:27 AM, Martin Serrano
mailto:mar...@attivio.com>> wrote:
Hi,
I'm e
Hi,
I'm exposing a custom source to the Spark environment. I have a question about
the best way to approach this problem.
I created a custom relation for my source and it creates a DataFrame. My
custom source knows the data types which are dynamic so this seemed to be the
appropriate return
