Re: EXT: Re: Create Dataframe from a single String in Java

2021-11-18 Thread Vibhor Gupta
uot;string") ).show(); Regards, Vibhor Gupta From: mar...@wunderlich.com Sent: Thursday, November 18, 2021 5:37 PM To: Vibhor Gupta Cc: sebastian....@gmail.com ; user Subject: Re: EXT: Re: Create Dataframe from a single String in Java EXTERNAL: Repor

Re: EXT: Re: Create Dataframe from a single String in Java

2021-11-18 Thread martin
Cc: user Subject: EXT: Re: Create Dataframe from a single String in Java EXTERNAL: Report suspicious emails to Email Abuse. You can call that on sparkSession to On Thu, 18 Nov 2021, 10:48 , wrote: PS: The following works, but it seems rather awkward having to use the SQLContext here. SQLCon

Re: EXT: Re: Create Dataframe from a single String in Java

2021-11-18 Thread Vibhor Gupta
From: Sebastian Piu Sent: Thursday, November 18, 2021 4:20 PM To: mar...@wunderlich.com Cc: user Subject: EXT: Re: Create Dataframe from a single String in Java EXTERNAL: Report suspicious emails to Email Abuse. You can call that on sparkSession to On Thu, 18 Nov 2021, 10:48

Re: Create Dataframe from a single String in Java

2021-11-18 Thread Sebastian Piu
You can call that on sparkSession to On Thu, 18 Nov 2021, 10:48 , wrote: > PS: The following works, but it seems rather awkward having to use the > SQLContext here. > > SQLContext sqlContext = new SQLContext(sparkContext); > > Dataset data = sqlContext > .createDataset(textList, Encoders.S

Re: Create Dataframe from a single String in Java

2021-11-18 Thread Sebastian Piu
The most convenient way I'm aware of from Java is to use createDataset and pass Encoder.String That gives you a Dataset if you still want Dataset the you can call .toDF on it On Thu, 18 Nov 2021, 10:27 , wrote: > Hello, > > I am struggling with a task that should be super simple: I would like t

Re: Create Dataframe from a single String in Java

2021-11-18 Thread martin
PS: The following works, but it seems rather awkward having to use the SQLContext here. SQLContext sqlContext = new SQLContext(sparkContext); Dataset data = sqlContext .createDataset(textList, Encoders.STRING()) .withColumnRenamed("value", "text"); Am 2021-11-18 11:26, schrieb mar.

Create Dataframe from a single String in Java

2021-11-18 Thread martin
Hello, I am struggling with a task that should be super simple: I would like to create a Spark DF of Type Dataset with one column from a single String (or from a one-element List of Strings). The column header should be "text". SparkContext.parallelize() does not work, because it returns RDD