Hi team,
In a single Linux node, I would like to set up Rstudio with Sparkly. Three
to four people make up the dev team.
I am aware of the single-node spark cluster's constraints. When there is a
resource problem with Spark, I want to know when more users join in to use
Sparkly in Rstudio. It shou
Hi all,
I am reading a parquet file like this and it gives
java.lang.IllegalArgumentException.
However i can work with other parquet files (such as nyc taxi parquet
files) without any issue. I have copied the full error log as well. Can you
please check once and let me know how to fix this?
impor
Hi team,
Any updates on this below issue
On Mon, 3 Jul 2023 at 6:18 PM, elango vaidyanathan
wrote:
>
>
> Hi all,
>
> I am reading a parquet file like this and it gives
> java.lang.IllegalArgumentException.
> However i can work with other parquet files (such as nyc
tools to see if you
> can read without Spark.
>
> On Wed, 5 Jul 2023, 07:25 elango vaidyanathan,
> wrote:
>
>>
>> Hi team,
>>
>> Any updates on this below issue
>>
>> On Mon, 3 Jul 2023 at 6:18 PM, elango vaidyanathan
>> wrote:
>>
>
Hi team,
I am loading an CSV. One column contains a json value. I am unable to parse
that column properly. Below is the details. Can you please check once?
val df1=spark.read.option("inferSchema","true").
option("header","true").option("quote", "\"")
.option("escape", "\"").csv("/FileStore/tab
Is there any way I can handle it in code?
Thanks,
Elango
On Thu, May 28, 2020, 8:52 PM Sean Owen wrote:
> Your data doesn't escape double-quotes.
>
> On Thu, May 28, 2020 at 10:21 AM elango vaidyanathan
> wrote:
>
>>
>> Hi team,
>>
>> I am loading
ner quotes and then reparse.
>
> On Thu, May 28, 2020 at 10:25 AM elango vaidyanathan
> wrote:
>
>> Is there any way I can handle it in code?
>>
>> Thanks,
>> Elango
>>
>> On Thu, May 28, 2020, 8:52 PM Sean Owen wrote:
>>
>>> Your data
