Hi Vikas,
He suggested to use the select() function after your withColumn function.
val ds1 = ds.select("Col1", "Col3").withColumn("Col2",
lit("sample”)).select(“Col1”, “Col2”, “Col3")
Thanks,
Subash
On Thu, Nov 12, 2020 at 9:19 PM Vikas Garg <[email protected]> wrote:
> I am deriving the col2 using with colunn which is why I cant use it like
> you told me
>
> On Thu, Nov 12, 2020, 20:11 German Schiavon <[email protected]>
> wrote:
>
>> ds.select("Col1", "Col2", "Col3")
>>
>> On Thu, 12 Nov 2020 at 15:28, Vikas Garg <[email protected]> wrote:
>>
>>> In Spark Datase, if we add additional column using
>>> withColumn
>>> then the column is added in the last.
>>>
>>> e.g.
>>> val ds1 = ds.select("Col1", "Col3").withColumn("Col2", lit("sample"))
>>>
>>> the the order of columns is >> Col1 | Col3 | Col2
>>>
>>> I want the order to be >> Col1 | Col2 | Col3
>>>
>>> How can I achieve this?
>>>
>>
