r parquet to ORC, not sure if this have an impact or not.
>
> Thanks you for our help.
>
> From: Mich Talebzadeh
> Date: Sunday, April 10, 2016 at 11:54 PM
> To: maurin lenglart
> Cc: "user @spark"
> Subject: Re: alter table add columns aternatives or hive refresh
gt;>
Cc: "user @spark" mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
This should work. Make sure that you use HiveContext.sql and sqlContext
correctly
This is an example in Spark, reading a CSV file, doing some manipulation,
crea
http://talebzadehmich.wordpress.com<http://talebzadehmich.wordpress.com/>
On 10 April 2016 at 19:34, Maurin Lenglart
mailto:mau...@cuberonlabs.com>> wrote:
Hi,
So basically you are telling me that I need to recreate a table, and re-insert
everything every time I update a column?
I unde
Dr Mich Talebzadeh
LinkedIn *
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
http://talebzadehmich.wordpress.com
On 11 April 2016 at 01:36, Maurin Lenglart wrote:
> Yo
l.com>>
Date: Sunday, April 10, 2016 at 12:25 PM
To: "user @spark" mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
Hi,
I am confining myself to Hive tables. As I stated it before I have not tried it
in Spark. So I stand correct
llow me not to move TB of data
> everyday?
>
> Thanks for you answer
>
> From: Mich Talebzadeh
> Date: Sunday, April 10, 2016 at 3:41 AM
> To: maurin lenglart
> Cc: "user@spark.apache.org"
> Subject: Re: alter table add columns aternatives or hive refresh
>
>
ser@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: alter table add columns aternatives or hive refresh
I have not tried it on Spark but the column added in Hive to an existing table
cannot be updated for existing rows. In other words the new column is set to
null which
I have not tried it on Spark but the column added in Hive to an existing
table cannot be updated for existing rows. In other words the new column is
set to null which does not require the change in the existing file length.
So basically as I understand when a column is added to an already table.
