Hive External Table Partiton Data Type.

[SB M]

Hi All,
   Am trying to create a dynamic partition with external table on hive
metastore using spark sql.

when am trying to create a partition column data type as bigint, partition
is not working even i tried with repair table. data is not shown when i ran
sample query select * from table.


but if i tried to create a dynamic partition with string as data type for
partition its working fine. partition are working as expected.


is there something am doing it wrong ??


Regards,
Sree

Re: Hive External Table Partiton Data Type.

[SB M]

spark version 2.1.0

Regards,
Sbm

On Mon, 16 Dec, 2019, 10:04 HARSH TAKKAR,  wrote:

> Please share the spark version you are using .
>
> On Fri, 13 Dec, 2019, 4:02 PM SB M,  wrote:
>
>> Hi All,
>>Am trying to create a dynamic partition with external table on hive
>> metastore using spark sql.
>>
>> when am trying to create a partition column data type as bigint,
>> partition is not working even i tried with repair table. data is not shown
>> when i ran sample query select * from table.
>>
>>
>> but if i tried to create a dynamic partition with string as data type for
>> partition its working fine. partition are working as expected.
>>
>>
>> is there something am doing it wrong ??
>>
>>
>> Regards,
>> Sree
>>
>>

Spark Submit through yarn is failing with Default queue.

[SB M]

Hi All,

Am trying to submit my application using spark-submit in yarn mode.

But its failing because of unknown queue default, we specified the queue
name in spark-default.conf as spark.yarn.queue SecondaryQueue

its failing for one application, but for another application dont know the
reason.

plesee help me with this.

Regards,
SBM