When table is created it is the time stamp when the table was created. When any
DDL is done it is the last DDL time it looks
0: jdbc:hive2://rhes564:10010/default> create table test (col1 int, col2
string);
No rows affected (0.168 seconds)
0: jdbc:hive2://rhes564:10010/default> show cre
I want to know for each of my tables the last time it was modified. some of
my tables don't have last_modified_time in the table parameters but all
have transient_lastDdlTime.
transient_lastDdlTime seems to be the same as last_modified_time in some of
the tables I randomly cheked.
what is the time
Thanks guys
A typical columnar database stores data by breaking the rows of a table into
individual columns and storing the successive values in an indexed and
compressed form in data blocks. The nth row of the table can be
reconstituted by taking the nth element from each column heap
So da
I am not sure how much performance one could gain in comparison to ORC or
Parquet. They work pretty well once you know how to use them. However,
there is still ways to optimize them. For instance, sorting of data is a
key factor for these formats to be efficient. Nevertheless, if you have a
lot of
Hi,
Sometimes, In the stage 1 of a query which is reading from an external
partitioned table, empty file is being read and the job is failing.
We are not sure why this is happening , please help us with this issue, we
are really stuck.
MR Logs:
Processing split:
Paths:
/be0d0d33-1101-4116-b5ae-6
The issue with this is that HDFS lacks the ability to co-locate blocks.
So if you break your columns into one file per column (the more
traditional column route) you end up in a situation where 2/3 of the
time only one of your columns is being locally read, which results in a
significant perfo
Apologies it starts OK and fails at reducer!
Map 1RUNNING 1 010 3 0
Reducer 2 INITED 1 001 0
0p: ap
Not starting at all!
Dr Mich Talebzadeh
LinkedIn
https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
Sybase ASE 15 Gold Medal Award 2008
A Winning Strategy: Running the most Critical Financial Data on ASE 15
http://login.sybase.com/files/Product_Overview
Is the job starting and getting stuck in the reducer like you mentioned in
the initial mail? or the job itself is not starting?
~Rajesh.B
On Wed, Jan 6, 2016 at 1:47 PM, Mich Talebzadeh wrote:
> Hi,
>
>
>
> Thanks for your help. I downloaded and installed snappy libraries as they
> were missing
Hi,
Thanks for your help. I downloaded and installed snappy libraries as they were
missing.
Setting Hive execution engine to tez and doing a simple query. Hive is stuck
> set hive.execution.engine=tez;
16/01/06 08:20:22 [main]: DEBUG parse.VariableSubstitution: Substitution is on:
10 matches
Mail list logo
