Will partition pruning will happen on HIVE views?

Hi, I have a scenario. Hive table "Table1" created with Partition with txn date. A view "VIEW_TABLE1" is created on top of "Table" with the query 'select * from table1'. If I query the view with the where clause using txn_date, will partition pruning happen? Please throw some light how it will

Re: LEFT JOIN and WHERE CLAUSE - How to handle

returns the correct > description. It only works if you don't have too many description per > currency though. > This is where Spark comes handy: it is simpler to define UDFs with it. > > > > On Wed, Aug 23, 2017 at 5:21 PM, Ramasubramanian Narayanan < > ram

Re: LEFT JOIN and WHERE CLAUSE - How to handle

lementations on github > <https://github.com/dataiku/dataiku-hive-udf#first_of_group-last_of_group> > . > > > > On Wed, Aug 23, 2017 at 3:37 PM, Ramasubramanian Narayanan < > ramasubramanian.naraya...@gmail.com> wrote: > >> Hi, >> >> Need your suggestion

LEFT JOIN and WHERE CLAUSE - How to handle

Hi, Need your suggestion on the below. Have two tables TXN and CURRENCY. Need all records in TXN and hence doing Left Join with CURRENCY. *Two problems :* 1. CURRENCY table may contain duplicate records hence it needs to be handled through RANK or some other function. 2. If we equate TXN_DT bet

HIVE or PIG - For building DQ framework

Hi All, Pls help me on the below. *Use Case :* Trying to develop a framework to do Data profiling and Data Quality. Data is stored HIVE table stored in RC format. No join only considering DQ checks that can be done in a single table. *Need suggestion :* Thinking either to use PIG or HIVE for per

Pro and Cons of using HBase table as an external table in HIVE

Hi, Can you please let us know Pro and Cons of using HBase table as an external table in HIVE. Will there be any performance degrade when using Hive over HBase instead of using direct HIVE table. The table that I am planning to use in HBase will be master table like account, customer. Wanting to

Is it ok to build an entire ETL/ELT data flow using HIVE queries?

Hi, Is it ok to build an entire ETL/ELT data flow using HIVE queries? Data is stored in HIVE. We have transactional and reference data. We need to build a small warehouse. Need suggestion on alternatives too. Regards, Rams

inline query in the select clause

Hi, I have below 2 tables… 1) create table dim (rank string,grade string) row format delimited fields terminated by ',' stored as textile; Data: 1,1 2,1 3,1 4,2 5,2 6,2 7,3 2) create table fact (rollno string,name string,sub1 string,rank1 string,sub2 string,rank2 string,sub3 string,rank3 str

How to overwrite Key in RecordReader function

DA, We are trying to write a UDF to read an XML which contains some unbounded tags. For repeated tags, new row has to be generated. Please let us know how to ovewrite the default key with the new key in the Record Reader function (where we do for loop to make multiple rows). *Sample XML:*

White papers/Solution implemented to use HIVE/HBASE as OLTP

Dear All, Request your help in providing link to the White papers/Solution implemented to use HIVE/HBASE as OLTP. regards, Rams

Storing and reading XML files in HIVE

Dear All, Request your help to guide how to store and read XML data in HIVE. while querying it should look as if we are having txt format file under HIVE (it is fine if we use view to parse the XML and show). Have gone through some sites but not able to figure out correctly.. few are mentioning

Merging different HDFS file for HIVE

Hi, Please help in providing solution for the below problem... this scenario is applicable in Banking atleast... I have a HIVE table with the below structure... Hive Table: Field1 ... Field 10 For the above table, I will get the values for each feed in different file. You can imagine that thes

Need help in joining 2 tables

Hi, Need to create a view in HIVE as per the below query (written in Oracle). Need help to provide the equivalent query in HIVE to create view. *EMP_ADDRESS* Emp_Id Address1 Address2 Address3 Address4 City State Pin Country Alternate_Address1 Alternate_Address2 Alternate_Address3 Alternate_Addr

Regarding Backup of MySQL if we have that as Metadata store for HIVE

Hi, If we have MySQL as the metadata store for HIVE, 1) do we need to backup every day ? 2) Is there any automatic way in Hadoop to have replication copy for MySQL too? 3) Anyway to update the metadata if we loose the information in MySQL? regards, Rams

Re: Join not working in HIVE

Hi, We are trying to build a tree structure in a table.. hence we have the left and right limits... Can't use where clause in that.. regards, Rams On Mon, Dec 17, 2012 at 6:53 PM, Nitin Pawar wrote: > hive is not mysql :) > > > On Mon, Dec 17, 2012 at 6:50 PM, Ramasubr

Re: Join not working in HIVE

Hi, But it is working fine in MySql... mysql> select count(A1.id) as LVL, A2.id, A2.code, A2.short_name, A2.lft, A2.rgt from product A1 join product A2 on (A1.lft <= A2.lft and A1.rgt >= A2.rgt) group by A2.id, A2.code, A2.short_name, A2.lft, A2.rgt; +-+--+--+--+--

How to overwrite a file inside hive table folder

Hi, We could not overwrite a file inside hive table folder. What is the command to over write it. Regards, Rams

How to update and delete a row in hive

Hi, What is the command to update/delete a row from hive? If not directly possible what is the work around for that? Regards, Rams