[
https://issues.apache.org/jira/browse/HIVE-26548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashok kumar updated HIVE-26548:
-------------------------------
Description:
Hi i am new to hive and i want understand what is the best way to load the
below data.
I am receving 50 countries data in a separate db for each country, each db has
250 tables also the dbs will be avaible in different dates with suffix,my
reporting team needs consolidated db data for their analysis. So i have
implemented, a loop using shell script to load data from each table and
insert it into targrt table , with this approach hive is creating a seasion and
closing a session for each table ,hence it is taking days to complete the
process. Can any one help the best way to implement it using shell and hive.
was:
Hi i am new to hive and i want understand what is the best way to load the
below data.
I am receving 50 countries data in a separate db for each country, each db has
250 tables also the dbs will be avaible in different dates with suffix,my
reporting team needs consolidated db data for their analysis. So i have
implemented, a loop using shell script to load data from each table and
insert it into targrt table , which this approach hive is creating a seasion
and closing a session for each table ,hence it is taking days to complete the
process. Can any one help the best way to implement it using shell and hive.
> Hive Data load without closing the session
> ------------------------------------------
>
> Key: HIVE-26548
> URL: https://issues.apache.org/jira/browse/HIVE-26548
> Project: Hive
> Issue Type: New Feature
> Environment: Test
> Reporter: Ashok kumar
> Priority: Major
>
> Hi i am new to hive and i want understand what is the best way to load the
> below data.
>
> I am receving 50 countries data in a separate db for each country, each db
> has 250 tables also the dbs will be avaible in different dates with suffix,my
> reporting team needs consolidated db data for their analysis. So i have
> implemented, a loop using shell script to load data from each table and
> insert it into targrt table , with this approach hive is creating a seasion
> and closing a session for each table ,hence it is taking days to complete the
> process. Can any one help the best way to implement it using shell and hive.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
