Re: Subqueries two tables to one in Hive

Thank you for replying. You are right, I just have to set these guys in: set hive.strict.checks.cartesian.product=false; set hive.mapred.mode=nonstrict; *From: *Furcy Pin *Date: *Tuesday, August 7, 2018 at 2:25 AM *To: *Sowjanya Kakarala *Subject: *[EXT] Re: Subqueries two tables to one

Subqueries two tables to one in Hive

Hi Everyone, I am trying to insert data from 2tables to one table as separate columns. Example: Table1 as A: Id Data time_stamp 1 0.1 2018-01-01 2 0.2 2018-01-01 3 0.3 2018-01-02 Table2 as B Id Data time_stamp 1 1.1 2018-01-01 2 2.2 2018-01-01 3 1.3 2018-01-02 Now I a

Re: Performance in hive fetch

8-07-20' and init_hour = 0 & SELECT f[0] FROM db.forecast WHERE cell_id = 9341 AND run_date between '2018-07-16' and '2018-07-20' and init_hour = 0 & SELECT g [0] FROM db.forecast WHERE cell_id = 9341 AND

Performance in hive fetch

Hi Guys, I am trying to fetch the data from hive through python code based on dates and id. For fetch of 20days till current day for 7tables together it is taking 30seconds. for fetching for an year worth data for 7tables together it is taking 3minutes26seconds. My tables are stored as orc and tr

Re:

on that you still have available space. This also > happens when YARN and/or M/R logs are filling up the disks where the > DataNode is running. > > On Wed, Jun 13, 2018 at 8:56 AM Sowjanya Kakarala > wrote: > >> Hi Sajid, >> >> As this is development environment, we

Re:

our rack topology ? > > On Tue, Jun 12, 2018 at 9:26 PM Sowjanya Kakarala > wrote: > >> Hi Guys, >> >> >> I have 4datanodes and one master node EMR cluster with 120GB data storage >> left. I have been running sqoop jobs which loads data to hive table. After

[no subject]

Hi Guys, I have 4datanodes and one master node EMR cluster with 120GB data storage left. I have been running sqoop jobs which loads data to hive table. After some jobs ran successfully I suddenly see these errors all over the name node logs and datanodes logs. I have tried changing so many confi

passing configuration through connection string

Hi all, I am trying to fetch the data from hive using python code, which works for normal tables. But, for bucketed tables with transactions set true, it is throwing error ` This command is not allowed on an ACID table dbname.tblname with a non-ACID transaction manager. ` I have set the folowing

Re: Combining hive tables as one query

> >> >> You could of course then resave it in .csv format. But if the entire >> process needs to be automated within Hive, then my Hive query skills are >> not quite that advanced yet (I’ve only been using Hive for about a month). >> >> >> >> Paul

Re: Combining hive tables as one query

would be helpful, since it's not clear > why you need the iteration provided by "with recursive". If you really > need the iteration I don't think Hive can do what you want. > > Alan. > > On Tue, May 15, 2018 at 9:34 AM, Sowjanya Kakarala > wrote: > >

Re: Combining hive tables as one query

ins, as in all SQL engines. A google > search on "intro to SQL joins" will suggest a number of resources, for > example https://www.essentialsql.com/get-ready-to- > learn-sql-12-introduction-to-database-joins/ > > Alan. > > On Tue, May 15, 2018 at 7:37 AM, Sowjanya Kak

Combining hive tables as one query

Hi all, Is there a way in hive that different tables data, can be read as in a single query? example: (something like) select a,b from (select col1 from tbl1)a , (select col1 from tb2)b); output as : a b 0.1 0.2 Any help is appreciated. Thanks Sowjanya

org.apache.hadoop.ipc.RemoteException: when writing data from Sqoop to Hive

Hi everyone, I Have a general question, about how the mappers are assigned to a job that are running. I have looked for this in aws documents and apache hadoop sites for knowledge but still am little confused by seeing the error I am getting. Scenario: So I was running Sqoop commands(75873280 job

Re: insert overwrite to hive orc table in aws

mething? > > > > On Fri, 27 Apr 2018, 21:30 Sowjanya Kakarala, > wrote: > >> >> >> >> >>> Hi Guys, >>> >>> I am new to aws, I am not sure how the hive works and store the data in >>> aws. >>> >>> I have

ACID transactions table data not getting inserted

Hi all, I am using S3 location to store data in ORC table and I am not seeing any data from it any help here? Even I used default location which is HDFS it results the same in ORC 'no data'. hive> *create* *table* test_S3_*text*(cell_id int, run_date string, init_hour double, pet array, rainfall

Re: insert overwrite to hive orc table in aws

> Hi Guys, > > I am new to aws, I am not sure how the hive works and store the data in > aws. > > I have created a text table and orc table. where text table have data and > when I do insert overwrite from text table the qury runs fine and when I do > a count on orc table its zero. > > I have no cl

insert overwrite to hive orc table in aws

Hi Guys, I am new to aws, I am not sure how the hive works and store the data in aws. I have created a text table and orc table. where text table have data and when I do insert overwrite from text table the qury runs fine and when I do a count on orc table its zero. I have no clue where the data

Migrating data from Postgres to Hive using Sqoop

Hi Guys, I am trying to migrate one of the tables from Postgres database to Hive. Schema of Postgres: db=> \d table Table "public.table" Column |Type| Collation | Nullable | Default -++---+--+- cell_id | integ