Re: Hive Stats shows numRows=0 when data imported through Sqoop

2015-04-17 Thread Suresh Kumar Sethuramaswamy
ore neither Peridale Ltd, its subsidiaries nor their employees accept > any responsibility. > > > > *From:* Suresh Kumar Sethuramaswamy [mailto:rock...@gmail.com > ] > *Sent:* 17 April 2015 16:46 > *To:* user@hive.apache.org > > *Subject:* Hive Stats shows numRows=0 whe

RE: Hive Stats shows numRows=0 when data imported through Sqoop

2015-04-17 Thread Mich Talebzadeh
maswamy [mailto:rock...@gmail.com] Sent: 17 April 2015 16:46 To: user@hive.apache.org Subject: Hive Stats shows numRows=0 when data imported through Sqoop Hi All, I'm using CDH 5.3.2 and i use sqoop to load data into hive tables. last statement of the sqoop import shows stats log whic

Hive Stats shows numRows=0 when data imported through Sqoop

2015-04-17 Thread Suresh Kumar Sethuramaswamy
Hi All, I'm using CDH 5.3.2 and i use sqoop to load data into hive tables. last statement of the sqoop import shows stats log which always shows [numFiles=,,numRows=0], am i missing any conffiguration here? Though I have set MySQL as stats db, auto stats doesn't seem to be working, but when I ru

RE: Hive Stats

2014-07-23 Thread Navdeep Agrawal
i digged into partitions params and checked out column_stats_accurate in metastore but found it to be true . From: Bala Krishna Gangisetty [mailto:b...@altiscale.com] Sent: Wednesday, July 23, 2014 12:46 AM To: user@hive.apache.org Subject: Re: Hive Stats What is the value of

RE: Hive Stats

2014-07-23 Thread Navdeep Agrawal
Hi , I am unable to see COLUMN_STATS_ACCURATE in desc formatted/extended ,but I think u r pointing to stats.reliable I have made that to false . From: Bala Krishna Gangisetty [mailto:b...@altiscale.com] Sent: Wednesday, July 23, 2014 12:46 AM To: user@hive.apache.org Subject: Re: Hive Stats

Re: Hive Stats

2014-07-22 Thread Bala Krishna Gangisetty
What is the value of "COLUMN_STATS_ACCURATE" field in "DESCRIBE FORMATTED " output under "Table Parameters" section. My suspect is, it's false even after executing your analyze query. If so, Hive launches the mapred jobs. Try using below analyze query: analyze table mytable partition(server_date=

Hive Stats

2014-07-22 Thread Navdeep Agrawal
i am trying to compute statistics on ORC File but i am unable see any changes in PART_COL_STATS as well on using set hive.compute.query.using.stats=true; set hive.stats.reliable=true; set hive.stats.fetch.column.stats=true; set hive.stats.fetch.partition.stats=true; set hive.cbo.enable=true; to