Simplest way to create partition hierarchies

2014-10-05 Thread Saumitra Shahapure (Vizury)
Hello, We are using hive 0.12. We have a large directory in S3 where we dump daily logs of various application servers s3://logs/20141005/machine1/log.gz s3://logs/20141005/machine2/log.gz s3://logs/20141006/machine1/log.gz s3://logs/20141006/machine2/log.gz In Hive, we have mapped it to table

Re: Tez Vertex failure

2014-10-05 Thread Echo Li
I try another query and was able to fetch the logs: query: select ymd,count(1),count(distinct sessionId) from visit where ymd<=20140831 group by ymd order by ymd ; in app logs: 2014-10-05 17:32:58,520 INFO [ORC_GET_SPLITS #4] org.apache.hadoop.hive.ql.io.orc.OrcInputFormat: ORC pushdown predicat

Re: Tez Vertex failure

2014-10-05 Thread Echo Li
Thanks guys, these are great info. - it works fine when use "set hive.execution.engine=mr" - there is nothing else printed after the exception; and no application logs either is this a bug? On Fri, Oct 3, 2014 at 6:39 PM, Gopal V wrote: > On 10/3/14, 5:20 PM, Echo Li wrote: > >> thanks for re