Thanks guys, these are great info. - it works fine when use "set hive.execution.engine=mr"
- there is nothing else printed after the exception; and no application logs either is this a bug? On Fri, Oct 3, 2014 at 6:39 PM, Gopal V <gop...@apache.org> wrote: > On 10/3/14, 5:20 PM, Echo Li wrote: > >> thanks for reply! >> >> the query is: *select count(customerid) from tableName where ymd=20140930 >> ;* >> > > That is simple enough that it should work anyway. > > There is strong possibility that the rest of that RuntimeException gives a > clue to the problem - if anything is printed. > > Since the mappers are stuck at -/-, I would speculate that ORC split > generation is failing on Google Cloud Storage. > > The data you need to collect can be collected via > > "yarn logs -applicationId application_1412033199033_6623" > > which will be more helpful in locating the root-cause of the issue. > > Cheers, > Gopal > > > >> when I try to get the application logs only got this: >> >> >> >> >> >> >> >> >> >> >> *dag_1412033199033_6639_1.dot : Total file length is 1562 bytes.stderr : >> Total file length is 0 bytes.stderr_dag_1412033199033_6639_1 : Total file >> length is 0 bytes.stderr_dag_1412033199033_6639_1_post : Total file >> length >> is 0 bytes.stdout : Total file length is 0 >> bytes.stdout_dag_1412033199033_6639_1 : Total file length is 0 >> bytes.stdout_dag_1412033199033_6639_1_post : Total file length is 0 >> bytes.syslog : Total file length is 7436 >> bytes.syslog_dag_1412033199033_6639_1 : Total file length is 14695 >> bytes.syslog_dag_1412033199033_6639_1_post : Total file length is 136 >> bytes.* >> >> Also when I run this query: select * from visit where ymd=20140930 limit >> 10; >> got error: >> *Failed with exception java.io.IOException:java.lang.RuntimeException: >> serious problem* >> >> The table is ORC format, in google cloud storage. >> >> >> On Fri, Oct 3, 2014 at 4:54 PM, Vikram Dixit <vik...@hortonworks.com> >> wrote: >> >> Hi, >>> >>> Can you share the query and the application logs with us? Which >>> version of hive is this? >>> >>> Thanks >>> Vikram. >>> >>> On Fri, Oct 3, 2014 at 4:51 PM, Echo Li <echo...@gmail.com> wrote: >>> > Hi guys, >>> > >>> > I run some simple hive query and got the error below: >>> > >>> > Status: Running (application id: application_1412033199033_6623) >>> > >>> > Map 1: -/- Reducer 2: 0/1 >>> > Status: Failed >>> > Vertex failed, vertexName=Map 1, vertexId=vertex_1412033199033_ >>> 6623_1_01, >>> > diagnostics=[Vertex Input: visit initializer failed., serious problem] >>> > Vertex killed, vertexName=Reducer 2, >>> > vertexId=vertex_1412033199033_6623_1_00, diagnostics=[Vertex received >>> Kill >>> > in INITED state.] >>> > DAG failed due to vertex failure. failedVertices:1 killedVertices:1 >>> > FAILED: Execution Error, return code 2 from >>> > org.apache.hadoop.hive.ql.exec.tez.TezTask >>> > >>> > >>> > Any idea what's the cause and what's the fix? I suspect its some sort >>> data >>> > issue as it only happens to certain partitions, anybody had any >>> experience >>> > on this? >>> > >>> > Thanks guys. >>> > >>> > >>> >>> -- >>> CONFIDENTIALITY NOTICE >>> NOTICE: This message is intended for the use of the individual or entity >>> to >>> which it is addressed and may contain information that is confidential, >>> privileged and exempt from disclosure under applicable law. If the reader >>> of this message is not the intended recipient, you are hereby notified >>> that >>> any printing, copying, dissemination, distribution, disclosure or >>> forwarding of this communication is strictly prohibited. If you have >>> received this communication in error, please contact the sender >>> immediately >>> and delete it from your system. Thank You. >>> >>> >> >> >
