Re: 答复: [ANNOUNCE] New Hive Committer - Wei Zheng

2016-03-10 Thread Daniel Lopes
ve Committer - Wei Zheng > > Congratulations Wei Zheng > > Thanks, > MAdhu > Help ever, Hurt never > > > > > -- *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55

hive memory error: GC overhead limit exceeded

2016-02-23 Thread Daniel Lopes
t;kill -9 15759 kill -9 15759"... Execution failed with exit status: 137 Obtaining error information Task failed! Task ID: Stage-35 Logs: /var/log/hive/user/hadoop/hive.log Best, -- *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.

Spark 1.5.2 + Hive 1.0.0 in Amazon EMR 4.2.0

2015-11-30 Thread Daniel Lopes
onseProcessingTime=[0.169], HttpClientSendRequestTime=[0.145], 15/11/30 21:40:21 WARN RetryingMetaStoreClient: MetaStoreClient lost connection. Attempting to reconnect. org.apache.thrift.TApplication*Exception: Invalid method name: 'alter_table_with_cascade'* Thanks! -- *Daniel Lopes, B.Eng*

Re: Best way to load CSV file into Hive

2015-10-30 Thread Daniel Lopes
> the intended recipient. If you receive this e-mail in error please delete > it from your system immediately and notify us either by e-mail or > telephone. You should not copy, forward or otherwise disclose the content > of the e-mail. The views expressed in this communication may not

Hive 1.0.0 Error: cannot be cast

2015-10-23 Thread Daniel Lopes
e(CommonJoinOperator.java:408) at org.apache.hadoop.hive.ql.exec.MapJoinOperator.processOp(MapJoinOperator.java:295) ... 13 more FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Stage-Stage-8: Map: 1 HDFS Read: 0 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 0 m

Better way to do UDF's for Hive

2015-10-01 Thread Daniel Lopes
how to do in a good way. Thanks, *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannyeuu Av. Nova Independência, 956, São

Re: Failed to execute command on hive - Relative path in absolute URI

2015-10-01 Thread Daniel Lopes
Hi, To call a hive conf, get by this: ${hiveconf:NAME_OF_PROPERTY} Bye *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannye

Re: Organising Hive Scripts

2015-09-14 Thread Daniel Lopes
Thanks Erwan, I needed this too, and works fine for me. *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannyeuu Av

Re: Subquery in select statement

2015-09-08 Thread Daniel Lopes
Sorry, but there are something that I can do in this case? *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannyeuu Av

Re: [ANNOUNCE] New Hive Committer - Lars Francke

2015-09-08 Thread Daniel Lopes
Congrats! *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP 5069410560 <http://edital.confea.org.br/ConsultaProfissional/cartao.aspx?rnp=2613651334> Mob +55 (18) 99764-2733 Ph +55 (11) 3522-8009 http://about.me/dannyeuu Av. Nova Independência, 956, São Paulo, SP Bairro Brooklin Pa

Subquery in select statement

2015-09-03 Thread Daniel Lopes
Hi, There are somthing that I can do this? SELECT tb.id, (SELECT tb3.field FROM database.table2 tb2 JOIN database.table3 tb3 ON ( tb3.id = tb2.table3_id) ORDER BY tb3.date DESC LIMIT 1) AS tb3_field FROM database.table1 tb1 Best, *Daniel Lopes, B.Eng* Data Scientist - BankFacil CREA/SP