her
servers, and it is never received.
Is there any configuration I am missing?
FYI, I'm am using HDP 2.4 with default configuration.
Has somebody made it work?
Thanks!
Pau.
--
----------
Pau Tallada Crespí
Dep. d'Astrofísica i Cosmologia
Port d'Informació Científica (PIC)
Tel: +34 93 586 8233
--
Hi Antoine,
Yes, I think you can replace the files backing a table (external or
managed) and if they conform to the same schema it should work. Remember
that you should regenerate the statistics afterwards.
For partitioned tables, you should run "MSCK REPAIR" after creating the new
directory and
ket each small table based on the id column, but
> this did not give us the desired result as the shuffling was still happening
>
>
> Can anyone suggest what is the best approach to go with in the above
> scenario?
>
--
--
Pau Tallada Crespí
Dep. d'Astrofísica i Cosmologia
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
hi!
alter table db1.tablename rename to db2.tablename
Cheers!
On Wed, Oct 30, 2019, 08:16 qq <987626...@qq.com> wrote:
> Hello:
>How to migrate a table of a Hive database to another database?
>For example:
>Hive contains two databases: databaseA and databaseB. I want to
reply！
>
>
> -- 原始邮件 --
> *发件人:* "我自己的邮箱"<987626...@qq.com>;
> *发送时间:* 2019年10月30日(星期三) 下午3:59
> *收件人:* "user"; "user";
> *主题:* 回复: How to migrate a table of a Hive database to another database
>
> think you very much
>
;/var/log/hadoop-yarn/containers/application_10/container_11/stderr
>>>
>>> |- 1253 1234 1234 123 (java) 1253 1234 1234 123
>>> /usr/lib/jvm/java-openjdk/bin/java -Xmx819m
>>> -Djava.io.tmpdir=/mnt/yarn/usercache/hadoop/appcache/application_10/container_11/tmp
>>> -server -Djava.net.preferIPv4Stack=true -Dhadoop.metrics.log.level=WARN
>>> -XX:+PrintGCDetails -verbose:gc -XX:+PrintGCTimeStamps -XX:+UseNUMA
>>> -XX:+UseParallelGC
>>> -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator
>>> -Dlog4j.configuration=tez-container-log4j.properties
>>> -Dyarn.app.container.log.dir=/var/log/hadoop-yarn/containers/application_10/container_11
>>> -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel=
>>> org.apache.tez.dag.app.DAGAppMaster --session
>>>
>>> Container killed on request. Exit code is 143
>>>
>>> Container exited with a non-zero exit code 143
>>>
>>>
>>>
>>>
--
--
Pau Tallada Crespí
Dep. d'Astrofísica i Cosmologia
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
tioning.
>
> Thanks,
> Sai.
>
> On Thu, Nov 14, 2019 at 12:43 PM Pau Tallada wrote:
>
>> Hi,
>>
>> The error is from the AM (Application Master), because it has s
>> many partitions to orchestrate that needs lots of RAM.
>> As Venkat said, try
>
> Also, You are right my Cluster capacity is very less. But, do you suggest
> we should keep on increasing the resources as the data grows.
>
> Thanks,
> Sai.
>
> On Fri, Nov 15, 2019 at 9:41 AM Pau Tallada wrote:
>
>> Hi Sai,
>>
>> Let me summarize some
ing Hive and/or
> assisting my engineers in preventing these errors?
> Thanks,
>
>
--
--
Pau Tallada Crespí
Dep. d'Astrofísica i Cosmologia
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
n advance for your help.
>
> Regards
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
can not copy file from local/remote system to Hdfs using
> webHDFS. please advise
>
> Regards
>
> On Sat, 18 Apr 2020, 1:20 am Pau Tallada, wrote:
>
>> Hi,
>>
>> You have to use HTTP requests to interact with an webhdfs endpoint.
>>
>> See: https://
partition.spec'='...');
>>
>>
>> I am looking for a way to rewrite the original (Hive syntactically not
>> correct) query to a new (syntactically correct) one.
>>
>> I was checking the hooks as a possible solution, but I have found that:
>>
&
Hi all,
I'm trying to understand (for the last months) why SMB joins (the most
efficient ones) are unable to work with partitions.
All my being tells me it should work but, it doesn't. I would really,
really, (really!) appreciate any insights on this problem.
First, the working example without pa
t; > set hivevar:start_tm=current_timestamp();
> >
> > select ${hivevar:start_tm};
> >
> > select query;__
> >
> > select ${hivevar:start_tm};
> >
> >
> > Here the start_tm variable calculates every time the c
')
>
>
> So I am asking Hive 3 doesn't support java 11 yet?
>
>
> Thanks.
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
Is it only me or the https://hive.apache.org/ web is showing a directory
listing?!
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
552)
> ~[hadoop-mapreduce-client-common-3.3.2.jar:?]
>
> Caused by: java.lang.OutOfMemoryError: Java heap space
>
>
>
> hadoop-3.3.2
>
> hive-3.1.2
>
> java version "1.8.0_321"
>
>
>
> How to fix this? thanks.
>
>
>
>
--
-
t;
> Sorry my test VM has 2gb Ram only. So I set all the above memory size to
> 1GB.
>
> But it still gets the same error.
>
>
>
> please help. thanks.
>
>
>
> On Tue, Mar 29, 2022 at 8:32 PM Pau Tallada wrote:
>
>> I assume you have to increa
000 rows for test purposes.
>
> Thanks
>
> On Tue, Mar 29, 2022 at 8:43 PM Pau Tallada wrote:
>
>> Hi,
>>
>> I think it depends a lot on the data volume you are trying to process.
>> Does it work with a smaller table?
>>
>> Missatge de Bitfox del di
ixed mode)
>
>
>
> But I can't enable tez execution engine for hive-3.1.2.
>
> Do you have a guide for this?
>
>
> Thanks in advance.
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
> >> And java:
> >>
> >>
> >> $ java -version
> >>
> >> java version "1.8.0_321"
> >>
> >> Java(TM) SE Runtime Environment (build 1.8.0_321-b07)
> >>
> >> Java HotSpot(TM) 64-Bit Server VM (build
>
> Query ID = pyh_20220514061049_da0bd690-080d-4acc-8ef8-d2a2c04b75c6
>
> Total jobs = 1
>
> Launching Job 1 out of 1
>
> FAILED: Execution Error, return code 1 from
> org.apache.hadoop.hive.ql.exec.tez.TezTask
>
>
>
> Can you help?
>
>
> Thank you.
>
>
>
> O
ere either :(
Am I doing something wrong? This feature/behaviour is greatly needed when
working with statistical analysis of huge datasets...
Any help would be greatly appreciated 🤔
Cheers,
Pau.
--
------
Pau Tallada Crespí
Departament de Serveis
Port d&
Can you provide more information?
what kind of error?
what sql sentence?
Cheers
On Mon, Aug 22, 2022, 18:10 qq <987626...@qq.com> wrote:
> Hello：
>
> In HIve on Tez mode, an error occurs when the select statement is
> executed with hive.optimize.bucketmapjoin.sortedmerge=true.
> Does an
tatic site generators. I was able to get a hugo version of
> the
> > site up very quickly with a landing page and docs and hugo also makes
> > maintaining the site very simple.
> >
> > Please have a look. Any feedback is much appreciated.
> >
> > Existing websit
;t really compare to that database. My current fix doesn't
>> disable this, but it does change the behavior to return NULL on this select.
>>
>>
>> I kinda feel that returning NULL is more correct than return 0, but I
>> wanted to throw this out there to see what y'all think. This would be a
>> change in behavior and that makes me nervous.
>>
>> Thanks!
>>
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
ve Community,
>>>
>>> Apache Hive PMC is pleased to announce that Ayush Saxena has accepted
>>> the Apache Hive PMC's invitation to become PMC Member, and is now our
>>> newest PMC member. Many thanks to Ayush for all the contributions he has
>>> made and looking forward to many more future contributions in the expanded
>>> role.
>>>
>>>
>>>
>>> Please join me in congratulating Ayush !!!
>>>
>>>
>>>
>>> Cheers,
>>>
>>> Naveen (on behalf of Hive PMC)
>>>
>>>
>>>
>>>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
>> I have all of them installed in the same system to work together.
>> This is how I did,
>>
>> https://blog.crypt.pw/How-to-run-Hadoop-3.3-and-Hive-3.1-in-same-node
>>
>> Hope it also helps to you too.
>>
>> Thanks.
>>
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
member. Please join me in congratulating Stamatis !!!
>> > >
>> > >
>> > >
>> > > He has been an active member in the hive community across many
>> aspects of
>> > > the project. Many thanks to Stamatis for all the contributions he has
>> > made
>> > > and looking forward to many more future contributions in the expanded
>> > role.
>> > >
>> > >
>> > >
>> > > Cheers,
>> > >
>> > > Naveen (on behalf of Hive PMC)
>> > >
>> >
>>
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
_table
TABLESAMPLE(0.1 PERCENT)
=>
*25 tasks*
* HDFS_BYTES_READ = 45484944 (45M)*
Please, any hint would be greatly appreciated!
[1] https://cosmohub.pic.es
[2] https://cwiki.apache.org/confluence/display/hive/languagemanual+sampling
--
------
Pau Tallada Crespí
De
5-0290-492f-aef8-c0249de328ad
>>>> HiveServer2-Handler-Pool: Thread-59] SessionState: No Stats for
>>>> tpcds_bin_partitioned_orc_1000@customer, Columns: c_customer_sk,
>>>> c_customer_id
>>>>
>>>> 2018-06-12T23:50:05,158 ERROR [b3041385-0290-492f-aef8-c0249de328ad
>>>> HiveServer2-Handler-Pool: Thread-59] annotation.StatsRulesProcFactory:
>>>> Invalid column stats: No of nulls > cardinality
>>>> 2018-06-12T23:50:05,159 ERROR [b3041385-0290-492f-aef8-c0249de328ad
>>>> HiveServer2-Handler-Pool: Thread-59] annotation.StatsRulesProcFactory:
>>>> Invalid column stats: No of nulls > cardinality
>>>> 2018-06-12T23:50:05,160 ERROR [b3041385-0290-492f-aef8-c0249de328ad
>>>> HiveServer2-Handler-Pool: Thread-59] annotation.StatsRulesProcFactory:
>>>> Invalid column stats: No of nulls > cardinality
>>>>
>>>> However, even after computing column stats, queries still return wrong
>>>> results, despite the fact that the above log messages disappear.
>>>>
>>>> I guess I am missing some configuration parameters (because I imported
>>>> hive-site.xml from Hive 2). Any suggestion would be appreciated.
>>>>
>>>> Thanks a lot,
>>>>
>>>> --- Sungwoo Park
>>>>
>>>>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
)
>
>
>
> For Hive release details and downloads, please visit:
>
> https://hive.apache.org/downloads.html
>
>
>
> Hive 4.0.0 Release Notes are available here:
>
>
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12343343&styleName=Text&projectId=12310843
>
>
>
> We would like to thank the many contributors who made this release
>
> possible.
>
>
>
> Regards,
>
>
>
> The Apache Hive Team
>
>
--
--
Pau Tallada Crespí
Departament de Serveis
Port d'Informació Científica (PIC)
Tel: +34 93 170 2729
--
org> 代表 Ayush Saxena <
>>> ayush...@gmail.com>
>>> *发送时间**:* 星期四, 四月 18, 2024 7:50 下午
>>> *收件人**:* dev ; user@hive.apache.org <
>>> user@hive.apache.org>
>>> *主题**:* [ANNOUNCE] New Committer: Simhadri Govindappa
>>>
>>>
&
ther updates or releases will be made for this release
> line.
>
> We urge all Hive 3.x users to upgrade to the latest versions promptly
> to benefit from new features and ongoing support.
>
> -Ayush Saxena
> (On Behalf of Apache Hive PMC)
>
--
----------
34 matches
Mail list logo
