That might be the truth. When I switched to a 4gb node it just worked.
Thanks
On Tue, Mar 29, 2022 at 8:49 PM Pau Tallada wrote:
> I don't know what to say.
> It it fails of OutOfMemory, then you have to assign more memory to it.
>
> Also a, 2GB VM for a hadoop node is too tiny. Hadoop ecosyste
I don't know what to say.
It it fails of OutOfMemory, then you have to assign more memory to it.
Also a, 2GB VM for a hadoop node is too tiny. Hadoop ecosystem is usually
memory-intensive
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:46:
> Yes, a quite small table with 1 rows for
Yes, a quite small table with 1 rows for test purposes.
Thanks
On Tue, Mar 29, 2022 at 8:43 PM Pau Tallada wrote:
> Hi,
>
> I think it depends a lot on the data volume you are trying to process.
> Does it work with a smaller table?
>
> Missatge de Bitfox del dia dt., 29 de març 2022 a les
Hi,
I think it depends a lot on the data volume you are trying to process.
Does it work with a smaller table?
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:39:
> 0: jdbc:hive2://localhost:1/default> set hive.tez.container.size=1024;
>
> No rows affected (0.027 seconds)
>
>
> 0: j
0: jdbc:hive2://localhost:1/default> set hive.tez.container.size=1024;
No rows affected (0.027 seconds)
0: jdbc:hive2://localhost:1/default> set hive.execution.engine;
+---+
|set|
+---+
| hive.execution.engine=mr
I assume you have to increase container size (if using tez/yarn)
Missatge de Bitfox del dia dt., 29 de març 2022 a les
14:30:
> My hive run out of memory even for a small query:
>
> 2022-03-29T20:26:51,440 WARN [Thread-1329] mapred.LocalJobRunner:
> job_local300585280_0011
>
> java.lang.Excepti
> ,row_number() over ( PARTITION BY A.dt,A.year, A.month,
>A.bouncer,A.visitor_type,A.device_type order by A.total_page_view_time desc )
>as rank
from content_pages_agg_by_month A
The row_number() window function is a streaming function, so this should not
consume a significant p
and Level 3, Cybercity, Magarpatta, Hadapsar Pune, Maharashtra, 411
013
off: +91-20-30418810
[Description: untitled]
"When the solution is simple, God is answering…"
From: Jörn Franke
Sent: 10 January 2019 PM 01:29
To: user@hive.apache.org
Cc: Shashikant Deore
Subject: Re: Out Of
Which hive version and engine?
If it is tez then you can also try mr as an engine set hive.execution.engine=mr
that will use less memory. Check also the max heap space configuration on the
nodes . Maybe you have physically 16 gb memory but the Java process takes only
4 or so memory.
Maybe your
