When hive.optimize.sort.dynamic.partition is off hive opens a file writer
for each new partition key as it is encountered and writes records to those
appropriate files. Since the parquet writer buffers writes in memory before
flushing to disk it can lead to OOMs when you have lots of partitions/ope
Any one tried this? Please help me if you have any knowledge on this kind of
use case.
From: yogesh.keshe...@outlook.com
To: user@hive.apache.org
Subject: Dynamic partitioned parquet tables
Date: Fri, 9 Oct 2015 11:20:57 +0530
Hello,
I have a question regarding parquet tables. We have
