: Problems with Hive Streaming. Compactions not working. Out of
memory errors.
I’m guessing that this is an issue in the metastore database where it is unable
to read from the transaction tables due to the ingestion rate. What version of
Hive are you using? What database are you storing the m
The OOM is most likely a side effect of not running compactions.
W/o compactions you never reduce the number of delta file that
need to be loaded to materialize the data set on read.
On 11/29/16, 10:03 AM, "Alan Gates" wrote:
>I¹m guessing that this is an issue in the metastore database where it
I’m guessing that this is an issue in the metastore database where it is unable
to read from the transaction tables due to the ingestion rate. What version of
Hive are you using? What database are you storing the metadata in?
Alan.
> On Nov 29, 2016, at 00:05, Diego Fustes Villadóniga wrote:
