Re: Changing compression format of existing table from snappy to zlib

2018-03-14 Thread Gopal Vijayaraghavan
Hi, > Would this also ensure that all the existing data compressed in snappy format > and the new data stored in zlib format can work in tandem with no disruptions > or issues to end users who query the table. Yes. Each file encodes its own compressor kind & readers use that. The writers u

Changing compression format of existing table from snappy to zlib

2018-03-14 Thread Gopi Krishnan
Hello, I have a Hive table with few a petabytes of data which is compressed in snappy format. This is a managed table in ORC format. Now I want to change the compression format of table to zlib from snappy. Can I use the alter table command to update the table properties? Would this also ensure th

Re: Best way/tool to debug memory leaks in HiveServer2

2018-03-14 Thread rajan sthapit
I tried getting the histo as you suggested jmap -histo:live ${PID} However, it only shows the histo of the live objects https://gist.github.com/anonymous/669eae8128c9a11f72fcdc1f82270460. Also the total memory from the histogram shows to be around 5GB. However, if I look at the total process m