Re: How to load a web log file (text format) to Hive with compression

2013-11-11 Thread Vijay
Hive has built-in support for gzipped text files so you don't need to do anything special with them (meaning you just load them like regular files). However, there is one important limitation with this approach these files are not splittable. Depending on the size of your log files and how many of

How to load a web log file (text format) to Hive with compression

2013-11-11 Thread Raj Hadoop
Hi, I have a web log files (text format). I want to load these files to a Hive table in compressed format. How do I do it ? Should I compress the text file (using any Linux utilities) and then create the Hive table? Can any one provide me the Hive syntax for loading the compressed file? Thank