Re: Partition by directory

2012-12-14 Thread Mark Grover
Erik, Did you find out the answer to this? I would be curious to hear what the problem is. BTW, I would check the hive logs (/var/log/apps/hive or /var/log/hive or similar on EMR). Try increasing the log level and see if that helps. Given that EMR comes with it's own distribution of Hive (which t

Partition by directory

2012-12-10 Thread Erik Thorson
Hello All, I have been using the AWS setup for EMR for some time now and I am currently in the process of implementing spark/shark on my own cluster. I am installing from https://github.com/downloads/mesos/spark/spark-0.6.0-sources.tar.gz. Which includes hive0.9.0. I am using this with s3 and a