Re: Spark development with IntelliJ

2015-04-17 Thread tanejagagan
This was little bit of frustration to get this working with Intellij IDEA 14.1 Clearing the Additional Compiler option was not fixing the issueI had to add following to Settings->Build Execution, Deployment-> S

Re: Support for Hive buckets

2014-12-24 Thread tanejagagan
(for example, you might be able to avoid a shuffle when doing joins on tables that are already bucketed by exposing more metastore information to the planner). Can you provide more input on how to implement this functionality so that i can speed up join between 2 hive tables, both with few bill