Re: Hive Problem in Pig generated Parquet file schema in CREATE EXTERNAL TABLE (e.g. bag::col1)

2014-12-23 Thread Jianshi Huang
FYI, Latest hive 0.14/parquet will have column renaming support. Jianshi On Wed, Dec 10, 2014 at 3:37 AM, Michael Armbrust wrote: > You might also try out the recently added support for views. > > On Mon, Dec 8, 2014 at 9:31 PM, Jianshi Huang > wrote: > >> Ah... I see. Thanks for pointing it

Re: Tuning Spark Streaming jobs

2014-12-23 Thread Timothy Chen
Hi Gerard, SPARK-4286 is the ticket I am working on, which besides supporting shuffle service it also supports the executor scaling callbacks (kill/request total) for coarse grain mode. I created SPARK-4940 to discuss more about the distribution problem, and let's bring our discussions there. Ti