Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-18 Thread Mich Talebzadeh
just to clarify you mean: Hive 2.1.1 works with Spark engine 2.X Thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.

Re: setup spark engine to hive ,the hive version and spark build problem

2017-06-18 Thread vergil
Hi,dear friend 1.After I try it and read the source code,I find that hive on spark2.X do works on hive 2.2.0 2.2.1 version and 2.4.x version which includes this commit history https://github.com/apache/hive/commit/ac977cc88757b49fbbd5c3bb236adcedcaae396c.I use the 2.2.0 version now. 2.Hive on s

hive.cli.print.row.to.vertical does not exist

2017-06-18 Thread baipeng
Hi, When I input set hive.cli.print.row.to.vertical=true ,the result is Query returned non-zero code: 1, cause: hive configuration hive.cli.print.row.to.vertical does not exists. Can anyone tell me how to solve this problem?

Format dillema

2017-06-18 Thread rakesh sharma
We are facing an issue of format. We would like to do bi style queries from hive using impala and that supports parquet but we would like the data to be compressed to the best ratio like orc. But impala cannot query orc formats. What can be a design consideration for this. Any help Thanks Rakes