If all you want to do is to load data into Hive, you don't need to use
Spark.
For subsequent query performance you would want to convert to ORC or
Parquet when loading into Hive.
Regards
Sab
On 16-Dec-2015 7:34 am, "Divya Gehlot" wrote:
> Hi,
> I am new bee to Spark and I am exploring option a
Hi,
I am new bee to Spark and I am exploring option and pros and cons which
one will work best in spark and hive context.My dataset inputs are CSV
files, using spark to process the my data and saving it in hive using
hivecontext
1) Process the CSV file using spark-csv package and create temptab