Hi All, We are trying to load data from Sybase Iq table to hive using sqoop. The hive table is partitioned and expecting to hold 29M records per day.
The sqoop job takes 7 hours to load 15 days of data, even while setting the direct load option to 6. Hive is using MR framework. Is there is way to speed up the process. Note - the aim is to load 1 year of data
