Hello Ibrahim,
A quick questio. Are you planning to replace your SQL DB with Hive? If
that is the case, I would not suggest to do that. Both are meant for
entirely different purposes. Hive is for batch processing and not for real
time system. So if you are requirements involve real time things, you need
to think before moving ahead.
Yes, Sqoop is 'the' tool. It is primarily meant for this purpose.
HTH
Best Regards,
Tariq
+91-9741563634
https://mtariq.jux.com/
On Mon, Dec 24, 2012 at 6:38 PM, Ibrahim Yakti <iya...@souq.com> wrote:
> Hi All,
>
> We are new to hadoop and hive, we are trying to use hive to
> run analytical queries and we are using sqoop to import data into hive, in
> our RDBMS the data updated very frequently and this needs to be reflected
> to hive. Hive does not support update/delete but there are many workarounds
> to do this task.
>
> What's in our mind is importing all the tables into hive as is, then we
> build the required tables for reporting.
>
> My questions are:
>
> 1. What is the best way to reflect MySQL updates into Hive with
> minimal resources?
> 2. Is sqoop the right tool to do the ETL?
> 3. Is Hive the right tool to do this kind of queries or we should
> search for alternatives?
>
> Any hint will be useful, thanks in advanced.
>
> --
> Ibrahim
>
