[ https://issues.apache.org/jira/browse/SQOOP-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16837237#comment-16837237 ]
Denes Bodo commented on SQOOP-3438: ----------------------------------- I do not know why I created this as a BUG. Now type is changed to improvement. > Sqoop Import with create hcatalog table for ORC will not work with Hive3 as > the table created would be a ACID table and transactional > ------------------------------------------------------------------------------------------------------------------------------------- > > Key: SQOOP-3438 > URL: https://issues.apache.org/jira/browse/SQOOP-3438 > Project: Sqoop > Issue Type: Improvement > Components: hive-integration > Affects Versions: 1.4.7 > Reporter: Denes Bodo > Assignee: Denes Bodo > Priority: Critical > Time Spent: 1.5h > Remaining Estimate: 0h > > PROBLEM: Running a sqoop import command with the option > --create-hcatalog-table will not work due to the following reasons > When create-hcatalog-table is used it creates the table as a Managed ACID > table. > HCatalog does not support transactional or bucketing table > So customer who need to create a ORC based table cannot use sqoop to create a > ORC based table which means their existing code where if in case they use > sqoop to create these tables would fail. > The current workaround is a two step process > 1. Create the ORC table in hive with the keyword external and set > transactional to false > 2. Then use the sqoop command to load the data into the orc table. > The request is to add in an extra argument in the sqoop command line to > specify that the table is external (example: --hcatalog-external-table )so we > can use the option --hcatalog-storage-stanza "stored as orc tblproperties > (\"transactional\"=\"false\")". > ---- > Thank you [~mbalakrishnan] for your findings. This ticket is created based on > your work. -- This message was sent by Atlassian JIRA (v7.6.3#76005)