Sean Meng created SQOOP-3356: -------------------------------- Summary: SQL Syntax Error Raised when Double Quotes Added for "check-column" Key: SQOOP-3356 URL: https://issues.apache.org/jira/browse/SQOOP-3356 Project: Sqoop Issue Type: Bug Components: connectors/oracle, metastore Affects Versions: 1.4.6 Reporter: Sean Meng
Goal: Implementing Sqoop Metastore to run daily incremental ETL. When executing the following Sqoop job: {code:java} sqoop job -Dmapreduce.job.queuename=D_NO_SLA \ --create yle0_gim_interaction_fact - import \ --connect "jdbc:oracle:thin:@//xxxx.xxxx.com:0000/xxxx" \ --username T0V0_DATALAKE_YLE0 \ --password-file /dev/xxxxxxx/YLE0_OAT.password --outdir ./sqoop/ \ --table RYLEINFOMART_2.INTERACTION_FACT \ --incremental append \ --check-column 'GREATEST(CREATE_AUDIT_KEY, UPDATE_AUDIT_KEY)' \ --last-value '53492217' --split-by 'CREATE_AUDIT_KEY' -m 16 --target-dir /dev/T0V0/hivedb/yle0/staging/yle0_gim_interaction_fact_staging/ \ --fields-terminated-by '\001'{code} Sqoop would automatically run the following query to update the max value: {code:java} SELECT MAX("GREATEST(CREATE_AUDIT_KEY, UPDATE_AUDIT_KEY)") FROM "RYLEINFOMART_2"."INTERACTION_FACT" {code} SQL syntax error was given since there shouldn't be double quotes around GREATEST() function. The proposal of using free form query is rejected since metastore cannot be implemented to automatically run the daily incremental job. -- This message was sent by Atlassian JIRA (v7.6.3#76005)