Daniel Voros created SQOOP-3336: ----------------------------------- Summary: Splitting on integer column can create more splits than necessary Key: SQOOP-3336 URL: https://issues.apache.org/jira/browse/SQOOP-3336 Project: Sqoop Issue Type: Bug Affects Versions: 1.4.7 Reporter: Daniel Voros Assignee: Daniel Voros Fix For: 1.5.0, 3.0.0
Running an import with {{-m 2}} will result in three splits if there are only three consecutive integers in the table ({{\{1, 2, 3\}}}). Work is (probably) spread more evenly between mappers this way, but ending up with more files than expected could be an issue. Split-limit can also result in more values than asked for in the last chunk (due to the closed interval in the end). -- This message was sent by Atlassian JIRA (v7.6.3#76005)