Re: Failed to use sqoop-1.4.3 job tool on hadoop-2.1.0-beta

2013-11-19 Thread sam liu
rage.version','0') INSERT INTO SQOOP_ROOT VALUES(0,'sqoop.hsqldb.job.info.table','SQOOP_SESSIONS') 2013/11/20 sam liu > I am confusing these exceptions... For using 'sqoop job --list' command, > sqoop will connect to hsqldb, and need hsqldb has

Re: Failed to use sqoop-1.4.3 job tool on hadoop-2.1.0-beta

2013-11-19 Thread sam liu
I am confusing these exceptions... For using 'sqoop job --list' command, sqoop will connect to hsqldb, and need hsqldb has a database for storing sqoop job metadata in advance, right? 2013/11/19 sam liu > Updated the exception info: > > > Now I failed to run sqoop-1.4.

Re: Failed to use sqoop-1.4.3 job tool on hadoop-2.1.0-beta

2013-11-18 Thread sam liu
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) 2013/11/19 sam liu > Hi Experts, > > My cluster is hadoop-2.1.0-beta and it requires hsqldb-2.0.0.jar. At the > same time, my sqoop is 1.4.3, and it requires hsqldb-1.8.0.10.jar. > > Now I f

Failed to use sqoop-1.4.3 job tool on hadoop-2.1.0-beta

2013-11-18 Thread sam liu
java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) Is it a defect of Sqoop? Thanks! -- Sam Liu

Re: Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files

2013-09-10 Thread sam liu
ft some comment there, thank you for > contributing that work! > > Jarcec > > On Tue, Sep 10, 2013 at 11:22:15AM +0800, sam liu wrote: > > Hi Jarcec, > > > > Hadoop-2.10-beta upgraded protobuf to 2.5 from 2.4.1, but the version of > > protobuf in my env is still

Re: Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files

2013-09-09 Thread sam liu
m! > > Jarcec > > On Mon, Sep 09, 2013 at 01:33:59PM +0800, sam liu wrote: > > Hi Jarek, > > > > I opened jira SQOOP-1195(UnsupportedOperationException occurs on > > TestAllTables of Sqoop-1.4.3 with Hadoop-2.1.0-beta jar > > files)<https://issues.apache.org

Re: Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files

2013-09-08 Thread sam liu
ing this out! Hadoop 2.1.0 do not necessary > have to be API compatible with the 2.0.0. I would suggest you to create a > JIRA to upgrade the dependency on hadoop 2 to 2.1.0-beta and solve the > failing test cases there. > > Jarcec > > On Fri, Sep 06, 2013 at 05:39:16PM +0800, s

Error occurs on TestAllTables using Hadoop-2.1.0-beta jar files

2013-09-06 Thread sam liu
Hi, For Sqoop-1.4.3 project, I updated build.xml and ivy.xml file to try to run build/UT with Hadoop-2.1.0-beta jar files. The compile could be successful. However, encounter following error when run UT. Any comments? Thanks!

Re: Why sqoop picks up hsqldb driver jar when connect to mysql db?

2013-08-19 Thread sam liu
e background. > > I've tried both 1.4.3 and 1.4.3 releases on BigTop 0.6 (that is based on > Hadoop 2.0.5-alpha) and both were working for me without any issues, so I'm > wondering what Hadoop version are you using? > > Jarcec > > On Wed, Aug 07, 2013 at 02:56:47

Re: Why sqoop picks up hsqldb driver jar when connect to mysql db?

2013-08-06 Thread sam liu
;. Thanks! 2013/8/7 Abraham Elmahrek > Sam, > > Did you try the --driver parameter? It allows you to choose the JDBC > driver class. > > -Abe > > > On Tue, Aug 6, 2013 at 7:54 PM, sam liu wrote: > >> I think this is a defect of Sqoop, and opened a jira for it:

Re: Why sqoop picks up hsqldb driver jar when connect to mysql db?

2013-08-06 Thread sam liu
should be mentioned that when we have many dirver jar files under sqoop/lib folder for multiple kinds of databases, or a script will connect to different databases, this workaround can not work well. Thanks! 2013/8/6 sam liu > Hi Experts, > > Under SQOOP/lib, I have both hsqldb driver

Why sqoop picks up hsqldb driver jar when connect to mysql db?

2013-08-05 Thread sam liu
g.apache.sqoop.Sqoop.runTool(Sqoop.java:220) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) -- Sam Liu

Re: Issue against Hadoop-2.0.4-alpha

2013-07-23 Thread sam liu
Hi Jarek, This issue still exists, and below is the output of jinfo: Attaching to process ID 11998, please wait... Debugger attached successfully. Client compiler detected. JVM version is 20.6-b01 Java System Properties: java.runtime.name = Java(TM) SE Runtime Environment sun.boot.library.path

Re: Issue against Hadoop-2.0.4-alpha

2013-07-21 Thread sam liu
Hi Jarek, Sqoop import tool still failed on my hadoop 2.x cluster, and above is my core-site.xml. can you help take a look at it? Thanks! 2013/7/19 sam liu > Hi Jarek, > > Yes, the hdfs-site.xml file is in ${HADOOP_HOME}/etc/hadoop. I also added > hadoop related jars into CLASSPA

Re: Issue against Hadoop-2.0.4-alpha

2013-07-18 Thread sam liu
t; to know the content of core-site.xml file. I would suggest to explore the > classpath that Sqoop will end up having (for example using jinfo) and > verify whether there are HDFS jars available. > > Jarcec > > On Wed, Jul 17, 2013 at 10:54:05AM +0800, sam liu wrote: > > Hi

Re: Issue against Hadoop-2.0.4-alpha

2013-07-16 Thread sam liu
; it's configured properly and that Sqoop is properly picking the > configuration and all the HDFS libraries. > > Jarcec > > On Tue, Jul 16, 2013 at 11:29:07AM +0800, sam liu wrote: > > I also tried another sqoop build sqoop-1.4.2.bin__hadoop-2.0.0-alpha on > > hadoop

Re: Issue against Hadoop-2.0.4-alpha

2013-07-15 Thread sam liu
ed? > > -Abe > > > On Thu, Jun 20, 2013 at 6:39 PM, sam liu wrote: > >> Anyone could provide a answer? We are making decision whether to leverage >> Sqoop 1.4.3 on yarn or not. >> >> Thanks! >> >> >> 2013/6/20 sam liu >> >>>

Re: Exception of import-tool with Sqoop 1.4.3 and Hadoop 1.1.1

2013-07-15 Thread sam liu
tar -Dhadoopversion=100 > > Jarcec > > On Fri, Jul 12, 2013 at 03:31:59PM +0800, sam liu wrote: > > Hi Experts, > > > > I built sqoop project to generate sqoop-1.4.3.bin__hadoop-1.0.0.tar.gz > > using command:'ant -Dhadoopversion=100 tar'. Before tha

Exception of import-tool with Sqoop 1.4.3 and Hadoop 1.1.1

2013-07-12 Thread sam liu
oop(Sqoop.java:181) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) -- Sam Liu

Re: Should not show NPE exception when occurs import failure

2013-07-01 Thread sam liu
u mind > opening a new JIRA for this? > > https://issues.apache.org/jira/browse/SQOOP > > Jarcec > > On Thu, Jun 27, 2013 at 02:57:49PM +0800, sam liu wrote: > > Hi, > > > > when failed to import a non-existing table, the returned failure > > informatio

Should not show NPE exception when occurs import failure

2013-06-26 Thread sam liu
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) -- Sam Liu

Re: Issue against Hadoop-2.0.4-alpha

2013-06-20 Thread sam liu
Anyone could provide a answer? We are making decision whether to leverage Sqoop 1.4.3 on yarn or not. Thanks! 2013/6/20 sam liu > Hi, > > Sqoop website says Sqoop 1.4.3 support Hadoop 2.0, but I failed to run > import tool against hadoop-2.0.4-alpha, using > sqoop-1.4.3.bi

Issue against Hadoop-2.0.4-alpha

2013-06-20 Thread sam liu
Hi, Sqoop website says Sqoop 1.4.3 support Hadoop 2.0, but I failed to run import tool against hadoop-2.0.4-alpha, using sqoop-1.4.3.bin__hadoop-2.0.0-alpha. Can anyone help provide triage/suggestion? Thanks in advance! - Command: sqoop import --connect jdbc:db2://host:5/SAMPLE --table DB2ADM

Why Yarn has worse performance for terasort, than MRv1?

2013-06-06 Thread sam liu
that Yarn is much faster than MRv1 on Map phase, but much worse on Reduce phase. Here I have two questions: *- Why my tests show Yarn is worse than MRv1 for terasort? * *- What's the stratage for tuning Yarn performance? Is any materials?* Thanks! -- Sam Liu

Doubts in '--update-mode allowinsert' argument

2012-05-23 Thread sam liu
In Sqoop User Guide (v1.4.1-incubating), it says 'you may also specify the --update-mode argument with allowinsert mode if you want to update rows if they exist in the database already or insert rows if they do not exist yet'. However, I have some questions: - How to determine if a row is existing

Re: An issue of importing a table from DB2 Luw 97 database using Sqoop 1.4.1

2012-05-23 Thread sam liu
ng > error by using the Universal Driver: > DB2 SQL error: SQLCODE: -7, SQLSTATE: 42601, SQLERRMC: > This is a simple sample of such a SQL statement: > static final String sqlQuery = "SELECT empno, firstnme, > lastname, salary \n" > + " FROM employee WHERE workdept=