[
https://issues.apache.org/jira/browse/SQOOP-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645013#comment-16645013
]
Hudson commented on SQOOP-3326:
-------------------------------
SUCCESS: Integrated in Jenkins build Sqoop-hadoop200 #1210 (See
[https://builds.apache.org/job/Sqoop-hadoop200/1210/])
SQOOP-3326: Mainframe FTP listing for GDG should filter out non-GDG (vasas:
[https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=18212becec800336533697c5795a06bcd38e6242])
* (edit) build.xml
* (edit) src/java/org/apache/sqoop/util/MainframeFTPClientUtils.java
* (edit)
src/scripts/thirdpartytest/docker-compose/sqoop-thirdpartytest-db-services.yml
* (add)
src/test/org/apache/sqoop/mapreduce/mainframe/TestMainframeFTPFileGdgEntryParser.java
* (add)
src/java/org/apache/sqoop/mapreduce/mainframe/MainframeFTPFileGdgEntryParser.java
* (edit)
src/java/org/apache/sqoop/mapreduce/mainframe/MainframeConfiguration.java
* (edit)
src/test/org/apache/sqoop/manager/mainframe/MainframeManagerImportTest.java
* (edit) src/test/org/apache/sqoop/manager/mainframe/MainframeTestUtil.java
* (edit) src/test/org/apache/sqoop/util/TestMainframeFTPClientUtils.java
> Mainframe FTP listing for GDG should filter out non-GDG datasets in a
> heterogeneous listing
> -------------------------------------------------------------------------------------------
>
> Key: SQOOP-3326
> URL: https://issues.apache.org/jira/browse/SQOOP-3326
> Project: Sqoop
> Issue Type: Improvement
> Reporter: Chris Teoh
> Assignee: Chris Teoh
> Priority: Minor
> Fix For: 3.0.0
>
>
> The FTP listing will automatically assume the first file in the listing is
> the most recent GDG file. This is a problem when there are mixed datasets in
> the listing that the FTP listing doesn't filter these out.
>
> GDG base is : HLQ.ABC.DEF.AB15HUP
>
> The sequential dataset in the middle of the GDG member listing is :
> HLQ.ABC.DEF.AB15HUP.DATA
>
> The pattern for listing GDG members should be : <<GDG base
> name>>.G\d\{4}V\d\{2}
>
> Sample below:-
> {{ Menu Options View Utilities Compilers Help
>
>
> ssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssssss
> DSLIST - Data Sets Matching HLQ.ABC.DEF.GDGBASE Row 1 of 8
> Command ===> Scroll ===>
> PAGE
>
>
> Command - Enter "/" to select action Message
> Volume
>
> -------------------------------------------------------------------------------
> HLQ.ABC.DEF.GDGBASE ??????
> HLQ.ABC.DEF.GDGBASE.DUMMY SHT331
> HLQ.ABC.DEF.GDGBASE.G0034V00 H19761
> HLQ.ABC.DEF.GDGBASE.G0035V00 H81751
> HLQ.ABC.DEF.GDGBASE.G0035V00.COPY SHT337
> HLQ.ABC.DEF.GDGBASE.G0036V00 H73545
> HLQ.ABC.DEF.GDGBASE.G0037V00 G10987
> HLQ.ABC.DEF.GDGBASE.HELLO SHT33A
> ***************************** End of Data Set list
> ****************************
> ftp> open some.machine.network.zxc.au
> Connected to some.machine.network.zxc.au (11.22.33.44).
> 220-TCPFTP01 IBM FTP CS V2R1 at some.machine.network.zxc.au, 00:12:29 on
> 2018-05-29.
> 220 Connection will close if idle for more than 10 minutes.
> Name (some.machine.network.zxc.au:someuser):
> 331 Send password please.
> Password:
> 230 someuser is logged on. Working directory is "someuser.".
> Remote system type is MVS.
> ftp> cd 'HLQ.ABC.DEF.GDGBASE'
> 250 "HLQ.ABC.DEF.GDGBASE." is the working directory name prefix.
> ftp> dir
> 227 Entering Passive Mode (11,22,33,44,55,66)
> 125 List started OK
> Volume Unit Referred Ext Used Recfm Lrecl BlkSz Dsorg Dsname
> H19761 Tape G0034V00
> H81751 Tape G0035V00
> H73545 Tape G0036V00
> G10987 Tape G0037V00
> SHT331 3390 **NONE** 1 15 VB 114 27998 PS DUMMY
> SHT337 3390 **NONE** 1 15 VB 114 27998 PS G0035V00.COPY
> SHT33A 3390 **NONE** 1 15 VB 114 27998 PS HELLO
> 250 List completed successfully.
> ftp>}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
