I'll see if I can carve out some time to put this together. If I do I'll probably post it here before making an official request, as people here are much smarter than me and will probably provide good feedback. Any initial thoughts from anyone here are also welcome!
________________________________ From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> on behalf of Seymour J Metz <sme...@gmu.edu> Sent: Wednesday, June 17, 2020 6:24 PM To: IBM-MAIN@LISTSERV.UA.EDU <IBM-MAIN@LISTSERV.UA.EDU> Subject: Re: Improve OMVS cp performance? I think that it is worth an RFE if you can put together a compelling business case. Be sure to cover any functionality that's important to you, e.g., Program Objects? PDS(E) directory data Performance for multiple members in the same PDS(E) Record formats Character set issues Line ending conventions, e.g., CRLF, LF, NEL, NL -- Shmuel (Seymour J.) Metz http://mason.gmu.edu/~smetz3 ________________________________________ From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf of Frank Swarbrick [frank.swarbr...@outlook.com] Sent: Wednesday, June 17, 2020 6:53 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Improve OMVS cp performance? Do you think its worth an RFE? ________________________________ From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> on behalf of Seymour J Metz <sme...@gmu.edu> Sent: Wednesday, June 17, 2020 4:52 PM To: IBM-MAIN@LISTSERV.UA.EDU <IBM-MAIN@LISTSERV.UA.EDU> Subject: Re: Improve OMVS cp performance? I think that technically it would be a piece of cake, although it would take some careful design to make it efficient and transparent. -- Shmuel (Seymour J.) Metz http://mason.gmu.edu/~smetz3 ________________________________________ From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf of Frank Swarbrick [frank.swarbr...@outlook.com] Sent: Wednesday, June 17, 2020 6:34 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Improve OMVS cp performance? I mean technical effort on IBM's part to implement it. It seems to me that, along with some mapping/naming rules and sensible defaults, in addition to Lionel's use case it could also be useful for FTP clients, so non-z/OS users can have "understandable" access to MVS data sets w/o having to even know that's what they are doing. ________________________________ From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> on behalf of Seymour J Metz <sme...@gmu.edu> Sent: Wednesday, June 17, 2020 12:42 PM To: IBM-MAIN@LISTSERV.UA.EDU <IBM-MAIN@LISTSERV.UA.EDU> Subject: Re: Improve OMVS cp performance? Technical effort or administrative effort. I suspect that it will be a lot more involved to get it approved than to actually implement it. -- Shmuel (Seymour J.) Metz http://mason.gmu.edu/~smetz3 ________________________________________ From: IBM Mainframe Discussion List [IBM-MAIN@LISTSERV.UA.EDU] on behalf of Frank Swarbrick [frank.swarbr...@outlook.com] Sent: Wednesday, June 17, 2020 1:12 PM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Improve OMVS cp performance? I wonder what kind of effort it might be for z/OS to support Unix path names as aliases/links to MVS legacy data sets. Probably a lot of work, but it seems like it would be quite useful for situations such as this where the Unix application only supports Unix paths. Just a wild thought. Not opening an RFE for it or anything, unless someone can say it sounds at all reasonable. By the way, z/OS Unix is z/OS, as some like to say. I prefer to use the terms "legacy data sets" or "MVS data sets" saying "the z/OS side". It's all z/OS! 🙂 ________________________________ From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> on behalf of Lionel B Dyck <lbd...@gmail.com> Sent: Wednesday, June 17, 2020 6:14 AM To: IBM-MAIN@LISTSERV.UA.EDU <IBM-MAIN@LISTSERV.UA.EDU> Subject: Re: Improve OMVS cp performance? Kirk - thank you for the ideas. What I'm doing is in the ZIGI (see https://secure-web.cisco.com/16y9woZ-KKNGioIsmrX3l0VloGx62ZmJbaIDUMxNEu3X4_DmZ6nR-qUkWT-lIJna_FSvyQDSqjJHfEE6JVKyGupXrO9tZC1YO3pkDcHdunPFAORyGUqh2yJwHFSDhnEN1TtNm5g8EvDfoNzNsauNWFq4Y_5InaggC3Djt9nYuC7fv4BlPnY08D6jHmqOOticix9GjXAoL9A2DFzRItsD7RyJt7tNFtjfWZFZu3E-ycsOQlpWifUJvx4QAe6GSVyJinMUnvQ0cG7veolIcRj9KdGLoHSjf0diK1UVO0q3LRSzwcLSv9K5aNecTApJaWO0YizryqgYg3UqT4cDPbHG-sLS4b_8_CV6WTBJFipgSWaH1SnA6EsjjHognkaFW_J9WuXnPRq9b-odk_z1k3sQt4Li6oWKIpRIBAyK2b2RvwvBW2Vq0v_9ybXpgNqjKaNAI/https%3A%2F%2Fzigi.rocks) where I need to copy PDS members to/from USS so that Git can manage them. With small projects this isn't an issue but with larger projects it could take enough time for you to go to lunch ☹ Btw. I voted your RFE. Lionel B. Dyck <sdg>< Website: https://secure-web.cisco.com/1M2R-g6A5gGoKDKQxyFiYYV7WXr9OdUyu6Ixa3zjpJ6CJbQmAW8FtYkxjXgLOeIDnvjGXI0lOmtzYcfyzGiCcRXXoTJiT7jNfLgtZaozhB1snDKIsuSqxrUFNz5eHiU9FuFPR_nAf45mLn3swUsAfJB77d53cb7b4d1kHMZxbp69FYPo4AbO7fSOmun_rPhg-ArrddqzghsnvKXAWOl88mKZ5TLED7NhEjdb1G3D2OauWeZmmrYS7YNoaApm9ci2dFr9POiD9mLXAhZEOO5HJImkuCdd3O0jGChFv7l7yIQnE1_ZXQ--KqkeAjWI7XPrhKZnpDex2AYCsAZ0f-4tNYyL1XagaW7uBJxH8OFBFFApall8WssfmP94dlBt_13DdsDtCrFzObRE8x5b5008xoJkZ08eOE8HskcXulsVEDlDkwgBNRyy-qwYCMUyXsKHV/https%3A%2F%2Fwww.lbdsoftware.com "Worry more about your character than your reputation. Character is what you are, reputation merely what others think you are." - John Wooden -----Original Message----- From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> On Behalf Of Kirk Wolf Sent: Wednesday, June 17, 2020 7:03 AM To: IBM-MAIN@LISTSERV.UA.EDU Subject: Re: Improve OMVS cp performance? Hi Lionel, Can you provide any more detail on how you are invoking "cp" ? - With cp, there won't be any way to avoid opening the PDSE for each member, but you might get some improvement by allocating a DD to the PDSE and then passing //DD(member) to cp, so as to avoid allocation each time. If you do this, then you will also know for sure if you are using local spawn (_BPX_SHAREAS=YES), since otherwise the DD won't be visible if a new AS was forked. - The other issue would be the cost of spawning a Unix process for each member, even if local spawned. I haven't tested this, but you might write a shell script that is passed the DD as arg and member names as lines to stdin. Then the script could do the cp for each member. The hope is that since cp is also a shell "built-in" you might avoid spawning processes for each one. - the "best" performance possible would be writing your own BPAM code that also does the Unix fileio. Assembler is fine, but I would use C/++ for everything except the low level BPAM I/O routines, since I would probably use buffered filestreams for the Unix files. FWIW: It's a pity that the IBM C library doesn't have any support for BLDL/NOTE/POINT processing of PDS/Es -- see my old RFE and vote if you agree: https://www.ibm.com/developerworks/rfe/execute?use_case=viewRfe&CR_ID=80811 On Wed, Jun 17, 2020 at 5:30 AM Lionel B Dyck <lbd...@gmail.com> wrote: > " What's on the non-OMVS side? a PDS(E)? Multiple PS data sets?" > > On the z/OS side is a PDS(E). > > Thanks > > > Lionel B. Dyck <sdg>< > Website: > https://secure-web.cisco.com/1M2R-g6A5gGoKDKQxyFiYYV7WXr9OdUyu6Ixa3zjpJ6CJbQmAW8FtYkxjXgLOeIDnvjGXI0lOmtzYcfyzGiCcRXXoTJiT7jNfLgtZaozhB1snDKIsuSqxrUFNz5eHiU9FuFPR_nAf45mLn3swUsAfJB77d53cb7b4d1kHMZxbp69FYPo4AbO7fSOmun_rPhg-ArrddqzghsnvKXAWOl88mKZ5TLED7NhEjdb1G3D2OauWeZmmrYS7YNoaApm9ci2dFr9POiD9mLXAhZEOO5HJImkuCdd3O0jGChFv7l7yIQnE1_ZXQ--KqkeAjWI7XPrhKZnpDex2AYCsAZ0f-4tNYyL1XagaW7uBJxH8OFBFFApall8WssfmP94dlBt_13DdsDtCrFzObRE8x5b5008xoJkZ08eOE8HskcXulsVEDlDkwgBNRyy-qwYCMUyXsKHV/https%3A%2F%2Fwww.lbdsoftware.com > > "Worry more about your character than your reputation. Character is > what you are, reputation merely what others think you are." - John > Wooden > > -----Original Message----- > From: IBM Mainframe Discussion List <IBM-MAIN@LISTSERV.UA.EDU> On > Behalf Of Paul Gilmartin > Sent: Tuesday, June 16, 2020 9:23 PM > To: IBM-MAIN@LISTSERV.UA.EDU > Subject: Re: Improve OMVS cp performance? > > On Tue, 16 Jun 2020 20:34:59 -0500, Lionel B Dyck wrote: > > >Any suggestions on how to speed up cp copying multiple file to and > >from > z/OS? > > > >I gave SHAREAS=YES. Anything else? Can I control buffers or ? > > > What's on the non-OMVS side? a PDS(E)? Multiple PS data sets? > > I might suggest as an extreme measure Rexx under ISPF using ADDRESS > SYSCALL I/O for OMVS and LM services for Classic. > SYSCALL READFILE/WRITEFILE are available for text files only. > > -- gil > > ---------------------------------------------------------------------- > For IBM-MAIN subscribe / signoff / archive access instructions, send > email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > > ---------------------------------------------------------------------- > For IBM-MAIN subscribe / signoff / archive access instructions, send > email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN > ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to lists...@listserv.ua.edu with the message: INFO IBM-MAIN