The first job can do one pass of the input to split the output into three files of 250 IDs each. Then run three subsequent jobs concurrently to split the first step output files into the individual files. That is one less pass on the total input.
If there is enough TIOT space, an additional variation to try is to split the first 250 IDs in the first job with two additional outputs for groups 251-500 and 501-750. Then run additional jobs to split the additional groups. That can save from having to do a second pass on part of the data. If the OP has enough system resources in the second step, they can consider changing the first step output files to groups of 125 IDs to run additional splits concurrently. HTH Alan ________________________________ From: "Farley, Peter x23353" <[email protected]> Sent: Saturday, June 11, 2022 11:35 To: [email protected] Subject: Re: dfsort -TASK I/O TABLE EXCEEDS TIOT LIMIT OF 0064K The simple solution is to split the single job into multiple jobs. As a start, put the first 250 into JOB1, the second 250 into JOB2 and the last 250 into JOB3. It means 3 passes of the input file instead of one, but the jobs will run and you will get the result you need. HTH Peter -----Original Message----- From: IBM Mainframe Discussion List <[email protected]> On Behalf Of Ron Thomas Sent: Saturday, June 11, 2022 12:14 AM To: [email protected] Subject: dfsort -TASK I/O TABLE EXCEEDS TIOT LIMIT OF 0064K Hello - We are splitting a very large files in to 750 files dynamically based on key , which means if the key changes the file is moved to the respective ones we are getting the message STEPBB - TASK I/O TABLE EXCEEDS TIOT LIMIT OF 0064K STEPBB - STEP WAS NOT EXECUTED. and hence the step is not getting executed . File LRECL = 500 Key is from position 19,4. Here is the control card used SORT FIELDS=COPY OUTREC IFTHEN=(WHEN=GROUP,KEYBEGIN=(19,4),PUSH=(501:ID=3)) OUTFIL FNAMES=OUT001,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,001) OUTFIL FNAMES=OUT002,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,002) OUTFIL FNAMES=OUT003,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,003) OUTFIL FNAMES=OUT004,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,004) OUTFIL FNAMES=OUT005,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,005) OUTFIL FNAMES=OUT006,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,006) OUTFIL FNAMES=OUT007,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,007) OUTFIL FNAMES=OUT008,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,008) --- -- OUTFIL FNAMES=OUT749,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,749) OUTFIL FNAMES=OUT750,BUILD=(1,500),INCLUDE=(501,3,ZD,EQ,750) so could some let me know how to get this fixed ? of is there any other way we can build this one ? Regards Ron T -- This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by e-mail and delete the message and any attachments from your system. ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [email protected] with the message: INFO IBM-MAIN ---------------------------------------------------------------------- For IBM-MAIN subscribe / signoff / archive access instructions, send email to [email protected] with the message: INFO IBM-MAIN
