What is your bottleneck in the process, an update of the backend data ?
Can your update or insert be made in groups of 100 or 1000 at a pass,
instead of one at a time? Or do you need a key back for
additional processing?
On Sat, Aug 1, 2020 at 12:07 PM MB Software Solutions, LLC <
mbsoftwaresoluti...@mbsoftwaresolutions.com> wrote:
> I've got a regular process that runs, basically using key information to
> grab data from an API and then update the local VFP database. There are
> maybe 64000 records to process, and each record to update through this
> process takes about a second, so to process this group would take over
> 17 hours. Each record could be processed on its own; there are no
> relationships between each.
>
> I don't want to start it and run the 64000 in a row for 17+ hours. I
> would like to design the app to use the table, RLOCK the row I'm
> processing, and the UNLOCK the row when I'm done. I figure with this
> design, I could run multiple instances of the MyProgram.exe (similar to
> how WestWind Web Connection allows you to run multiple instances) to
> process the batch maybe 4x faster (if I launched 4 instances of
> MyProgram.exe). The basic construct would be as follows:
>
> USE ListOfRecsToProcess IN 0 SHARED Alias MyList && record is PK (to
> process) i, tProcessed t, tError t, cSession c(10)
> SCAN FOR EMPTY(cSession) AND RLOCK('MyList')
> IF ProcessRecord(MyList.ID) THEN
> REPLACE tProcessed WITH DATETIME(), cSession WITH this.cSession
> IN MyList
> ELSE
> REPLACE tError WITH DATETIME(), cSession WITH this.cSession IN
> MyList
> ENDIF
> ENDSCAN
>
>
> Does anybody see any problems with that general design? The
> ProcessRecord method calls an API to get values and then updates the
> local VFP record accordingly.
>
> tia,
> --Mike
>
>
>
> --
> This email has been checked for viruses by Avast antivirus software.
> https://www.avast.com/antivirus
>
>
[excessive quoting removed by server]
_______________________________________________
Post Messages to: ProFox@leafe.com
Subscription Maintenance: https://mail.leafe.com/mailman/listinfo/profox
OT-free version of this list: https://mail.leafe.com/mailman/listinfo/profoxtech
Searchable Archive: https://leafe.com/archives
This message:
https://leafe.com/archives/byMID/cajidmykzwsphe+euz6t5bgipvt-4a2abdbzvriyu13ooo2g...@mail.gmail.com
** All postings, unless explicitly stated otherwise, are the opinions of the
author, and do not constitute legal or medical advice. This statement is added
to the messages for those lawyers who are too stupid to see the obvious.
