On Tue, Sep 27, 2022 at 3:19 AM Axy via Python-list
wrote:
>
> > Did you check the ThreadPoolExecutor or the ProcessPoolExecutor? They
> > won't give you atomic writes unless you add a Lock or a Condition, but
> > they will execute your code in another thread or process.
>
> Yes, I did, but they a
On 2022-09-26, Stefan Ram wrote:
> So, I wanted to try to download all pages in parallel with
> processes to avoid any GIL effect, while I don't understand
> what the GIL actuall is. But processes didn't work here, so
> I tried threads. This worked and now the total run time is
> down to
Did you check the ThreadPoolExecutor or the ProcessPoolExecutor? They
won't give you atomic writes unless you add a Lock or a Condition, but
they will execute your code in another thread or process.
Yes, I did, but they are too complicated to use. I'd like something for
humans, such as
asynch
Did you check the ThreadPoolExecutor or the ProcessPoolExecutor? They
won't give you atomic writes unless you add a Lock or a Condition, but
they will execute your code in another thread or process.
https://docs.python.org/3/library/concurrent.futures.html#threadpoolexecutor
https://docs.python.or
