Solved. I had a bug in one of my modules sharing the same npz files. That's why there was a slow down in performance. Regards
On Sun, May 1, 2022, 12:24 AM jonatha...@whatho.net < jonathan.cl...@whatho.net> wrote: > I'm probably wrong, but isn't this a numpy question? > > On Saturday, 30 April 2022 at 11:12:39 UTC+1 mauri...@gmail.com wrote: > >> I use it like this: >> import numpy as np >> data = np.load(os.path.join(current.request.folder, 'modules', >> 'test_me.npz'), allow_pickle=True ) >> moa = data['x'] >> arr = np.asarray(moa) >> for item in arr: >> ...... >> >> >> This I find it to be slow >> >> On Sat, Apr 30, 2022 at 12:06 PM Maurice Waka <mauri...@gmail.com> wrote: >> >>> Anyone with experience using large .npz files? >>> I find it to slow the app when calling out functions that access the >>> (lists inside) npz files. >>> Would storing the lists in the DB be faster? >>> Regards >>> >>> -- >>> Resources: >>> - http://web2py.com >>> - http://web2py.com/book (Documentation) >>> - http://github.com/web2py/web2py (Source code) >>> - https://code.google.com/p/web2py/issues/list (Report Issues) >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "web2py-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to web2py+un...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/web2py/f817bf60-7d7b-49a3-bc47-0936b4670d7cn%40googlegroups.com >>> <https://groups.google.com/d/msgid/web2py/f817bf60-7d7b-49a3-bc47-0936b4670d7cn%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- > Resources: > - http://web2py.com > - http://web2py.com/book (Documentation) > - http://github.com/web2py/web2py (Source code) > - https://code.google.com/p/web2py/issues/list (Report Issues) > --- > You received this message because you are subscribed to the Google Groups > "web2py-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to web2py+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/web2py/fa4fb44b-3591-4bad-b880-7e73858b002cn%40googlegroups.com > <https://groups.google.com/d/msgid/web2py/fa4fb44b-3591-4bad-b880-7e73858b002cn%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/web2py/CALkNK56g3nG0OA7e06Y15WrZdNH8XCBS8vWpp%2BSwUOtY7edNTA%40mail.gmail.com.
