Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread Pavol Lisy
On 3/30/17, INADA Naoki wrote: > Maybe, this commit make this regression. > > https://github.com/python/cpython/commit/4897300276d870f99459c82b937f0ac22450f0b6 > > Old: > minused = (so->used + other->used)*2 (L619) > > New: > minused = so->used + other->used (L620) > minused = (minused > 5)

Re: error in syntax description for comprehensions?

2017-03-30 Thread Terry Reedy
On 3/30/2017 4:57 PM, Boylan, Ross wrote: https://docs.python.org/3/reference/expressions.html#displays-for-lists-sets-and-dictionaries describes the syntax for comprehensions as comprehension ::= expression comp_for comp_for ::= [ASYNC] "for" target_list "in" or_test [comp_iter] comp_iter

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread MRAB
On 2017-03-30 19:04, INADA Naoki wrote: Maybe, this commit make this regression. https://github.com/python/cpython/commit/4897300276d870f99459c82b937f0ac22450f0b6 Old: minused = (so->used + other->used)*2 (L619) New: minused = so->used + other->used (L620) minused = (minused > 5) ? minus

Re: error in syntax description for comprehensions?

2017-03-30 Thread Ned Batchelder
On Thursday, March 30, 2017 at 4:59:03 PM UTC-4, Boylan, Ross wrote: > https://docs.python.org/3/reference/expressions.html#displays-for-lists-sets-and-dictionaries > describes the syntax for comprehensions as > comprehension ::= expression comp_for > comp_for ::= [ASYNC] "for" target_list "

error in syntax description for comprehensions?

2017-03-30 Thread Boylan, Ross
https://docs.python.org/3/reference/expressions.html#displays-for-lists-sets-and-dictionaries describes the syntax for comprehensions as comprehension ::= expression comp_for comp_for ::= [ASYNC] "for" target_list "in" or_test [comp_iter] comp_iter ::= comp_for | comp_if comp_if :

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread INADA Naoki
FYI, this small patch may fix your issue: https://gist.github.com/methane/8faf12621cdb2166019bbcee65987e99 -- https://mail.python.org/mailman/listinfo/python-list

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread Jan Gosmann
That's great news. I'm busy with other things right now, but will look into your findings in more detail later. On 03/30/2017 02:09 PM, INADA Naoki wrote: Filed an issue: https://bugs.python.org/issue29949 Thanks for your report, Jan. On Fri, Mar 31, 2017 at 3:04 AM, INADA Naoki wrote: May

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread INADA Naoki
Filed an issue: https://bugs.python.org/issue29949 Thanks for your report, Jan. On Fri, Mar 31, 2017 at 3:04 AM, INADA Naoki wrote: > Maybe, this commit make this regression. > > https://github.com/python/cpython/commit/4897300276d870f99459c82b937f0ac22450f0b6 > > Old: > minused = (so->used + ot

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread INADA Naoki
Maybe, this commit make this regression. https://github.com/python/cpython/commit/4897300276d870f99459c82b937f0ac22450f0b6 Old: minused = (so->used + other->used)*2 (L619) New: minused = so->used + other->used (L620) minused = (minused > 5) ? minused * 2 : minused * 4; (L293) So size of

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread INADA Naoki
I reproduced the issue. This is very usual, memory usage issue. Slashing is just a result of large memory usage. After 1st pass of optimization, RAM usage is 20GB+ on Python 3.5 and 30GB on Python 3.6. And Python 3.6 starts slashing in 2nd optimization pass. I enabled tracemalloc while 1st pass.

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Rhodri James
On 30/03/17 16:57, Mikhail V wrote: Steve, it is not bad to want to spell your name using spelling which was taught you in the school. But it is bad to stay in illusion that there is something good in using accents. *plonk* -- Rhodri James *-* Kynesim Ltd -- https://mail.python.org/mailman/lis

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Mikhail V
On 30 March 2017 at 16:14, Steve D'Aprano wrote: > On Thu, 30 Mar 2017 03:21 pm, Rick Johnson wrote: > >> On Sunday, March 26, 2017 at 2:53:49 PM UTC-5, Chris Angelico wrote: >>> On Mon, Mar 27, 2017 at 6:25 AM, Mikhail V wrote: >>> > On 26 March 2017 at 20:10, Steve D'Aprano >>> > wrote: >>> [

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Michael Torrie
On 03/30/2017 08:14 AM, Steve D'Aprano wrote: >> Why is it my responsibiliy to encode my text with >> pronuciation tutorials? Are we adults here or what? > > Now you're just being absurd. Ahh yes, good old RR with his reductio ad absurdum fallacies when he's lost the argument. -- https://mail.py

django authentication multi upload files

2017-03-30 Thread Xristos Xristoou
I have create I simple Django auth project and I need to add the user to can upload some images. multi upload images from internet views.py from django.shortcuts import render from django.http import HttpResponse def Form(request): return render(request, "index/form.html", {}) def Upload(req

add processing images in the model.py using django

2017-03-30 Thread Xristos Xristoou
want to create a simple image processing using Django. my tasks is easy I have some user a simple model and that user can upload images in my project using html form or django form and then that images saves to upload_to='mypath' in upload from my model. but I have some questions : I have a simp

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Chris Angelico
On Fri, Mar 31, 2017 at 1:16 AM, Steve D'Aprano wrote: > On Fri, 31 Mar 2017 12:25 am, Mikhail V wrote: > >> Call me a bigot > > Okay. You're a bigot. +1 QOTD ChrisA -- https://mail.python.org/mailman/listinfo/python-list

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Steve D'Aprano
On Fri, 31 Mar 2017 12:25 am, Mikhail V wrote: > Call me a bigot Okay. You're a bigot. -- Steve “Cheer up,” they said, “things could be worse.” So I cheered up, and sure enough, things got worse. -- https://mail.python.org/mailman/listinfo/python-list

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Steve D'Aprano
On Thu, 30 Mar 2017 03:21 pm, Rick Johnson wrote: > On Sunday, March 26, 2017 at 2:53:49 PM UTC-5, Chris Angelico wrote: >> On Mon, Mar 27, 2017 at 6:25 AM, Mikhail V wrote: >> > On 26 March 2017 at 20:10, Steve D'Aprano >> > wrote: >> >> On Mon, 27 Mar 2017 03:57 am, Mikhail V wrote: > >> I ge

Re: Text-mode apps (Was :Who are the "spacists"?)

2017-03-30 Thread Mikhail V
On 30 March 2017 at 07:43, Chris Angelico wrote: > On Thu, Mar 30, 2017 at 3:21 PM, Rick Johnson > wrote: >> On Sunday, March 26, 2017 at 2:53:49 PM UTC-5, Chris Angelico wrote: >>> On Mon, Mar 27, 2017 at 6:25 AM, Mikhail V wrote: >>> > On 26 March 2017 at 20:10, Steve D'Aprano >>> > wrote: >

Re: Python under PowerShell adds characters

2017-03-30 Thread Steve D'Aprano
On Thu, 30 Mar 2017 04:43 pm, Marko Rauhamaa wrote: > Steven D'Aprano : > >> On Thu, 30 Mar 2017 07:29:48 +0300, Marko Rauhamaa wrote: >>> I'd expect not having to deal with Unicode decoding exceptions with >>> arbitrary input. >> >> That's just silly. If you have *arbitrary* bytes, not all >> by

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread Pavol Lisy
On 3/29/17, Jan Gosmann wrote: > On 28 Mar 2017, at 14:21, INADA Naoki wrote: > >> On Wed, Mar 29, 2017 at 12:29 AM, Jan Gosmann >> wrote: >> >> I suppose smaller and faster benchmark is better to others looking for >> it. >> I already stopped the azure instance. >> [...] >> There are no maxrss d

Re: pandas dataframe, find duplicates and add suffix

2017-03-30 Thread Pavol Lisy
On 3/28/17, zljubi...@gmail.com wrote: > In dataframe > > import pandas as pd > > data = {'model': ['first', 'first', 'second', 'second', 'second', 'third', > 'third'], > 'dtime': ['2017-01-01_112233', '2017-01-01_112234', > '2017-01-01_112234', '2017-01-01_112234', '2017-01-01_112234', >

Re: Program uses twice as much memory in Python 3.6 than in Python 3.5

2017-03-30 Thread INADA Naoki
> > Running further trials indicate that the problem actually is related to > swapping. If I reduce the model size in the benchmark slightly so that > everything fits into the main memory, the problem disappears. Only when the > memory usage exceeds the 32GB that I have, Python 3.6 will acquire way