Re: [web2py] Re: cpdb errors

> > *Final conclusion:* memory leak confined to pg8000. psycopg2 works fine in Windows and Linux. > > > --

Re: [web2py] Re: cpdb errors

I hate this. Its fixed (stable) for the time being, but cant clearly identify the cause. I'm sure that there is a still memory leak and it may appear again.. Early in the process, Ubuntu was acting similarly to Windows 7 i.e. consuming memory when importing the csv file and eventually failing.

Re: [web2py] Re: cpdb errors

9.1 (fresh install yesterday) --

Re: [web2py] Re: cpdb errors

which postgres version? On Wednesday, 9 January 2013 16:46:45 UTC-6, Simon Ashley wrote: > > Just confirming that csv imports fail with Postgres on Ubuntu 12.10, but > both sqlite and mysql import fine. > > Suspect its a postgres issue, and will attempt different adapters/ > refactor of the DAL

Re: [web2py] Re: cpdb errors

Just confirming that csv imports fail with Postgres on Ubuntu 12.10, but both sqlite and mysql import fine. Suspect its a postgres issue, and will attempt different adapters/ refactor of the DAL table def to try and identify the cause Error message is fairly generic.

Re: [web2py] Re: cpdb errors

I don't think so. Once Simon unquoted his cmd line option values, he was able to do a DB copy with the following OS/DB combinations: Windows + sqlite Windows + mysql But is reporting issues with Windows + postgres (memory leak?) His plan is to repeat the same steps but on a linux system, then

[web2py] Re: cpdb errors

Is there still an open issue here? On Tuesday, 8 January 2013 04:58:58 UTC-6, Simon Ashley wrote: > > That's a negative on cache.py. > It's from a nightly build pulled about 5 days ago. > The csv in question is about 150k records. > (have pruned it down to a test of 10 records, and they import O

[web2py] Re: cpdb errors

That's a negative on cache.py. It's from a nightly build pulled about 5 days ago. The csv in question is about 150k records. (have pruned it down to a test of 10 records, and they import OK). Has about 140 fields, quite a few nulls, and have compensated for the adapter's postgres decimal precisi

[web2py] Re: cpdb errors

Hi Simon, Thanks for the update! This is interesting. One question, are you making use of cache.py? I had huge memory problems a while ago and I didn't have time to debug. A colleague was testing on windows and each time it crapped out his system where he was forced to do a hard reboot (but see

[web2py] Re: cpdb errors

Thanks Mart, That gives me some clues and a renewed focus. Issue may be with postgres (at least the install I had - has been deleted and will be installed). Will also try ubuntu environment. Will report back ... --

[web2py] Re: cpdb errors

Hi Simon, Yes, that looks like a CSV error message. Possibly, the CSV format is missing something expected... I would say that the problem occurs when converting from CSV. I would suggest that you take a look at Massimo's "CSVStudio" @https://code.google.com/p/csvstudio/ i think it has

[web2py] Re: cpdb errors

Thanks Mart, That's sort of fixed it, but starting to get additional issues with the auth tables. Think have seen this before with csv imports and have gotten around by deleting suspe

[web2py] Re: cpdb errors

hum... you should just remove the quotes around the connection strings (options -y and -Y) since they are already strings when passed in. Otherwise, argparse will do this: " ' sqlite://storage.sqlite' " and then dal will not be able to open the DB. So, no quotes, should fix the problem. -y sql

[web2py] Re: cpdb errors

Interesting but encountering similar problems to *backseat *on windows 7 using the following command from a prompt in web2py root folder: i.e. c:\web2py> set path=%path%;c:\web2py\gluon c:\web2py> c:\python27\python scripts\cpdb.py -d gluon -f application\app\databases -y 'sqlite://storage.sqli

[web2py] Re: cpdb errors

the first message is expected because of this import: try: from gluon import DAL except ImportError as err: print('gluon path not found') It wants to assume that that gluon is already loaded as part of the web2py environment (or as part of some other environment, like Aptana for exam