Re: python+sqlite3 in memory database

2010-08-30 Thread Benjamin Peterson
John Nagle animats.com> writes: > "sqlite" has reasonably good SELECT performance on simple indices, > but anything beyond that isn't all that great. Multiple processes > updating the same sqlite database will have terrible performance, > because the locking mechanism not only locks the entir

Re: python+sqlite3 in memory database

2010-08-30 Thread John Nagle
On 8/30/2010 12:00 PM, Benjamin Peterson wrote: Denis Gomes gmail.com> writes: Eventually my goal is to dynamically load and unload sections of a file based database (could be tables or rows) in and out of memory for effeciency purposes. Have you actually found this to be an useful optimiz

Re: python+sqlite3 in memory database

2010-08-30 Thread Denis Gomes
Yep, I see what you are saying. I am going to do a bit more research to see how sqlite3 works internally, ie. cache size, page size, etc, and then decide if I will need to mess with in-memory databases. Thanks for your insight, appreciate it. Denis On Mon, Aug 30, 2010 at 3:51 PM, Benjamin Pete

Re: python+sqlite3 in memory database

2010-08-30 Thread Benjamin Peterson
Denis Gomes gmail.com> writes: > > > Hey Benjamin, >   >  Take a look at this website I found about cached and in-memory databases.  I think the gist of the article is that caching is good if you are doing SELECTs on data that is frequently used whereas in-memory speeds up writes, (inserts and

Re: python+sqlite3 in memory database

2010-08-30 Thread Denis Gomes
Hey Benjamin, Take a look at this website I found about cached and in-memory databases. I think the gist of the article is that caching is good if you are doing SELECTs on data that is frequently used whereas in-memory speeds up writes, (inserts and updates) to the db as well as querying. Maybe I

Re: python+sqlite3 in memory database

2010-08-30 Thread Benjamin Peterson
Denis Gomes gmail.com> writes: > > Eventually my goal is to dynamically load and unload sections of a file based database (could be tables or rows) in and out of memory for effeciency purposes. Have you actually found this to be an useful optimization? SQLite already internally caches database

python+sqlite3 in memory database

2010-08-30 Thread Denis Gomes
Hi Everyone, I am using sqlite3 with python2.5 and the pysqlite wrapper. I am trying to copy tables from one database (in memory) to another database (file) using ATTACH. I looked on the internet and found a couple of sites that show how to do this but the table schema is not copied. def Save