Re: [GNC] Database storage

2024-09-21 Thread Liz
On Fri, 20 Sep 2024 08:49:16 -0700 (PDT) Chris Miller via gnucash-user wrote: > This was quite helpful, and I would have done it myself, had I a > running example. I am a QuickBooks refugee and after reviewing dozens > of offerings, I am beginning to conclude that GnuCash is probably the > best a

Re: [GNC] Database storage

2024-09-21 Thread Fred Bone
On 19 September 2024 at 12:31, Michael or Penny Novack said: > On 9/19/2024 11:16 AM, Roberts K wrote: > > In my experience the amount of data is relatively small (even for > > thousands of records) > > A bit of historical perspective is needed, particularly because our > heads have not yet abso

Re: [GNC] Database storage

2024-09-20 Thread David Cousens
Hi Chris, Sorry I didn't reply earlier but your email ended up in my spam folder. The transaction report should do it if you select all accounts but that will double up as most transactions will affect at least two accounts but there is no count of them provided in the report.  It may be possible

Re: [GNC] Database storage

2024-09-20 Thread Jim DeLaHunt
Chris: On 2024-09-20 06:32, Chris Miller via gnucash-user wrote: Hi Jim, Beware of confusion: the word "transaction" is already used on this list to mean an "accounting record of an exchange of value". But I suspect that here you use the word "transaction" to mean a "controlled and reliable ch

Re: [GNC] Database storage

2024-09-20 Thread Chris Miller via gnucash-user
Hi Mark, > I have ~some~ knowledge. > In SQL, these are the 'tables' used for storage; >> sqlite> .tables >> accounts employees orders taxtables >> billterms entries prices transactions >> books gnclock recurrences vendors >> budget_amounts gnucashew_vars schedxactions versions >> budgets invoic

Re: [GNC] Database storage

2024-09-20 Thread Mark at Lorimark
~mark petryk ~w:http://www.lorimarksolutions.com On 9/18/24 22:30, Chris Miller via gnucash-user wrote: Hi David, I don't suppose GnuCash has a transaction list report that could tell us that quickly? A simple way to answer this question would be to save the file as SQL, open the SQL wit

Re: [GNC] Database storage

2024-09-20 Thread Michael or Penny Novack via gnucash-user
On 9/19/2024 3:53 PM, Steve Butler wrote: My first job out of college had a Honeywell 115 Mod 2 box.  Hard drive (singular) was 10 MB.  RAM was 32K of magnetic core.  6 bit CPU and 7 track 556 bpi tape (3 of them). Thought we were going to heaven when it was replaced by an HP 3000 with 7 hard

Re: [GNC] Database storage

2024-09-20 Thread Mark at Lorimark
~mark petryk ~w:http://www.lorimarksolutions.com On 9/19/24 11:27, Chris Miller via gnucash-user wrote: Hi Roberts, * Transactional database updates implies multiple user concurrency, but everywhere I hear that multiple users is "problematic". Certainly this is true with the XML storag

Re: [GNC] Database storage

2024-09-20 Thread Mark at Lorimark
Hi Chris, I have ~some~ knowledge. In SQL, these are the 'tables' used for storage; sqlite> .tables accounts employees orderstaxtables billterms entries pricestransactions books gnclock recurrences

Re: [GNC] Database storage

2024-09-20 Thread Chris Miller via gnucash-user
Hi Robert, > One thing that all of the *SQL backends do provide over the flat XML file > storage: accessing the data (*read-only!*) between runs of GnuCash is easier. > Instead of either trying to parse the XML or using Python bindings to the > GnuCash API, one can write code using SQL (in any la

Re: [GNC] Database storage

2024-09-20 Thread Chris Miller via gnucash-user
Hi Jim, > Beware of confusion: the word "transaction" is already used on this list > to mean an "accounting record of an exchange of value". But I suspect > that here you use the word "transaction" to mean a "controlled and > reliable change to data stored in a database". Yes. They are similar. B

Re: [GNC] Database storage

2024-09-20 Thread Robert Heller
At Fri, 20 Sep 2024 06:32:13 -0700 (PDT) Chris Miller wrote: > > Hi Jim, > > > Beware of confusion: the word "transaction" is already used on this list > > to mean an "accounting record of an exchange of value". But I suspect > > that here you use the word "transaction" to mean a "controlled

Re: [GNC] Database storage

2024-09-20 Thread Mark Penner
Sep 20, 2024 03:51:56 Jim DeLaHunt : > Then when you tell GnuCash to store a single "accounting record of an > exchange of value" entry, GnuCash updates the data it has in memory. In > simple terms, it does not make any change to data stored in the database at > that moment.  When you tell GnuC

Re: [GNC] Database storage

2024-09-20 Thread Jim DeLaHunt
Chris: On 2024-09-19 09:27, Chris Miller via gnucash-user wrote: I had already come to the same conclusion. And I have also already posed questions to myself: * Does SQLite support transactions? -- Yes. Beware of confusion: the word "transaction" is already used on this list to mean an "

Re: [GNC] Database storage

2024-09-19 Thread Kalpesh Patel
ucash-user@gnucash.org Subject: Re: [GNC] Database storage Blast from the past, Yes, I do remember when 200mb hard drive was quite big harddrive to buy in the shop. I was fairly young man then :-D. But W541 is pretty sweet machine. I run linux on P70 and do not foresee the need to change it anytime soo

Re: [GNC] Database storage

2024-09-19 Thread Steve Butler
My first job out of college had a Honeywell 115 Mod 2 box. Hard drive (singular) was 10 MB. RAM was 32K of magnetic core. 6 bit CPU and 7 track 556 bpi tape (3 of them). Thought we were going to heaven when it was replaced by an HP 3000 with 7 hard drives of 47 MB each and 512 KB memory. The p

Re: [GNC] Database storage

2024-09-19 Thread Roberts K
Blast from the past, Yes, I do remember when 200mb hard drive was quite big harddrive to buy in the shop. I was fairly young man then :-D. But W541 is pretty sweet machine. I run linux on P70 and do not foresee the need to change it anytime soon. Roberts > Now this Lenovo work station I am sitti

Re: [GNC] Database storage

2024-09-19 Thread Bruce Griffis
Slightly off topic. In my earliest working days we had a Honeywell mainframe, were bringing in an IBM mainframe and had a Tandem system for airline reservations. The Tandem wrote to two different disks at the same time so if there was ever a failure, no data would be lost. One day I came in and

Re: [GNC] Database storage

2024-09-19 Thread R Losey
On Wed, Sep 18, 2024 at 8:54 PM Chris Miller via gnucash-user < gnucash-user@gnucash.org> wrote: > > It should be noted: GnuCash does *not* do database queries as it > processes > > transactions. > Well, that's disappointing ... and definitive. > > If this content is stored as flat XML, then I wou

Re: [GNC] Database storage

2024-09-19 Thread Michael or Penny Novack via gnucash-user
However the behavior of autosave is a pet peeve of mine. The behavior I would like to see is for gnucash to have two states, "not in the middle of entering a transaction" an "in the middle of entering a transaction"  I want autosave to pop up only when in the first state (if the timer goes off

Re: [GNC] Database storage

2024-09-19 Thread Michael or Penny Novack via gnucash-user
On 9/19/2024 11:16 AM, Roberts K wrote: In my experience the amount of data is relatively small (even for thousands of records) A bit of historical perspective is needed, particularly because our heads have not yet absorbed a fundamental change in technology. Back in my working days, the IBM

Re: [GNC] Database storage

2024-09-19 Thread Chris Miller via gnucash-user
Hi Roberts, > I found the best of both worlds is to use SQLite backend - because it is > fastest and most portable - you just need to copy the file. It allows me to > run quite complex reports from R using standard SQL approach. Even more - I > made some bash scripts with SQL queries utilizing re

Re: [GNC] Database storage

2024-09-19 Thread Roberts K
In my experience the amount of data is relatively small (even for thousands of records) and database performs well in XML form. As other people have said - it is copied into memory, So not much use putting it on proper RDBMS. I remember when I used it on MySQL over 100Mb connection on LAN (or even

Re: [GNC] Database storage

2024-09-19 Thread Robert Heller
At Thu, 19 Sep 2024 07:32:05 -0700 "Stan Brown (using GC 4.14)" wrote: > > On 2024-09-18 18:54, Jim DeLaHunt wrote: > > In other words, if you have GnuCash store data in a database, GnuCash > > reads all its data out of the database when it starts, and writes all > > the data back when it stops.

Re: [GNC] Database storage

2024-09-19 Thread Stan Brown (using GC 4.14)
On 2024-09-18 18:54, Jim DeLaHunt wrote: > In other words, if you have GnuCash store data in a database, GnuCash > reads all its data out of the database when it starts, and writes all > the data back when it stops. It does not write and commit each > transaction as it goes. That's true. However,

Re: [GNC] Database storage

2024-09-18 Thread Geoff
Hi Chris I have a GnuCash implementation with: 705 Accounts 53,083 Splits ("legs" of a Transaction) 44MB when stored as Uncompressed XML 28MB when stored as Sqlite Database I run this on an ancient Windows PC driven by an Intel 3rd generation chip (i3770) and stored on a SATA SSD. It takes a

Re: [GNC] Database storage

2024-09-18 Thread David Carlson
I am not sure whether Liz stores her data files in a compressed format but she probably does as that is the default for the xml file type. However, modern computers usually have anywhere from 2 to 16 gigabytes or more of 64 bit ram so even if the xml expands to more than a gigabyte Gnucash does no

Re: [GNC] Database storage

2024-09-18 Thread Chris Miller via gnucash-user
Hi Liz, > Looking at my 2 biggest data files with data from about 1990 for one > and 1995 for the other > 2.2 MiB (2351153 bytes) > 1.5 MiB (1537242 bytes) > and I don't notice any delays on using these files. How many transactions do you suppose are saved? My personal case would be ten or fift

Re: [GNC] Database storage

2024-09-18 Thread Chris Miller via gnucash-user
Hi David, > I have over 14 years of personal data and some business data in one > file and no performance issues. For my own purposes, I will be incurring ten or fifteen transactions per month, however the other use case might be two hundred transactions a month. That would accumulate five thou

Re: [GNC] Database storage

2024-09-18 Thread David Cousens
Chris,  I have over 14 years of personal data  and some business data  in one file and no performance issues. May be a bit different for a business if there are a lot of transactions on a daily basis though. David Couses On Wed, 2024-09-18 at 18:53 -0700, Chris Miller via gnucash-user wrote: > >

Re: [GNC] Database storage

2024-09-18 Thread Liz
On Wed, 18 Sep 2024 18:53:02 -0700 (PDT) Chris Miller via gnucash-user wrote: > > It should be noted: GnuCash does *not* do database queries as it > > processes transactions. > Well, that's disappointing ... and definitive. > > If this content is stored as flat XML, then I would expect it not

Re: [GNC] Database storage

2024-09-18 Thread Jim DeLaHunt
Chris, On 2024-09-18 18:32, Chris Miller via gnucash-user wrote: Is there support for database storage? I see reference to sqlite3, PostgreSQL, and MySQL. Sqlite3 is obviously supported, since I can simply save my content as sqlite3 in preference to XML, but I'd really like to use either Postgr

Re: [GNC] Database storage

2024-09-18 Thread Chris Miller via gnucash-user
> It should be noted: GnuCash does *not* do database queries as it processes > transactions. Well, that's disappointing ... and definitive. If this content is stored as flat XML, then I would expect it not to scale very well. When does it start having performance problems? Thanks for the help,

Re: [GNC] Database storage

2024-09-18 Thread Robert Heller
It should be noted: GnuCash does *not* do database queries as it processes transactions. It copies the whole "database" to memory at start and writes the whole in-memory database out when it "saves". Using a database system is not any different than using a XML file on a shared file system. Y

[GNC] Database storage

2024-09-18 Thread Chris Miller via gnucash-user
Hi Folks, The FAQ talks about PostgreSQL storage and how it was tired and discontinued, but then tried again. This was around version 2 - 3. We are now at version 5.8. Is there support for database storage? I see reference to sqlite3, PostgreSQL, and MySQL. Sqlite3 is obviously supported, sin