TRS-80: I applaud you for automating your downloads using Selenium. It works really quite well and I'm using it myself to download ETF basket compositions (https://github.com/blais/baskets; warning: this isn't polished code). It works well, but I concur with Justus: if you don't run it very regularly you're bound to find out that it breaks as soon as even minor things on the websites change. It's a matter of constant gardening.
Justus; I agree with what you said. It's mostly not worth the effort (unless you're having fun doing it, or you want to update very frequently). BTW, "baskets" is a project that would benefit from the participation, contribution and constant gardening by a multitude of people, and unlike banks, there's no personal password to downloading these portfolios and there are only a relatively small number of ETF issuers; many would benefit from having a unified source of portfolio compositions for ETFs. There are commercial services selling this and it's expensive. I think we could even extend the codebase to update an associated separate git repo with the latest values for a broad spectrum of these portfolios so that others wouldn't even have to run webdriver themselves (instead of running a database, just using files with a simple API to obtain the data in a common way across all issuers). Right now it downloads the portfolio files to a local cache; I should have had it write to a git repo instead. Anyhow, I use this to deaggregate my ETF positions and be able to surface my specific exposure to a particular stock, across all positions, across all accounts. Beancount provides the input portfolio. And of course, I don't run it often enough... I had to make fixes to it a few days ago and it's still not fully operational on all my ETFs. So little time... On Thu, Jul 16, 2020 at 9:26 AM Justus Pendleton <justu...@gmail.com> wrote: > I'm somewhat amused that you don't have time to spend five minutes once a > month downloading CSV files but you have the many, many hours required to > investigate, implement, and write about your alternative that saves five > minutes a month :) > > Your approach won't work with any institution that has 2FA and I can't > imagine not having 2FA on my financial accounts. > > Also, having spent many years dealing with substantial Selenium test > suites, they are extremely brittle and required a surprising amount of > ongoing maintenance. Failures due to timeouts from some DOM element taking > too long to arrive, changes in the DOM breaking everything, etc. For a > small personal project those may not be as frustrating as they were for a > commercial software effort, though. > > -- > You received this message because you are subscribed to the Google Groups > "Beancount" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to beancount+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/beancount/39f2aa01-b039-4eb4-ada6-257f6b511627o%40googlegroups.com > . > -- You received this message because you are subscribed to the Google Groups "Beancount" group. To unsubscribe from this group and stop receiving emails from it, send an email to beancount+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/beancount/CAK21%2BhMo2b-DL-ZmcU%3Dq5PH6CWFDwvVAjMhnY4X-NAbk%2BcmRow%40mail.gmail.com.
