Jim said > On 10/17/2019 6:52 PM, Cameron Kaiser via cctalk wrote: >>>> Yeah, it sucks. The Tomy Tutor users group has been there for years, and I >>>> guess we'll jump over to groups.io. I managed to archive everything last >>>> night. >>> What's your strategy for archiving material off YahooGroups? Their Files and >>> Photo (photostreams) sections are so heavily Javascript-encrusted that it's >>> not at all easy to bulk archive from them. I tried a few tools (httrack, >>> wget, >>> curl) with no valid results, but I only used some basic settings. >> For the messages, I used >> >> https://github.com/andrewferguson/YahooGroups-Archiver >> >> Unfortunately, the (rather inadequate) Y!G API for files makes it difficult >> to iterate over files in a directory tree. I ended up manually downloading >> them, since it was only about 30 files and not worth ginning up something >> to scrape them. Some people have used >> >> https://github.com/csaftoiu/yahoo-groups-backup > I didn't get that to work. Has anyone here got suggestions? Contact off > list. It is getting errors, and I spent about an hour trying to figure > it out. > > every issue was a bug in either Python that was unresolved, or the tools > they were using, not errors in the tool, so I'm not really interested in > a lot more debugging. > > I suspect it ran at some point, maybe I've got the wrong versions of > some sort. > > thanks > Jim >> to get everything but it needs a MongoDB instance which seemed kind of >> overkill for a one-time dump.
I set it up with python 3.7.3, pip installed the required modules such as Selenium, installed geckodriver for Firefox (but I don't run Firefox on this machine, I use a popular fork) and it emitted an error that referes to Selenium not being the correct match to Firefox. I have other things to do so that's where I left it for now, will try it out again sometime soon with an earlier actual Firefox. Steve.
