-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Moin,
On Thursday 13 July 2006 08:26, Adam Kennedy wrote: > Tels wrote: > > The DB backend shouldn't matter at all, it should be transparent and be > > switchable without any noticable change at the front. > > Yep, right with you. Hence DBIx::Class. *sigh* Another dependecy... > Plus, I planned to > > use YAML because it creates a _much_ less heavy overhead and dependency > > chain. Using SQLite or similiar is what really creates the problems > > with CPANTS - you cant just access the raw database without the > > front-end. > > Erm, I'm not sure I get you here. The main problem with all the things > that loads the index currently is that they tend to consume 50-100 meg > of ram, and that's just the active index. Add in extra stuff and you're > up into stupid amounts of ram quite quickly. I am not sure what "stupid" consists, but my system wouldn't have problems handling 512 MB of memory. OTOH, if the raw data in memory is like 100 Megabyte, then where does all the data come from? The CPAN index is surely not 100 Megabyte, right? I didn't intend to read all of it into ram and keep it there, thats for sure. But thats why I also wrote that YAML might be replaced by something else. > > WithYAML, at least you could get at the data by other means. Of course > > for performance reasons it might not be good, but since premature > > optimization is the root of all evil, I'd say use YAML now, change when > > nec. > > It's already necesary, based on the memory load. That's not to say you > have to use SQLite to DISTRIBUTE or publish the data, just that when you > access and manipulate it computationally, you do it via SQLite. Well, I guess you have more experience on that than I have. I would have tried without it first. > This method has worked spectacularly well in the JSAN code, which What is JSAN? > implements something very similar to what I'm heading towards. Er, so why aren't you using what JSAN is? *confused* > To do > dependencies and so on, it just links an Algorithm::Dependency object Another dependency to find out what the dependency is. > into the DBIx::Class code, and there you have your full range of > graph-math things, like dep chains (up and downstream) weights, etc. That sounds like quite a bit overkill. Well, I guess I just wanted to keep the dependecies to a very minimum. I rally _DONT_ want to install 20 different modules just to find out what Foo::Bar has on dependencies. Thats why CPANTS never worked for me, I never could find the patience to hunt down and install everything just to get it working. And I guess every user of Graph::Dependency doesn't want to do that, either. However, at the current stage I would settle for a working method, almost any method at all. > > Otherwise, the projects seem similiar in scope, except that I focus on > > the DB and let things like "download stuff" be done outside. > > > > Whether that works out, uh I don't know. In any event I have quite a > > few ideas I'd like to try out and this proves to be fun to me. I hope > > it doesn't end upI have to implement other people ideas - thats too > > much work like :D > > Have a look at just the database parts, which I've finished already from > memory. > > The bit that isn't finished is the complete "grab your CPAN.pm config > and stream down all the files and populate the database". I see you have don muchmuch more work and given it much much more though, so I better just shut my mouth, throw my silly alittle attempt at yet-another-wheel into the dustbin and go away. :-/ Good luck with CPAN::Index. Best wishes, Tels - -- Signed on Thu Jul 13 18:29:40 2006 with key 0x93B84C15. Visit my photo gallery at http://bloodgate.com/photos/ PGP key on http://bloodgate.com/tels.asc or per email. "In my opiniation, "burglarize" is a perfectionally validative wordification. How else would reportization of the securitial/policial forceship appearize to be importantive enoughly to be respectative by the massmediaship and influentate the societyness?" SharpFang (651121) on 2004-12-13 at /. about "burgle" vs. "burglarize" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (GNU/Linux) iQEVAwUBRLZ2x3cLPEOTuEwVAQLOIAf/QITUcv+L68ekV/4TfpUVM0akC9slGCLM 0FoUdAkCIvd8PbwZTgGenc9aYOU3/2h41PB5rV5ub+LNAQYT2DyjUs+kMZPHkoAo LO20UQZMtAwQKl65gI11XBSh5bIJEbVh5UVnSubv9uKcokYTDHEgiQzppI52/BT1 jKXW9/dX2jbn74+AjhtnpIcvANfs/DeYcJeCOoqacQCTo7Wer0HZEmxKmlOppgJL YjCK6X9DY+HYstIO4bZXn1NUxqXIKsvjK38I7HlspODyCMqlLzyj0O+lubcGT/A4 EyKJHh6nSDgbb7X+eM1104uvrgeRp49F/yNAceSDRSssWuLGpxoOmA== =I7Ex -----END PGP SIGNATURE-----
