On Wed, Oct 13, 2010 at 4:00 AM, Mark Engelberg <mark.engelb...@gmail.com> wrote: > On Tue, Oct 12, 2010 at 6:41 AM, Moritz Ulrich > <ulrich.mor...@googlemail.com> wrote: >> Regarding your error: Maybe you open too many sockets which don't get >> closed and your process runs out of file descriptors. > > Yes, I think that's the problem. I found a blurb on the net about how > to expand the range of usable ports for sockets, but instead I went > the route of writing my documents in batches of 50 as both of you > suggested. This didn't entirely solve the problem, but it definitely > helped and I was able to get much further. But after entering about > 2,000,000 small documents, the database size was nearing 4GB and couch > seemed to really crawl to add new documents. I like couch's > ease-of-use alongside Clojure, but I think I need something that isn't > quite so space-hungry and remains fast for largish collections. So > I'm thinking I'm going to have to punt on couch db. Any other tips on > what I might be doing wrong, or does this sound typical? > > Thanks, > > Mark >
Do you update your documents often? CouchDB keeps old versions of documents in the database. To remove them, do a "compact" on the database. If you don't update your documents often, you could have a look at the config parameters. However, I'm not sure if that will bring you the desired results. -- Moritz Ulrich Programmer, Student, Almost normal Guy http://www.google.com/profiles/ulrich.moritz BB5F086F-C798-41D5-B742-494C1E9677E8 -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en
