Skyscraper 0.2.0 has been released. New in this release: - Skyscraper now supports pluggable cache backends. - The caching mechanism has been completely overhauled and Skyscraper no longer creates temporary files when the HTML cache is disabled. - Support for capturing scraping results to CSV via scrape-csv. - Support for updating existing scrapes: new processor flag :updatable, scrape now has an :update option. - New scrape option: :retries. - Fixed a bug whereby scraping huge datasets would result in an OutOfMemoryError. (scrape no longer holds onto the head of the lazy seq it produces).
Skyscraper's home is at https://github.com/nathell/skyscraper/ . There is also a satellite project, skyscraper-cache-mapdb, which implements a MapDB backend for Skyscraper. skyscraper-cache-mapdb has just been released as version 0.1.0 to Clojars and the code is available at: https://github.com/nathell/skyscraper-cache-mapdb/ Happy scraping, -dj -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
