Hello! After more than 3 years in the making, I am proud to announce the release of Skyscraper 0.3.0, a scraping framework that helps you build structured dumps of whole websites.
Home: https://github.com/nathell/skyscraper/ Major improvements in 0.3.0: - Skyscraper has been rewritten from scratch to be asynchronous and multithreaded, based on core.async. - Skyscraper now supports saving the scrape results to a SQLite database. - In addition to the classic scrape function that returns a lazy sequence of nodes, there is an alternative, non-lazy, imperative interface ( scrape!) that treats producing new results as side-effects. - reaver (using JSoup) is now available as an optional underlying HTML parsing engine, as an alternative to Enlive. See NEWS.md for a complete list. I’m particularly happy about the database abilities of this release – for a glimpse of what it can do, see https://cljdoc.org/d/skyscraper/skyscraper/0.3.0/doc/database-integration. Happy scraping! – Daniel -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/clojure/1120591d-0cf2-4962-96d9-0ea5672b7b89%40googlegroups.com.
