Re: clojure, not the go to for data science

2015-04-01 Thread Joseph Guhlin
and css selector based > of jsoup https://github.com/davidsantiago/hickory . > > Gorilla is amazing why is this not heard? http://gorilla-repl.org/ > > Not data related but for graphics quil seems awesome > https://github.com/quil/quil > > > > On Tuesday, 31 March 20

Re: clojure, not the go to for data science

2015-04-01 Thread Joseph Guhlin
eph On Tuesday, March 31, 2015 at 7:36:11 AM UTC-5, Erebus Mons wrote: > > Joseph Guhlin wrote: > > > Incanter gets your pretty far, especially when combined with Gorilla > > REPL, but all the tools and features aren't quite there yet, but > progress > > is be

Re: clojure, not the go to for data science

2015-03-29 Thread Joseph Guhlin
Incanter gets your pretty far, especially when combined with Gorilla REPL, but all the tools and features aren't quite there yet, but progress is being made. There are a few features I really need for clojure that I think are out there, but aren't in core and I haven't found the external libra

lein-ring :init only runs once, never on reload

2014-08-04 Thread Joseph Guhlin
I'm sure this may be desired functionality for many, but I use the :init fn to connect to the database. When files are reloaded, this is never called again and my database connection is lost. Is there another way or is it possible to check for connection from the handler itself? :ring {:handle

Re: [ANN] Gorilla REPL initial release (0.1.2)

2014-03-06 Thread Joseph Guhlin
Thanks, I've just gotten around to playing with this and it's something I've been looking for. I think Incanter integration is the way to go, even if I have to figure it out myself I'd be happy to help (limited in my incanter knowledge as is, but this works great with it so far). Best, --Joseph

Re: 'neostore' does not contain a store version, please ensure that the original database was shut down in a clean state.

2013-12-11 Thread Joseph Guhlin
I just want to fully agree with Wes, don't run this from eclipse. I get best performance from Neo4j batch inserter by compiling it and then running it from the jar, as opposed to lein run. Definitely check your heap to the JVM and to the batchinserter initialization, as they are separate and it

Re: 'neostore' does not contain a store version, please ensure that the original database was shut down in a clean state.

2013-12-10 Thread Joseph Guhlin
When is this happening, during the batch import or after for a query? It sounds like an incomplete shutdown. You need to make sure you issue a .shutdown to the db (batchinserter) and give it time to complete, it can take awhile. Make sure you have write permissions for the directory. And always

Re: Import dbpedia data into neo4j using clojure

2013-12-06 Thread Joseph Guhlin
Glad it worked, if you have any further questions feel free to ask. I'm using it extensively and it and Clojure seem to be a perfect match these days, especially on very large datasets. --Joseph On Friday, December 6, 2013 12:56:40 AM UTC-6, Himakshi Mangal wrote: > > Hi Jo

Re: Import dbpedia data into neo4j using clojure

2013-12-03 Thread Joseph Guhlin
What version of neo4j are you using? For your swap! you are mixing transients and atoms (swap! id-map #(assoc! % res id)) should be: (swap! id-map assoc res id) The swap! fn will apply the value of the atom id-map to the fn as the first argument, followed by the remaining arguments, and then se

Atom for vector of vectors (100 million) and a way to wrap around them?

2013-07-10 Thread Joseph Guhlin
Hello, I'm using clojure to create a database from various files. Because the database in batch insert mode is single threaded I am using an agent to handle communications with the database. Creating a node in the database doesn't have any dependencies, and I return a promise and deliver it in t

Re: How to implement a distributed and concurrent system in Clojure?

2013-07-03 Thread Joseph Guhlin
I'd like to hear others opinions on this too. I don't believe Clojure has anything built in at this point. My plan of action (not yet implemented) is to use gearman(possibly java, but it seems that it is no longer updated) and zeroconf for clusters (just for automatic master determination). I k

Re: How to read a file into a string up until a line? Any way to make it lazy?

2012-06-22 Thread Joseph Guhlin
Awesome, thank you so much. Is there any way to make it lazy to avoid the dreaded outOfMemoryError ? Or is it already lazy and I'm not seeing it / working with it properly? Best, --Joseph On Friday, June 22, 2012 7:30:28 AM UTC-5, Walter Tetzner wrote: > > > > On Friday, June 22, 2012 8:28:02 A

How to read a file into a string up until a line? Any way to make it lazy?

2012-06-22 Thread Joseph Guhlin
I have a 2.5GB file, and will have other files, where the records are mutli-line (variable length) and are separated by // on a line by itself. What is the best way to read the record into a sequence of strings for parsing, and act on that record, and read the next record? It'd be great if it w