Hi all,
Technically speaking this is not a question specific to Clojure. I 'd
like to see how people are generally accessing some big resource (e.g a
massive .csv file). My use case is this:
I've got code that fetches the weather conditions from Yahoo, given a
WOE_ID code. The problem is that I'd like to be able to search by city
name rather than WOE_ID. After hours of searching I managed to find a
downloadable .tsv file from yahoo which includes the mapping from
WOE_IDs to cities. However it is a 253MB file! Including it in my
/jar/uberjar is out of the question of course...I had , what appeared to
be a good idea, to put the file in my public dropbox folder and access
the url from my code. This works but is terribly slow because I'm
opening and reading the file through the network (it takes roughly 25
sec to look up 'Manchester').
Since I cannot claim to have extensive industrial experience, I'd like
to ask how people are tackling this issue, in the large?
as always, many thanks in advance :)
Jim
--
--
You received this message because you are subscribed to the Google
Groups "Clojure" group.
To post to this group, send email to clojure@googlegroups.com
Note that posts from new members are moderated - please be patient with your
first post.
To unsubscribe from this group, send email to
clojure+unsubscr...@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/clojure?hl=en
---
You received this message because you are subscribed to the Google Groups "Clojure" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to clojure+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
