It sounds like you either need a local cache, so each client only needs to download the file once, or to place the data on an external database that's accessibly publicly in some fashion.
- James On 7 December 2013 12:06, Jim - FooBar(); <jimpil1...@gmail.com> wrote: > Hi all, > > Technically speaking this is not a question specific to Clojure. I 'd like > to see how people are generally accessing some big resource (e.g a massive > .csv file). My use case is this: > > I've got code that fetches the weather conditions from Yahoo, given a > WOE_ID code. The problem is that I'd like to be able to search by city name > rather than WOE_ID. After hours of searching I managed to find a > downloadable .tsv file from yahoo which includes the mapping from WOE_IDs > to cities. However it is a 253MB file! Including it in my /jar/uberjar is > out of the question of course...I had , what appeared to be a good idea, to > put the file in my public dropbox folder and access the url from my code. > This works but is terribly slow because I'm opening and reading the file > through the network (it takes roughly 25 sec to look up 'Manchester'). > > Since I cannot claim to have extensive industrial experience, I'd like to > ask how people are tackling this issue, in the large? > > as always, many thanks in advance :) > > Jim > > -- > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- You received this message because you are subscribed to the Google > Groups "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > -- -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
