Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Erik de Castro Lopo
Ozgun Ataman wrote: > If you are doing row-by-row transformations, I would recommend > giving a try to my csv-conduit I was using csv-conduit. > If you're keeping an accumulator around, however, you may still > run into issues with too much laziness. This was the problem which I solved with de

Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Johan Tibell
On Sat, Feb 2, 2013 at 5:14 PM, Ozgun Ataman wrote: > If you are doing row-by-row transformations, I would recommend giving a try > to my csv-conduit or csv-enumerator packages on Hackage. They were designed > with constant space operation in mind, which may help you here. > > If you're keeping

Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Ozgun Ataman
If you are doing row-by-row transformations, I would recommend giving a try to my csv-conduit or csv-enumerator packages on Hackage. They were designed with constant space operation in mind, which may help you here. If you're keeping an accumulator around, however, you may still run into issues

Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Erik de Castro Lopo
Nick Rudnick wrote: > thanks for the interesting info. I quite often have processing of CSV file > data of about 100M-1G done. What library are you using to process the CSV? I have had problems with excessive laziness causing processing of a 75Meg CSV file consuming 500+ megabytes and after I fix

Re: [Haskell-cafe] Monadic parser vs. combinator parser

2013-02-02 Thread Doaitse Swierstra
On Jan 31, 2013, at 10:47 , Jan Stolarek wrote: > Thanks for replies guys. I indeed didn't notice that there are monads and > applicatives used in > this parser. My thought that monadic parsers are more verbose came from > Hutton's paper where the > code is definitely less readable than in e

Re: [Haskell-cafe] Parsec Vs. src exts

2013-02-02 Thread Roman Cheplyaka
Hi Sean, 1. Please do not confuse haskell-src and haskell-src-exts. You should definitely use the latter. I also find it relatively well documented. 2. If your goal is to write a tool and not to write a Haskell parser as an exercise, then I would recommend haskell-src-exts. Another option

Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Nick Rudnick
Hi Gwern, thanks for the interesting info. I quite often have processing of CSV file data of about 100M-1G done. Thanks a lot, Nick 2013/2/2 Gwern Branwen > On Sat, Feb 2, 2013 at 3:19 PM, Nick Rudnick > wrote: > > Roughly, I would say the differences in runtime can reach a factor as > much >

Re: [Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Gwern Branwen
On Sat, Feb 2, 2013 at 3:19 PM, Nick Rudnick wrote: > Roughly, I would say the differences in runtime can reach a factor as much > as 1:10 at many times -- and so I am curious whether this subject has > already been observed or even better discussed elsewhere. I have spoken to > somebody, and our

[Haskell-cafe] Substantial (1:10??) system dependencies of runtime performance??

2013-02-02 Thread Nick Rudnick
Dear all, for quite a while now, I have experienced this issue with some curiosity; yesterday I had it again, when a program that took well over one hour before only needed about ten minutes, after a system reboot (recent Ubuntu) and with no browser started -- finally deciding to post this. I sti

[Haskell-cafe] Parsec Vs. src exts

2013-02-02 Thread Sean Cormican
Hi, I've been spending a bit of time looking into using Parsec as a parser for a subset of the syntax of the Haskell language, a high level description of what I'm looking to create is a parser which confirms whether a given Haskell code file is valid or in the case that it isn't returns some help

[Haskell-cafe] Announce: Leksah 0.13.2.0 (still a bit experimental)

2013-02-02 Thread Hamish Mackenzie
Version Control --- Harald and Stephan's Version Control integration has been merged in! If you want to help out on this there are still some cool things that could be added. I for one would love something to show my changes vs. the repo as I edit. Harald and Stephan also added a num

Re: [Haskell-cafe] Most used functions in hackage

2013-02-02 Thread Rustom Mody
On Sat, Feb 2, 2013 at 12:43 PM, Casey Basichis wrote: > I'm not sure what you mean. > > I would imagine popular success for either would be circumstantial and > have little to do with their actual ability and more to do with the > opportunities they pursue and the cultural atmosphere at the time.