Hi, Yes measuring it now shall get back, on a side note do we have any big datafile parsing package part of go or some library? The basic sort.Sort() what I have is taking 44sec for 48MB of data, I have to parse 2G of data.
Regards, Subu K On Wed, Nov 29, 2017 at 8:03 PM, Jan Mercl <0xj...@gmail.com> wrote: > On Wed, Nov 29, 2017 at 3:19 PM Subramanian K <subub...@gmail.com> wrote: > > > To run 2GB of data it takes really long time, I am trying to split these > to buckets and make it run concurrently, finally need to collate results of > all these small sorted buckets. > > Have you measured and detected where the bottleneck is? If it's in any of > the sort.Interface methods, concurrency might not be the best approach to > consider. > > > > -- > > -j > -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
