Hi Vinny, Thanks for the tips, but actually I'm not loading a file. I'm only using mapreduce lib for read all the entities for one of my kinds, work with them (I only read some properties to compose the csv line format) and then I write to CSV file on cloud storage using mapreduce FileOutputWriter.
Any idea why I'm getting this Criticals memory errors? Thanks all again. Saludos. Moisés Belchín. 2013/10/10 Vinny P <[email protected]> > On Thu, Oct 10, 2013 at 5:47 AM, Moises Belchin <[email protected]> > wrote: > >> I'm getting a lot of memory limit critical errors in my app when I use >> mapreduce library. >> I'm working with Python 2.7, app engine 1.8.5 and F2 instances with 256MB. >> >> Has anyone got these critical errors? >> >> > > Hello Moises, > > How large is your input file? Are you loading the entire file into memory > at once? If so, try moving to a BlobstoreLineInputReader which reads in one > line at a time - it reduces the memory being used during file processing. > > > ----------------- > -Vinny P > Technology & Media Advisor > Chicago, IL > > App Engine Code Samples: http://www.learntogoogleit.com > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/google-appengine. > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/google-appengine. For more options, visit https://groups.google.com/groups/opt_out.
