> On Apr 2, 2015, at 2:18 PM, Gary Tsai <gary.m.t...@gmail.com> wrote: > > Thanks for the reply Jason, > > Yea the ticket is currently in Heroku Support - I’m not sure how helpful they > are - haven’t heard a response yet. I actually tested this against my > clients production app (it’s paid) so there can’t be anything wrong with the > service itself terms of a 10,000 rows limit I’ve received before. > > Can you explain more about why the runner would have “max memory on it’s > ‘headless’ runner dyno” >
I’m not actually sure exactly what you get with a headless running, but keep in mind that you have either 1X, 2X, or PX dynos so there must be a corresponding memory allocation for the headless runner. I’m just talking about the memory on the dyno — RAM — once it runs out, the platform kills it. There isn’t much you can do about that. > It can’t be a memory issue because I tested the upload with only one row. > Indeed, then it sounds like a different problem. Maybe your approach is wrong? I don’t understand if the file you are uploading is local or if it is on the app? Perhaps Heroku is detecting your code try to make a disk call and killing it for security purposes? It definitely looks like it is killed by the platform. > I haven’t tried a rake task, but would it be any different? What I do in my app is save the CSV files to a Paperclip object, which gets saved to an Amazon S3 bucket. The CSV import job (which runs in a worker job, not a rake task or runner), first downloads a copy of the CSV and saves it to /tmp (this is safe even in the disk-less Heroku environment because I don’t rely on this file being there again in the future). Once saved, I then read the CSV file into memory and process it. Heroku support is usually pretty good, depending on the issue. Seems like either a platform limitation or some other platform-imposed security blocker that you are seeing. -Jason -- -- You received this message because you are subscribed to the Google Groups "Heroku" group. To unsubscribe from this group, send email to heroku+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/heroku?hl=en_US?hl=en --- You received this message because you are subscribed to the Google Groups "Heroku Community" group. To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.