[google-appengine] Task Queue Stored Task Count off

2011-02-08 Thread master outside
After quota reset and there are no tasks in queue I see there are many more "task stored" than I would expect. For our app (collardata) each api call is one task. And the tasks should really never be stored as there is enough in the bit bucket. So is there a bug in the display or am I computing

[google-appengine] Re: CPU Time for Datastore Access

2011-02-08 Thread Strom
I'm not too sure how that iteration works under the covers, but if you want to iterate over the result set multiple times then this is surely faster: List> arr = ofy.query(FakeEntity.class).filter("lookAtMe", "woo").listKeys(); // Or use .list() to get the actual entities On Feb 7, 8:30 pm, Halcy

[google-appengine] how to dynamicly generate a new class during runtime on google app engine

2011-02-08 Thread Abdelrahman eid
hello all i am facing a real problem i want to know how to generate a new class during runtime using google app engine (i succeeded to make it on a desktop application by writing to a file.java then compile it using javac) but there is no writing to a file on google app engine ... so what can i

[google-appengine] Re: errors in updating entry in the datastore, through our own python script or through gae admin console

2011-02-08 Thread Tim Hoffman
Hi You can update these entities via the remote_api_shell. It is an overlooked extremely valuable tool T -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscri

[google-appengine] Re: how to dynamicly generate a new class during runtime on google app engine

2011-02-08 Thread Tonny
you should probably look into generating it dynamically purely in mem - similar to frameworks using byte code enhancement. On Feb 8, 11:46 am, Abdelrahman eid wrote: > hello all > i am facing a real problem i want to know how to generate a new class during > runtime using google app engine (i suc

[google-appengine] Re: mail.send_mail_to_admins raise InvalidSenderError

2011-02-08 Thread Matteo Bertini
A workaround that worked for me is to use an admin mail as sender in mail.send_mail_to_admins. All other valid senders for mail.send_mail I tried were invalid for mail.send_mail_to_admins. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group.

[google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
I've already posted this on the Java GAE group, but maybe someone has seen this issue on a Python-hosted app. I'm carrying out some testing of my app against the HR-store, instead of the M/S datastore, and I've noticed that occasionally I'll get a request which has a massive CPU spike. These spik

Re: [google-appengine] Re: Cache headers not working w/ billing enabled

2011-02-08 Thread Joshua Smith
Have you tried using: self.response.headers["Cache-Control"] = "public" self.response.headers["Expires"] = …some code to generate a time stamp... On Feb 7, 2011, at 11:03 PM, David wrote: > I understand the cache hits aren't guaranteed, but I've yet to see any > cache hits though

Re: [google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Wim den Ouden
I'm tuning for the hr. update entities are fast entities with 3 properties add, delete 149ms 101cpu_ms 84api_cpu_ms (tested over more days) entities with 25 properties http://code.google.com/p/relat/source/browse/trunk/relat/e-comm/contactmodel.py add, delete 1825cpu_ms 1807api_cpu_ms (tested over

Re: [google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
Just to emphasise, I'm seeing these spikes on requests which don't hit the datastore at all, and I don't see the same spikes on the same app with the datastore set to M/S. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this gr

Re: [google-appengine] High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Wim den Ouden
Hi Simon, I'm glad your mention the subject, to get a spead gain i moved out all the transaction surrounding where possible before testing the hr datastore. But it seems optimized for transactions because it is much faster in a transaction. After putting all put actions in a transaction the kind wh

[google-appengine] Re: High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread master outside
I has nothing to do with your code as you do not write the appstats interface. My only guess is that when the Master DB is having problems it those with HR take more cpu time to get requests done. Did you see a spike while they were doing maintenance? -- You received this message because you

Re: [google-appengine] Re: Prerelease SDK 1.4.2 is available for download

2011-02-08 Thread Jay
"bummer" = instant feedback looking forward to it when it is available though -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send emai

[google-appengine] Urgent: Task Queue reached 100% Task Queue Stored Task Bytes and no tasks in queue

2011-02-08 Thread David
Somehow this morning my app has reached 100% quota on Task Queue Stored Task Bytes and I have no tasks queues. I has never even went above a small percentage of the total allowable before the maintenance. Something with this update is messed up. I have 0% on the two other quotas and I only pass

[google-appengine] Re: Design Question

2011-02-08 Thread Ravi
Any reply from google guys?? Hi, I have 2-3 properties(Unowned Relationship keys) in my class which i will be using in where clause to filter records. Class PropertyAd{ Key locationKey; //This will point for which location this ad has been created Key categoryKey;//This will point for which

[google-appengine] Re: High Replication - Large CPU spikes without Datastore Access

2011-02-08 Thread Simon Knott
I've been getting these spikes since I started testing on the 3rd Feb. As I'm just testing to see if my app works on the HR datastore, at the moment, there is very low traffic. These spikes seem to occur when I haven't hit the app for a few hours, so I'd almost put them down to loading reque

Re: [google-appengine] Urgent: Task Queue reached 100% Task Queue Stored Task Bytes and no tasks in queue

2011-02-08 Thread David Mora
same here (already reported thru appengine billing tho) It seemed to happend just after the maintenance On 8 February 2011 10:30, David wrote: > Somehow this morning my app has reached 100% quota on Task Queue > Stored Task Bytes and I have no tasks queues.  I has never even went > above a smal

[google-appengine] App Engine for Business roadmap out date: When is Custom Domain SSL coming?

2011-02-08 Thread Jacob G
The App Engine for Business roadmap is out of date: http://code.google.com/appengine/business/roadmap.html It say Custom Domain SSL is estimating a limited release by EOY 2010. And here we are in Feb 2011 with no SSL or updated target date. Does anyone have an update? We are developers need to ma

[google-appengine] App Engine Down?

2011-02-08 Thread Abhranil Das
Experiencing problems with Google App Engine app since around 0930 hrs IST. Almost no response. DNS servers are fine. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To

[google-appengine] Datastore quota full, statistics reports ~10% usage

2011-02-08 Thread Erik Lindblad
Hello! I've been experimenting with GAE for a couple of weeks. My project is a leaderboard java/js app for an online game. It's currently backed by ~200k data point entities that should use <200 mb of storage. The datastore statistics tab reports that size of all entities (153k) is 105mb. I have

[google-appengine] Re: CPU Time for Datastore Access

2011-02-08 Thread HalcyonDays
I was considering calling list, but what's nice about the iterative method is that if I ever run out of time on a task (i.e. catch the exception that is thrown when the deadline is approaching) I can grab a cursor from the iterator and kick off a new task starting where I left off on the query...

[google-appengine] Billing Command Failed

2011-02-08 Thread proxima
Hi, I'm trying to enable billing but faced a big problem. Whenever I try to enable billing, the message below shows up. "Billing Command Failed There was an unexpected error and your budget settings were not saved. Please try again. If this problem persists, please contact support." There is no

[google-appengine] Error Handler Not Working

2011-02-08 Thread César de Tassis Filho
Hello. This application has an error handler but AppEngine is showing the default 503 Over Quota page: http://trendingtopicshistory-hr.appspot.com/ Here's how it is configured (in app.yaml): error_handlers: - file: error.html The "error.html" file is not missing either. Could you please fix

[google-appengine] Re: Storage: alternatives to Blobstore

2011-02-08 Thread John Wheeler
My bad Ikai. The distinction between the two occurred to me as I was watching some of the I/O videos last week and I thought the same thing. On Feb 7, 10:54 am, "Ikai Lan (Google)" wrote: > Looks like a good article. I wish the author would call example #1 > "datastore blob storage" instead of Bi

[google-appengine] Task Queue Over Improperly Quota

2011-02-08 Thread Daniel
I have opened a production issue (4533) for this error. I only have 5k or so of stored data in the task queue, but it is showing that I am over quota using 104,794,117 of 104,857,600. This is blocking all new tasks and severely compromising my counters. It seems to have begun with your "scheduled

[google-appengine] Re: Task Queue Over Improperly Quota

2011-02-08 Thread Lenny Rachitsky
I have the same exact problem! Makes no sense for me to be over that quota, and I reached it very early in the morning. Screenshot: https://skitch.com/lennysan/rp1sh/quota-details-localmind My add is broken until this is resolved. Rather painful :( On Feb 8, 6:07 pm, Daniel wrote: > I have opene

Re: [google-appengine] Billing Command Failed

2011-02-08 Thread Robert Kluin
I would file a billing support issue. http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSupport Robert On Tue, Feb 8, 2011 at 08:07, proxima wrote: > Hi, > > I'm trying to enable billing but faced a big problem. > Whenever I try to enable billing, the message be

Re: [google-appengine] Datastore quota full, statistics reports ~10% usage

2011-02-08 Thread Robert Kluin
Hi Erik, There are several things that can eat into your stored-data quota. Did you explicitly disable indexes on all of your properties except the timestamp? If not you have two indexes on each property. Indexes can easily double your stored data size. If you'd like to see index stats, sta

Re: [google-appengine] Re: Task Queue Over Improperly Quota

2011-02-08 Thread Ikai Lan
What are your app IDs? I'll apply a short term fix while following up on this issue. Daniel, I think I've already resolved your issue via the production issues template. Let me know if I haven't. -- Ikai On Tue, Feb 8, 2011 at 10:12 AM, Lenny Rachitsky wrote: > I have the same exact problem!

Re: [google-appengine] Urgent: Task Queue reached 100% Task Queue Stored Task Bytes and no tasks in queue

2011-02-08 Thread Ikai Lan (Google)
I've reset the quotas on both your apps. We're looking into what caused the issue. -- Ikai Lan Developer Programs Engineer, Google App Engine Blogger: http://googleappengine.blogspot.com Reddit: http://www.reddit.com/r/appengine Twitter: http://twitter.com/app_engine On Tue, Feb 8, 2011 at 9:08

[google-appengine] Re: Task Queue Over Improperly Quota

2011-02-08 Thread Lenny Rachitsky
my app id: reconplatform I just found out you can increase the task queue storage limit, so I just doubled it and things are OK again. But it still makes no sense how it got there, would love to know if it was my fault or something behind the scenes. On Feb 8, 6:22 pm, Ikai Lan wrote: > What are

Re: [google-appengine] Datastore quota full, statistics reports ~10% usage

2011-02-08 Thread Ikai Lan (Google)
Hi Erik, Can you post the definition for one of your entities? I look at look at your dashboard, and here's what I see: - 105mb used by datastore entities - 0 tasks using task queue stored bytes quota - 0 blobstore bytes used - 1 COMPOSITE index Note that built-index indices also consume storage

[google-appengine] Can I now in wich version my code is running?

2011-02-08 Thread nacho
For example, I have this method to know if my code is running is hosted mode or over appengine: public static boolean isDevelopment() { return (SystemProperty.environment.value() == SystemProperty.Environment.Value.Development); } And I need a similar method that returns me in wich vers

[google-appengine] Re: Problems when downloading data from the app

2011-02-08 Thread Ricardo Bánffy
I would suggest placing a strategic pdb.set_trace() around the error lines right before the bulkloader checks if the error is in the non_fatal_error_codes set. This way, you could check what the error code is and add it in the same fashion I did in my patch. On Feb 2, 3:48 am, antichrist wrote: >

Re: [google-appengine] Re: Task Queue Over Improperly Quota

2011-02-08 Thread Wesley C (Google)
it was something behind the scenes, and you have not been overcharged. apps should be returning to normal soon. we'll provide an update once the dust has settled (keep an eye on Downtime Notify). best regards, -- wesley - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - "Core Python Progr

[google-appengine] Re: Missing Dashboard Graph Data

2011-02-08 Thread Ernesto Karim Oltra
me too +1. I can't see it. But I don't need it especially, I use Google Analytic, it's better. On 8 feb, 08:53, master outside wrote: > I am missing all data on the dashboard for before the maintenance today. I > see this on all my app. I often will look back 30 days to see how the load > is chan

[google-appengine] Re: How to trigger a function every 5 minutes

2011-02-08 Thread Sandeep Arneja
tasks and task queues should do that... schedule one task to run and let that task schedule itself in 5 mins. remember that the eta is not respected in dev env but will work once deployed. On Feb 5, 11:38 pm, momijigari wrote: > Hello! > > I've just started to work with Google App Engine. So I'm

Re: [google-appengine] Datastore quota full, statistics reports ~10% usage

2011-02-08 Thread Erik Lindblad
Hey guys! This seems to be exactly what's happening. I'll take a look at it tomorrow when I'm, ehrm, back in the game (happy birthday to me! :) I have 17 props/entity, so if GAE started to implicitly index the the quota makes sense. (code is available on http://github.com/onemanbucket/alleg-leade

Re: [google-appengine] Billing Command Failed

2011-02-08 Thread 한우진
Thank you for replying, but I've already tried it several times, and no reply has come yet. Anybody who could change billing budget in past 10 hours? 2011/2/9 Robert Kluin > I would file a billing support issue. > > http://code.google.com/support/bin/request.py?contact_type=AppEngineBillingSuppo

Re: [google-appengine] Re: Task Queue Over Improperly Quota

2011-02-08 Thread David Mora
seems to be behaving correctly now The mapreduce that filled up all our quotas yesterday is currently running (hour and a half) and is using the right amount of "stored task bytes" thanks btw ! On 8 February 2011 14:03, Wesley C (Google) wrote: > it was something behind the scenes, and you have

[google-appengine] Linking a domain without Google Apps

2011-02-08 Thread Sean
Hi, I'm trying to link a domain to my App, but I'm unable to register it with Google Apps because it contains "profanity" (even though my app id contains the same words) The Google Apps help says it is completely absolutely impossible to bypass the filter. So is there another way to link my do

[google-appengine] Empty blobs in blobstore

2011-02-08 Thread Piotr Jaroszyński
Hello, I have a form with an optional file upload handled by blobstore. By optional I mean that the form is always submitted to an url created with blobstore.create_upload_url() but the user is not required to actually upload a file. What I am noticing recently is that even if a user doesn't submi

[google-appengine] BlobStore - DownloadError: ApplicationError: 2 [Errno 35] Resource temporarily unavailable

2011-02-08 Thread Jawon
In my app, the user uploads one or more files as blobs, then the app takes the blobs, adds BlobReader objects of them to a SOAP request, and sends the request to an external server. I've tested the SOAP request sender outside GAE (using open(filename) instead of BlobReader), and also confirmed that

[google-appengine] Mobile Integration and the Channel API

2011-02-08 Thread Richard Arrano
Hello, I was thinking about how to integrate my App Engine app with mobile devices; my favorite choices so far are phonegap and Titanium, and it seems relatively simple to port things to these platforms. However, the sticking point has been that my application uses the Channel API. What I'm wonderi

Re: [google-appengine] Billing Command Failed

2011-02-08 Thread 한우진
I tried again and it was done. I think there was a bug in appengine billing system and fixed. Thank you :) 2011/2/9 한우진 > Thank you for replying, but I've already tried it several times, and no > reply has come yet. > Anybody who could change billing budget in past 10 hours? > > 2011/2/9 Robert

[google-appengine] Can App Engine for Business be behind the firewall of the company?

2011-02-08 Thread Zeynel
I wasn't sure reading documentation: http://code.google.com/appengine/docs/python/overview.html Thanks. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe

[google-appengine] Abnormal Number Of Instances and High CPU

2011-02-08 Thread Stephen Johnson
I understand some people were having issues with task queue after the maintenance period. Well, I'm seeing an out of the norm number of instances and higher than usual CPU and latency since the maintenance period. Before the maintenance period things were extremely fast (in fact they were screaming

[google-appengine] Re: Adding a custom domain?

2011-02-08 Thread ultimatebuster
How exactly do I do that? On Feb 7, 4:35 pm, Robert Kluin wrote: > Try adding the app from your domain management pannel.  I have no > issues with apps on 'domain alias' subdomains. > > Robert > > > > On Sun, Feb 6, 2011 at 15:51, ultimatebuster wrote: > > I have this domain registered as a seco

[google-appengine] Re: Adding a custom domain?

2011-02-08 Thread ultimatebuster
Never mind, I figured it out. On Feb 8, 10:24 pm, ultimatebuster wrote: > How exactly do I do that? > > On Feb 7, 4:35 pm, Robert Kluin wrote: > > > > > Try adding the app from your domain management pannel.  I have no > > issues with apps on 'domain alias' subdomains. > > > Robert > > > On Sun,

[google-appengine] Quota of stored data doesn't update after deleting all data

2011-02-08 Thread Upsuper Quan
I have an application whose id is fanfou-top100 on gae. And today I deleted all data of this application since the quota is almost reached. I have deleted all data of my application by using the Delete Entities in Datastore Admin in my Admin Console, but after deleting the data, the quota of st

Re: [google-appengine] Quota of stored data doesn't update after deleting all data

2011-02-08 Thread Robert Kluin
It does not immediately reset. Give it a few hours. Robert On Tue, Feb 8, 2011 at 23:05, Upsuper Quan wrote: > I have an application whose id is fanfou-top100 on gae. And today I deleted > all data of this application since the quota is almost reached. > I have deleted all data of my a

Re: [google-appengine] Quota of stored data doesn't update after deleting all data

2011-02-08 Thread Upsuper Quan
so do you know how long will it take? -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@google

Re: [google-appengine] Can App Engine for Business be behind the firewall of the company?

2011-02-08 Thread Robert Kluin
Not unless Google's datacenter is behind your firewall. "Your Python application runs on Google's scalable infrastructure, and uses large-scale persistent storage and services." (first paragraph of the doc you linked to). Are you trying to restrict access to you app, or give your app secure

Re: [google-appengine] Can I now in wich version my code is running?

2011-02-08 Thread Robert Kluin
How about applicationVersion? http://code.google.com/appengine/docs/java/javadoc/com/google/appengine/api/utils/SystemProperty.html#applicationVersion Robert On Tue, Feb 8, 2011 at 14:21, nacho wrote: > For example, I have this method to know if my code is running is hosted mode > or over

Re: [google-appengine] Datastore quota full, statistics reports ~10% usage

2011-02-08 Thread Robert Kluin
Hi Erik, If you mark them as unindexed, new entities will not be indexed, but you'll have to re-put your existing data to clear up the space. Robert On Tue, Feb 8, 2011 at 16:54, Erik Lindblad wrote: > Hey guys! > > This seems to be exactly what's happening. I'll take a look at it > t

Re: [google-appengine] Quota of stored data doesn't update after deleting all data

2011-02-08 Thread Robert Kluin
I don't, no. People usually see it drop down within a few hours though. On Tue, Feb 8, 2011 at 23:56, Upsuper Quan wrote: > so do you know how long will it take? > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this

Re: [google-appengine] Quota of stored data doesn't update after deleting all data

2011-02-08 Thread Upsuper Quan
I have been waiting for about 7 hours, but it doesn't drop down... On Wed, Feb 9, 2011 at 1:21 PM, Robert Kluin wrote: > I don't, no. People usually see it drop down within a few hours though. > > > > > > > On Tue, Feb 8, 2011 at 23:56, Upsuper Quan wrote: > > so do you know how long will it t