HI ALL

   Urgently required some help.

I am facing a slowness problem while writing the data to the big query.

My problem is I have 5000 task , and each task is interacting with the Rest 
Api. The rest api is giving me the JSON response. I am parsing the JSON 
response, and the same response I have to write to big query. 

Every JSON response will give me around 3000 List of JSON Array.
If I calculate the total data which will get inserted in the google big 
query is around 15000000. 
To insert 47000 record its taking 1 hour. If I have to insert lakhs of 
record of data , my performance is getting hit.

Please give a good suggestion to improve the time complexity for this 
problem. How I will resolve this using Google App Engine,

-- 
You received this message because you are subscribed to the Google Groups 
"Google App Engine" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/google-appengine.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/google-appengine/eedb801c-9a33-4864-bd72-d818abc43e97%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
  • [google-appengine] H... Hemanth Kumar

Reply via email to