pycurl and MAX_RECV_SPEED_LARGE

[Emanuel dos Reis Rodrigues]

Hello Folks,

I have a problem with pycurl. I need to do a download with a lower rate, 
+ or - 1 Kb / 128bytes.

I use the  MAX_RECV_SPEED_LARGE setting with 128 as value.

My problem is:  The download take a long time to be finished.

File:  test.jpg 92 KB, with 128 rate,  take 2.38 Minutes.

The strange behavior is that:   The connection keep ESTABLISHED only 1/5 
from all time ( 2.38 minutes )


Analyzing with wireshark, I see that: After pass 1/5 of all time, do not 
change packages anymore until reach 2.38 minutes, and client send a RST ACK.

Have a high delay between the transfer and the finished connection.


I need to solution that I can download with a lower rate, include using 
Multi-Threading with many simultaneous downloads.



Follow my test code:


import pycurl
import random
import os



def download1(t_url):
        headers = [
                   'Accept: 
text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8',
                   'Accept-Language: en-us,pt-br;q=0.8,pt;q=0.5,en;q=0.3',
                   'Accept-Encoding: gzip,deflate',
                   'Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7',
                   'Cache-control: no-cache',
                   'Pragma: no-cache',
                   'Connection: Keep-Alive',
                   'Keep-Alive: 300']

        c = pycurl.Curl()
        f = "/tmp/teste.tmp"
        c.setopt(c.URL, t_url)
       c.setopt(c.FAILONERROR, 1)
#       c.setopt(c.VERBOSE, 1)
        c.setopt(c.MAX_RECV_SPEED_LARGE, 128)
#        c.setopt(c.TIMEOUT, timeout)
        c.setopt(c.NOSIGNAL, 1)
        c.setopt(pycurl.HTTPHEADER, headers)
        c.setopt(c.CONNECTTIMEOUT,10)
        c.setopt(c.WRITEDATA, file(f,"w"))
        c.setopt(c.USERAGENT,"XADASSDASDASD")
        try:
                c.perform()
        except pycurl.error:
                print "Connection Problem"
                c.close()
                return 2
        else:
                print "Download Complete"
                print f
                c.close()
                return 0

download1("http://192.168.111.128/teste.jpg";)


Thank You.

Emanuel





--
http://mail.python.org/mailman/listinfo/python-list