libcurl's throttling option can trigger its own transfer stall detection

Hi all, I'm not completely sure that I'm interpreting this correctly, but it seems that setting the "throttling" option for uploads falls foul of the "low speed limit". Take the following: ``` #include #include #include #include #include // Not sure who's defining this on Windows but i

Re: libcurl's throttling option can trigger its own transfer stall detection

On 26/02/2020 22:16, Daniel Stenberg wrote: > On Tue, 25 Feb 2020, Tomalak Geret'kal via curl-library > wrote: > >> I'm not completely sure that I'm interpreting this >> correctly, but it seems that setting the "throttling" >> option for uploads

Re: curl is 22 years old now!

On 2020-03-19 23:28, Daniel Stenberg via curl-library wrote: > Hi friends, > > I just wanted to highlight the fact that today is exactly 22 years since the > first ever curl release shipped. Lots of things have happened and changed of > the years. > > I dug up data and generated 22 graphs

Re: Use of cookies

On 06/04/2020 17:41, Mac-Fly via curl-library wrote: > I understand that and I was compiling a minimal example > for you. While doing so I found the error!!! > In the libCURL example (cookies_interface.c), you call: > curl_easy_setopt([CURL_handle], CURLOPT_COOKIELIST, cookie); > ...where "cookie"

Re: Use of cookies

On 06/04/2020 18:02, Tomalak Geret'kal wrote: > It is more likely that curl_east_setopt is expecting the > C-string you give it to live for the duration of the handle > (as it does with the request headers). > > Thus, switching to a "buffer" may not be enough (the pointer > you were extracting from

Re: Fwd: Libcurl error message [ Undefined symbols for architecture x86_64 ]

On 21/09/2020 01:30, @roadup via curl-library wrote: > I'm learning how to use curl library.  but I got an error > about link libcurl. The first thing that jumps out at me here (though I had to squint at your console output: please provide this as text, not images!) is that you're building libcurl

Re: Problem setting content-type header when connecting to Microsoft Exchange

On 08/10/2020 00:06, Jeffrey McKay via curl-library wrote: > This seems straightforward enough, except that my code *is* explicitly > setting the content-type header to be > "text/html; charset=utf-8". I do this via CURLOPT_HTTPHEADER. I have > checked and re-checked, and there is no doubt > that

curl_easy_recv and SIGPIPE

Hi guys, curl_easy_perform temporarily ignores /SIGPIPE/. Why doesn't curl_easy_recv? Should it? I'm finding that curl_easy_recv after sending an iOS app to the background via the lock button, then waking it all up again, can raise /SIGPIPE/ (which crashes the app in my case). Fundamentally, th

Re: curl_easy_recv and SIGPIPE

On 26/10/2020 16:15, Daniel Stenberg wrote: > On Mon, 26 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >> curl_easy_perform temporarily ignores /SIGPIPE/. >> >> Why doesn't curl_easy_recv? Should it? > > I can't remember that this is a del

Re: curl_easy_recv and SIGPIPE

On 26/10/2020 22:09, Daniel Stenberg wrote: > On Mon, 26 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >> On closer examination, sigpipe_ignore is a no-op unless >> USE_OPENSSL or USE_MBEDTLS are set. > > Are you saying you're not using any

Re: curl_easy_recv and SIGPIPE

On 26/10/2020 23:30, Daniel Stenberg wrote: > On Mon, 26 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >> Based on the `#if defined`s in sigpipe.h, from what I can >> tell, curl doesn't protect anything from SIGPIPE unless >> OpenSSL or MBEDTLS

Re: curl_easy_recv and SIGPIPE

On 26/10/2020 23:54, Daniel Stenberg wrote: > On Mon, 26 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >>> I don't think so, since it uses callbacks to our code >>> for the actual sending to the socket and we set the >>> socket to not cau

Re: curl_easy_recv and SIGPIPE

On 27/10/2020 00:08, Daniel Stenberg wrote: > On Mon, 26 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >>> The question is still: why do you get a SIGPIPE? >>> >> I'm just telling you what I've seen Daniel. > > What did you see? F

Re: curl_easy_recv and SIGPIPE

On 27/10/2020 12:33, Daniel Stenberg wrote: > On Tue, 27 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >>> What did you see? From where is the SIGPIPE and was >>> SO_NOSIGPIPE set on that socket? >>> >> I've said already: from t

Re: curl_easy_recv and SIGPIPE

On 27/10/2020 14:59, Daniel Stenberg wrote: > On Tue, 27 Oct 2020, Tomalak Geret'kal via curl-library > wrote: > >> I don't think there's anything to do here in libcurl, >> beyond confirming (or denying!) that sigpipe_ignore is >> /supposed/ to be a no-

Re: Is there a guarantee that for multiple parallel responses header function and write function will not be interleaved?

On 13/11/2020 13:59, Arvind Srivaths via curl-library wrote: > > Firstly, I would like to thank all the developers working > on Curl for a reliable library that is easy to use for > beginners and yet is customisable for very advanced work. > > I am using curl to make REST calls and each request > c

Re: Feature request: extend CURLOPT_RESOLVE to allow adding non-permanent DNS cache entries

On 18/11/2020 15:05, Groke, Paul via curl-library wrote: > On Wed, 18 Nov 2020, Daniel Stenberg wrote: > >> Exactly how to extend the format can of course be further discussed. I think >> I would prefer a slighly more descriptive text, like perhaps ":temp" - and >> we could then introduce that ex

Re: CURLOPT_RESOLVE problem

On 19/11/2020 14:48, James Read via curl-library wrote: > I have some error messages in libcurl logs like as follows: > > == Info: Couldn't parse CURLOPT_RESOLVE entry > 'http://kitcheneroktoberfest.com/:443:69.172.201.153 > '! > == Info: Couldn'

Re: Epoll performance issues.

On 23/11/2020 20:16, James Read via curl-library wrote: > I have attempted to make two minimal codes that > demonstrate my problem. > > The first can be > downloaded from https://github.com/JamesRead5737/fast > > It basically recursively downloads http://www.

Re: Online API

On 04/12/2020 18:21, Request X via curl-library wrote: > Hello cURL subscribers, > I code in node.js and recently wanted to use cURL in a > node.js environment. I noticed that while there are some > modules that say they are cURL, most are not actually > based on curl, which sometimes results in cU

Re: Continue Download C++ Implementation

On 08/12/2020 15:49, Tomas Berger via curl-library wrote: > I have been trying to be able to continue a download from > a half finished state, my write function is rather simple, > but I have a couple of couts. > The idea is to download to a temporary file, and when the > download is complete copy,

Re: libcurl read-llike interface.

On 14/12/2020 16:35, Daniel Stenberg via curl-library wrote: > On Mon, 14 Dec 2020, XSLT2.0 via curl-library wrote:  > >> It is also pretty un-optimised: the write callback could >> be called multiple times in a multi_perform cycle. > > There's this saying about premature optimization... You mean,

Re: time to remove Visual Studio project files?

On 14/12/2020 08:25, Daniel Stenberg via curl-library wrote: > On Sat, 5 Sep 2020, Daniel Stenberg via curl-library wrote: > >> I'd like to get a better feel for the need to ship the >> visual studio project files we currently host in the >> project/ directory. > > We're now three months later and

Re: FTP with CURLOPT_NOBODY different behavior when performing onnon-existing files #5953

On 15/12/2020 15:00, Lukas Friembichler via curl-library wrote: > Hi all, > > I have run into a problem when updating to the most recent > CURL release (7_74, I was on 7_70 before) - it seems I can > no longer rename directories on my ftp server, I suspect > due to issue #5953 Why can't your FTP s

Re: FTP with CURLOPT_NOBODY different behavior when performingonnon-existing files #5953

On 15/12/2020 17:51, Lukas Friembichler via curl-library wrote: > Thanks for your reply > >> Why can't your FTP server report the size of that file? >> It does >> exist. > > I was under the impression that this simply didn't work > for directories > (like I said I'm not a FTP expert), so I thought

Re: curl_easy_pause() documentation question

On 28/12/2020 10:22, XSLT2.0 via curl-library wrote: > Hello, > > curl_easy_pause() documentation says: >> While it may feel tempting, take care and notice that you cannot >> call this function from another thread. To unpause... > > I have tested the opposite: we can although the document says "you

Re: Binary garbage for amazon?

On 31/12/2020 16:30, Mac-Fly via curl-library wrote: > Dear all, > > amazon.com was working just fine with cURL until > yesterday. When I issue: > > curl.exe -A "Mozilla/5.0 (Windows NT 6.1; Win64; x64; > rv:59.0) > Gecko/20100101 Firefox/59.0" https://www.amazon.com -o > "out.html" > > ...I get bi

Re: Binary garbage for amazon?

On 31/12/2020 16:52, Tomalak Geret'kal wrote: > Per the headers, it's gzip-encoded. If you output to > out.html.gzip, then unzip, it'll be fine. > > I don't know why this just happened. I would have thought > curl would auto decode the contents to be honest. > > curl 7.29.0 (x86_64-redhat-linux-gnu

Re: Binary garbage for amazon?

On 31/12/2020 16:54, Tomalak Geret'kal wrote: > On 31/12/2020 16:52, Tomalak Geret'kal wrote: >> Per the headers, it's gzip-encoded. If you output to >> out.html.gzip, then unzip, it'll be fine. >> >> I don't know why this just happened. I would have thought >> curl would auto decode the contents t

Re: Binary garbage for amazon?

On 31/12/2020 16:56, Tomalak Geret'kal via curl-library wrote: > Okay, this has been discussed before > (https://github.com/curl/curl/issues/3192) and is deemed > by-design for compatibility reasons. > > I guess Amazon returning gzipped data regardless of the > request head

Re: Git protocol support of (lib)curl.

On 06/01/2021 00:29, Hongyi Zhao via curl-library wrote: > $ curl git://git.sv.gnu.org/emacs.git > curl: (1) Protocol "git" not supported or disabled in libcurl > > So, any hints for the git protocol support of (lib)curl? > > Regards, Why would curl support git? Use a git client! Cheers ---

Re: On memory-leaks as security problems

On 07/01/2021 14:07, Daniel Stenberg via curl-library wrote: > For example, I really cannot with a straight face write up > a security advisory for a memory leak in libcurl that > leaks a few bytes for a transfer in a specific setup even > if there is a single user somewhere who runs an up that > *

Re: On memory-leaks as security problems

On 07/01/2021 16:27, Erik Janssen via curl-library wrote: >> In the curl security team, we have a discussion going on with someone who >> wants a set of memory-leaks we fixed in the past to be highlighted and >> reported as "security problems". > So that street should be wiped (if that's a way to

Re: On memory-leaks as security problems

On 07/01/2021 13:47, Jeffrey Walton via curl-library wrote: > All memory leaks can lead to resource exhaustion on > platforms that use > managed languages due to the process lifecycle model. > > The managed languages load and unload a shared object multiple times > throughout the lifetime of the pr

Re: Can the CURLOPT_WRITEFUNCTION ever be called when CURLOPT_UPLOAD is set to 1?

On 18/01/2021 19:48, Andreas Falkenhahn via curl-library wrote: > On 18.01.2021 at 15:49 Daniel Stenberg wrote: > >> This thread made me refresh the HTTP upload secion in "everything curl": >>https://ec.haxx.se/libcurl-http/upload >> Does it perhaps help to shine some light on this? > Yes, it d

Re: Periodic segfault in curl_easy_perform()

On 10/02/2021 12:35, Adrián Gimeno Balaguer via curl-library wrote: > The program crashes after 5-10 minutes since startup > (provided the periodic check always sends files) at > curl_easy_perform() with the following stack trace: > > What could I be doing wrong? > Any one of many, many things. Yo

Re: Non-constness of field "data" in "struct curl_blob" with setopt

On 22/02/2021 15:21, Laurent Dufresne via curl-library wrote: > > Hi everyone, > >   > > Version 7.71.0 of libcurl added few more options to enable > user to easily use Mutual TLS. > > Two of them, namely CURLOPT_SSLCERT_BLOB and > CURLOPT_SSLKEY_BLOB, take a “struct curl_blob” as > parameter and t

Re: Non-constness of field "data" in "struct curl_blob" with setopt

On 22/02/2021 16:43, Laurent Dufresne via curl-library wrote: > -Original Message- > From: curl-library On Behalf Of Tomalak > Geret'kal via curl-library > Sent: Monday, February 22, 2021 5:16 PM > To: curl-library@cool.haxx.se > Cc: Tomalak Geret'kal >

Re: Periodic segfault in curl_easy_perform()

On 09/03/2021 14:23, Adrián Gimeno Balaguer via curl-library wrote: > Considering the fact that apparently Valgrind is aimed to > detect memory leaks and it can't (easily?) detect the > source code line/s that might cause deferred UB errors, > should I even bother to install and run it on the test

Re: Periodic segfault in curl_easy_perform()

On 09/03/2021 19:48, Adrián Gimeno Balaguer wrote: > I had been passing a pointer of an unrelated type to > curl_easy_setopt > (to set CURLOPT_POST), instead of the proper CURL handle. I've just > removed the call since the POST should be enabled already when > supplying POST fields (which I do). A

Re: TFTP get filesize/file exist

On 24/03/2021 14:45, Tomas Berger via curl-library wrote: > I have been trying to create a function that returns true > if a file exists or not on a TFTP server. I had a function > for this for SFTP/FTP using CURLOPT_NOBODY, and that has > been for those protocols. However, did not work for TFTP. >

Re: DNS cache performance

On 25/03/2021 15:28, Sergey Polovko via curl-library wrote: > 40K - 60K of hosts every 15 seconds, performing around 3K requests per second :O What sort of use case is this? This strikes me as an edge case for any software. Cheers ---

Re: self signed certificates evaluation fails on Windows and OSX using the system provided back end

On 10/04/2021 23:05, Daniel Stenberg via curl-library wrote: > > >> Shouldn't libcurl offer a switch to disable revocation >> check of self-signed >> certificates? > > libcurl doesn't know "self-signed". but you can ask it to > disable revocation checks with CURLOPT_SSL_OPTIONS's > CURLSSLOPT_NO_RE

Re: Support better than MD5 hostkey hash

On 09/06/2021 12:29, Mats Lindestam via curl-library wrote: > > ​Hi, > > > I am new to this community and I am looking into how to > develop support for this > feature: https://curl.se/docs/todo.html#Support_better_than_MD5_hostkey > ​

Re: curl websockets

On 23/06/2021 16:23, Daniel Stenberg via curl-library wrote: > On Tue, 22 Jun 2021, Weston Schmidt via curl-library wrote: > >> I'm interested in feedback or suggestions for what/how to >> define a good websocket API that complements libcurl. > > My very simple idea on how it could be added to the

Re: curl websockets

On 23/06/2021 16:38, Henrik Holst via curl-library wrote: > Would it not be better to use the normal URI used for > Websockets which are "ws(s)://" instead of the http(s) or > am I missing something? Yes, this. Cheers --- Unsubscribe

Re: curl websockets

On 23/06/2021 20:23, Weston Schmidt wrote: > Support for ws(s):// appears to depend on both the client and server > handling the scheme. I'd imagine if we chose some reasonable defaults > like wss:// implies websocket and provide the ability to request that > an https:// be handled as a websocket

Re: Recv failure error under censorship conditions

On 15/07/2021 13:50, Gealber Morales via curl-library wrote: > > The curious thing is that I can access google from the > browser, and I tried another thing, I made the same > request changing the `User-Agent` to simulate the request > of a browser: [..] > In this case, I get the expected response

Re: Read from specified location

On 02/08/2021 16:01, jeev2000 via curl-library wrote: > hello, > > If accept ranges are not supported, how to seek and start > a read from specific location. > > I am using Read callback using |CURLOPT_WRITEFUNCTION. I > don't see any option to be specified for reading from > specifed location. Eve