I don't know if this will help, but I had to set the curl option FOLLOWLOCATION in order to retrieve binary data from GitHub. This ensure that redirects are followed.
Thanks, Dick Brooks Active Member of the CISA Critical Manufacturing Sector, Sector Coordinating Council - A Public-Private Partnership Never trust software, always verify and report! T Risk always exists, but trust must be earned and awarded.T https://businesscyberguardian.com/ Email: d...@businesscyberguardian.com Tel: +1 978-696-1788 -----Original Message----- From: curl-users <curl-users-boun...@lists.haxx.se> On Behalf Of toby via curl-users Sent: Friday, January 10, 2025 11:20 AM To: curl-users@lists.haxx.se Cc: paste...@gmx.com Subject: Re: curl getting different html Thanks Hans for the code and your help i don't get the gz'ed page with curl at all (no matter what i send - headers/no header -L/no -L etc) - just the 'needs javascript and cookies' page' a line from 'band of brothers' comes to mind here https://www.youtube.com/watch?v=cQE1YIJDNWo substitue 'cloudfare' for capt sobel and 'curl' for sgt randelman :) On Fri, 10 Jan 2025 16:17:24 +0100 Hans Henrik Bergan <divinity76+c...@gmail.com> wrote: > >can curl give me a gzipped page if i use the correct header? (hint > >hint - can you tell me what to use for curl) > > if you want to witness the compressed version first-hand, run > > curl --header 'Accept-Encoding: gzip, deflate, br, zstd' -o - > https://www.podchaser.com/podcasts/crypto-corner-bitcoin-and-bloc-9509 > 63/episodes/recent > > probably useless tho -- Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users Etiquette: https://curl.se/mail/etiquette.html -- Unsubscribe: https://lists.haxx.se/mailman/listinfo/curl-users Etiquette: https://curl.se/mail/etiquette.html
