Re: url no longer working as expected

2024-06-28 Thread Richard Gaskin via use-livecode
Likely the case. The expense of collating all that data and presenting it to their site visitors is considerable. They use advertising to cover those costs. If the data were easily scrapable, scrapers diminish revenue, putting the resource itself at risk. Some data provides offer APIs. When

Re: url no longer working as expected

2024-06-28 Thread Paul Dupuis via use-livecode
Yes. put url "https://uk.finance.yahoo.com/quote/SHEL.L/history/"; In the message box on 9.6.11 and 9.6.12 under Windows 11. Both return a pile of HTML text that is all the formatting and CSS linked stuff to show a "404" page. This suggests that put URL is working and it is the Yahoo server

Re: url no longer working as expected

2024-06-28 Thread Bob Sneidar via use-livecode
Did you try that in the message box? Bob S > On Jun 28, 2024, at 10:50 AM, Paul Dupuis via use-livecode > wrote: > > I get a response from Yahoos that is an html page with a 404 information as > part of it. > > This happens under LC 9.6.12 and 9.6.11 > > I think this is Yahoo Finance not

Re: url no longer working as expected

2024-06-28 Thread Paul Dupuis via use-livecode
I get a response from Yahoos that is an html page with a 404 information as part of it. This happens under LC 9.6.12 and 9.6.11 I think this is Yahoo Finance not being able to detect the browser type and intentionally returning a 404 as a method of deterring screen scraping. On 6/28/2024 1:

Re: url no longer working as expected

2024-06-28 Thread Bob Sneidar via use-livecode
I get the HTML of the page. Are you trying to open the page in a browser? Bob S > On Jun 28, 2024, at 10:04 AM, Hugh Senior via use-livecode > wrote: > > > Platform: Windows 11, LC 9.6.12 > Query: Using URL to access a web page > > Problem: > Enter "https://uk.finance.yahoo.com/quote/SHEL.