url no longer working as expected

[Paul Dupuis]

Yes.

put url "https://uk.finance.yahoo.com/quote/SHEL.L/history/"

In the message box on 9.6.11 and 9.6.12 under Windows 11. Both return a 
pile of HTML text that is all the formatting and CSS linked stuff to 
show a "404" page.

This suggests that put URL is working and it is the Yahoo server that 
returning a different page of HTML/CSS for the put vs when you enter the 
URL in a browser (Firefox in my case, where I get the Yahoo finance data 
for Shell, although I did have to respond to a Cookies dialog first).


On 6/28/2024 2:03 PM, Bob Sneidar via use-livecode wrote:
> Did you try that in the message box?
>
> Bob S
>
>
>> On Jun 28, 2024, at 10:50 AM, Paul Dupuis via use-livecode <use-livecode at lists.runrev.com> wrote:
>>
>> I get a response from Yahoos that is an html page with a 404 information as part of it.
>>
>> This happens under LC 9.6.12 and 9.6.11
>>
>> I think this is Yahoo Finance not being able to detect the browser type and intentionally returning a 404 as a method of deterring screen scraping.
>>
>>
>> On 6/28/2024 1:04 PM, Hugh Senior via use-livecode wrote:
>>> Platform: Windows 11, LC 9.6.12
>>> Query: Using URL to access a web page
>>>
>>> Problem:
>>> Enter "https://uk.finance.yahoo.com/quote/SHEL.L/history/" into any web
>>> browser and the page is displayed as expected.
>>>
>>> Use LC's URL command to access the same page direct returns a 404
>>> put url "https://uk.finance.yahoo.com/quote/SHEL.L/history/"
>>>
>>> Anyone got any insights?
>>>
>>> Hugh Senior
>>>
>>>
>>> _______________________________________________
>>> use-livecode mailing list
>>> use-livecode at lists.runrev.com
>>> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
>>> http://lists.runrev.com/mailman/listinfo/use-livecode
>>
>> _______________________________________________
>> use-livecode mailing list
>> use-livecode at lists.runrev.com
>> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
>> http://lists.runrev.com/mailman/listinfo/use-livecode
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode