Web crawling/spidering with LiveCode?
keith.clarke at clarkeandclarke.co.uk
Thu Jun 16 01:25:55 CDT 2011
Having made some progress with screen-scraping specific web page content into LiveCode, I'm now wondering about how I might automate the process of finding the pages of interest on a website.
The idea is to work through a documentation site (or wiki), returning structured tabular data containing key/value pairs, together with the the links to the relevant pages.
Has anyone experimented with creating website crawler/spidering procedures within LiveCode - or looked into accessing, parsing and processing site-map files?
More information about the use-livecode