How can I scrape text from a web page that is generated by javascript?

Mike Kerner MikeKerner at roadrunner.com
Mon Jul 24 13:34:10 EDT 2017


Don't know what to tell you.  I scrape a few hundred thousand pages at a
time from multiple sites with this plugin.

On Mon, Jul 24, 2017 at 12:12 PM, Bob Sneidar via use-livecode <
use-livecode at lists.runrev.com> wrote:

> No workie. I create a new sitemap with a URL of http://192.168.1.87 and
> it tells me it's not a valid URL!!! That is strike 3 for me when I
> encounter that kind of problem. Even if I load the full url default page
> for that device, then copy paste the URL it STILL tells me it's invalid.
>
> Bob S
>
>
> > On Jul 24, 2017, at 06:13 , Mike Kerner via use-livecode <
> use-livecode at lists.runrev.com> wrote:
> >
> > Roger,
> > I use a chrome plugin called "Web Scraper", and then I process the CSV in
> > LC - then again, I'm usually scraping many many many pages, and this
> > automates the process.
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>



-- 
On the first day, God created the heavens and the Earth
On the second day, God created the oceans.
On the third day, God put the animals on hold for a few hours,
   and did a little diving.
And God said, "This is good."



More information about the Use-livecode mailing list