How can I scrape text from a web page that is generated by javascript?

Roger Eller roger.e.eller at sealedair.com
Mon Jul 24 14:59:15 EDT 2017


I installed the plugin, but am unfamiliar with how to use it.  I didn't see
an obvious way to filter the page down to the current prices I want to grab.

~Roger

On Mon, Jul 24, 2017 at 1:34 PM, Mike Kerner via use-livecode <
use-livecode at lists.runrev.com> wrote:

> Don't know what to tell you.  I scrape a few hundred thousand pages at a
> time from multiple sites with this plugin.
>
> On Mon, Jul 24, 2017 at 12:12 PM, Bob Sneidar via use-livecode <
> use-livecode at lists.runrev.com> wrote:
>
> > No workie. I create a new sitemap with a URL of http://192.168.1.87 and
> > it tells me it's not a valid URL!!! That is strike 3 for me when I
> > encounter that kind of problem. Even if I load the full url default page
> > for that device, then copy paste the URL it STILL tells me it's invalid.
> >
> > Bob S
> >
> >
> > > On Jul 24, 2017, at 06:13 , Mike Kerner via use-livecode <
> > use-livecode at lists.runrev.com> wrote:
> > >
> > > Roger,
> > > I use a chrome plugin called "Web Scraper", and then I process the CSV
> in
> > > LC - then again, I'm usually scraping many many many pages, and this
> > > automates the process.
> > > _______________________________________________
> > > use-livecode mailing list
> > > use-livecode at lists.runrev.com
> > > Please visit this url to subscribe, unsubscribe and manage your
> > subscription preferences:
> > > http://lists.runrev.com/mailman/listinfo/use-livecode
> >
> >
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> > subscription preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
> >
>
>
>
> --
> On the first day, God created the heavens and the Earth
> On the second day, God created the oceans.
> On the third day, God put the animals on hold for a few hours,
>    and did a little diving.
> And God said, "This is good."
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>



More information about the Use-livecode mailing list