How can I scrape text from a web page that is generated by javascript?

Roger Eller roger.e.eller at sealedair.com
Mon Jul 24 16:27:56 EDT 2017


Scratch that.  It's amazing what watching the video or reading the docs can
do to enlighten the unenlightened.


On Mon, Jul 24, 2017 at 2:59 PM, Roger Eller <roger.e.eller at sealedair.com>
wrote:

> I installed the plugin, but am unfamiliar with how to use it.  I didn't
> see an obvious way to filter the page down to the current prices I want to
> grab.
>
> ~Roger
>
> On Mon, Jul 24, 2017 at 1:34 PM, Mike Kerner via use-livecode <
> use-livecode at lists.runrev.com> wrote:
>
>> Don't know what to tell you.  I scrape a few hundred thousand pages at a
>> time from multiple sites with this plugin.
>>
>> On Mon, Jul 24, 2017 at 12:12 PM, Bob Sneidar via use-livecode <
>> use-livecode at lists.runrev.com> wrote:
>>
>> > No workie. I create a new sitemap with a URL of http://192.168.1.87 and
>> > it tells me it's not a valid URL!!! That is strike 3 for me when I
>> > encounter that kind of problem. Even if I load the full url default page
>> > for that device, then copy paste the URL it STILL tells me it's invalid.
>> >
>> > Bob S
>> >
>> >
>> > > On Jul 24, 2017, at 06:13 , Mike Kerner via use-livecode <
>> > use-livecode at lists.runrev.com> wrote:
>> > >
>> > > Roger,
>> > > I use a chrome plugin called "Web Scraper", and then I process the
>> CSV in
>> > > LC - then again, I'm usually scraping many many many pages, and this
>> > > automates the process.
>> > > _______________________________________________
>> > > use-livecode mailing list
>> > > use-livecode at lists.runrev.com
>> > > Please visit this url to subscribe, unsubscribe and manage your
>> > subscription preferences:
>> > > http://lists.runrev.com/mailman/listinfo/use-livecode
>> >
>> >
>> > _______________________________________________
>> > use-livecode mailing list
>> > use-livecode at lists.runrev.com
>> > Please visit this url to subscribe, unsubscribe and manage your
>> > subscription preferences:
>> > http://lists.runrev.com/mailman/listinfo/use-livecode
>> >
>>
>>
>>
>> --
>> On the first day, God created the heavens and the Earth
>> On the second day, God created the oceans.
>> On the third day, God put the animals on hold for a few hours,
>>    and did a little diving.
>> And God said, "This is good."
>> _______________________________________________
>> use-livecode mailing list
>> use-livecode at lists.runrev.com
>> Please visit this url to subscribe, unsubscribe and manage your
>> subscription preferences:
>> http://lists.runrev.com/mailman/listinfo/use-livecode
>>
>
>



More information about the use-livecode mailing list