LC7 and 8 - Non responsive processing large text files

Roland Huettmann roland.huettmann at gmail.com
Fri Apr 15 13:07:04 EDT 2016


Absolutely Richard

It changed the execution speed dramatically reducing the buffer size. I
really still need the time to set up various tests and check it carefully
trying to find the right size on my machine. Maybe 128k - we will see.

>From Bernd - in an internal mail - he worked on my script and made that
happen changing the buffersize.: It is Windows. Same as you are reporting
about Linux.

Optimization here is the goal. Yes.

But also I would like to optimize the code if that gives additional
advantages.

Also to be noted by Bernd, the speed also dramatically increases using an
SSD. I am still using old fashioned hard drive (.

Roland





On 15 April 2016 at 17:41, Richard Gaskin <ambassador at fourthworld.com>
wrote:

> Roland Huettmann wrote:
>
> < Richard: "You may find the sample stack attached to this report useful:
>> <http://quality.livecode.com/show_bug.cgi?id=17210>"
>>
>> Richard, thanks a lot for the sample stack. I downloaded and tested
>> "LargeFileRead.livecode". Unfortunately it also creates the same symptoms
>> on Windows...
>>
>
> The responsiveness is a separate matter, well covered in Mark's replies.
>
> Here my interest is in making sure your operation runs and efficiently as
> it can.
>
> Have you had a chance to explore measuring different executions times as
> you adjust the kBufferSize constant at the top of the script?
>
> Here on my Linux box I found, rather surprisingly, that a buffer as small
> as 128k delivered optimal speeds.  In discussing this with Peter Brett it
> turns out there are memory-mappings provided by the OS that seem to play a
> role there.
>
> It would be very interesting to me to learn what buffer size you find
> optimal on Windows.
>
> --
>  Richard Gaskin
>  Fourth World Systems
>  Software Design and Development for the Desktop, Mobile, and the Web
>  ____________________________________________________________________
>  Ambassador at FourthWorld.com                http://www.FourthWorld.com
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>



More information about the Use-livecode mailing list