process data in steps of 50 lines

Matthias Rebbe matthias_livecode at me.com
Tue Jun 7 17:07:33 EDT 2011


Hi Mark,

could you please explain how you did that. How you chunk the data into groups?

That is not clear for me.

Regards,

Matthias
Am 07.06.2011 um 20:46 schrieb Mark Talluto:

> On Jun 7, 2011, at 6:27 AM, Mark Schonewille wrote:
> 
>> Since the data is already in memory, there is no reason to process it in steps of 50. Also, using repear with x =... is very slow. Use repear for each with a counter instead:
> 
> 
> I believe there is a major speed benefit to chunking the data into smaller groups.  We optimized a data processing app with this technique and brought tasks from minutes of processing down to milliseconds.
> 
> The technique chunks the data into groups of 600 lines.  Then you use a basic repeat.  No with or for each.  Then you read just the first line of the repeat.  Then delete the first line of the dataset.  You will see a major improvement in speed.
> 
> 
> Best regards,
> 
> Mark Talluto
> http://www.canelasoftware.com
> 
> 
> 
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode





More information about the use-livecode mailing list