Dreaming up a benchmarking suite of stacks

Malte Brill revolution at derbrill.de
Mon Nov 10 06:34:16 EST 2014


Hi folks,

sorry I was quiet about this for a while. I really want / need to push the benchmarking forward. I made 2 initial stacks available here:

https://www.dropbox.com/sh/uspg0njkwdg7z6x/AABa-ybZ1E_BWIvFf_2O2PfGa?dl=0

If some / any of you want to help / participate I would be really glad. 
@Richard / Mats: Yes, I would be willing to take the lead in this project. A forum might be helpful. I also would like the mothership to give some attention / feedback here, as the results of my first tests are rather shocking to me...

The simple datagrid Test on a Mac Core I7:

Time taken to prepare data: 211
Time taken to fill in data: 1749

Testing datagrid performance; engine version 7.0.1-rc-1
Time taken to prepare data: 953
Time taken to fill in data: 2835

The involved script:

on mouseUp
   local tData,tLog,tTest
   put "Testing datagrid performance; engine version"&&the version into tLog
   lock screen
   put the millisecs into tTest
   repeat with i=1 to 100000
      put i & TAB & any word of "mee moo maa muh" &TAB & the millisecs & cr after tData
   end repeat
   put cr & "Time taken to prepare data:"&&the millisecs - tTest after tLog
   put the millisecs into tTest
   set the dgText of grp "datagrid" to tData
   put cr & "Time taken to fill in data:"&&the millisecs - tTest after tLog
   put tLog into fld "log"
   unlock screen
end mouseUp

This is really really no good to have such an impact on performance. The real problem appears to be that it is an overall phenomenon. It appears the engine got slower in each and every aspect. Of course there is a price we have to pay for unicode, but also in other areas it got really quite a bit slower. So if there are some of you who want to help testing your special field of interest with the engine, I would really appreciate setting up a good test suite and maybe Richard could present the results to the mothership.

All the best,

Malte


> Hi all,
> 
> inspired by a post by Geoff, I started thinking that it would be rather cool to have a suite of stacks that lets us benchmark the performance of the different engine versions. I started with a stack that benchmarks graphics rendering performance using different settings. Unfortunately it crashes LC7 (http://quality.runrev.com/show_bug.cgi?id=13833 , already assigned). But I think it would be a good idea to have a set of tests that benchmarks the different aspects of the engine. Would anyone of you be willing to participate in setting up such a testsuite and / or run tests on their machines?
> 
> All the best,
> 
> Malte
> 





More information about the use-livecode mailing list