Fastcode MM chalenge B&V 0.23

From: Pierre le Riche (pleriche_at_hotmail.com)
Date: 02/25/05 

Date: Fri, 25 Feb 2005 12:17:11 +0200

Hi,

Posted to attachments.

There are many small changes including some new benchmarks, but the major
change is the total revamp of the scoring system (and the ability to export
the scores from the graph screen).

The scoring methods:

To determine a MM's score in a particular benchmark:
1) A memory score and a speed score is calculated by taking the inverse of
the peak address space usage and the inverse of the tick count respectively.
2) The average for these two scores (across all MMs that participated in the
benchmark) is calculated.
3) The scores in (1) are divided by the average, so that the new average
memory score and average speed score is 100%
4) The combined score is calculated by taking the two scores in (3) and
combining them in a ratio that is determined by the benchmark (so speed can
weigh more than memory usage, or vice versa).
5) The scores in (4) are also scaled so that the relative performance scores
also average out to 100%

The determine a MM's average performance across all benchmarks:
1) The combined score for all benchmarks that the MM took part in is scaled
by a weighting factor (determined by the benchmark, so some benchmarks can
count more than others) and added together.
2) The score in (1) is then divided by the sum of the weighting factors of
the benchmarks to determine the average performance for the MM.
3) The result in (2) is scaled so that the winning MM has an average
performance score of 100.

Hope this makes sense....

Regards,
Pierre