The following graph shows variation over time of the time taken to run each benchmark in Guile's master branch benchmark suite.
For separate plots of each benchmark, see here.
The number on the X axis is the number of days counting forwards from 2009-09-28 (so 0 means 28th September, and 28 is 27th October). See here to map from each X axis index to the corresponding date and Git commit. There's one line for each benchmark (that existed in the repository on 28th September), and the times are all normalised by the time that the benchmarks took on 28th September (so that they can all be plotted on the same graph).
The wayward lines are caused by a few benchmarks that are run for two few iterations and so only take 0.01s or 0.02s overall. The benchmark results only have 2 decimal places, so we get inaccurate and blocky results when dividing such small numbers by each other.
Ignoring the wayward lines, the rest of the results just show random variation - except for a hint of time increase in the last week or so - to be confirmed or denied by future results.
Here is a similar plot for the branch_release-1-8 branch. If the lines look less tightly packed, that's because there are fewer benchmarks in the 1.8.x branch. The X axis mapping for this graph is here.
For separate plots of each benchmark, see here.
Here the results only show random variation - which is reassuring, given that there have been almost no changes in this branch over the measured period.
Similar plots for the stable-2.0 branch. The X axis mapping is here.
For separate plots of each benchmark, see here.
Neil Jerram - 2009-10-27