I tried it once again, here are results
Test | Classic | Zeitwerk | Percent |
---|---|---|---|
categories-50 | 25 | 25 | 100.00 |
categories-75 | 26 | 26 | 100.00 |
categories-90 | 37 | 33 | 89.19 |
categories-99 | 57 | 48 | 84.21 |
home-50 | 26 | 26 | 100.00 |
home-75 | 27 | 28 | 103.70 |
home-90 | 38 | 35 | 92.11 |
home-99 | 60 | 50 | 83.33 |
topic-50 | 27 | 26 | 96.30 |
topic-75 | 35 | 27 | 77.14 |
topic-90 | 41 | 33 | 80.49 |
topic-99 | 54 | 50 | 92.59 |
categories_admin-50 | 48 | 50 | 104.17 |
categories_admin-75 | 60 | 61 | 101.67 |
categories_admin-90 | 76 | 71 | 93.42 |
categories_admin-99 | 122 | 122 | 100.00 |
home_admin-50 | 47 | 46 | 97.87 |
home_admin-75 | 58 | 55 | 94.83 |
home_admin-90 | 66 | 63 | 95.45 |
home_admin-99 | 99 | 121 | 122.22 |
topic_admin-50 | 50 | 49 | 98.00 |
topic_admin-75 | 62 | 50 | 80.65 |
topic_admin-90 | 72 | 65 | 90.28 |
topic_admin-99 | 103 | 74 | 71.84 |
load_rails | 2675 | 2216 | 82.84 |
rss_kb | 279924 | 315240 | 112.62 |
pss_kb | 267659 | 303026 | 113.21 |
We can try another way to benchmark. What would you say about more iterations, something which would run for an hour? In addition, instead of taking the best result, compare the average from each experiment. That may give more consistent numbers. What do you think?