Got a second? Help us profile Ember and make Discourse faster!

ember
performance

(Robin Ward) #1

We are curious about the performance profile of the latest versions of Ember.js, the client side JavaScript framework that we use to build Discourse.

Please check out the Ember Performance Suite in the browser of your choice and run the tests. After you do, you will have the option to submit them to our server for aggregation.

If you don’t have time to run the full suite, we’ve found the “Render Complex List” test is the closest to Discourse’s real world performance. Run it and submit your posts online :wink:

Here’s mine:

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.104 Safari/537.36

.--------------------------------------------------------.
|           Ember Performance Suite - Results            |
|--------------------------------------------------------|
|        Name         | Speed | Error | Samples |  Mean  |
|---------------------|-------|-------|---------|--------|
| Render Complex List |  7.85 | 17.28 |      91 | 127.45 |
'--------------------------------------------------------'

P.S. There is a bug with Firefox when runing the tests. You won’t see any output until the whole thing finishes. It should still finish though, so just be patient :smile:

edit: we can stop posting them in the topic now, but please submit your results via the suite itself!


(cpradio) #2

Do you want us to run only against latest or all of the versions listed? Any special flags we should include?


(Robin Ward) #3

The latest version of Ember would be great (it’s selected by default). No flags are required.


(Richard Livsey) #4
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.104 Safari/537.36

.---------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                     |
|---------------------------------------------------------------------------|
|              Name               |    Speed    | Error  | Samples |  Mean  |
|---------------------------------|-------------|--------|---------|--------|
| Baseline: Render List           |      258.75 |      3 |     466 |   3.86 |
| Baseline: Handlebars List       |      251.99 |      3 |     729 |   3.97 |
| Ember.get                       |   700437.71 |   5.09 |      87 |      0 |
| Ember.set                       |   229253.25 |   1.51 |      90 |      0 |
| Ember.set (primed)              |   225751.51 |   2.41 |      89 |      0 |
| Ember.get (primed)              |    765309.6 |      2 |      87 |      0 |
| Ember.run                       |   133413.75 |   3.35 |      87 |      0 |
| Ember.LinkView.create           |     39518.3 |   5.57 |      76 |      0 |
| Ember.View.create               |   139886.13 |   7.95 |      63 |      0 |
| Baseline: Object initialization | 43951444.57 |   3.85 |      92 |      0 |
| Ember.Object.create             |   137916.59 |   2.31 |      87 |      0 |
| Render List                     |       19.63 |  68.48 |     194 |  50.95 |
| Render List (Unbound)           |       28.84 |  39.64 |     243 |  34.67 |
| Render Complex List             |        4.62 | 148.54 |      54 | 216.52 |
| Render Simple Ember List        |       32.23 |  27.98 |     255 |  31.02 |
| Render List with link-to        |        5.97 | 114.39 |      65 | 167.48 |
| Render link-to                  |      362.78 |  17.81 |     772 |   2.76 |
'---------------------------------------------------------------------------'

(cpradio) #5

I submitted my results and I’ll do it again on my mobiles and work machine in a bit (work machine will be tomorrow).

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.101 Safari/537.36

.----------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                      |
|----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error  | Samples |  Mean  |
|---------------------------------|-------------|---------|---------|--------|
| Baseline: Render List           |      219.24 |   24.56 |     180 |   4.56 |
| Baseline: Handlebars List       |       248.8 |   17.98 |     208 |   4.02 |
| Ember.get                       |  1369700.94 |     0.4 |      98 |      0 |
| Ember.set                       |   481757.84 |    1.11 |      93 |      0 |
| Ember.set (primed)              |   501339.78 |     0.4 |      99 |      0 |
| Ember.get (primed)              |  1345323.12 |    1.42 |      94 |      0 |
| Ember.run                       |   224297.18 |    2.94 |      79 |      0 |
| Ember.LinkView.create           |   112450.69 |    4.14 |      77 |      0 |
| Ember.View.create               |   444070.49 |    6.33 |      84 |      0 |
| Baseline: Object initialization | 83462314.25 |    0.41 |      97 |      0 |
| Ember.Object.create             |   279836.42 |    2.08 |      89 |      0 |
| Render List                     |        7.85 | 20455.5 |      49 | 127.39 |
| Render List (Unbound)           |       27.78 |   376.1 |       8 |     36 |
| Render Complex List             |        7.73 |  457.89 |       8 | 129.38 |
| Render Simple Ember List        |           1 |    0.19 |       5 | 1000.2 |
| Render List with link-to        |           1 |    0.11 |       5 |   1000 |
| Render link-to                  |      329.84 |   33.27 |     126 |   3.03 |
'----------------------------------------------------------------------------'

(blazed) #6
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.50 Safari/537.36

.-----------------------------------------------------------------------------.
|                      Ember Performance Suite - Results                      |
|-----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error   | Samples |  Mean  |
|---------------------------------|-------------|----------|---------|--------|
| Baseline: Render List           |         250 |     59.3 |      71 |      4 |
| Baseline: Handlebars List       |      139.13 |   189.52 |      16 |   7.19 |
| Ember.get                       |  1140097.59 |     1.95 |      92 |      0 |
| Ember.set                       |   285970.43 |     1.65 |      98 |      0 |
| Ember.set (primed)              |   281321.63 |     0.18 |      93 |      0 |
| Ember.get (primed)              |  1004556.41 |     1.86 |     101 |      0 |
| Ember.run                       |   147137.65 |     3.41 |      82 |      0 |
| Ember.LinkView.create           |   133081.11 |     3.72 |      77 |      0 |
| Ember.View.create               |   303148.74 |      5.2 |      68 |      0 |
| Baseline: Object initialization | 78388456.34 |     0.32 |     100 |      0 |
| Ember.Object.create             |   217210.62 |     4.36 |      80 |      0 |
| Render List                     |       33.24 |    16.59 |     304 |  30.08 |
| Render List (Unbound)           |       33.39 |   255.86 |      78 |  29.95 |
| Render Complex List             |        5.48 |   556.54 |       8 |  182.5 |
| Render Simple Ember List        |        3.08 | 29094.33 |      18 | 324.39 |
| Render List with link-to        |           1 |     0.99 |       5 |  999.2 |
| Render link-to                  |       588.5 |    10.29 |     522 |    1.7 |
'-----------------------------------------------------------------------------'

#7
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.101 Safari/537.36

.-----------------------------------------------------------------------------.
|                      Ember Performance Suite - Results                      |
|-----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error   | Samples |  Mean  |
|---------------------------------|-------------|----------|---------|--------|
| Baseline: Render List           |      355.77 |     4.19 |     333 |   2.81 |
| Baseline: Handlebars List       |      328.96 |    11.35 |     326 |   3.04 |
| Ember.get                       |  1036023.39 |     1.15 |      94 |      0 |
| Ember.set                       |   355429.67 |     0.29 |      97 |      0 |
| Ember.set (primed)              |   315022.35 |     1.13 |      98 |      0 |
| Ember.get (primed)              |   966988.48 |     1.25 |      94 |      0 |
| Ember.run                       |   188623.63 |     3.21 |      92 |      0 |
| Ember.LinkView.create           |     86059.7 |     2.24 |      92 |      0 |
| Ember.View.create               |   337686.51 |     4.28 |      85 |      0 |
| Baseline: Object initialization | 73584705.63 |     0.78 |      99 |      0 |
| Ember.Object.create             |   256057.24 |     2.05 |      83 |      0 |
| Render List                     |         7.2 | 21747.67 |      44 | 138.95 |
| Render List (Unbound)           |       25.64 |   533.51 |       8 |     39 |
| Render Complex List             |         7.5 |   497.67 |       8 | 133.38 |
| Render Simple Ember List        |        8.92 | 20653.76 |      52 | 112.15 |
| Render List with link-to        |        6.96 |   9024.9 |      50 |  143.6 |
| Render link-to                  |      668.55 |    12.83 |     355 |    1.5 |
'-----------------------------------------------------------------------------'

(cpradio) #8

Mobile

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Linux; Android 4.4.2; SCH-I545 Build/KOT49H) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36

.----------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                      |
|----------------------------------------------------------------------------|
|              Name               |   Speed    |  Error  | Samples |  Mean   |
|---------------------------------|------------|---------|---------|---------|
| Baseline: Render List           |      31.44 |   18.07 |     332 |   31.81 |
| Baseline: Handlebars List       |      35.64 |   29.89 |     363 |   28.06 |
| Ember.get                       |   90213.67 |     8.1 |      80 |       0 |
| Ember.set                       |    22758.8 |   10.41 |      73 |       0 |
| Ember.set (primed)              |   23114.29 |    6.22 |      76 |       0 |
| Ember.get (primed)              |   88471.11 |    6.47 |      69 |       0 |
| Ember.run                       |   16832.11 |     6.5 |      82 |       0 |
| Ember.LinkView.create           |    8270.41 |    7.23 |      83 |       0 |
| Ember.View.create               |   17030.65 |    6.86 |      72 |       0 |
| Baseline: Object initialization | 9151604.58 |   12.98 |      76 |       0 |
| Ember.Object.create             |   15600.87 |    3.98 |      76 |       0 |
| Render List                     |       3.73 |  912.76 |      40 |  268.33 |
| Render List (Unbound)           |       4.39 |  891.31 |      44 |  227.61 |
| Render Complex List             |       0.85 | 5424.74 |      11 | 1179.45 |
| Render Simple Ember List        |       5.01 |  364.69 |      48 |  199.44 |
| Render List with link-to        |       0.95 | 2558.45 |      11 | 1049.73 |
| Render link-to                  |      62.02 |   60.02 |     369 |   16.12 |
'----------------------------------------------------------------------------'

(Tim Stone) #9

From my desktop:

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2342.2 Safari/537.36

.--------------------------------------------------------------------------.
|                    Ember Performance Suite - Results                     |
|--------------------------------------------------------------------------|
|              Name               |    Speed    | Error | Samples |  Mean  |
|---------------------------------|-------------|-------|---------|--------|
| Baseline: Render List           |      480.52 |   1.1 |     148 |   2.08 |
| Baseline: Handlebars List       |      488.13 |     3 |     370 |   2.05 |
| Ember.get                       |   924984.72 |  1.26 |      95 |      0 |
| Ember.set                       |   230322.76 |  0.69 |      98 |      0 |
| Ember.set (primed)              |   232404.33 |  1.28 |      94 |      0 |
| Ember.get (primed)              |   841830.26 |  0.55 |      98 |      0 |
| Ember.run                       |   185785.48 |   1.7 |      94 |      0 |
| Ember.LinkView.create           |   175619.26 |  1.17 |      93 |      0 |
| Ember.View.create               |   404726.07 |  2.04 |      91 |      0 |
| Baseline: Object initialization | 71282231.93 |  0.87 |      94 |      0 |
| Ember.Object.create             |   239156.02 |   2.9 |      83 |      0 |
| Render List                     |       39.04 | 17.42 |     314 |  25.61 |
| Render List (Unbound)           |       55.89 | 12.15 |     372 |  17.89 |
| Render Complex List             |        9.99 | 49.78 |     109 | 100.08 |
| Render Simple Ember List        |        58.8 |  8.18 |     379 |  17.01 |
| Render List with link-to        |       12.55 | 35.62 |     130 |  79.71 |
| Render link-to                  |     1111.97 |  6.44 |     864 |    0.9 |
'--------------------------------------------------------------------------'

And from my Moto X:

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Linux; Android 5.0; XT1095 Build/LXE22.46-11) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36

.---------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                     |
|---------------------------------------------------------------------------|
|              Name               |   Speed    |  Error  | Samples |  Mean  |
|---------------------------------|------------|---------|---------|--------|
| Baseline: Render List           |      44.37 |   12.31 |     432 |  22.54 |
| Baseline: Handlebars List       |      47.54 |   80.06 |     454 |  21.03 |
| Ember.get                       |  153710.44 |    6.72 |      80 |      0 |
| Ember.set                       |   41364.08 |    3.14 |      85 |      0 |
| Ember.set (primed)              |      46109 |     4.3 |      85 |      0 |
| Ember.get (primed)              |   151604.7 |    4.36 |      85 |      0 |
| Ember.run                       |   26960.58 |    4.74 |      86 |      0 |
| Ember.LinkView.create           |   11794.54 |    5.41 |      89 |      0 |
| Ember.View.create               |   30498.59 |    6.32 |      78 |      0 |
| Baseline: Object initialization | 16655363.6 |    6.99 |      87 |      0 |
| Ember.Object.create             |   23910.84 |     3.5 |      84 |      0 |
| Render List                     |       5.82 |  520.81 |      63 | 171.76 |
| Render List (Unbound)           |       7.85 |  296.27 |      74 | 127.38 |
| Render Complex List             |       1.51 | 1349.93 |      19 | 660.74 |
| Render Simple Ember List        |       8.43 |   326.7 |      76 | 118.66 |
| Render List with link-to        |       1.77 | 1203.67 |      20 |  566.2 |
| Render link-to                  |      89.69 |   44.45 |     467 |  11.15 |
'---------------------------------------------------------------------------'

(Brian Adams) #10
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.2341.0 Safari/537.36

.--------------------------------------------------------------------------.
|                    Ember Performance Suite - Results                     |
|--------------------------------------------------------------------------|
|              Name               |    Speed    | Error | Samples |  Mean  |
|---------------------------------|-------------|-------|---------|--------|
| Baseline: Render List           |      340.97 |  2.03 |     119 |   2.93 |
| Baseline: Handlebars List       |      355.72 |     3 |     641 |   2.81 |
| Ember.get                       |   907169.63 |  0.78 |      94 |      0 |
| Ember.set                       |   228389.15 |   1.1 |      90 |      0 |
| Ember.set (primed)              |   238387.91 |  0.77 |      91 |      0 |
| Ember.get (primed)              |   932231.74 |  0.68 |      95 |      0 |
| Ember.run                       |    148862.4 |  0.64 |      95 |      0 |
| Ember.LinkView.create           |   168890.06 |  0.87 |      91 |      0 |
| Ember.View.create               |   176396.24 |   4.7 |      74 |      0 |
| Baseline: Object initialization | 66303096.08 |  0.61 |      95 |      0 |
| Ember.Object.create             |    228176.1 |  0.85 |      94 |      0 |
| Render List                     |       27.34 | 14.83 |     251 |  36.57 |
| Render List (Unbound)           |        34.7 |  8.63 |     291 |  28.82 |
| Render Complex List             |        7.66 | 64.75 |      88 | 130.48 |
| Render Simple Ember List        |       41.43 |  7.65 |     309 |  24.14 |
| Render List with link-to        |       10.25 | 42.33 |     109 |  97.56 |
| Render link-to                  |      521.85 |  5.28 |     800 |   1.92 |
'--------------------------------------------------------------------------'

(Brian Adams) #11

Presumably you want everyone to leave the tab in focus as the test runs to prevent skews?


(Michael Downey) #12
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Linux; Android 5.0; XT1095 Build/LXE22.46-11) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36

.----------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                      |
|----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error  | Samples |  Mean  |
|---------------------------------|-------------|---------|---------|--------|
| Baseline: Render List           |       42.32 |    5.63 |     409 |  23.63 |
| Baseline: Handlebars List       |       47.49 |   17.43 |     438 |  21.06 |
| Ember.get                       |   150741.99 |    6.82 |      82 |      0 |
| Ember.set                       |    38548.64 |    5.37 |      82 |      0 |
| Ember.set (primed)              |    41563.07 |    4.25 |      82 |      0 |
| Ember.get (primed)              |   146426.15 |    4.35 |      80 |      0 |
| Ember.run                       |    24256.38 |    7.09 |      83 |      0 |
| Ember.LinkView.create           |    10336.58 |   11.89 |      80 |      0 |
| Ember.View.create               |    32434.95 |    6.15 |      79 |      0 |
| Baseline: Object initialization | 15657060.78 |    8.67 |      90 |      0 |
| Ember.Object.create             |    21778.23 |    3.62 |      86 |      0 |
| Render List                     |        5.89 |  729.02 |      64 | 169.73 |
| Render List (Unbound)           |        7.43 |  419.77 |      74 | 134.55 |
| Render Complex List             |        1.37 | 1569.22 |      17 | 731.94 |
| Render Simple Ember List        |        8.02 |  407.84 |      73 | 124.73 |
| Render List with link-to        |        1.61 | 3319.63 |      17 | 621.88 |
| Render link-to                  |       96.09 |   48.64 |     470 |  10.41 |
'----------------------------------------------------------------------------'

(Robin Ward) #13

Yes, ideally it should be front and centre.


(Gerhard Schlager) #14

Ha, I can beat that on my desktop. :stuck_out_tongue_winking_eye:

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.101 Safari/537.36

.-------------------------------------------------------------------------.
|                    Ember Performance Suite - Results                    |
|-------------------------------------------------------------------------|
|              Name               |    Speed    | Error | Samples | Mean  |
|---------------------------------|-------------|-------|---------|-------|
| Render Complex List             |       14.85 | 39.29 |     149 | 67.34 |
'-------------------------------------------------------------------------'

I submitted the full tests from my desktop, notebook and mobile. Hope it helps.
Surprisingly, Chrome on my Nexus 5 is only about 10 times slower.


(Michael Downey) #15
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.104 Safari/537.36

.--------------------------------------------------------------------------.
|                    Ember Performance Suite - Results                     |
|--------------------------------------------------------------------------|
|              Name               |    Speed    | Error | Samples |  Mean  |
|---------------------------------|-------------|-------|---------|--------|
| Baseline: Render List           |      217.25 |  3.12 |     937 |    4.6 |
| Baseline: Handlebars List       |      247.96 |   3.5 |     971 |   4.03 |
| Ember.get                       |  1348091.64 |  1.45 |      91 |      0 |
| Ember.set                       |   398239.01 |  1.76 |      92 |      0 |
| Ember.set (primed)              |   439232.26 |  1.22 |      97 |      0 |
| Ember.get (primed)              |  1252155.16 |  1.36 |      93 |      0 |
| Ember.run                       |   258369.12 |  6.12 |      88 |      0 |
| Ember.LinkView.create           |    99009.26 |   3.2 |      81 |      0 |
| Ember.View.create               |   386579.42 |  3.74 |      65 |      0 |
| Baseline: Object initialization | 81698932.83 |  0.91 |     100 |      0 |
| Ember.Object.create             |   296628.99 |  2.18 |      89 |      0 |
| Render List                     |       32.01 | 18.48 |     293 |  31.24 |
| Render List (Unbound)           |       41.75 |  9.49 |     333 |  23.95 |
| Render Complex List             |        9.04 | 69.75 |     100 | 110.59 |
| Render Simple Ember List        |       34.65 | 15.36 |     271 |  28.86 |
| Render List with link-to        |       10.35 | 57.85 |     104 |  96.59 |
| Render link-to                  |      357.88 |  6.97 |     758 |   2.79 |
'--------------------------------------------------------------------------'

(Michael Downey) #16
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:35.0) Gecko/20100101 Firefox/35.0

.---------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                     |
|---------------------------------------------------------------------------|
|              Name               |    Speed    | Error  | Samples |  Mean  |
|---------------------------------|-------------|--------|---------|--------|
| Baseline: Render List           |      287.55 |   1.36 |     134 |   3.48 |
| Baseline: Handlebars List       |      328.91 |      3 |     248 |   3.04 |
| Ember.get                       |    363673.2 |   1.32 |      91 |      0 |
| Ember.set                       |   398426.32 |   3.48 |      86 |      0 |
| Ember.set (primed)              |   675154.85 |   2.49 |      74 |      0 |
| Ember.get (primed)              |   344284.99 |   1.48 |      94 |      0 |
| Ember.run                       |   164101.96 |   2.72 |      86 |      0 |
| Ember.LinkView.create           |   119850.06 |   2.21 |      89 |      0 |
| Ember.View.create               |   251350.48 |   4.02 |      94 |      0 |
| Baseline: Object initialization | 14711363.43 |   1.69 |      90 |      0 |
| Ember.Object.create             |   403729.88 |   3.04 |      88 |      0 |
| Render List                     |          32 |  37.65 |     273 |  31.25 |
| Render List (Unbound)           |       49.21 |  21.78 |     353 |  20.32 |
| Render Complex List             |        9.66 | 204.78 |      97 | 103.54 |
| Render Simple Ember List        |       34.72 |  26.14 |     284 |   28.8 |
| Render List with link-to        |       10.53 | 184.71 |     112 |  94.94 |
| Render link-to                  |      459.49 |      3 |     465 |   2.18 |
'---------------------------------------------------------------------------'

(Jens Maier) #17

On some tests, Chrome’s performance appears to be IO bound. The more DOM updates and associated font rendering operations a test causes per second, the more likely it is that Chrome’s single-thread CPU usage falls below a single physical core.

Interestingly, Firefox stays at >100% single core usage but doesn’t achieve significantly higher performance than Chrome…


(Michael Downey) #18

For some reason with Safari Version 8.0.4 (10600.4.10.7) I couldn’t view text data & got an error when trying to submit:

Error Sending Results perhaps there is a problem with the remote server?

Anyway, here’s the data:

Name	Speed	Error	Samples	Mean
Baseline: Render List	332.61 / sec	∓ 3.00%	923	3.01 ms
Baseline: Handlebars List	423.34 / sec	∓ 3.00%	555	2.36 ms
Ember.get	468,366.91 / sec	∓ 1.79%	91	0.00 ms
Ember.set	429,098.08 / sec	∓ 1.23%	93	0.00 ms
Ember.set (primed)	431,190.86 / sec	∓ 1.33%	94	0.00 ms
Ember.get (primed)	466,121.23 / sec	∓ 1.27%	90	0.00 ms
Ember.run	0.00 / sec	∓ 0.00%	84	0.00 ms
Ember.LinkView.create	165,704.15 / sec	∓ 1.70%	93	0.00 ms
Ember.View.create	303,571.54 / sec	∓ 1.16%	92	0.00 ms
Baseline: Object initialization	62,216,656.92 / sec	∓ 1.59%	93	0.00 ms
Ember.Object.create	867,091.57 / sec	∓ 1.33%	90	0.00 ms
Render List	52.10 / sec	∓ 3.00%	389	19.19 ms
Render List (Unbound)	83.33 / sec	∓ 3.00%	468	12.00 ms
Render Complex List	16.93 / sec	∓ 5.83%	165	59.05 ms
Render Simple Ember List	37.55 / sec	∓ 111.48%	315	26.63 ms
Render List with link-to	18.41 / sec	∓ 11.36%	183	54.32 ms
Render link-to	661.18 / sec	∓ 3.00%	562	1.51 msClear Results

(Jesse Perry) #19
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_2) AppleWebKit/600.4.10 (KHTML, like Gecko) Version/8.0.4 Safari/600.4.10

.-------------------------------------------------------------------------.
|                    Ember Performance Suite - Results                    |
|-------------------------------------------------------------------------|
|              Name               |    Speed    | Error | Samples | Mean  |
|---------------------------------|-------------|-------|---------|-------|
| Baseline: Render List           |      246.91 |  1.83 |     120 |  4.05 |
| Baseline: Handlebars List       |      300.15 |     3 |     205 |  3.33 |
| Ember.get                       |   378816.39 |  1.82 |      87 |     0 |
| Ember.set                       |    351482.5 |  1.08 |      93 |     0 |
| Ember.set (primed)              |   337695.57 |  1.49 |      93 |     0 |
| Ember.get (primed)              |   400812.17 |  1.05 |      94 |     0 |
| Ember.run                       |   182935.78 |  1.67 |      72 |     0 |
| Ember.LinkView.create           |    81106.23 |  1.27 |      95 |     0 |
| Ember.View.create               |   144535.11 |  1.09 |      97 |     0 |
| Baseline: Object initialization | 68013657.23 |  0.94 |      94 |     0 |
| Ember.Object.create             |   632439.82 |  1.06 |      92 |     0 |
| Render List                     |       35.05 |  5.91 |     301 | 28.53 |
| Render List (Unbound)           |       53.74 |     3 |     295 | 18.61 |
| Render Complex List             |       10.77 |  8.67 |     117 | 92.81 |
| Render Simple Ember List        |       35.22 | 52.29 |     251 | 28.39 |
| Render List with link-to        |       14.09 | 24.92 |     143 | 70.97 |
| Render link-to                  |      575.37 |  2.99 |     542 |  1.74 |
'-------------------------------------------------------------------------'

(Dean Taylor) #20

##Mobile Phone: OnePlus One

###Chrome 41
Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Linux; Android 4.4.4; A0001 Build/KTU84Q) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/41.0.2272.96 Mobile Safari/537.36

.----------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                      |
|----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error  | Samples |  Mean  |
|---------------------------------|-------------|---------|---------|--------|
| Baseline: Render List           |        28.2 |   48.45 |     305 |  35.46 |
| Baseline: Handlebars List       |       29.94 |   92.22 |     317 |   33.4 |
| Ember.get                       |   141383.75 |   10.46 |      81 |      0 |
| Ember.set                       |    33734.72 |    8.55 |      77 |      0 |
| Ember.set (primed)              |    40711.74 |     5.9 |      74 |      0 |
| Ember.get (primed)              |      124201 |    7.79 |      74 |      0 |
| Ember.run                       |    23656.62 |    6.61 |      75 |      0 |
| Ember.LinkView.create           |    10288.99 |   12.08 |      77 |      0 |
| Ember.View.create               |    28214.17 |   10.26 |      82 |      0 |
| Baseline: Object initialization | 14138998.47 |   17.36 |      81 |      0 |
| Ember.Object.create             |    21025.86 |    9.06 |      74 |      0 |
| Render List                     |        5.07 |   743.5 |      53 | 197.13 |
| Render List (Unbound)           |        5.69 |  700.08 |      60 | 175.73 |
| Render Complex List             |        1.18 | 1133.71 |      15 | 844.47 |
| Render Simple Ember List        |        5.65 |  716.58 |      58 | 177.09 |
| Render List with link-to        |        1.34 | 4763.89 |      15 | 747.67 |
| Render link-to                  |       69.79 |   67.73 |     416 |  14.33 |
'----------------------------------------------------------------------------'

###Chrome 42 Beta

Ember Version: 1.11.0-beta.5.9e711066
User Agent: Mozilla/5.0 (Linux; Android 4.4.4; A0001 Build/KTU84Q) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/42.0.2311.51 Mobile Safari/537.36

.----------------------------------------------------------------------------.
|                     Ember Performance Suite - Results                      |
|----------------------------------------------------------------------------|
|              Name               |    Speed    |  Error  | Samples |  Mean  |
|---------------------------------|-------------|---------|---------|--------|
| Baseline: Render List           |       26.89 |   75.13 |     294 |  37.19 |
| Baseline: Handlebars List       |       29.38 |    54.5 |     313 |  34.04 |
| Ember.get                       |   101165.49 |    8.42 |      71 |      0 |
| Ember.set                       |       22459 |       8 |      76 |      0 |
| Ember.set (primed)              |    26246.48 |    6.23 |      79 |      0 |
| Ember.get (primed)              |   101997.94 |   11.91 |      75 |      0 |
| Ember.run                       |    18981.62 |   10.64 |      80 |      0 |
| Ember.LinkView.create           |    15027.49 |   15.86 |      80 |      0 |
| Ember.View.create               |    33898.77 |    7.23 |      74 |      0 |
| Baseline: Object initialization | 14939480.03 |    9.24 |      79 |      0 |
| Ember.Object.create             |    20090.89 |    9.49 |      75 |      0 |
| Render List                     |           5 |  978.54 |      53 | 200.17 |
| Render List (Unbound)           |        7.43 |  440.92 |      73 | 134.52 |
| Render Complex List             |         1.1 | 5110.43 |      14 | 907.36 |
| Render Simple Ember List        |        6.28 |  731.92 |      61 | 159.11 |
| Render List with link-to        |        1.35 |  5178.2 |      16 | 740.63 |
| Render link-to                  |       58.81 |   54.44 |     376 |     17 |
'----------------------------------------------------------------------------'

EDIT:
I was expecting to see a marked improvement in Chrome 42 Beta for complex - I’m not sure I’m seeing that - the comparison seems difficult to read for complex with the high Error value.