A-Team: Visualizing IonMonkey

Posted on

EDIT: Sorry, the image links were broken everywhere but on the main page of my blog. Fixed now. Still getting used to Octopress. :)

It’s been a while since I last wrote about it, but the A-Team is still maintaining the SpeedTests framework, gathering the results of a few different benchmarks on all the major browsers on a 32-bit Windows 7 installation. I haven’t had any time to add new tests, but I made sure to keep the results coming in for the tests we do have.

With IonMonkey having landed a couple weeks ago, I expected to see some big improvements. Sure enough, we can see a big jump in Kraken, as David Anderson saw:

That’s about a 27% improvement, right about what David measured on his machine. That makes Firefox about 16% faster than Chrome 21 (which itself improved by about 6% from Chrome 20).

As for V8,

The data is a bit noisy, but it looks like an improvement of around 9-10% on the overall results (geometric mean of the total test results). Not as much of an improvement, and Chrome is still 25% better, overall.

The “Speed” Tests also run (a sort of old version of) test262, a conformance suite:

No changes there, which is what we would expect.

I looked through the other tests, and it doesn’t look like IonMonkey has made much of a difference. But of course all these tests are very specific and/or artificial. If there are any JavaScript-based tests that should show clear improvements, feel free to let me know and maybe I’ll find the time to add them!