Microsoft's top executive for Internet Explorer (IE) today dismissed browser speed trials as "at best, not very useful and at worst, misleading."
In a lengthy entry on the IE blog, Hachamovitch argued that benchmarks don't realistically reflect the speed of a browser, but instead said what he called "real world scenarios" make a better yardstick.
"We think people should evaluate browser performance with real world scenarios," said Hachamovitch. "Real world scenarios involve using all the subsystems in the browser together rather than looking at single subsystems in isolation. Using a narrow slice of features to assess the big picture makes as little sense here as using the Acid tests to understand standards compliance."
Acid3 is the standards benchmark that most browser makers trumpet when they match their software against rivals.
On one test that Hachamovitch cited as an alternative to SunSpider, IE9 Platform Preview 7 actually took longer to solve 1,000 Sudoku puzzles than Chrome's current beta version on Windows. However, Microsoft's preview beat Chrome's "dev" build, which is roughly equivalent to IE9's Platform Preview, in the same test.
According to our last SunSpider tests, IE9 Beta, which launched in mid-September, lags behind the closest comparable versions of browser from Opera, Mozilla, Google and Apple. Mozilla and Google did not immediately respond to requests for comment about Microsoft''s take on browser performance.
IE9 Platform Preview 7, which runs only on Windows Vista and Windows 7, can be downloaded from Microsoft's site.