Microsoft will be publishing a whitepaper containing a set of guidelines designed to describe accurately the benchmarking procedure of Windows Vista. The Redmond Company revealed that the whitepaper will comprise Microsoft’s own in-house methodology, and Matt Ayers, a Program Manager from the Client Performance Team delivered a preview of the procedure.
According to Ayers, Microsoft’s approach to benchmarking Windows Vista involves configuring the system, preparing the system and preparing the workload. “We recommend turning off animations (of windows, menus, dialog boxes, etc) that introduce artificial delays. I love watching a menu slide down into place instead of popping up onto the screen but, in a benchmarking scenario, these animations could impact accurate measurement. This is especially true if you are timing a sequence of events. Although they improve user experience, animations may erroneously impact your responsiveness measurements,