Related tools & artifacts:
We show two severe problems with the state-of-the-art in empirical computer system performance evaluation, observer effect and measurement context bias, and we outline the path toward a solution.
title="We have it easy, but do we have it right?",
author="Todd Mytkowicz and Amer Diwan and Matthias Hauswirth and Peter F. Sweeney",
booktitle="Proceedings of the NFS Next Generation Software Program workshop",
location="Miami, FL, USA",