Statistical Evaluation of Complex Gaming Performance

Past practices in measuring performance in complex management games are reviewed. Focus is directed to the controversy of objective measurement of profitability versus decision and analysis input evaluation. As a middle ground between these extremes, a multi-dimensional approach to the evaluation problem was developed for teams competing in a simulation game. Multi-dimensional performance criteria provide a means to increase learning effectiveness by reducing feedback ambiguity and providing a vehicle for the student to understand the cause-effect relationships inherent in the game and the business environment. This paper describes the development and usage of thirteen performance criteria, and also utilizes the technique of path analysis to investigate the relationships among the performance variables. The results of the path analysis indicated both that teams which forecasted accurately were top performers in terms of profitability and that a consistent and logical relationship existed among the performance variables. These findings, though an indirect measure, contribute to confidence in the internal construct validity of the game.