Free Access

Feature Article—Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis

Saul I. Gass
Saul I. Gass
University of Maryland, College Park, Maryland
Search for more papers by this author

Saul I. Gass

University of Maryland, College Park, Maryland

Search for more papers by this author

Published Online:1 Aug 1983https://doi.org/10.1287/opre.31.4.603

Cited by
- Managing large-scale invasions: Simulation-optimization with Gaussian dispersal Kernels and stochastic seed establishment
  23 March 2026 | Journal of the Operational Research Society, Vol. 69
- Developing optimization models with cognitive systems engineering
  18 June 2025 | Journal of the Operational Research Society, Vol. 77, No. 3
- Towards Standardizing Validation Practices in Agent-Based Modeling: A Hierarchical ABM Validation Framework
  18 January 2026 | ACM Transactions on Modeling and Computer Simulation, Vol. 36, No. 1
- Holistic Consideration of Sustainable Energy Transition in the Field of Electricity in Bosnia and Herzegovina
  20 October 2025
- A Validation Framework for Bulk Distribution Logistics Simulation Models
  25 December 2024 | Logistics, Vol. 9, No. 1
- The role of validation in optimization models for forest management
  8 May 2024 | Annals of Forest Science, Vol. 81, No. 1
- Analysing interventions for energy-efficient appliances and heating & cooling systems adoption: An agent-based model
  Energy for Sustainable Development, Vol. 80
- Energy flexibility in aerospace manufacturing: The case of low carbon intensity production
  Journal of Manufacturing Systems, Vol. 74
- Applying analytic hierarchy process for site selection of a recreational-educational children complex in Shiraz City, Iran
  10 April 2024 | Landscape Online
- Optimal verification strategy for general development plans using a belief‐based approach
  2 July 2023 | Systems Engineering, Vol. 27, No. 1
- Appraising Kenyan energy demand policies for energy efficiency improvement and GHG emissions mitigation
  Energy Strategy Reviews, Vol. 51
- Are “wrong” models useful? A qualitative study of discrete event simulation modeller stories
  18 August 2022 | Journal of Simulation, Vol. 17, No. 5
- Model‐based systems engineering approaches to chemicals and materials manufacturing
  16 May 2023 | AIChE Journal, Vol. 69, No. 8
- A proposed validation framework for the system theoretic process analysis (STPA) technique
  Safety Science, Vol. 162
- How to keep it adequate: A protocol for ensuring validity in agent-based simulation
  Environmental Modelling & Software, Vol. 159
- Study of goal programming approach in resource allocation in acute care hospitals
  1 January 2023 | i-manager’s Journal on Mathematics, Vol. 12, No. 1
- Decision‐first modeling should guide decision making for emerging risks
  1 February 2022 | Risk Analysis, Vol. 42, No. 12
- A Framework for Clinicians to Improve the Decision-Making Process in Return to Sport
  13 April 2022 | Sports Medicine - Open, Vol. 8, No. 1
- Will Capacity Mechanisms Conflict with Carbon Pricing?
  16 December 2022 | Energies, Vol. 15, No. 24
- The impact of allocation methods on carbon emission trading under electricity marketization reform in China: A system dynamics analysis
  Energy, Vol. 259
- A critical examination of models of annual‐plant population dynamics and density‐dependent fecundity
  13 September 2022 | Methods in Ecology and Evolution, Vol. 13, No. 11
- How do small changes enable the shift to net-zero? a techno-environmental-economic analysis
  4 August 2022 | The International Journal of Advanced Manufacturing Technology, Vol. 122, No. 11-12
- An experimentation framework for validating architectural properties as proxies for the ilities
  15 March 2022 | Systems Engineering, Vol. 25, No. 4
- Mathematical Modeling to Estimate Photosynthesis: A State of the Art
  30 May 2022 | Applied Sciences, Vol. 12, No. 11
- Evaluation of the skill of length-based indicators to identify stock status and trends
  26 March 2022 | ICES Journal of Marine Science, Vol. 79, No. 4
- Optimal verification strategies in multi‐firm projects
  22 February 2022 | Systems Engineering, Vol. 25, No. 3
- Evaluation framework for systems models
  10 January 2022 | CPT: Pharmacometrics & Systems Pharmacology, Vol. 11, No. 3
- How to Keep it Adequate: A Validation Protocol for Agent-Based Simulation
  SSRN Electronic Journal, Vol. 26
- Consistent Allocation of Emission Responsibility in Fossil Fuel Supply Chains
  Sanjith Gopalakrishnan,
  Daniel Granot,
  Frieda Granot
  23 February 2021 | Management Science, Vol. 67, No. 12
- Reducing cooling load and lifecycle cost for residential buildings: a case of Lahore, Pakistan
  19 November 2021 | The International Journal of Life Cycle Assessment, Vol. 26, No. 12
- The State of the Practice in Validation of Model-Based Safety Analysis in Socio-Technical Systems: An Empirical Study
  18 October 2021 | Safety, Vol. 7, No. 4
- Principles For Verification Of Mathematical Fire Models
- An evaluation of the optimality of frequent verification for vertically integrated systems
  7 December 2020 | Systems Engineering, Vol. 24, No. 1
- Validation of an Optimized Resilient Water Supply System
  27 May 2021
- Artificial neural network based hybrid modeling approach for flood inundation modeling
  Journal of Hydrology, Vol. 592
- Structured Approach for Best-Value Evaluation Criteria: US Design–Build Highway Procurement
  Journal of Management in Engineering, Vol. 36, No. 6
- Computer Simulation as Evaluation Tool of Information Systems: Identifying Quality Factors of Simulation Modeling
- Integrating narratives into decision making for complex systems engineering design issues
  9 September 2019 | Systems Engineering, Vol. 23, No. 1
- Design and validation of a tax sustainability index
  European Journal of Operational Research, Vol. 278, No. 3
- Principles and methods of model validation for model risk reduction
  19 March 2019 | Environment Systems and Decisions, Vol. 39, No. 2
- Understanding foodborne transmission mechanisms for Norovirus: A study for the UK's Food Standards Agency
  European Journal of Operational Research, Vol. 275, No. 2
- RETRACTED: How good (“valid”) are models?
- RETRACTED: References
- A review of operations research models in invasive species management: state of the art, challenges, and future directions
  28 October 2017 | Annals of Operations Research, Vol. 271, No. 2
- Finite element analysis of dental implants with validation: to what extent can we expect the model to predict biological phenomena? A literature review and proposal for classification of a validation process
  8 March 2018 | International Journal of Implant Dentistry, Vol. 4, No. 1
- Modeling the Neuman’s well function by an artificial neural network for the determination of unconfined aquifer parameters
  18 May 2018 | Computational Geosciences, Vol. 22, No. 4
- Sustainable electricity generation mix for Iran: A fuzzy analytic network process approach
  Sustainable Energy Technologies and Assessments, Vol. 28
- Capacity expansion under regulatory uncertainty: A real options-based study in international container shipping
  Transportation Research Part E: Logistics and Transportation Review, Vol. 113
- Robustness of capacity markets: a stochastic dynamic capacity investment model
  31 January 2018 | OR Spectrum, Vol. 40, No. 2
- Application of ANN technique to predict the performance of solar collector systems - A review
  Renewable and Sustainable Energy Reviews, Vol. 84
- A Regional Dynamic General Equilibrium Model with Historical Calibration: A Counterfactual Exercise
  3 May 2018
- History of verification and validation of simulation models
- Was Angelina Jolie Right? Optimizing Cancer Prevention Strategies Among BRCA Mutation Carriers
  Eike Nohdurft,
  Elisa Long,
  Stefan Spinler
  12 July 2017 | Decision Analysis, Vol. 14, No. 3
- ‘Behavioural System Dynamics’: A Very Tentative and Slightly Sceptical Map of the Territory
  20 July 2017 | Systems Research and Behavioral Science, Vol. 34, No. 4
- 11 Modelling of intermodal systems
  2 June 2017
- Improved validation framework and R-package for artificial neural network models
  Environmental Modelling & Software, Vol. 92
- Alliance formation in a cooperative container shipping game: Performance of a real options investment approach
  Transportation Research Part E: Logistics and Transportation Review, Vol. 101
- Validation, Verification, and Uncertainty Quantification for Models with Intelligent Adversaries
  17 June 2017
- Validation of a decision support model for investigation and improvement in stroke thrombolysis
  European Journal of Operational Research, Vol. 253, No. 1
- An introductory tutorial on verification and validation of simulation models
- Validity is a Matter of Confidence—But Not Just in System Dynamics
  7 July 2015 | Systems Research and Behavioral Science, Vol. 32, No. 4
- Formula for calculating spatial similarity degrees between point clouds on multi-scale maps taking map scale change as the only independent variable
  Geodesy and Geodynamics, Vol. 6, No. 2
- Model Verification and Validation
  1 May 2015
- Model Validations
  9 August 2014
- Validation, Verification, and Uncertainty Quantification for Models with Intelligent Adversaries
  29 March 2016
- Verifying and validating simulation models
- Multi-faceted energy planning: A review
  Renewable and Sustainable Energy Reviews, Vol. 38
- Merging validation and evaluation of ecological models to ‘evaludation’: A review of terminology and a practical approach
  Ecological Modelling, Vol. 280
- Towards better modelling and decision support: Documenting model development, testing, and analysis using TRACE
  Ecological Modelling, Vol. 280
- Protocol for developing ANN models and its application to the assessment of the quality of the ANN model development process in drinking water quality modelling
  Environmental Modelling & Software, Vol. 54
- Saul Gass, a Tribute to Him and to His Leadership in Model Assessment and Validation
  Frederic H. Murphy
  4 February 2014 | Interfaces, Vol. 44, No. 1
- Verification, Validation and Confidence
- Robustness of Renewable Energy Support Schemes Facing Uncertainty and Regulatory Ambiguity
  SSRN Electronic Journal, Vol. 9
- An introduction to verification and validation of simulation models
- Operational research and ethics: A literature review
  European Journal of Operational Research, Vol. 228, No. 2
- Verification and validation of simulation models
  19 December 2017 | Journal of Simulation, Vol. 7, No. 1
- Implementation of OR/MS in the Public Sector
  23 January 2016
- Model Evaluation
  23 January 2016
- Hierarchy, Process, and Cessation: Contributions to When and How to Validate
  8 June 2012
- Global Applied General Equilibrium Analysis Using the Global Trade Analysis Project Framework
- A process for the development and application of simulation models in applied economics
  11 December 2012 | Australian Journal of Agricultural and Resource Economics, Vol. 57, No. 1
- On the validation of system dynamics type simulation models
  24 March 2011 | Telecommunication Systems, Vol. 51, No. 2-3
- Contributions to model validation: hierarchy, process, and cessation
  13 February 2012 | System Dynamics Review, Vol. 28, No. 2
- Urban Renaissance or Invasion: Planning the Development of a Simulation Model of Gentrification
  18 April 2012
- Verification and validation of simulation models
- Structuring and validating a cost-effectiveness model of primary asthma prevention amongst children
  9 November 2011 | BMC Medical Research Methodology, Vol. 11, No. 1
- Evaluation of Location-Specific Predictions by a Detailed Simulation Model of Aedes aegypti Populations
  25 July 2011 | PLoS ONE, Vol. 6, No. 7
- Saul I. Gass
  24 February 2011
- Verification and validation of simulation models
- The impact of contingency factors on validation of problem structuring methods
  21 December 2017 | Journal of the Operational Research Society, Vol. 61, No. 9
- Software implementation of project duration assessment model and its evaluation
- Independent Verification and Validation of an Industrial Simulation Model
  17 July 2009 | SIMULATION, Vol. 86, No. 7
- A comprehensive analytical approach for policy analysis of system dynamics models
  European Journal of Operational Research, Vol. 203, No. 3
- How to do structural validity of a system dynamics type simulation model: The case of an energy policy model
  Energy Policy, Vol. 38, No. 5
- Critical perspectives on the evaluation and optimization of complex numerical models of estuary hydrodynamics and sediment dynamics
  15 December 2009 | Earth Surface Processes and Landforms, Vol. 35, No. 2
- The Strategic Role of Business Intelligence Systems: An Assessment Model
  25 June 2010
- On the Validation of System Dynamics Type Simulation Models
- Does Trade Openness Make Countries Vulnerable?
  SSRN Electronic Journal, Vol. 22
- Analysing complex behaviour of hydrological systems through a system dynamics approach
  Environmental Modelling & Software, Vol. 24, No. 12
- Verification and validation of simulation models
- Model Based IT-Governance Compliance Analysis
- Model Concept to Determine the Optimal Maturity of IT Service Management Processes
- Verification and validation of simulation models
- Building confidence in models for multiple audiences: The modelling cascade
  European Journal of Operational Research, Vol. 186, No. 3
- Structural Validation of Simulation Models: An Illustration
- Verification and validation of simulation models
- The Dynamic Structure of Management Support Systems: Theory Development, Research Focus, and Direction1
  1 September 2007 | MIS Quarterly, Vol. 31, No. 3
- Assessing Global Computable General Equilibrium Model Validity Using Agricultural Price Volatility
  1 May 2007 | American Journal of Agricultural Economics, Vol. 89, No. 2
- Four Score Years of Saul I. Gass: Portrait of an OR Professional
- Sensitivity Analysis in Monte Carlo Simulation of Stochastic Activity Networks
- ASP, The Art and Science of Practice: Elements of a Theory of the Practice of Operations Research: Expertise in Practice
  Frederic H. Murphy,
  1 August 2005 | Interfaces, Vol. 35, No. 4
- Using an expert panel to validate a requirements process improvement model
  Journal of Systems and Software, Vol. 76, No. 3
- Soft Systems Methodology: A Context Within a 50-Year Retrospective of OR/MS
  Arnold Reisman,
  Muhittin Oral,
  1 April 2005 | Interfaces, Vol. 35, No. 2
- Evaluating a Rapid Simulation Modelling Process (RSMP) through Controlled Experiments
- Verification and Validation of Simulation Models
- Distributed Simulation and Simulation Practice
  1 January 2005 | SIMULATION, Vol. 81, No. 1
- Irrational agents or accomplished social actors?
  17 August 2004 | Systems Research and Behavioral Science, Vol. 21, No. 4
- Validation of Numerical Ground Water Models Used to Guide Decision Making
  13 December 2005 | Groundwater, Vol. 42, No. 2
- Validation and Verification of Simulation Models
- Model calibration as a testing strategy for system dynamics models
  European Journal of Operational Research, Vol. 151, No. 3
- Client Involvement in Simulation Model Building: Hints and Insights from a Case Study in a London Hospital
  Health Care Management Science, Vol. 6, No. 2
- Verification and validation of simulation models
- General concepts of quality for discrete-event simulation
  European Journal of Operational Research, Vol. 138, No. 1
- Modeling Structural Linkages in Dynamic and Spatial Interindustry Systems
- A hierarchical approach for validating simulation models
  International Journal of Computer Applications in Technology, Vol. 15, No. 1/2/3
- The Analytic Hierarchy Process—An Exposition
  Ernest H. Forman,
  Saul I. Gass,
  1 August 2001 | Operations Research, Vol. 49, No. 4
- Implementation in the public sector
  8 July 2014
- Model evaluation
  25 October 2005
- Friendly amendment: a commentary on Doyle and Ford's proposed re-definition of ‘mental model’
  System Dynamics Review, Vol. 15, No. 2
- An Evaluative Tool for Solid Waste Management
  Journal of Urban Planning and Development, Vol. 126, No. 3
- A genetic algorithm approach to policy design for consequence minimization
  European Journal of Operational Research, Vol. 124, No. 1
- A co-evolutionary approach to strategy design for decision makers in complex negotiation situations
- Verification, validation and accreditation of simulation models
- Science, information, technology, and the changing character of public policy in non-point source pollution
- Validation and verification of simulation models
- Three sources of simulation inaccuracy (and how to overcome them)
- Measuring Service Quality in the Process of Delivering a Simulation Study: The Customer's Perspective
  24 August 2006 | International Transactions in Operational Research, Vol. 5, No. 5
- Towards a practical method to validate decision support systems
  Decision Support Systems, Vol. 23, No. 3
- The greater whole: Towards a synthesis of system dynamics and soft systems methodology
  European Journal of Operational Research, Vol. 107, No. 1
- Integrated Modeling Environments in Organizations: An Empirical Study
  Gordon P. Wright,
  Alok R. Chaturvedi,
  Radha V. Mookerjee,
  Susan Garrod,
  1 March 1998 | Information Systems Research, Vol. 9, No. 1
- Modellanalytische Vorgehensweise: Grundlagen und Anwendungen in der Betriebswirtschaftslehre
- Verification and validation of simulation models
- Verification and validation and complex environments: a study in service sector
- The Washington operations research connection: the rest of the story
  Socio-Economic Planning Sciences, Vol. 31, No. 4
- Operations Research applications: Opportunities and accomplishments
  European Journal of Operational Research, Vol. 97, No. 2
- Operations Research in Defense
- The design and implementation of OR/SM: A prototype integrated modeling environment
  Annals of Operations Research, Vol. 72, No. 0
- EVALUATING AUDIT DECISION MODELS: A METHODOLOGICAL PERSPECTIVE
  Managerial Finance, Vol. 22, No. 11
- M
- An adequate model of photosynthesis—I Parameterization, validation and comparison of models
  Agricultural Systems, Vol. 50, No. 2
- Modeling experts' consensual judgments for new product entry timing
  IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, Vol. 26, No. 5
- A Comparative Study of Cell Formation Techniques: Experimental Findings on Data‐Dependency and Solution Quality
  7 June 2007 | Decision Sciences, Vol. 26, No. 4
- Validation, verification, and testing techniques throughout the life cycle of a simulation study
  Annals of Operations Research, Vol. 53, No. 1
- Limits of Reasonable Planning
  Journal of Professional Issues in Engineering Education and Practice, Vol. 120, No. 3
- Quality assessment of science information research and service
  Scientometrics, Vol. 30, No. 2-3
- Optimal Design of Large-Scale Opencut Coal Mine System
- Chapter 2 Public sector analysis and operations research/management science
- Chapter 3 Models fail
- Verification and validation of simulation models
- Measurement theoretic representation of large, diverse model bases
  Decision Support Systems, Vol. 10, No. 3
- Analogical reasoning and case-based learning in model management systems
  Decision Support Systems, Vol. 10, No. 2
- The predictive validation of ecological and environmental models
  Ecological Modelling, Vol. 68, No. 1-2
- The facets of the modeling and validation process in operations research
  European Journal of Operational Research, Vol. 66, No. 2
- Modeling muddles: Validation beyond the numbers
  European Journal of Operational Research, Vol. 66, No. 2
- Integrating communications theory, cognitive style and computer simulation as an aid to research on implementation of operations research
  Computers & Operations Research, Vol. 20, No. 2
- Objective information about energy models
  Government Information Quarterly, Vol. 10, No. 1
- Defining real world problems: a conceptual language
  IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23, No. 5
- Validation of Simulation Models: General Approach
- Model Validation and Decision Making: An Example Using the Twin Lakes Tracer Test
  1 January 1992 | MRS Proceedings, Vol. 294
- Validation of an integrated decision support and expert system for analysis of individual sow-herd performance
  Computers and Electronics in Agriculture, Vol. 6, No. 1
- Simulation model verification and validation
- Validating and applying a model for locating emergency medical vehicles in Tuczon, AZ
  European Journal of Operational Research, Vol. 49, No. 3
- Validation of livestock herd simulation models: a review
  Livestock Production Science, Vol. 26, No. 2
- Optimization/Simulation Modeling for Waste Management Capacity Planning
  Journal of Urban Planning and Development, Vol. 116, No. 2
- Knowledge acquisition for effective and efficient use of engineering software
  Engineering with Computers, Vol. 6, No. 2
- A simulation model for evaluating a set of emergency vehicle base locations: Development, validation, and usage
  Socio-Economic Planning Sciences, Vol. 24, No. 2
- Validating complex computer system availability models
  IEEE Transactions on Reliability, Vol. 39, No. 4
- Inheritance and instantiation in model management
- Guidelines for successful simulation studies
- Representing knowledge about linear programming formulation
  Annals of Operations Research, Vol. 21, No. 1
- Application of dynamic programming for guiding IPM on groundnut leafminer in India
  Crop Protection, Vol. 8, No. 5
- Analyzing the Economic Impacts of a Military Mobilization
- Semantic structures in linear programs
- Model assessment objectives in or
  Mathematical Programming, Vol. 42, No. 1-3
- Validation of Decision Support Systems
- RESOURCE MODELLING: ITS NATURE AND USE
  31 May 2012 | Memoirs of the Entomological Society of Canada, Vol. 120, No. S143
- INTRODUCTION
  31 May 2012 | Memoirs of the Entomological Society of Canada, Vol. 120, No. S143
- Managing the modeling process: A personal reflection
  European Journal of Operational Research, Vol. 31, No. 1
- A KNOWLEDGE‐BASED DSS FOR MANAGERIAL PROBLEM DIAGNOSIS
  7 June 2007 | Decision Sciences, Vol. 18, No. 3
- Some tools for fire model validation
  Fire Technology, Vol. 23, No. 2
- Estimating post-secondary student flow with limited data
  Research in Higher Education, Vol. 27, No. 1
- VALIDATION IN ILL-DEFINED PROBLEM MODELLING: RESOURCE ALLOCATION POLICY ANALYSIS
- Validation of Linear Programming Models
  5 September 2016 | Journal of Agricultural and Applied Economics, Vol. 18, No. 2
- Validation in ILL-Defined Problem Modelling: Resource Allocation Policy Analysis
  IFAC Proceedings Volumes, Vol. 19, No. 10
- A Framework for the Nonstatistical Assessment of Behaviorally Based Policy Models
  1 June 1986 | Environment and Planning A: Economy and Space, Vol. 18, No. 6
- Stochastic Audit Planning and Control Using GERT Simulation
  Accounting and Business Research, Vol. 16, No. 63
- References/Literatur
- Model assessment in the context of policy analysis
  Omega, Vol. 14, No. 1
- Requirements for model development environments
  Computers & Operations Research, Vol. 13, No. 1
- The Use of Expert Judgments in Predicting Interregional Migration Patterns: An Analytic Hierarchy Approach
  7 September 2010 | Geographical Analysis, Vol. 18, No. 1
- Validation of Simulation Models via Simultaneous Confidence Intervals
  American Journal of Mathematical and Management Sciences, Vol. 4, No. 3-4
- What is a computer-based mathematical model?
  Mathematical Modelling, Vol. 4, No. 5

Volume 31, Issue 4

July-August 1983

Pages 603-801

Article Information

Metrics

Information

Published Online:August 01, 1983

Cite as

Saul I. Gass, (1983) Feature Article—Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis. Operations Research 31(4):603-631.

https://doi.org/10.1287/opre.31.4.603

Keywords

PDF download

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Available Issues

Feature Article—Decision-Aiding Models: Validation, Assessment, and Related Issues for Policy Analysis

Volume 31, Issue 4

Article Information

Metrics

Information

Cite as

Keywords

Sign Up for INFORMS Publications Updates and News