Proper and Consistent Production Tradeoffs in Models of Data Envelopment Analysis
Abstract
In data envelopment analysis, value judgements expressed as weight restrictions in multiplier models correspond to production tradeoffs in the dual envelopment models. Such tradeoffs are interpretable as simultaneous changes to the inputs and outputs that are assumed to be technologically possible for all decision-making units (DMUs) in the technology. The specification of production tradeoffs leads to the creation of additional DMUs, expansion of technology, and improved discriminating power of the model. A known requirement to production tradeoffs is that they should be consistent with the set of observed DMUs; that is, they should not generate free and unlimited production of a nonzero vector of outputs. In this paper, we define a new principle of proper production tradeoffs and weight restrictions that should be verified in their assessment. No combination of proper tradeoffs can lead to an improvement of some inputs and outputs without simultaneously making at least some of the other inputs and outputs worse. It is possible that the tradeoffs are consistent but not proper and that they are proper but inconsistent. If the tradeoffs are not proper or are inconsistent, or both, they cannot be used in applications and should be reassessed. In this paper, we develop analytical and computational tests of proper tradeoffs, which are significantly simpler than the known tests of their consistency. We prove that, for a very large class of tradeoffs, the fact that they are proper implies that they are also consistent, which further simplifies the testing. The notion of proper tradeoffs and approaches to its testing are also applicable in decision analysis with imprecise information about the preferences of the decision-maker, stated as a set of linear inequalities in terms of criterion weights. We illustrate the new theoretical results and their use by examples and an application in the context of higher education.
1. Introduction
Most models of data envelopment analysis (DEA) are used to assess the efficiency of decision-making units (DMUs) on a selected set of inputs and outputs without taking into account the relative value of individual inputs for the production process and the complexity of producing individual outputs. This leads to a common situation in which DMUs that excel on some relatively insignificant measures (inputs and outputs) may be shown as technically efficient, even if they do not perform well on the remaining technologically more important measures.
1.1. Production Tradeoffs and Weight Restrictions
For the conventional constant and variable returns-to-scale (CRS and VRS) models, introduced to DEA by Charnes et al. (1978) and Banker et al. (1984), information about the relative value of inputs and outputs in the production process can be specified in two mutually dual ways. In the multiplier CRS and VRS models, this takes on the form of restrictions on the input and output weights, or weight restrictions—see, for example, Allen et al. (1997). In the envelopment CRS and VRS models, the weight restrictions are restated in the dual forms as production tradeoffs, which are interpretable as simultaneous changes to the inputs and outputs that are technologically possible at any DMU in the technology (Podinovski 2004).
The specification of technologically realistic production tradeoffs or weight restrictions leads to a meaningful (explainable by the assumptions made) expansion of the CRS or VRS production technology and improved discrimination on efficiency of the models based on them. The use of such tradeoffs and weight restrictions in different models has been reported in various application contexts, including primary healthcare provision (Amado and Santos 2009, Capeletti et al. 2024), school education (Khalili et al. 2010, Podinovski et al. 2024), courts of justice (Santos and Amado 2014), agricultural farms (Atici and Podinovski 2015), labor inspectorates (Santos et al. 2020), railway traffic control centers (Roets et al. 2018), industrial robots (Ravanos and Karagiannis 2023), bank branches (Razipoor-GhalehJough et al. 2020), and electricity distributors (Santos et al. 2011).
As earlier applications of DEA showed, the incorporation of weight restrictions in multiplier DEA models may lead to their infeasibility (Allen et al. 1997, Thanassoulis et al. 2008), in which case the weight restrictions are unusable and need to be reassessed. Podinovski and Bouzdine-Chameeva (2013) proved that the infeasibility of multiplier VRS and CRS models with weight restrictions corresponds to the case in which the dual production tradeoffs expand the technology in such a way that it includes either free (with a zero input) or unlimited production of some nonzero output vector. Furthermore, free or unlimited production does not necessarily manifest itself in an infeasible multiplier model and may remain undetected in the evaluation of efficiency of DMUs.
Free and unlimited production is disallowed by production theory (Färe et al. 1985). Podinovski and Bouzdine-Chameeva (2013) introduced the notion of consistent weight restrictions and tradeoffs as those that do not generate free and unlimited production in the VRS and CRS technologies and develop computational and analytical tests of their consistency. If the tradeoffs are inconsistent, then they should not be used because the expanded VRS or CRS technology and its production frontier are theoretically unsubstantiated. In this case, we need to reconsider the tradeoffs or weight restrictions.
1.2. Motivation and Contribution
In this paper, we show that the requirement of consistency may fail to detect another potential problem with production tradeoffs, which would require correction in any practical application. (The main definitions, models, and tests developed in this paper are naturally introduced in the language of tradeoffs, but they can equivalently be restated in terms of dual weight restrictions.) Namely, we call the specified set of production tradeoffs proper if none of their combinations can lead to an improvement in some inputs and outputs (i.e., a reduction of inputs and increase in outputs) without simultaneously worsening some other inputs and outputs. Otherwise, the tradeoffs are not proper.
It is clear why the tradeoffs should be proper. If they are not, then every DMU in the technology (at least those with strictly positive inputs and outputs) can be improved on some inputs and outputs “for free” without having to become worse on the other measures. This implies that no DMU in the technology can be efficient, which is unrealistic and means that we made an error in the specification of tradeoffs.
We show that production tradeoffs (and weight restrictions) can be consistent but not proper and, similarly, proper but inconsistent. Because both are problematic and require reassessing, in addition to the known tests of consistency, in this paper we develop analytical and computational tests for proper tradeoffs and weight restrictions. We prove that the multiplier VRS or CRS program with not proper weight restrictions either is infeasible or, if it is feasible, assigns a zero weight to all inputs and outputs that, according to the specified tradeoffs, can be improved “for free” in all its feasible (and, therefore, in all optimal) solutions.
We further identify a large and practically important class of production tradeoffs (and weight restrictions), for which it is sufficient to test only if the tradeoffs are proper because this would imply that they are also consistent. (It is worth noting that the tests developed in this paper for proper tradeoffs are also conceptually and computationally simpler than similar tests for consistent tradeoffs, which offers further theoretical and practical advantages.) However, if the specified tradeoffs are not in this class, we generally need to perform both tests.
1.3. Proper Tradeoffs in Decision Analysis
The notion of proper tradeoffs introduced in this paper in the framework of DEA and related mathematical results allow a straightforward interpretation in the terminology of multicriteria decision analysis (MCDA). In this interpretation, the input and output measures in DEA correspond to criteria in MCDA that the decision-maker wishes to minimize and maximize, respectively.
There is significant literature in the field of MCDA devoted to the assessment of tradeoffs between different criteria—see, for example, Keeney and Raiffa (1976). A tradeoff represents a judgement that balances out an improvement on some criteria at the expense of detriment to some other criteria. Often, such information is incomplete and imprecise and is stated in the dual form as a set of linear inequalities in terms of criterion weights (Hazen 1986, Weber 1987, Harju et al. 2019).
Several tradeoffs can be applied collectively, creating complex substitutions involving multiple criteria. If there is some inconsistency, then it is possible that a “collective” tradeoff may represent improvements to only some criteria, without any detriment to the other criteria. In this paper, we call sets of judgements that can create such tradeoffs not proper and develop analytical and computational tests for their identification.
As follows from our main results obtained in Section 4 (stated in terminology of DEA but equally applicable to MCDA), any criterion whose improvement in at least one “collective” tradeoff appears without a detriment to at least some of the other criteria would necessarily have a zero weight in any weighting scheme based on the given set of tradeoffs. This means that any such criterion is effectively excluded from the ranking of decision alternatives, which should be highlighted as possibly based on erroneous judgements that need reassessing.
1.4. Organization of This Paper
The structure of this paper is as follows. In Sections 2 and 3, we briefly outline the known definitions and results concerning production tradeoffs and their consistency. In Section 4, we define proper production tradeoffs, give their dual characterization in terms of weight restrictions, and develop computational and analytical tests for proper tradeoffs. In Section 5, we establish a relationship between proper and consistent tradeoffs for different types of tradeoffs. In Section 6, we give examples that illustrate theoretical results and tests developed in our paper. In Section 7, we consider an illustrative application in the context of research-intensive universities in the United Kingdom. Section 8 contains concluding discussion. The proofs of all mathematical statements are given in Appendix A. In Appendix B, we present detailed statements of several linear programs discussed in the main sections.
2. Production Tradeoffs
Consider technology characterized by inputs and outputs. Decision making units are elements of stated as pairs , where and are the vectors of inputs and outputs, respectively.
Let be the set of observed DMUs (the data set) , . We assume that and for all , that is, that each observed DMU has at least one strictly positive input and output.
The VRS technology of Banker et al. (1984) generated by the set of observed DMUs is stated as the set of all DMUs defined by the following conditions:
Removing the normalizing equality from the conditions (1), we obtain a statement of the CRS technology of Charnes et al. (1978).
For both CRS and VRS technologies, Podinovski (2004) defines a production tradeoff as a pair of vectors of sign-free components
Let DMUs be similar academic departments of different universities, for example, business schools. Let the vector of inputs be , where is the number of academic staff who teach and do research and is research staff who do research only. Let the vector of outputs be , where and are, respectively, the numbers of undergraduate (UG) and postgraduate (PG) students and is the number of published papers.
In the described setting, we may identify several production tradeoffs. For example, we may assume that the teaching of one UG student does not require more resources than the teaching of one PG student. Therefore, no department should claim extra resources (namely, academic and research staff) if they are required to teach one UG student instead of one PG student. This is expressed by the tradeoff , where
In this statement, the components of vector specify a reduction of the number of PG students by 1 and a simultaneous increase in the UG numbers by 1, whereas the zero vector means that such change is possible without any change to the academic and research staff.
We may also judge that one additionally employed academic member of staff should be able to teach, for example, at least 10 UG students and publish one paper per year. We state this by the tradeoff , where
Finally, suppose that the reduction of one research staff should in most cases not lead to the reduction of more than five papers per year. This is expressed by the tradeoff , where
Suppose that we have specified production tradeoffs, which we state as follows:
Because, as assumed, changing the inputs and outputs of any DMU by any of the tradeoffs (5) leads to another DMU that is technologically possible, we can subsequently modify the resulting DMU by the same or another tradeoff, and so on. Allowing for fractional proportions , , in which the tradeoffs in (5) are used, we finally obtain the following DMU:
If all components of vectors and are nonnegative, then the DMU is technologically feasible and should be included in the model of technology.
Podinovski (2004) defines the VRS technology expanded by production tradeoffs (5) as the smallest technology (in the sense of the minimum extrapolation principle of Banker et al. 1984) that is freely (strongly) disposable, convex and incorporates the stated tradeoffs. An operational statement of this technology is given by the following conditions:
Similarly, an extension of the CRS technology by production tradeoffs (5) is defined by the axioms of technology and the additional axiom of scalability, referred to as “ray unboundedness” by Banker et al. (1984). Such extended CRS technology is obtained from the statement (6) by removing the equality .
Consider the VRS technology with a single input x and single output y defined by three observed DMUs A, B, and C in Figure 1. This technology is shown as the darker shaded area below and to the right of the line KABL. Further consider the two production tradeoffs:

The specification of these two tradeoffs adds the lighter shaded areas UAK and LBV to the technology. For example, the new DMU is obtained if we apply the tradeoff to the observed DMU A. Applying this tradeoff three times (with in the above notation), we obtain DMU U. Similarly, the line BV is obtained by modifying DMU B by the tradeoff taken in varying proportions .
The VRS model based on the expanded technology exhibits a better discriminating power than the original VRS model based on technology . Indeed, in the latter, the input projection of the inefficient DMU C is DMU , and the input radial efficiency of DMU C is equal to . In the expanded technology, the input projection of DMU C is DMU , and the input radial efficiency of DMU C is reduced to .
The statement of envelopment models for the assessment of efficiency of DMUs in technologies and , which may employ different measures of efficiency, is straightforward. Examples of such efficiency measures include the input and output radial measures of efficiency employed by Charnes et al. (1978) and Banker et al. (1984), measures based on directional distance functions of Chambers et al. (1998) and various nondirectional and slack-based measures, such as those developed by Tone (2001), Fukuyama and Weber (2009), and Färe and Grosskopf (2010).
Dual to the envelopment models are multiplier models stated in terms of vectors of input and output weights and and, in the case of VRS, the sign-free variable that is dual to the normalizing equality .
Podinovski (2004) showed that the specification of tradeoffs (5) in envelopment models is equivalent (in the sense of duality) to the incorporation of the following weight restrictions in the multiplier models:
As an illustration, let and be the vectors of input and output weights in the setting considered in Example 1. The specification of tradeoffs (2)–(4) in envelopment VRS and CRS models is equivalent to the incorporation of the following weight restrictions in their dual multiplier models: , and .
The duality of tradeoffs (5) and weight restrictions (8) allows us to give an interpretation of production tradeoffs in terms of marginal characteristics of production frontiers such as marginal productivity and rates of transformation and substitution between inputs and outputs. As a simple example, consider technology in Example 2, which incorporates tradeoffs (7). According to (8), the latter can be restated in the dual form as the weight restrictions and or as the two-sided inequality
For any optimal solution of the multiplier model based on technology , the ratio of optimal weights is equal to the marginal productivity on the supporting hyperplane to the technology whose equation (in the input and output dimensions x and y) is . (For the standard VRS technology, this was shown by Banker et al. (1984). For arbitrary polyhedral technologies, including the VRS and CRS technologies with tradeoffs, this was proved by Podinovski and Bouzdine-Chameeva (2021). The formula for marginal productivity then follows from the implicit function theorem.)
The two-sided inequality (9) and the underlying tradeoffs (5) state that the production frontier enveloping the data must have the marginal productivity in the range between 0.25 and 1. This technology is depicted in Figure 1. The highest marginal productivity equal to 1 is observed on the supporting hyperplane that includes the segment UA. The lowest marginal productivity equal to 0.25 is observed on the supporting hyperplane that includes the line BV. Any other supporting hyperplane to the technology has the marginal productivity strictly in the range [0.25, 1]. For example, it is equal to 0.5 on the segment AB.
3. Consistent Production Tradeoffs
In this section, we briefly outline the notion of consistent tradeoffs and weight restrictions introduced by Podinovski and Bouzdine-Chameeva (2013, 2015). We use this outline to contrast consistent tradeoffs with the new notion of proper tradeoffs introduced in Section 4.
The specification of production tradeoffs (5) or weight restrictions equivalent to them (8) expands technologies and to the generally larger technologies and . In some cases, the expanded technology may become unrealistically large and no longer comply with the basic axioms of production theory (see, e.g., Färe et al. 1985). This means that the tradeoffs and the expanded technology based on them are theoretically unsubstantiated.
Podinovski and Bouzdine-Chameeva (2013, 2015) identified a case in which the expanded technologies and allowed either free or unlimited production of a nonzero output vector (we define this formally below), which is disallowed by production theory and indicates an error in the specification of production tradeoffs. This leads to the notion of consistent production tradeoffs (and weight restrictions dual to them) whose specification does not result in free and unlimited production.
Let be a nonzero output vector, that is, . Technology allows free production of vector if . Technology allows unlimited production of if there exists an input vector such that for all .
It is clear that the standard VRS and CRS technologies based on a finite set of observed DMUs do not allow free and unlimited production. However, their extensions by tradeoffs may generate such production; see Example 3 below.
Production tradeoffs (5) are consistent with technology (or with technology ) generated by the data set of observed DMUs if the expanded technology (respectively, ) does not allow free and unlimited production. Otherwise, the tradeoffs (5) are inconsistent with technology (or, respectively, ).
As shown by Podinovski and Bouzdine-Chameeva (2013), the consistency of production tradeoffs generally depends on the set of observed DMUs . Namely, the tradeoffs (5) may be consistent with the VRS or CRS technology generated by one data set and inconsistent with these technologies generated by another data set.
Consider a modification of Example 2 in which we use the same tradeoffs (7) but employ a modified set of observed DMUs A, B, and C. Figure 2 shows the standard VRS technology as the darker shaded area below and to the right of the line KABL. Let us show that although we employ the same tradeoffs as in Example 2, these tradeoffs are no longer consistent with the technology (which is generated by a different data set).
Indeed, if we modify DMU A by the tradeoff taken in proportion , we obtain DMU W, which represents free production. (The input of DMU W is equal to zero, and its output is equal to one.) Note that free production caused by the specification of tradeoff is not easily observed by the standard assessment of efficiency. Indeed, in Figure 2, DMU C is projected on DMU , and its input radial efficiency is equal to , which may not appear as problematic. Below, we discuss how the consistency of tradeoffs (5) can be rigorously tested.
As proven by Podinovski and Bouzdine-Chameeva (2013), production tradeoffs (5) are consistent with the VRS technology generated by a set of observed DMUs if and only if they are consistent with the CRS technology generated by the same data set. Therefore, we can simply state that the tradeoffs (5) are consistent or inconsistent with the data set without referring to the VRS or CRS technology. It further turns out that the inconsistency of tradeoffs manifests itself differently in the two technologies. In the CRS technology, inconsistent tradeoffs always generate both free and unlimited production. In the case of VRS, inconsistent production tradeoffs (5) may generate free production but not necessarily unlimited production (as, for example, in Figure 2), and vice versa.
Podinovski and Bouzdine-Chameeva (2013, 2015) developed several analytical and computational tests of the consistency of tradeoffs (5). The main computational test is based on the fact that the consistency of production tradeoffs with the data set is equivalent to the absence of unlimited production in the expanded CRS technology . The latter is tested by solving a single linear program. Below, we state this program in the form suggested by Mehdiloo et al. (2026).
Namely, the tradeoffs (5) are consistent with the data set if and only if the optimal value of the following program is equal to zero (and inconsistent if the optimal value is unbounded):
Podinovski and Bouzdine-Chameeva (2013) stated program (10) in a slightly different form, with the input vector on the right-hand side of its first constraint replaced by the input vector of any observed DMU. The two approaches are equivalent. Indeed, in the terminology of convex analysis, the unlimited production of a nonzero output vector means that the combined input-output vector is a direction of recession of the CRS technology, which is a closed convex set. As follows from theorem 8.3 in Rockafellar (1970), the production of vector is unlimited from the input vector of any observed DMU if and only if it is unlimited from the input vector of any other (observed or unobserved) DMU in the CRS technology, including the origin . For the latter DMU, we have , which leads to program (10).
We also have the following simple result, which has not been noted previously.
Let the set of tradeoffs (5) be consistent with the data set , and let be any subset of . Then, the subset of tradeoffs (5) indexed by (i.e., the tradeoffs , ) is also consistent with .
4. Proper Production Tradeoffs
In this section, we define the new notion of proper production tradeoffs, which, as we show, is different from the notion of consistent tradeoffs considered in the previous section. Similar to inconsistent production tradeoffs, if the tradeoffs are found to be not proper, then this indicates that an error has been made in their assessment and that the tradeoffs need revisiting.
4.1. Definitions
We consider a single production tradeoff proper if it improves some of the inputs and outputs only at the expense of making some other inputs and outputs worse and not proper otherwise. Formally, a single tradeoff is not proper if , , and at least one of the two vectors and is not a zero vector.
We consider the set of production tradeoffs (5) proper if, for any proportions , , their nonnegative linear (conical) combination
It is clear why the not proper tradeoffs (5) are problematic and indicate an error. Indeed, in this case, there exists a combined tradeoff stated by (11) that makes it possible to improve some inputs and outputs, without worsening some other inputs and outputs, for any DMU in the technology. This implies that all DMUs in the technology (including all observed DMUs) can be improved (by such tradeoffs) and are inefficient, which is unrealistic. This conclusion means that we made an error in the specification of tradeoffs and that they need to be reconsidered.
To formalize the above definitions, we first introduce the cone consisting of all tradeoffs that can be obtained as a combination (11) of tradeoffs (5):
Furthermore, define the set (which is also a cone as the intersection of two cones)
It is clear that the cone contains the origin. Moreover, if it also contains any nonzero tradeoff , then this tradeoff would represent only improvements to some inputs and outputs without making the other inputs and outputs worse. This leads to the following formal definition of proper tradeoffs.
Production tradeoffs (5) are proper if the cone is a singleton that includes only the origin, that is, , and not proper otherwise.
The notion of proper tradeoffs is generally different from the notion of consistent tradeoffs; that is, proper tradeoffs are not necessarily consistent, and vice versa, consistent tradeoffs are not necessarily proper. As illustrated by Examples 2 and 3, the tradeoffs (5) may be consistent or inconsistent, depending on the data set . In contrast, the notion of proper tradeoffs (5) is independent of the observed data set and is therefore their endogenous characteristic.
The following examples highlight the difference between the notions of proper and consistent tradeoffs.
The linked tradeoff defined by (7) was shown to be consistent with the data set in Example 2 and inconsistent in Example 3. It is also clear that this tradeoff is proper; it improves (reduces) the input at the expense of worsening (reducing) the output. Therefore, it is possible that a tradeoff is proper but inconsistent.
Consider a technology with three inputs . (The outputs in this example are unimportant.) Consider the following two tradeoffs (their output component vectors and are assumed to be zero vectors):
Consider the sum (11) of these two tradeoffs taken with :
The tradeoff improves (reduces) the first two inputs but does not make worse the remaining third input or any of the outputs. Therefore, the tradeoffs (14) are not proper. However, for most data sets these tradeoffs would be consistent. Indeed, note that the vectors and change only the first two inputs and do not affect the third input. If the third input of all observed DMUs is strictly positive, then the tradeoffs (14) would not be able to reduce it to zero and hence, create free (and therefore, unlimited) production in the expanded CRS technology. As highlighted in Section 3, this means that the tradeoffs (14) are consistent, although they are not proper.
The following is a useful result concerning proper tradeoffs.
Let the set of tradeoffs (5) be proper, and let be any subset of . Then, the subset of tradeoffs (5) indexed by (i.e., the tradeoffs , ) is also proper.
4.2. A Computational Test for Proper Tradeoffs
As follows from Definition 3, to test whether tradeoffs (5) are proper, we need to check whether the cone defined by (13) contains a nonzero tradeoff . This can be achieved by solving the following linear program and verifying whether its optimal value is equal to zero:
The tradeoffs (5) are proper if and only the optimal value of the program (15) is equal to zero and not proper if and only if program (15) has an unbounded optimal value.
In program (15), all components of vector are nonpositive. In practical computations, this would require declaring a sign-free vector and incorporating the constraint . An alternative is to make the substitution , in which case program (15) is restated as
Programs (15) or (16) require only the statement of tradeoffs (5) and do not depend on the data set of observed DMUs. In contrast, the test of consistency of tradeoffs accounts for the full data set of observed DMUs and requires solving a separate larger program (10) for each such data set. This reflects the fact that the notion of being proper is an endogenous characteristic of tradeoffs, whereas the notion of their consistency depends on the data set and is not endogenous.
4.3. Dual Characterization of Proper Tradeoffs
Let us now obtain the dual characterization of proper tradeoffs. Multiply the second (output) equality in the constraints of program (16) by . The dual to the resulting program can be stated in terms of vectors and dual to the input and output constraints as follows:
The constraints of the dual (17) are the weight restrictions (8), with the additional requirement that all components of vectors and are greater than or equal to one. This leads to the following analytical test of proper tradeoffs (5).
The tradeoffs (5) are proper if and only if there exist strictly positive vectors and that satisfy the weight restrictions (8).
In some applications, verifying the conditions of Theorem 4 may be a simpler alternative to performing a computational test based on solving program (15). We illustrate this by examples in Section 6.
Clearly, program (17) can itself be used as a computational test of proper tradeoffs instead of program (15). This may be useful in applications in which we prefer to specify weight restrictions (8) without a need to restate them as production tradeoffs.
The tradeoffs (5) are proper if program (17) is feasible (in which case its optimal value ) and are not proper if program (17) is infeasible.
Note that the actual objective function of program (17) is unimportant and can be replaced by any other objective function, in which case may be any other finite value or be unbounded.
Let us obtain a more precise characterization of proper and not proper tradeoffs (5). Denote as the set of all inputs for which there exists a not proper tradeoff (generally different for each ) such that . Similarly, denote as the set of all outputs for which there exists a not proper tradeoff (generally different for each ) such that . Restating Definition 3, the tradeoffs (5) are proper if both sets and are empty sets and not proper otherwise.
Now consider the weight restrictions (8). Denote and as the subsets of inputs and outputs such that , for all , and , for all , in all nonnegative solutions of the set of inequalities (weight restrictions) (8).
We have and .
The meaning of Theorem 6 is clear. Suppose that the tradeoffs (5) are not proper. Then, by Definition 3, there exists a tradeoff that improves some inputs and outputs “for free,” that is, without worsening the remaining inputs and outputs. According to Theorem 6, all such inputs and outputs that can be improved “for free” (and only they) will have zero weights in any nonnegative solution to the set of inequalities (weight restrictions) (8) and in any feasible (including any optimal) solution of the multiplier VRS or CRS program that incorporates them. (The latter assumes that the multiplier model is feasible. This may not be the case if the not proper tradeoffs (5) are also inconsistent with the data set—see Podinovski and Bouzdine-Chameeva (2013).)
5. Proper and Consistent Production Tradeoffs
In Section 4, we showed that production tradeoffs (5) may be proper but inconsistent and vice versa, consistent but not proper. Therefore, generally, in order to verify that the tradeoffs are both proper and consistent, we would need to solve two linear programs, (10) and (15).
In this section, we identify a very large class of production tradeoffs for which it suffices to verify only that the tradeoffs are proper because this in turn is sufficient for their consistency. We further identify a class of tradeoffs for which the notions of consistency and being proper are equivalent.
The tradeoffs (5) can be assigned to one of the following three groups (we do not assume that all three groups are present):
The input tradeoffs (18a) and output tradeoffs (18b) are referred to as unlinked tradeoffs. For the tradeoffs (18c), we assume that and , for all . These tradeoffs identify simultaneous changes to both inputs and outputs and are referred to as linked tradeoffs.
Assume that the set of tradeoffs (18) either does not include linked tradeoffs (18c) or, if it does, then for all . Then, if the tradeoffs (18) are proper, then they are also consistent for any data set .
As noted, we generally need to check that the tradeoffs are both proper and consistent. The analytical conditions for proper tradeoffs stated by Theorem 4 in our paper are easier to verify than the more complex conditions required for consistent tradeoffs (Podinovski and Bouzdine-Chameeva 2013, 2015). Similarly, as noted in Remark 3, the computational testing that the tradeoffs are proper is significantly simpler than the testing of their consistency. If the tradeoffs (18) satisfy the assumptions of Theorem 7, then the overall testing task is simplified further because it suffices to perform only the simpler check that the tradeoffs are proper, which also implies their consistency.
Before we state the next result concerning the equivalence of the notions of proper and consistent tradeoffs, we first prove the following theorem concerning consistent tradeoffs.
Assume that the set of tradeoffs (18) does not include input tradeoffs (18a), and, if the linked tradeoffs (18c) are specified, then for all . Then, the tradeoffs (18) are either consistent for all data sets or they are inconsistent for all data sets (i.e., the tradeoffs (18) cannot be consistent for some data sets and inconsistent for the other).
The next result shows that, for the types of tradeoffs described by the conditions of Theorem 8, the notions of proper and consistent tradeoffs are equivalent.
Assume that the set of tradeoffs (18) does not include input tradeoffs (18a), and, if the linked tradeoffs (18c) are specified, then for all . Then, the tradeoffs (18) are proper if and only if they are consistent for any, and therefore for all, data sets .
As a special case of Theorem 9, we observe that if we have only the output tradeoffs (18b), then they are proper if and only if they are consistent for any, and therefore for all, data sets .
The next result was proved by Podinovski and Bouzdine-Chameeva (2015) for consistent tradeoffs. We show that it also extends to the case of proper tradeoffs.
Let all tradeoffs be linked, that is, stated in the form (18c), where for all . Then, the tradeoffs (18c) are proper (and, by Theorem 9, consistent for any data set ).
6. Examples
In this section, we consider examples that illustrate theoretical results obtained in the previous sections. The first example provides an illustration to Theorems 4 and 7.
Let there be two inputs and two outputs. Consider the following two tradeoffs:
The corresponding weight restrictions are stated as and . These inequalities are satisfied by . By Theorem 4, the tradeoffs (19) are proper. Furthermore, by Theorem 7, they are also consistent for any data set of observed DMUs.
The next example provides an illustration to Theorems 1, 4, and 9.
Assume that there are two inputs and two outputs. Consider the following three tradeoffs:
Restating these tradeoffs as weight restrictions, we have , and . It is straightforward to see that there do not exist strictly positive vectors and that satisfy these three inequalities. Indeed, adding the first two inequalities, we have , which implies that . According to Theorem 4, the tradeoffs (20) are not proper. Furthermore, by Theorem 9, they are also inconsistent for any data set of observed DMUs.
Alternatively, we notice that the subset of the first two tradeoffs (20) is not proper. (As shown, the corresponding two weight restrictions imply that .) By Theorem 9, these two tradeoffs are also inconsistent for any data set . By Theorem 1, the set of all three tradeoffs (20) is inconsistent for any .
In the next final example, we use Theorem 4 to verify that the tradeoffs are proper but need to solve a linear program (10) to test whether they are consistent.
Let us have one input and two outputs. Consider the following two tradeoffs:
Restating these tradeoffs as weight restrictions, we have and . These inequalities are satisfied by strictly positive weights , and . By Theorem 4, the tradeoffs (21) are proper.
Because the input component is negative, we cannot use any of the theorems proven in Section 5 to confirm whether the tradeoffs are consistent. In this case, given a specific set of observed DMUs, we need to solve program (10) to verify this. It is easy to see that the result will depend on the data set . For example, suppose that the data set includes the DMU , where the first component is the input and the remaining two components are outputs. Applying the tradeoff to this DMU in proportion , we obtain the modified DMU , which represents free production. Therefore, if the data set includes the above DMU A, then the tradeoffs (21) are proper but inconsistent.
7. Illustrative Application
We illustrate the methodology developed in our paper in the context of higher education.
7.1. The Data and Preliminary Results
The data set consists of 24 research-intensive U.K. universities collectively referred to as the Russell group of universities. The model includes one input and seven outputs. The latter represent the teaching and research functions of academic staff. Table 1 shows summary statistics of this data set.
|
Table 1. Descriptive Statistics for the Application
| Measure | Mean | Median | Minimum | Maximum | Standard deviation |
|---|---|---|---|---|---|
| Input: Academic staff | 4,598.75 | 3,872.5 | 1,935 | 10,400 | 2,077.06 |
| Output 1: UG medical students | 2,049.17 | 2,177.5 | 0 | 3,915 | 1,002.86 |
| Output 2: UG science students | 8,725 | 9,280 | 915 | 14,000 | 2,794.22 |
| Output 3: UG nonscience students | 9,919.58 | 10,445 | 500 | 14,880 | 3,270.99 |
| Output 4: PG medical students | 711.04 | 545 | 0 | 2,745 | 662.75 |
| Output 5: PG science students | 4,251.25 | 3,810 | 630 | 12,010 | 2,254.54 |
| Output 6: PG nonscience students | 5,264.58 | 4,922.5 | 2,260 | 10,855 | 2,338.15 |
| Output 7: Papers | 7,614.96 | 6,101 | 2,105 | 17,765 | 4,273.27 |
Note. UG, undergraduate students; PG, postgraduate (taught and research) students.
The single input is the total academic staff of the universities. Six of the seven outputs represent the numbers of undergraduate (UG) and postgraduate (PG) students (including both taught and research variants), split by the three groups of departments. The first group is referred to as medical departments, which also includes veterinary departments. The second group is referred to as science departments, which also includes mathematics, engineering, and computer science. The third group is referred to as nonscience departments and includes social sciences, business schools, and arts. This split accounts for different teaching and research cultures across different types of disciplines. The data for total academic staff and students in all six categories is obtained from the publicly available tables for the 2024–2025 academic year published by the Higher Education Statistics Agency (HESA) on www.hesa.ac.uk. The seventh output is the number of academic papers included in the Scopus database as published in 2025.
Table 2 shows additional summary statistics for the two useful ratio indicators: students per staff, also known as the student-to-staff ratio (the total number of UG and PG students divided by total academic staff), and papers per staff (the number of papers published in 2025 divided by total academic staff).
|
Table 2. Students and Papers per Academic Staff
| Outputs per staff | Mean | Median | Minimum | Maximum | Standard deviation |
|---|---|---|---|---|---|
| Students per staff | 7.38 | 8.05 | 3.3 | 11.9 | 1.99 |
| Papers per staff | 1.62 | 1.6 | 0.9 | 2.9 | 0.44 |
The first and third numerical rows of Table 3 show summary statistics of the output radial efficiency of all universities evaluated in the standard VRS and CRS models (without tradeoffs). As expected, because the number of inputs and outputs is relatively large for the given small data set, the VRS model does not show good discrimination on efficiency, with 20 universities shown as efficient and the average efficiency being more than 98%.
|
Table 3. Output Radial Efficiency in Different Models
| Model | Number of efficient DMUs | Average efficiency | Minimum efficiency | Standard deviation |
|---|---|---|---|---|
| VRS without tradeoffs | 20 | 0.9871 | 0.8572 | 0.0358 |
| VRS with the tradeoffs | 8 | 0.9225 | 0.7282 | 0.0885 |
| CRS without tradeoffs | 12 | 0.933 | 0.5819 | 0.1033 |
| CRS with the tradeoffs | 4 | 0.8417 | 0.5383 | 0.1227 |
7.2. Specifying and Using Production Tradeoffs
We now consider the incorporation of production tradeoffs in the VRS and CRS models. The first three tradeoffs are variants of the tradeoff (2) specified separately for the medical, science, and nonscience groups of departments:
(To avoid confusion with the previously discussed examples, we add a bar over the vectors and .)
The tradeoffs (22) state the assumption that the teaching of one PG student takes no less academic time than the teaching of one UG student. The rationale for this is that, in the United Kingdom, PG students are typically taught over almost the entire year and in smaller classes compared with the UG students in the same department who are taught only nine months, excluding the summer.
We now specify tradeoffs that relate the time used to teach students to the time required to write an academic paper. The underlying assumption is that a six-month period (spent, for example, on a study leave) should typically be sufficient to write two academic papers. According to Table 2, the mean “student-per-staff” ratio across all universities is 7.38. This suggests that the writing of two papers (e.g., six months on a study leave) should typically require the same academic time as the teaching of about four students (equal to 0.5 full-time academic staff equivalent). Because this is just a rough estimate, which is also likely to vary between the universities, the statements of the following tradeoffs use more relaxed assumptions.
Namely, the next group of tradeoffs assumes that the reduction of the number of UG students by five releases sufficient academic time to write just one paper (instead of the more demanding assumption of two papers, as estimated) at each of the three groups of departments:
The second group of tradeoffs states the opposite change. Namely, it assumes that, if required, the reduction of the number of papers by one releases sufficient time to teach at least three extra students:
Computations show that the optimal value of program (15) stated for tradeoffs (22)–(24) is equal to zero. Therefore, by Theorem 3, this set of tradeoffs is proper. Furthermore, because all these tradeoffs concern only the outputs, that is, they are of the type (18b), by either Theorem 7 or 9, the set of tradeoffs (22)–(24) is also consistent with the data set.
We now assess the output radial efficiency of all universities in the VRS technology expanded by the tradeoffs (22)–(24), according to its statement (6), and also in its CRS variant. The second and fourth numerical rows of Table 3 show summary statistics for the results.
It is clear that the incorporation of tradeoffs in the VRS and CRS models has a significant effect on the efficiency estimation. For example, whereas the standard VRS model shows 20 out of 24 universities as efficient, the VRS model with tradeoffs shows only eight universities as efficient, with the average efficiency reduced from more than 98% to almost 92%. A similar improvement is also observed in the case of CRS.
7.3. What If the Tradeoffs Are Not Proper?
Suppose that, instead of the tradeoff in the group of tradeoffs (23), we have specified the more demanding tradeoff
To justify this tradeoff, we may take into account that the teaching of one medical student requires more time than the teaching of students at other departments and that, therefore, the reduction of only 2.5 students should release sufficient time to write an academic paper.
Computations show that as a result of replacing tradeoff with the tradeoff , the average efficiency across all universities drops to 0.8264 and 0.7578 in the VRS and CRS models, respectively. There is no indication that any of these results may be problematic.
Let us test whether the set of tradeoffs (22)–(24), where the tradeoff is substituted by the tradeoff , is proper. Solving the appropriately specified program (15), we find out that its objective function is unbounded. By Theorem 3, the above set of tradeoffs is not proper.
It is easy to point out where the problem is. Indeed, if we combine the tradeoff with the tradeoff from the group (24), we obtain the combined tradeoff
The tradeoff states that at any university in the technology, it is possible to increase the number of UG medical students without any worsening of the other outputs or increasing the input. (Note that we cannot say that either individual tradeoff or is problematic. However, these two tradeoffs contradict each other and should not be specified simultaneously.)
We have shown that the set of tradeoffs (22)–(24), with the tradeoff substituted by , is not proper. Such a set is theoretically unsubstantiated and cannot be used, even though the results of computations do not appear problematic.
8. Conclusion
The specification of production tradeoffs or, equivalently, weight restrictions leads to an enlargement of the model of technology and improved discrimination of efficiency analysis based on it. The notions of consistent tradeoffs, already known from the existing literature, and proper tradeoffs introduced in our paper are useful for the identification of possible errors made in their specification.
The tradeoffs are inconsistent if their specification generates free or unlimited production of a nonzero output vector. As noted, this also explains the possible infeasibility of the multiplier model based on them. Inconsistent tradeoffs contradict the established assumptions of production theory, which makes them unacceptable in efficiency analysis.
The new notion of proper tradeoffs is based on a different principle. The tradeoffs are not proper if their use may lead to an improvement of some inputs and outputs “for free” without worsening any other inputs and outputs. It is clear that, in this case, any DMU can be improved “for free.” This further means that no DMU can be considered as efficient, which is unrealistic.
As we show in this paper, the notions of consistent and proper tradeoffs are overlapping but nevertheless different. The tradeoffs can be consistent but not proper and, vice versa, proper but inconsistent. Both inconsistent and not proper tradeoffs are problematic and indicate that we have made an error in their specification that needs rectifying.
In this paper, we explore the notion of proper tradeoffs (and weight restrictions equivalent to them) in detail. It turns out that although, as known, the tradeoffs may be consistent for one set of observed DMUs and inconsistent for another set, the characterization of tradeoffs as proper or not proper is endogenous and independent of the data set. This means that, for example, if we change the data set (e.g., by including additional observed DMUs), the consistency of tradeoffs generally needs rechecking but the fact that they remain proper does not.
We develop a computational test for proper tradeoffs based on solving a single linear program and its equivalent dual variant stated in terms of weight restrictions. We also obtain an analytical condition for proper tradeoffs that does not require solving linear programs. Both the computational and analytical tests for proper tradeoffs are significantly simpler than the corresponding tests of their consistency.
We finally prove that for a large class of production tradeoffs that are considered in most applications, the fact that they are proper implies that they are also consistent, and we need only to verify the former. The only exception is the case in which the specified tradeoffs include a linked tradeoff (changing both inputs and outputs) that shows a reduction of one or more inputs. In this case, we need to perform two separate tests, one for proper and one for consistent tradeoffs.
We illustrate the notion of proper tradeoffs in an application to a sample of U.K. universities. We show that even if the results of efficiency evaluation with production tradeoffs (or weight restrictions) do not appear to be problematic, the tradeoffs may still be not proper and therefore theoretically unsubstantiated together with the efficiency scores obtained by using them. We show how the simple tests developed in our paper can be used to check whether the tradeoffs are proper or point out an error in their specification that needs correcting.
Appendix A. Proofs
Consider programs (10) stated for the full set of tradeoffs (5) and its subset, indexed by and , respectively. Let and be their corresponding optimal values. The proof follows from the obvious inequality . □
Denote as the cone (12) defined for the set . Then, , and the proof follows from Definition 3 of proper tradeoffs. □
Program (15) is always feasible (its constraints are satisfied by the zero vectors , , and ). Two cases arise. First, let . Then, and in any feasible solution of program (15). Therefore, , and by Definition 3, the tradeoffs are proper. Second, let there exist a feasible solution of program (15) for which . Then, is not a zero vector, and . By Definition 3, the tradeoffs (5) are not proper. Furthermore, in this case, for any , the solution is also feasible in program (15), and the corresponding value of the objective function is equal to , which is unbounded as . □
This theorem is a simple corollary of Theorem 6. We can also give its independent proof as follows. By Theorem 3, the tradeoffs (5) are proper if and only if program (15), restated as (16), has a finite optimal value (equal to zero). This is equivalent to the feasibility of the dual (17). Therefore, if the tradeoffs (5) are proper, there exist strictly positive vectors and (more precisely, and ) that satisfy (8). Conversely, if there exist strictly positive vectors and that satisfy (8), then there exists an such that and . The vectors and also satisfy (8). Therefore, the dual (17) is feasible, which implies that program (16) has a finite optimal value. Therefore, the tradeoffs (5) are proper. □
The proof follows from the fact that program (17) is dual to (16). □
Assume that . Then, there exists a such that . Note that for all . Therefore, program (16) with the objective function changed to the maximization of the single component is feasible and has an unbounded optimal value. Then its dual is infeasible, which is program (17) in which the constraints , are replaced by and . Therefore, the set of inequalities (8) does not have a nonnegative solution with (as otherwise we could scale this solution by some factor to satisfy the inequality ). Therefore, in any nonnegative solution of (8), and .
Conversely, let . If the described dual is infeasible, the primal, which is always feasible, has an unbounded optimal value . Therefore, the set contains a nonzero tradeoff with , and the tradeoffs (5) are not proper. Therefore, .
The proof for the output sets and is similar and not given. □
Consider program (10), which is restated as follows:
We need to prove that . Consider any feasible solution of program (A.1). Let us first prove that . Two possible cases arise.
Case 1. Let . Then, the inequality (A.1b) implies that
The second term in (A.2) is either nonnegative (because for all ) or is missing (if ). Therefore, . Because and , for all , we have .
Case 2. Let . Consider program (15) stated only for the subset of tradeoffs (18a),
From (A.1b), because and, if , , we have
Denote . From (A.4), the pair is feasible in program (A.3). Taking the scalar product of both sides of inequality (A.1b) and the vector and rearranging, we have
(Note that the last inequality in (A.5) is true because is a feasible solution of program (A.3).) Because , the inequality (A.5) implies . As in Case 1, this further implies .
We have proved that in both Cases 1 and 2. From (A.1b) and (A.1c), and because , we have
Therefore, is a feasible solution of program (15). Taking the scalar product of both sides of inequality (A.6b) and the vector , and rearranging, we have
(Note that the second inequality in (A.7) is true because is a feasible solution of program (15).) Because , the inequality (A.7) implies . Because is an arbitrary feasible solution of program (A.1), its optimal value . Therefore, the tradeoffs (18) are consistent. □
Because , program (10) is restated as program (A.1) in which the summation term for the set is removed from the constraint (A.1b). Because , , for all and, as assumed, , , for all (or ) ,the inequality (A.1b) (with the term for removed) implies that in any feasible solution of program (A.1), we have and for all . (We also replace the inequality in (A.1c) by an equality, which we need in the proof of Theorem 9.) Program (A.1) is now restated as
The optimal value of this program does not depend on . As proven by Podinovski and Bouzdine-Chameeva (2013) and noted in Section 3, if is equal to zero, then the tradeoffs (18) are consistent for any data set . If is unbounded, then these tradeoffs are inconsistent for any . □
As shown in the proof of Theorem 8, because the set , program (10) is stated as (A.8). Furthermore, program (15) is stated as
Because , , for all , the first constraint of program (A.9) implies that, in any of its feasible solutions , we have for all , and . This transforms program (A.8) to program (A.8), with notation replacing . Therefore, . The tradeoffs (18) are consistent (for any and therefore for all data sets ) if and only if , which is equivalent to . By Theorem 3, this is equivalent to tradeoffs (18) being proper. □
In the assumed case, program (15) is stated as
Because , , for all , and, for any feasible vector we must have , the first constraint of program (A.10) implies that, in any of its feasible solutions , we have . Therefore, , and for the optimal solution of program (A.10), we have . By Theorem 3, the tradeoffs (18) are proper. □
Appendix B. Examples of Linear Programs
Below, we show detailed statements of some linear programs discussed in this paper.
To check consistency of the two tradeoffs (7) used in Example 3 with its data set as in Figure 2, we solve program (10) stated as follows:
Calculations show that the optimal value of program (B.1) is unbounded, and therefore, the tradeoffs (7) are inconsistent with the data set shown in Figure 2.
As noted in Remark 2, we can change zero on the right-hand side of the first (input) constraint of program (B.1) to the input vector (in this case, scalar input) of any observed DMU. For example, if we change this zero to the input of DMU A equal to 2, the resulting program also has an unbounded value, confirming that the tradeoffs (7) are inconsistent with the data set.
Note that the optimal value of a similar program to (B.1) based on the data set used in Figure 1 is finite (equal to zero). Therefore, the tradeoffs (7) are consistent with the data set used in Figure 1. We can also use the input of any of the observed DMUs instead of the zero on the right-hand side of the first constraint. The optimal values of all such programs are (different) positive finite numbers, and any of these confirm that the tradeoffs are consistent with the data set in Figure 1.
Consider the three tradeoffs (20) in Example 7, which we already showed to be not proper. As an alternative way to verify the same result, we can solve program (17) stated as
Computations show that program (B.2) is infeasible. Therefore, by Theorem 5, the tradeoffs (20) in Example 7 are not proper.
References
- (1997) Weights restrictions and value judgements in data envelopment analysis: Evolution, development and future directions. Ann. Oper. Res. 73:13–34.Crossref, Google Scholar
- (2009) Challenges for performance assessment and improvement in primary health care: The case of the Portuguese health centres. Health Policy 91(1):43–56.Crossref, Google Scholar
- (2015) Using data envelopment analysis for the assessment of technical efficiency of units with different specialisations: An application to agriculture. Omega 54:72–83.Crossref, Google Scholar
- (1984) Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Sci. 30(9):1078–1092.Link, Google Scholar
- (2024) Performance assessment of primary health care services using data envelopment analysis and the quality-adjusted Malmquist index. J. Oper. Res. Soc. 75(2):361–377.Crossref, Google Scholar
- (1998) Profit, directional distance functions, and Nerlovian efficiency. J. Optim. Theory Appl. 98(2):351–364.Crossref, Google Scholar
- (1978) Measuring the efficiency of decision making units. Eur. J. Oper. Res. 2(6):429–444.Crossref, Google Scholar
- (2010) Directional distance functions and slacks-based measures of efficiency. Eur. J. Oper. Res. 200(1):320–322.Crossref, Google Scholar
- (1985) The Measurement of Efficiency of Production (Kluwer, Boston).Crossref, Google Scholar
- (2009) A directional slacks-based measure of technical inefficiency. Socio-Econom. Planning Sci. 43(4):274–287.Crossref, Google Scholar
- (2019) Spatial multi-attribute decision analysis: Axiomatic foundations and incomplete preference information. Eur. J. Oper. Res. 275(1):167–181.Crossref, Google Scholar
- (1986) Partial information, dominance, and potential optimality in multiattribute utility theory. Oper. Res. 34(2):296–310.Link, Google Scholar
- (1976) Decisions with Multiple Objectives: Preferences and Value Tradeoffs (Wiley, New York).Google Scholar
- (2010) The measurement of relative efficiency using data envelopment analysis with assurance regions that link inputs and outputs. Eur. J. Oper. Res. 203(3):761–770.Crossref, Google Scholar
- (2026) Production trade-offs in free disposal hull technologies. Eur. J. Oper. Res. 328(2):530–544.Crossref, Google Scholar
- (2004) Production trade-offs and weight restrictions in data envelopment analysis. J. Oper. Res. Soc. 55(12):1311–1322.Crossref, Google Scholar
- (2013) Weight restrictions and free production in data envelopment analysis. Oper. Res. 61(2):426–437.Link, Google Scholar
- (2015) Consistent weight restrictions in data envelopment analysis. Eur. J. Oper. Res. 244(1):201–209.Crossref, Google Scholar
- (2021) Optimal solutions of multiplier DEA models. J. Prod. Anal. 56(1):45–68.Crossref, Google Scholar
- (2024) Production trade-offs in models of data envelopment analysis with ratio inputs and outputs: An application to schools in England. Eur. J. Oper. Res. 313(1):359–372.Crossref, Google Scholar
- (2023) On VEA, production trade-offs and weights restrictions. J. Oper. Res. Soc. 74(10):2081–2093.Crossref, Google Scholar
- (2020) Finding closest target for bank branches in the presence of weight restrictions using data envelopment analysis. Ann. Oper. Res. 288(2):755–787.Crossref, Google Scholar
- (1970) Convex Analysis (Princeton University Press, Princeton, NJ).Crossref, Google Scholar
- (2018) Multi-output efficiency and operational safety: An analysis of railway traffic control centre performance. Eur. J. Oper. Res. 271(1):224–237.Crossref, Google Scholar
- (2014) On the need for reform of the Portuguese judicial system – Does data envelopment analysis assessment support it? Omega 47:1–16.Crossref, Google Scholar
- (2011) Formative evaluation of electricity distribution utilities using data envelopment analysis. J. Oper. Res. Soc. 62(7):1298–1319.Crossref, Google Scholar
- (2020) Labor inspectorates’ efficiency and effectiveness assessment as a learning path to improve work-related accident prevention. Ann. Oper. Res. 288(2):609–651.Crossref, Google Scholar
- (2008)
Data envelopment analysis: The mathematical programming approach to efficiency analysis . Fried HO, Lovell CAK, Schmidt SS, eds. The Measurement of Productive Efficiency and Productivity Growth (Oxford University Press, New York), 251–420.Crossref, Google Scholar - (2001) A slacks-based measure of efficiency in data envelopment analysis. Eur. J. Oper. Res. 130(3):498–509.Crossref, Google Scholar
- (1987) Decision making with incomplete information. Eur. J. Oper. Res. 28(1):44–57.Crossref, Google Scholar
Victor V. Podinovski is professor of operational research at Loughborough Business School of Loughborough University, United Kingdom. His research interests focus on optimization-based methodologies for the evaluation of efficiency and productivity of organizations.
Grammatoula Papaioannou is a reader (associate professor) in business analytics at Loughborough Business School, Loughborough University, United Kingdom. Her research spans the areas of optimization and efficiency analysis of organizations, operations, and supply chains.

