Assessment of academic departments efficiency using data envelopment analysis

doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 301 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Assessment of academic departments efficiency using data envelopment analysis Salah R. Agha, Ibrahim Kuhail, Nader Abdelnabi, Mahmoud Salem, Ahmed Ghanim Islamic University-Gaza (GAZA STRIP) [email protected]m; [email protected]; nade[email protected]; [email protected]; [email protected] Received August 2010 Accepted June 2011 Abstract: Purpose: In this age of knowledge economy, universities play an important role in the development of a country. As government subsidies to universities have been decreasing, more efficient use of resources becomes important for university administrators. This study evaluates the relative technical efficiencies of academic departments at the Islamic University in Gaza (IUG) during the years 2004-2006. Design/methodology/approach: This study applies Data Envelopment Analysis (DEA) to assess the relative technical efficiency of the academic departments. The inputs are operating expenses, credit hours and training resources, while the outputs are number of graduates, promotions and public service activities. The potential improvements and super efficiency are computed for inefficient and efficient departments respectively. Further, multiple linear -regression is used to develop a relationship between super efficiency and input and output variables. Findings: Results show that the average efficiency score is 68.5% and that there are 10 efficient departments out of the 30 studied. It is noted that departments in the faculty of science, engineering and information technology have to greatly reduce their laboratory expenses. The department of economics and finance was found to have the highest super efficiency score among the efficient departments. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 302 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Finally, it was found that promotions have the greatest contribution to the super efficiency scores while public services activities come next. Research limitations/implications: The paper focuses only on academic departments at a single university. Further, DEA is deterministic in nature. Practical implications: The findings offer insights on the inputs and outputs that significantly contribute to efficiencies so that inefficient departments can focus on these factors. Originality/value: Prior studies have used only one type of DEA (BCC) and they did not explicitly answer the question posed by the inefficient departments "Which of the resources should be given priority so that these inefficient DMUs become efficient?". This study uses both (BCC) and (CCR) in addition to relating efficiencies to input and output variables. Keywords: data envelopment analysis, performance, higher education, academic, efficiency 1 Introduction Higher education is the backbone of development and economic growth in any country. Given that the academic institutions are responsible for the capacity building required for a country’s long-term plans, the educational system in particular, is one of the pillars a country depends on to increase its productivity and thus efficiently implement its strategic plans. There is no doubt that an efficient system of institutions of higher education is crucial to providing the necessary profession manpower of scientists, engineers, doctors, and teachers. Therefore, there is a need to assess the efficiency of the educational institutions, and whether the high cost being spent on them is worthwhile. Further, it is necessary to have standards by which all educational institutions could be questioned through the evaluation of efficiency of using resources (Inputs) and achieving the goals (Outputs) for which these resources were spent. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 303 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim From 1948 to 1967, there were no higher education institutions in Gaza Strip, therefore most of Gazan students used to study at Egyptian universities without any obstacles. After Gaza Strip was occupied in 1967, Gazans found great difficulties in sending their sons and daughters to study abroad. Hence, the idea of establishing the Islamic University was coined. The Islamic University in Gaza (IUG) was established in 1978. Till 1991, the Islamic University was the sole university in Gaza Strip. It started with three faculties: Faculty of Shariah (Islamic Law), Faculty of Ussoul Eldeen (religious foundation), and the Faculty of Arabic language, which later became the Faculty of Arts. Due to the need of Palestinian society for other disciplines, Faculty of Education, Faculty of Commerce and Faculty of Sciences were established in 1980. In 1991, the Faculty of Engineering was established, and at the beginning of the academic year 1992- 1993, the Faculty of Nursing was established and the Faculty of medicine witnessed its birth at the beginning of the academic year 2006-2007. Throughout those years, IUG witnessed a remarkable growth in its academic and administrative staff, as well as in its students and graduates. This growth was associated with the expanding of its facilities, units, laboratories and services in the field of scientific research, community development, in addition to its national, regional and international relations. Data Envelopment Analysis (DEA) is a relatively new data-oriented approach for evaluating the technical efficiency of a set of peer entities called Decision Making Units (DMUs). DEA provides a single measure and easily deals with multiple inputs and multiple outputs. Since the DEA technique was first developed, it has been widely applied to industries as diverse as health care (Bhat, Verma, & Reuben, 2001; Jacobs, Smith, & Street, 2006), Banking (Hassan & Sanchez, 2007), and transportation (Pathomsiri, 2006) and many other industries and organizations. Further, DEA-approach has proved especially valuable in cases where we have nonmarketed inputs or outputs and/or cannot be derived or agreed upon among different DMUs. In this study, DEA is used to assess the efficiencies of the academic departments (DMUs) at IUG. This paper is organized as follows: section 2 gives a brief review of the relevant literature and specifically variables used as inputs and outputs in similar studies. Section 3 gives a background on the Decision making Units (DMUs) used in this doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 304 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim study and describes the way these DMUs were selected. Variable selection is given in section 4. Section 5 describes the models used in the study. Results and discussion are given in section 6. Finally, section 7 concludes the paper. 2 Literature review In recent years, several studies have analyzed performance and efficiency in educational institutions using DEA approach. Each study differs in its scope, DMUs, and variables. An overview of the related studies is given. It is noted that these studies can be divided into two types. The first deals with efficiencies of universities while the second one deals with efficiencies of academic departments within universities and this is the focus of this study. The study of Abbott and Doucouliagos (2003) is one of the first type. It used data envelopment analysis to estimate technical and scale efficiency of individual Australian universities. Measures of teaching output include the number of equivalent full-time students, the number of post-graduate and under-graduate degrees enrolled, as well as the number of post-graduate degrees conferred and the number of under-graduate degrees conferred. The input measures include the total number of academic staff, the number of non-academic staff, expenditure on all other inputs other than labor inputs, and the value of non-current assets. The technical and scale efficiency results suggest that the Australian universities are operating at a fairly high level of efficiency relative to each other, although there is a room for improvement in several universities. This study is included here due to the fact that it uses similar variables like those used in the second type. As for the second type of studies, Lopes and Lanzer (2002) used data envelopment analysis and fuzzy sets to assess the performance of academic departments at Federal University of Santa Catarina in Brazil. The model applied to a set of fiftyeight departments showed fifteen with low performance. In addition, Moreno and Tadepalli (2002) assessed academic department efficiency of a public university. Data envelopment analysis is proposed for evaluating the efficiency of 42 academic departments at a public university. The inputs are faculty salaries, staff salaries, operational budget, equipment budget, and building space allocated to each academic unit while the outputs are number of graduates, number of undergraduates, full time equivalents produced, student credit hours generated, doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 305 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim and amount of grants awarded. The study results show 22 of departments were relatively efficient. Finally, Kao and Hung (2006) used data envelopment analysis to assess the relative efficiency of the academic departments at National Cheng Kung University in Taiwan. The outputs considered are total credit-hours, publications, and external grants; and the inputs utilized by the departments are personnel, operating expenses, and floor space. An assurance region is constructed by the top administrators of the university to confine the flexibility in selecting the virtual multipliers in DEA. As it can be seen, each study differs in its scope, DMUs, and variables. These studies are summarized as shown in Table 1. It is noted here that most of these studies used only one type of DEA (BCC). In addition, most of these studies, did not explicitly answer the question posed by the inefficient departments" Which of the resources should be given priority so that these inefficient DMUs become efficient?" In other words, most of these studies did not suggest where to start improving the efficiency. Therefore, this study uses not just one DEA model but it used the two DEA models in order to determine which of these models better represent the system. Further, the current study models the efficiency as a function of inputs and outputs, thus, inefficient DMUs can select the input that contributes more to their efficiencies. It is further noted that most of the studies were performed in developed countries. Therefore, it is imperative to use and diffuse these technologies in the developing countries. Clearly, the differences among these countries lead to different input and output variables due to the nature of departments, their interdependence, and availability of data. Due to the high subjectivity of research evaluation and avenues of publications, number of promotions was considered as a factor in this study. Since it is the first study, and due to the difficulty of obtaining some needed qualitative data, authors attempted to use only quantitative data just as a start so departments would make sure in the future to make available whatever qualitative data deemed to be necessary to perform future studies. It is not inconceivable that the absence of efficiency studies in the developing countries may be attributed to the following reasons. First: data availability regarding some of the common criterion used in developed countries. Second: the inappropriateness of some of these criteria to be used in developing countries. Therefore, the purpose of this study is threefold. First: to bridge the doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 306 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim gap existing in the literature, Second: introduce this methodology to developing countries and in the mean time find the relevant factors affecting the efficiency or at least thought to affect it based on experts' opinions. Author (s) Inputs Outputs Lope and Lanzer (2002) • Faculty salaries • Staff salaries • Operational budget • Equipment budget • Building space allocated to each academic unit • Number of graduate majors • Number of undergraduate majors • Full time equivalents produced • Student credit hours generated Amount of grants awarded Moreno and Tadepalli (2002) • Faculty salaries • Staff salaries • Operational budget • Equipment budget • Space allocated in square feet. • Graduates. • Under-graduates • Full time equivalents produced. • Student credit hours generated. • Amount of grants awarded. Abbott and Doucouliagos (2002) • Total number of academic staff • The number of non-academic staff • Expenditure on all other inputs • The number of equivalent fulltime students • The number of post-graduate • Under-graduate degrees enrolled • The number of post-graduate degrees conferred • The number of under-graduate degrees conferred. Kao and Hung (2006) • Personnel • Operating expenses • Floor space. • Credit-hours • Publications • External grants Table 1. “Input and Output Variables in Previous Studies Using DEA”. 3 Decision Making Units “DMUs” The Islamic University of Gaza (IUG) has ten faculties awarding BA. , B.Sc., MA, M.Sc., MBBS, and higher diplomas in a variety of disciplines. The ten faculties have 37 departments that offer 44 bachelor programs. Departments that have no graduates over the study period are excluded such as mathematics/statistics, optometry and biotechnology departments and faculty of medicine. As for the faculty of education, it was considered as one DMU because of the huge overlap among its departments especially in the faculty requirements courses. For the same reason, economics department is merged with political sciences; and journalism and mass communication departments were also treated as one department. Eventually, considering all above, the research sample includes 30 DMUs spanning nine of the IUG faculties as shown in Table 2. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 307 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Faculty DMUs Ussoul Eldeen (Religious Foundation) 1. General Ussoul Eldeen (Religious Foundation) Shariah and law 2. Islamic Shariah. Arts 3. Arabic 4. English 5. Geography 6. Journalism & Information 7. Public Relations and Advertisements 8. Social Work 9. History and Archeology Education 10. Education Commerce 11. Business Administration 12. Economics and Political Sciences 13. Accounting 14. Banking and Finance Science 15. Chemistry 16. Mathematics 17. Physics 18. Biology 19. Medical Technology 20. Environment and Earth Science 21. Mathematics-Computer 22. Chemistry-Biochemistry Nursing 23. General Nursing Information Technology “IT” 24. Computer Science 25. Information Technology System Engineering 26. Civil Engineering 27. Architectural Engineering 28. Electrical Engineering 29. Computer Engineering 30. Industrial Engineering Table 2. “Decision Making Units”. 4 Variables selection The selection of input and output variables for evaluating academic departments’ performance using DEA has been discussed in several studies. There are at least two difficulties in selecting the variables. One is the availability of data. For example, some scholars suggest using the salary of the first job as a measure of the achievement of teaching. Unfortunately, these data are difficult to obtain. Further, different professions have different salary standards. The other difficulty is doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 308 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim the measurement of quality, there is a lack of a common base for comparing the quality of research works and subjectivity is usually involved. Since the objective of this paper is to investigate the work load and effort devoted to teaching and research, only quantifiable measures are considered. To obtain input and output variables in this study, a preliminary list was composed using all input and output variables used in the literature. This list was shown to senior university who were asked to give their feedback whether the list is reasonable. Further, they were asked to add/delete/combine variables. Based on these responses, a refined list was compiled and shown again and again to university administration until a consensus was reached on what variables should be used to better represent the efficiency of the system (department). Thus, a final list of variables was obtained. These variables include Operating Expenses (OE), Training Resources (TR) and Credit Hours (CH) as inputs, while the number of Graduates (GR), Promotions (PROM) and Public Services Activities (PSA) are selected as outputs for the current study. The following paragraphs give more details about these measures. Operating Expenses (OE) of each department is the ongoing operational expenses such as administrative cost and stationery. Credit Hours (CH) is the actual hours offered by each department. Finally, Training Resources (TR) is the fixed cost of laboratories, facilities, and special assistance units from which the graduates benefited over the three-year study period. On the other hand, Graduates (GR) is the number of students who graduated during the study period, while promotions (PROM) is the number of promotions attained by the academic staff of each department over the period of study 2004- 2006. The final output is Public Service Activities (PSA)which includes the number of officially documented workshops, conferences, training courses and other extracurricular activities by the teaching staff of each department, that are officially documented at the university. A summary of these variables is given in Table 3. To ensure meaningful efficiency scores, the number of departments (DMUs) must be large enough relative to the number of input and output variables. A rule of thumb is given by Banker, Charnes and Cooper (1984) as [s+m ≤ n/3], where s is the number of output variables, m the number of input variables, and n the number of DMUs. In this research, the number of input and output variables is (3+3), which is less than one-third of the number of DMUs. It is important though doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 309 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim to note that this rule of thumb is not universally accepted and still the research sample size is large enough when using another rule which requires that the number of DMUs >= 2*s*m=18 was considered which is less than the 30 DMUs used in this study. Variable Source of data 1. Operating Expenses (OE): equipments, stationery and other materials. Questionnaire and financial department. 2. Load in Hours (LH): load hours minus overlap hours between departments. Questionnaire and registration & admission unit. 3. Training Resources (TR): laboratories, facilities, ceremonies and special assistance units. Technicians and financial department. 4. Graduates (GR): number of students who graduate over the three-year study period. Planning and development deanship 5. Promotions (PRO): represented by promotions. Scientific research deanship. 6. Public Service Activities (PSA): number of meetings, workshops, conferences, training courses outside the approved hours and extracurricular activities. Scientific research deanship, public relations unit, university website and information technology unit. Table 3. “Data Collection Summary”. 4.1 Data collection After input and output variables were finalized, a data sheet was designed in such a way that the values of these variables are filled in by different departments and units. The values of research variables were obtained in three ways: first, questionnaires that were distributed to all heads of departments to obtain operating expenses and load hours of each department. Second, interviews with quality unit directors, faculties’ deans and directors, heads of departments, technicians, planning and development deanship, public relations unit, admission and registration office, financial department, scientific research deanship, information technology unit and university president’s office. Finally, university website, publications, and brochures were used in data collection. The methods used in collecting these study variables are shown in Table 3. As it is noted from Table 3, operating expenses were obtained from the financial department of the university, while load hours for each department were obtained from the admission and registration unit. As for training resources, it was obtained from the financial doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 316 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Faculty Department “DMU” Efficiency score Reference set Ussoul Eldeen 1. General Ussoul Eldeen 100% 2 Shariah and law 2. Islamic Shariah 100% 1 Arts 3. Arabic 100% 1 4. English 85% 2, 3, 8, 12 5. Geography 100% 0 6. Journalism and Information 78% 1 , 7, 10, 13, 15 7. Public Relations and Adv. 100% 5 8. Social Work 100% 1 9. History And Archaeology 100% 0 Average score 94.7% Education 10. Education 100% 2 Commerce 11. Business Administration 100% 2 12. Economics and Political Sciences 100% 4 13. Accounting 100% 1 14. Banking And Finance 100% 0 Average score 100% Science 15. Chemistry 100% 7 16. Mathematics 100% 2 17. Physics 63% 7, 15, 16, 21, 25 18. Biology 100% 0 19. Medical Technology 93% 1, 7, 15 20. Environment and Earth Science 100% 0 21. Mathematics-Computer 100% 1 22. Chemistry-Biochemistry 100% 0 Average score 94.5% Nursing 23. General Nursing 81% 7, 11, 12, 15, 29 Information Technology “IT” 24. Computer Science 90 % 12, 15, 16, 25 25. Information Technology Sys. 100% 2 Average score 95% Engineering 26. Civil Engineering 100% 10, 15, 29 27. Architecture 100% 0 28. Electrical Engineering 100% 0 29. Computer Engineering 100% 3 30. Industrial Engineering 83% 7, 12, 15, 29 Average score 96.6 % Total average score 95.8% Table 6. “BCC Results and Reference Sets”. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 317 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Faculty Department “DMU” Efficiency score Reference set Ussoul Eldeen 31. General Ussoul Eldeen 100% 2 Shariah and law 32. Islamic Shariah 100% 1 Arts 33. Arabic 100% 1 34. English 85% 2, 3, 8, 12 35. Geography 100% 0 36. Journalism and Information 78% 1 , 7, 10, 13, 15 37. Public Relations and Adv. 100% 5 38. Social Work 100% 1 39. History And Archaeology 100% 0 Average score 94.7% Education 40. Education 100% 2 Commerce 41. Business Administration 100% 2 42. Economics and Political Sciences 100% 4 43. Accounting 100% 1 44. Banking And Finance 100% 0 Average score 100% Science 45. Chemistry 100% 7 46. Mathematics 100% 2 47. Physics 63% 7, 15, 16, 21, 25 48. Biology 100% 0 49. Medical Technology 93% 1, 7, 15 50. Environment and Earth Science 100% 0 51. Mathematics-Computer 100% 1 52. Chemistry-Biochemistry 100% 0 Average score 94.5% Nursing 53. General Nursing 81% 7, 11, 12, 15, 29 Information Technology “IT” 54. Computer Science 90 % 12, 15, 16, 25 55. Information Technology Sys. 100% 2 Average score 95% Engineering 56. Civil Engineering 100% 10, 15, 29 57. Architecture 100% 0 58. Electrical Engineering 100% 0 59. Computer Engineering 100% 3 60. Industrial Engineering 83% 7, 12, 15, 29 Average score 96.6 % Total average score 95.8% Table 6. “BCC Results and Reference Sets”. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 318 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Further, the values of CCR and BCC efficiencies are close to each other, which imply that either the CCR or BCC may be adopted for this research depending on the value of the correlation coefficient between DMUs size and CCR results. If Credit Hours (CH) is considered to represent the DMU size, the correlation coefficient between DMUs size and CCR results equals 0.205 which means that there is no relation between efficiency score and DMU size. Further, even if the number of graduates is used to represent the DMU size, the correlation coefficient between the number of graduates and CCR results was still as low as 0.01. So, the results of CCR model can be adopted to be the research result (Avkiran, 2002). In other words, there is no relationship between efficiency scores and DMU size. Equivalently said, the DMUs do not benefit from what is known in economics as economies of scale. Therefore, CCR results will be used in the analysis throughout the rest of the paper. Finally, the results obtained here are different than those in some of the previous studies. This could be attributed to the fact that some of these studies (Kao & Hung, 2008) only used the BCC model and it was assumed to be the one representing the academic departments’ performance. 6.2 Potential improvements For inefficient departments to benefit from the study, the amounts by which these DMUs should decrease their inputs to become efficient are calculated using the CCR model. Figure 1 shows the actual and the targeted values of the operating expenses variable (OE). In this study, the targeted value of a variable represents the amount to which a given DMU can decrease its consumption of that specific variable. It is noticed that mathematics, physic and biology departments in addition to departments in IT faculty, nursing and engineering to decrease their operating expenses by certain amounts to reach the targeted level shown in order to be efficient. As for Credit Hours, Figure 2 shows the actual and target values for this input. If inefficient departments can reduce their inputs to the corresponding target levels, then, they would become efficient. In general, departments in faculty of science and engineering need to reduce their inputs of Credit Hours in order to become efficient. Finally, as for the third input variable (TR), it is noticed in Figure 3 still that all departments belonging to faculties of science and engineering should decrease their usage of training resources and fixed assets incurred by the expensive labs. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 319 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Figure 1. “Comparison between actual and targeted values of Operating Expenses”. Figure 2. “Comparison between actual and targeted values of Credit Hours”. 0 5000 10000 15000 20000 25000 12345678910111213141516171819202122232425262728293031 Operating Expenses ($) DMUs Targeted OE 0 500 1000 1500 2000 2500 3000 12345678910111213141516171819202122232425262728293031 Credit Hours (CH) DMUs Targeted CH doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 320 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Figure 3. “Comparison between actual and targeted values of Training Resources”. 6.3 Super-efficiency analysis Department “DMU” Super-Efficiency score% 1. General Ussoul Eldeen. 204.40 2. Islamic Shariah. 256.50 3. Arabic. 324.50 4. Geograph. 137.20 5. Public Relations and Adv. 785.50 6. Social Work. 172.30 7. Education. 110.40 8. Business Administration. 148.50 9. Accounting. 135.50 10. Banking and Finance. 1971.40 Table 7. “Super-efficiency Scores of Efficient Departments”. Basic DEA models evaluate the relative efficiency of DMUs but do not allow ranking of the efficient DMUs themselves. Therefore, and for efficient departments to benefit from this study as well, super efficiency of efficient DMUs is evaluated by removing the inefficient DMUs in CCR results. Table 7 shows the super efficiency results. It is noticed that banking and finance department has the highest efficiency score of 1971% while the other efficient departments have a super- 0 50000 100000 150000 200000 250000 300000 350000 400000 12345678910111213141516171819202122232425262728293031 Training Resources ($) DMUs Targeted TR Actual TR doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 321 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim efficiency scores ranging from 110% to 785%. Therefore efficient departments can benefit from this study by learning from more efficient ones. The next section shows how super efficiency scores relate to input and output variables. 6.4 Regression model In order to help departments prioritize their goals and focus on the significant variables to become efficient, a multiple linear regression model that relates super efficiency scores to amounts of outputs is built. Equation (4) shows super efficiency in terms of outputs. 𝑆𝑢𝑝𝑒𝑟 𝐸𝑓𝑓𝑖𝑐𝑖𝑒𝑛𝑐𝑦 (𝑂)= 0.084 + 0.0086 𝐺𝑅 + 0.391 𝑃𝑅𝑂𝑀 + 0.08 𝑃𝑆𝐴 (4) It is obvious that the PROM has the largest effect on super efficiency score, as indicated by its coefficient in equation (4), followed by PSA while GR has the least effect since it contributes to efficiency as much as one tenth of PSA. In other words, the effect of increasing the number of promotions by one is equivalent to increasing the number of graduates by ten. Therefore; inefficient departments should set their priorities by focusing on PROM first, then PSA and finally GR. The correlation coefficient of the resulting equation was found to be 0.9 which is pretty good. Figure 4 shows the relationship between the actual values of super efficiency versus predicted ones in terms of outputs. Figure 4. “Comparison between actual values of super efficiency and predicted ones using outputs only”. 0 300 600 900 1200 1500 1800 2100 12345678910111213141516171819202122232425262728293031 Super-Efficiency Score % DMUs SE(O) SE doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 322 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim In order to have a more sensitive prediction, both outputs and inputs were also included in the model. Clearly, as seen in Figure 5, the model performs better in terms of its prediction power and correlation coefficient which is 0.98. Super efficiency scores can be expressed as shown in equation (5): 𝑆𝑢𝑝𝑒𝑟 𝐸𝑓𝑓𝑖𝑐𝑖𝑒𝑛𝑐𝑦 (𝐼,𝑂)= 1.9 − 0.000335 𝑂𝐸 − 0.0045 𝐶𝑅 −1.95𝑒−5 𝑇𝑅 + 0.00945𝐺𝑅 + 0.371 𝑃𝑅𝑂𝑀+ 0.0641 𝑃𝑆𝐴. (5) Figure 5. “Comparison between actual values of super efficiency and predicted ones using inputs and outputs”. It is clear that PROM. still has the largest contribution to super efficiency score as it was the case in model 1, since it has the largest of 0.371 while TR has the lowest effect on the efficiency score. Moreover, PSA, GR, CH and OE do not have a large effect on efficiency scores because their weights are between 0.00033 and 0.064 and consequently they will not have a dramatic effect if they are changed since the problem is an input minimizing one. It is clear from equation (5) that a one unit increase in PROM is equivalent to increasing the number of students by more than 45 units. Meanwhile, PSA contributes reasonably high to the efficiency score, so it is in the interest of each department to increase its public service activities since it will enhance the output of a given department and certainly the efficiency score. 0 300 600 900 1200 1500 1800 2100 12345678910 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 Super-Efficiency Score % DMUs SE(I,O) SE doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 323 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim 7 Conclusions This research used the input minimizing Data Envelopment Analysis approach to measure the technical efficiency of academic IUG departments. The DMUs of the research are 30 departments and the study covered the period (2004-2006). Six input and output variables are selected to represent these departments' efficiencies. Operating Expenses (OE), Credit Hours (CH), and Training Resources (TR) are used as inputs, while the outputs include number of Graduates (GR), Promotions (PROM), and Public Service Activities (PSA). The results of CCR model have an average of 68.5%. 10 DMUs are 100% efficient in CCR. The potential improvements are then evaluated for each inefficient DMU. It was found that PSA needs the most improvement in outputs and TR needs the most improvement in inputs. Furthermore, the super-efficiency of efficient departments is measured for each department in order to identify the most efficient department and hence rank the rest of the efficient departments. Finally, and to help decision makers in the inefficient departments select the most promising variables to improve their efficiencies; a multiple linear model was built. The model expresses super efficiency as a function of inputs and outputs. Even in a better economic situation, this research will add a new tool to the decision makers’ toolbox to effectively evaluate the performance of their institutions and to optimally manage their resources. The fact that there are large differences in the efficiency scores of the different departments require that university administrators should allocate different amounts of different resources to the different departments. Based on the above, it is recommended that university administration encourage and motivate its academic staff to focus more on publications which is mainly the criteria of promotion. Here comes the role of scientific research deanery to help those inefficient departments through more research grants and projects. This can be easily done due to the fact that scientific research grants are mainly centralized through the deanship. Worth mentioning here is the fact that the classical method of increasing cost efficiency through increasing number of graduates which is normally achieved through more aggressive recruitment efforts would not really be a very effective method to increase the technical efficiency of the corresponding departments. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 324 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Further, university departments should make sure to collect and properly document the pertinent data in special data bases to make it easier to perform similar and more detailed studies in the future. Although DEA is such a powerful tool, it should be noted here that this study is deterministic in nature. In other words, it does not deal with outliers. Therefore, it is recommended that other tools be used in future studies. References Abbott, M., & Doucouliagos, C. (2003). The Efficiency of Australian Universities: A Data Envelopment Analysis. Economics of Education Review, 22(1), 89-97. doi:10.1016/S0272-7757(01)00068-1 Asmilda, M., Paradib, J., Reesec, D. & Tamb, F. (2007). Measuring overall efficiency and effectiveness using DEA. European Journal of Operational Research, 178(1), 305-321. doi:10.1016/j.ejor.2006.01.014 Avkiran, N. (2002). Productivity Analysis in the Service Sector. Australia: N. K. Avkiran Publisher. Banker, R. D., Charnes, A., & Cooper, W.W. (1984). Some Models for Estimating Technical and Scale Inefficiency in Data Envelopment Analysis. Management Science, 30(9), 1078-1092. doi:10.1287/mnsc.30.9.1078 Bhat, R., Verma, B. & Reuben, E. (2001). Data Envelopment Analysis (DEA). Journal of Health Management, 3(2), 309-328. doi:10.1177/097206340100300207 Charnes, A. Copper, W., Lewin, A. & Seiford, L. (1994). Data Envelopment Analysis: Theory, Methodology, and Application. Kluwer Academic Publisher. Hassan, K. & Sanchez, B. (2007). Efficiency Determinants and Dynamic Efficiency Changes in Latin American Banking Industries. Networks Financial Institute Working Paper, No. 2007-WP-32. doi:10.3926/jiem.2011.v4n2.p301-325 JIEM, 2011 – 4(2): 301-325 – Online ISSN: 2013-0953 Print ISSN: 2013-8423 Assessment of academic departments efficiency using data envelopment analysis 325 S.R. Agha; I. Kuhail; N. Abdelnabi; M. Salem; A. Ghanim Jacobs, R., Smith, P. & Street, A. (2006). Measuring Efficiency in Health Care: Analytic Techniques and Health Policy. Cambridge University Press. doi:10.1017/CBO9780511617492 Kao, C. & Hung, H. (2008). Efficiency Analysis of University Departments: An Empirical Study. Omega, 36(4), 653–664. doi:10.1016/j.omega.2006.02.003 Lopes, A., Lanzer, E. (2002). Data Envelopment Analysis-DEA And Fuzzy Sets to Assess The Performance of Academic Departments: A Study at Federal University Of Santa Catrina-UFSC. Pesquisa Operacional, 22(2), 217-230. doi:10.1590/S0101-74382002000200008 Moreno, A. & Tadepalli, R. (2002). Assessing Academic Department Efficiency a Public University. Managerial and Decision Economics, 23(7), 385-397. doi:10.1002/mde.1075 Pathomsiri, S. (2006). Assessment of Productive Efficiency of Airports. Dissertation at the University of Maryland - USA. Scheel, H. (2000). Efficiency Measurement System Software “EMS”, Version 1.3.0. Seiford, L.M. (1996). Data Envelopment Analysis: the evolution of the state of the art (1978 – 1995). Journal of Productivity Analysis, 7(2-3), 99-137. doi:10.1007/BF00157037 Journal of Industrial Engineering and Management, 2011 (www.jiem.org) Article's contents are provided on a Attribution-Non Commercial 3.0 Creative commons license. Readers are allowed to copy, distribute and communicate article's contents, provided the author's and Journal of Industrial Engineering and Management's names are included. It must not be used for commercial purposes. To see the complete license contents, please visit http://creativecommons.org/licenses/by-nc/3.0/.