You are here:

A multilevel decomposition of school performance using robust nonparametric frontier techniques
ARTICLE

, ,

Economics of Education Review Volume 32, Number 1, ISSN 0272-7757 Publisher: Elsevier Ltd

Abstract

We propose a methodology for evaluating educational performance, from a multilevel perspective. We use partial frontier approaches to mitigate the influence of outliers and the curse of dimensionality. Our estimation considers idiosyncratic variables at the school, class, and student levels. Our model is applied to a sample of students in fourth year of primary school in urban schools in Chile. Results are in line with previous findings that less than 30% of the variance in students’ educational attainment is attributable to their schools. Results also corroborate that a model considering only student-level variables yields high inefficiencies not attributable to school management, but rather to inadequate resource-endowment policy. Therefore, when disregarding specific variables concerning the resources allocated to the schools, the performance of those schools is undervalued, largely because inefficiencies caused by suboptimal resource endowments or difficulties arising from the socioeconomic environment are instead attributed to poor school management.

Citation

Thieme, C., Prior, D. & Tortosa-Ausina, E. (2013). A multilevel decomposition of school performance using robust nonparametric frontier techniques. Economics of Education Review, 32(1), 104-121. Elsevier Ltd. Retrieved August 8, 2024 from .

This record was imported from Economics of Education Review on March 1, 2019. Economics of Education Review is a publication of Elsevier.

Full text is availabe on Science Direct: http://dx.doi.org/10.1016/j.econedurev.2012.08.002

Keywords

References

View References & Citations Map
  1. Aitkin, M., & Longford, N. (1986). Statistical modelling issues in school effectiveness studies?. Journal of the Royal Statistical Society Series A (General), 149(1), pp. 1-43.
  2. Anand, P., Mizala, A., & Repetto, A. (2009). Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile?. Economics of Education Review, 28(3), pp. 370-381.
  3. Auguste, S., & Valenzuela, J. P. (2003). Do students benefit from school competition? Evidence from Chile. Mimeo. Michigan: University of Michigan.
  4. Badunenko, O., Henderson, D. J., & Kumbhakar, S. C. (2012). When, where and how to perform efficiency estimation. Journal of the Royal Statistical Society Series A, in press.
  5. Balaguer-Coll, M.T., Prior, D., & Tortosa-Ausina, E. (2010). Devolution dynamics of Spanish local government?. Environment and Planning A, 42(6), pp. 1476-1495.
  6. Bass, B.M., & Avolio, B.J. (1997). Full range leadership development: Manual for Multifactor leadership questionnaire. CA: Mindgarden.
  7. Battese, G.E., & Rao, D. (2002). Technology gap efficiency, and a stochastic metafrontier function. International Journal of Business, 1(2), pp. 87-93.
  8. Battese, G.E., Rao, D., & O’Donnell, C.J. (2004). A metafrontier production function for estimation of technical efficiencies and technology gaps for firms operating under different technologies?. Journal of Productivity Analysis, 21(1), pp. 91-103.
  9. Bauer, P.W., Berger, A.N., Ferrier, G.D., & Humphrey, D.B. (1998). Consistency conditions for regulatory analysis of financial institutions: A comparison of frontier efficiency methods?. Journal of Economics and Business, 50(2), pp. 85-114.
  10. Bessent, A., Bessent, W., Kennington, J., & Reagan, B. (1982). An application of mathematical programming to assess productivity in the Houston independent school district?. Management Science, 28(12), pp. 1355-1367.
  11. Bifulco, R., & Bretschneider, S. (2001). Estimating school efficiency: A comparison of methods using simulated data?. Economics of Education Review, 20(5), pp. 417-429.
  12. Blanco, E. (2010). Eficacia escolar y desigualdad: aportes para la política educativa. Perfiles Latinoamericanos, 17(34), pp. 51-85.
  13. Bosker, R.J., & Witziers, B. (1996). The magnitude of school effects, or: Does it really matter which school a student attends. Annual meeting of the American Educational Research Association.
  14. Bryk, A.S., & Raudenbush, S.W. (2002). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage Publications.
  15. Caldas, S.J., & Bankston, C. (1997). Effect of school population socioeconomic status on individual academic achievement?. The Journal of Educational Research, 90(5), pp. 269-277.
  16. Cazals, C., Florens, J.-P., & Simar, L. (2002). Nonparametric frontier estimation: A robust approach. Journal of Econometrics, 106, pp. 1-25.
  17. Cervini, R.A. (2009). Class, school, municipal, and state effects on mathematics achievement in Argentina: A multilevel analysis. School Effectiveness and School Improvement, 20(3), pp. 319-340.
  18. Charnes, A., Cooper, W.W., & Rhodes, E. (1978). Measuring the efficiency of decision making units?. European Journal of Operational Research, 2(6), pp. 429-444.
  19. Cook, W.D., & Seiford, L.M. (2009). Data envelopment analysis (DEA) – Thirty years on?. European Journal of Operational Research, 192(1), pp. 1-17.
  20. Cummins, J.D., & Zi, H. (1998). Comparison of frontier efficiency methods: An application to the U.S. life insurance industry. Journal of Productivity Analysis, 10, pp. 131-152.
  21. Daraio, C., & Simar, L. (2007). Advanced robust and nonparametric methods in efficiency analysis. Methodology and applications. Studies in productivity and efficiency. New York: Springer.
  22. De Borger, B., & Kerstens, K. (1996). Cost efficiency of Belgian local governments: A comparative analysis of FDH, DEA, and econometric approaches. Regional Science and Urban Economics, 26, pp. 145-170.
  23. De Witte, K., Thanassoulis, E., Simpson, G., Battisti, G., & Charlesworth-May, A. (2010). Assessing pupil and school performance by non-parametric and parametric techniques?. Journal of the Operational Research Society, 61(8), pp. 1224-1237.
  24. Deprins, D., Simar, L., & Tulkens, H. (1984). Measuring labor-efficiency in post offices. The performance of public enterprises: Concepts and measurement, pp. 243-267. Amsterdam: North-Holland.
  25. Elacqua, G., Schneider, M., & Buckley, J. (2006). School choice in Chile: Is it class or the classroom?. Journal of Policy Analysis and Management, 25(3), pp. 577-601.
  26. Emrouznejad, A., Parker, B.R., & Tavares, G. (2008). Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA?. Socio-Economic Planning Sciences, 42(3), pp. 151-157.
  27. Fan, Y., Li, Q., & Weersink, A. (1996). Semiparametric estimation of stochastic production frontier models. Journal of Business and Economic Statistics, 14, pp. 460-468.
  28. Ferrier, G.D., & Lovell, C.A.K. (1990). Measuring cost efficiency in banking: Econometric and linear programming evidence. Journal of Econometrics, 46, pp. 229-245.
  29. Gallego, F. (2002). Competencia y resultados educativos: teoría y evidencia para Chile?. Cuadernos de Economía, 39(118), pp. 309-352.
  30. Gallego, F. (2006). Inter-school competition incentives and outcomes: Evidence from Chile. Technical report. Massachusetts: Department of Economics, MIT.
  31. Goldhaber, D.D., & Eide, E.R. (2003). Methodological thoughts on measuring the impact of private sector competition on the educational marketplace?. Educational Evaluation and Policy Analysis, 25(2), pp. 217-232.
  32. Goldstein, H. (1995). Multilevel statistical models. Wiley: London.
  33. Goldstein, H. (1997). Methods in school effectiveness research?. School Effectiveness and School Improvement, 8(4), pp. 369-395.
  34. Goldstein, H., & Woodhouse, G. (2000). School effectiveness research and educational policy?. Oxford Review of Education, 26(3), pp. 353-363.
  35. Heckman, J.J. (1979). Sample selection bias as a specification error?. Econometrica, 47(1), pp. 153-162.
  36. Henderson, V., Mieszkowski, P., & Sauvageau, Y. (1978). Peer group effects and educational production functions?. Journal of Public Economics, 10(1), pp. 97-106.
  37. Hox, J.J. (2002). Multilevel analysis: Techniques and applications. Mahwah, NJ: Lawrence Erlbaum Associates.
  38. Hsieh, C., & Urquiola, M. (2006). The effects of generalized school choice on achievement and stratification: Evidence from Chile's voucher program. Journal of Public Economics, 90, pp. 1477-1503.
  39. Kneip, A., Park, B.U., & Simar, L. (1998). A note on the convergence of nonparametric DEA estimators for production efficiency scores. Econometric Theory, 14, pp. 783-793.
  40. Kneip, A., Simar, L., & Wilson, P.W. (2008). Asymptotics for DEA estimators in nonparametric frontier models. Econometric Theory, 24, pp. 1663-1697.
  41. Kumar, S., & Russell, R.R. (2002). Technological change, technological catch-up, and capital deepening: Relative contributions to growth and convergence. American Economic Review, 92(3), pp. 527-548.
  42. Lara, B., Mizala, A., & Repetto, A. (2011). The effectiveness of private voucher education?. Educational Evaluation and Policy Analysis, 33(2), pp. 119-137.
  43. Lee, L. (1983). Generalized econometric models with selectivity. Econometrica, 51, pp. 507-512.
  44. Li, Q. (1996). Nonparametric testing of closeness between two unknown distribution functions. Econometric Reviews, 15, pp. 261-274.
  45. Loader, C.R. (1996). Local likelihood density estimation. The Annals of Statistics, 24(4), pp. 1602-1618.
  46. Mancebón, M.J., & Mar Molinero, C. (2000). Performance in primary schools?. Journal of the Operational Research Society, 51(7), pp. 843-854.
  47. Mancebón, M.J., & Muñiz, M.A. (2007). Private versus public high schools in Spain: Disentangling managerial and programme efficiencies?. Journal of the Operational Research Society, 59(7), pp. 892-901.
  48. McEwan, P.J. (2001). The effectiveness of public, Catholic, and non-religious private schools in Chile's voucher system. Education Economics, 9(2), pp. 103-128.
  49. McEwan, P.J. (2003). Peer effects on student achievement: Evidence from Chile?. Economics of Education Review, 22(2), pp. 131-141.
  50. McEwan, P.J., & Carnoy, M. (2000). The effectiveness and efficiency of private schools in Chile's voucher system?. Educational Evaluation and Policy Analysis, 22(3), pp. 213-239.
  51. Mizala, A., & Romaguera, P. (2001). Factores socioeconómicos explicativos de los resultados escolares en la educación secundaria en Chile?. El Trimestre Económico, 68(272), pp. 515-549.
  52. Mizala, A., & Romaguera, P. (2004). School and teacher performance incentives: The Latin American experience?. International Journal of Educational Development, 24(6), pp. 739-754.
  53. Mizala, A., Romaguera, P., & Farren, D. (2002). The technical efficiency of schools in Chile?. Applied Economics, 34(12), pp. 1533-1552.
  54. Mizala, A., Romaguera, P., & Urquiola, M. (2007). Socioeconomic status or noise? Tradeoffs in the generation of school quality information. Journal of Development Economics, 84(1), pp. 61-75.
  55. Mizala, A., & Torche, F. (2012). Bringing the schools back in: The stratification of educational achievement in the Chilean voucher system?. International Journal of Educational Development, 32(1), pp. 132-144.
  56. Murillo, F.J. (2010). ‘Quiénes son los responsables de los resultados de las evaluaciones’ Hacia un planteamiento de valor agregado en educación.. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 8(4), pp. 3-9.
  57. Murillo-Melchor, C., Pastor, J.M., & Tortosa-Ausina, E. (2010). A bootstrap approach to analyse productivity growth in European banking. Journal of the Operational Research Society, 61, p. 1729L 1745.
  58. O’Donnell, C.J., Prasada Rao, D.S., & Battese, G.E. (2008). Metafrontier frameworks for the study of firm-level efficiencies and technology ratios. Empirical Economics, 34, pp. 231-255.
  59. Oliveira, M.A., & Santos, C. (2005). Assessing school efficiency in Portugal using FDH and bootstrapping?. Applied Economics, 37(8), pp. 957-968.
  60. Opdenakker, M.C., & Van Damme, J. (2001). Relationship between school composition and characteristics of school process and their effect on mathematics achievement?. British Educational Research Journal, 27(4), pp. 407-432.
  61. Ouellette, P., & Vierstraete, V. (2005). An evaluation of the efficiency of Québec's school boards using the Data Envelopment Analysis method?. Applied Economics, 37(14), pp. 1643-1653.
  62. Park, B.U., Simar, L., & Weiner, C. (2000). The FDH estimator for productivity efficiency scores?. Econometric Theory, 16(6), pp. 855-877.
  63. Pastor, J.M., & Tortosa-Ausina, E. (2008). Social capital and bank performance: An international comparison for OECD countries?. The Manchester School, 76(2), pp. 223-265.
  64. Pastor, J.T. (1996). Translation invariance in Data Envelopment Analysis: A generalization?. Annals of Operations Research, 66(2), pp. 91-102.
  65. Patrinos, H.A. (1995). Socioeconomic background, schooling, experience, ability and monetary rewards in Greece. Economics of Education Review, 14(1), pp. 85-91.
  66. Phillips, M. (1997). What makes schools effective? A comparison of the relationships of communitarian climate and academic climate to mathematics achievement and attendance during middle school. American Educational Research Journal, 34(4), pp. 633-662.
  67. Resti, A. (1997). Evaluating the cost-efficiency of the Italian banking system: What can be learned from the joint application of parametric and non-parametric techniques?. Journal of Banking & Finance, 21, pp. 221-250.
  68. Ruggiero, J., Duncombe, W., & Miner, J. (1995). On the measurement and causes of technical inefficiency in local public services: With an application to public education?. Journal of Public Administration Research and Theory, 5(4), pp. 403-428.
  69. Sammons, P., Thomas, S., & Mortimore, P. (1997). Forging links: Effective schools and effective departments. London: Paul Chapman Publishing.
  70. Sapelli, C., & Vial, B. (2002). The performance of private and public schools in the Chilean voucher system?. Cuadernos de Economía, 39(118), pp. 423-454.
  71. Silva Portela, M.C.A., & Camanho, A.S. (2010). Analysis of complementary methodologies for the estimation of school value added?. Journal of the Operational Research Society, 61(7), pp. 1122-1132.
  72. Silva Portela, M.C.A., & Thanassoulis, E. (2001). Decomposing school and school-type efficiency?. European Journal of Operational Research, 132(2), pp. 357-373.
  73. Simar, L. (2003). Detecting outliers in frontier models: A simple approach?. Journal of Productivity Analysis, 20(3), pp. 391-424.
  74. Simar, L., & Wilson, P.W. (2000). Statistical inference in nonparametric frontier models: The state of the art?. Journal of Productivity Analysis, 13(1), pp. 49-78.
  75. Simar, L., & Wilson, P.W. (2008). Statistical inference in nonparametric frontier models: Recent developments and perspectives.. The measurement of productive efficiency, pp. 421-521. Oxford: Oxford University Press.
  76. Somers, M.A., McEwan, P.J., & Willms, J.D. (2004). How effective are private schools in Latin America?. Comparative Education Review, 48(1), pp. 48-69.
  77. Summers, A.A., & Wolfe, B.L. (1977). Do schools make a difference?. The American Economic Review, 67(4), pp. 639-652.
  78. Thanassoulis, E., & Silva Portela, M.C.A. (2002). School outcomes: Sharing the responsibility between pupil and school?. Education Economics, 10(2), pp. 183-207.
  79. Thanssoulis, E. (1999). Setting achievement targets for school children?. Education Economics, 7(2), pp. 101-119.
  80. Thieme, C., Prior, D., Giménez, V., & Tortosa-Ausina, E. (2011). Desempeño de los centros educativos: ‘un problema de recursos o de capacidades organizativas’. Hacienda Pública Española, 199, pp. 81-118.
  81. Valenzuela, J.P., Bellei, C., & De los Ríos, D. (2009). Evolución de la segregación socioeconómica de los estudiantes chilenos y su relación con el financiamiento compartido. Santiago de Chile: FONIDE, Ministerio de Educación de Chile.
  82. Waslander, S., Pater, C., & van der Weide, M. (2010). Markets in education: An analytical review of empirical research on market mechanisms in education. Education Working Papers 52. Paris: OECD.
  83. Weill, L. (2004). Measuring cost efficiency in European banking: A comparison of frontier techniques. Journal of Productivity Analysis, 21, pp. 133-152.
  84. Wheelock, D.C., & Wilson, P.W. (2009). Robust nonparametric quantile estimation of efficiency and productivity change in U.S. commercial banking, 1985–2004. Journal of Business and Economic Statistics, 27(3), pp. 354-368.
  85. Winkler, D. (1975). Educational achievement and school peer group composition?. Journal of Human Resources, 10(2), pp. 189-204.

These references have been extracted automatically and may have some errors. Signed in users can suggest corrections to these mistakes.

Suggest Corrections to References