Zero Score, Now What?

Analysis of Accounting Students’ Zero Scores on the ENADE

Authors

DOI:

https://doi.org/10.17524/repec.v16i4.3060

Keywords:

Grade, Academic performance, Higher education, Accounting, ENADE

Abstract

Objective: To analyze the zero scores obtained by accounting students on the ENADE 2018 based on the literature addressing the quality of accounting education and the purpose of the Enade.
Method: This is an archival study in which microdata was collected from the INEP’s website. In total, 52,847 observations were analyzed using descriptive analysis and binary regression models.

Results: A micro portion of the students scored zero both in the general knowledge (FG) and specific content (CE) portions of the exam. The reason for these students having scored zero is that they left the answers blank. Nevertheless, when these portions were explored separately, zero scores became more representative and were mainly concentrated on open-ended questions. This finding suggests a greater need to motivate students to solve accounting-related open-ended questions. On the other hand, a lower number of zero scores was found among the close-ended questions, which may be associated with the students being more used to tests predominantly presenting close-ended questions. Gender, age, program modality (brick-and-mortar vs. distance learning), and region were relevant to explain the students’ likelihood of scoring zero points.

Contributions: Zero scores provide some lessons, especially regarding the students’ motivations and variables, which can either increase or decrease the probability of zero scores. Likewise, it encourages a critical reflection on the importance of the ENADE and how to motivate students to perform it, including a debate on regulatory implications.

Author Biographies

Vitor Hideo Nasu, Universidade de São Paulo

Doutorando em Controladoria e Contabilidade pela FEA/USP.

Breno Gabriel da Silva, Escola Superior de Agricultura Luiz de Queiroz da Universidade de São Paulo (ESALQ/USP)

Doutorando em Estatística e Experimentação Agronômica (ESALQ/USP).

References

Ahinful, G. S., Tauringana, V., Bansah, E. A., & Essuman, D. (2019). Determinants of academic performance of accounting students in Ghanaian secondary and tertiary education institutions. Accounting Education, 28(6), 553–581. https://doi.org/10.1080/09639284.2019.1679204

Ben, M. G., & Yohai, V. J. (2004). Quantile–Quantile Plot for Deviance Residuals in the Generalized Linear Model. Journal of Computational and Graphical Statistics, 13(1), 36–47. https://doi.org/10.1198/1061860042949_a

Boyle, D. M., & Hermanson, D. R. (2020). Research Initiatives in Accounting Education: Developing and Utilizing Faculty. Issues in Accounting Education, 35(4), 75–86. https://doi.org/10.2308/ISSUES-2020-015

Brasil. (2004). Lei no 10.861 - Institui o Sistema Nacional de Avaliação da Educação Superior – SINAES e dá outras providências. Retrieved from http://www.planalto.gov.br/ccivil_03/_ato2004-2006/2004/lei/l10.861.htm

Brink, A. G., & Reichert, B. E. (2020). Research Initiatives in Accounting Education: Serving and Enhancing the Profession. Issues in Accounting Education, 35(4), 25–33. https://doi.org/10.2308/ISSUES-2020-018

Chartered Global Management Accountant. (2019). CGMA Competency Framework, 2019 Update. Retrieved from https://www.cgma.org/resources/tools/cgma-competency-framework.html

Chen, C. C., Jones, K. T., & Moreland, K. A. (2013). Online Accounting Education versus In-Class Delivery: Does Course Level Matter? Issues in Accounting Education, 28(1), 1–16. https://doi.org/10.2308/iace-50303

Chiu, V., Gershberg, T., Sannella, A. J., & Vasarhelyi, M. A. (2014). Does a Live Instructor Matter? Journal of Emerging Technologies in Accounting, 11(1), 1–25. https://doi.org/10.2308/jeta-51058

Coetzee, S. A., Schmulian, A., & Coetzee, R. (2018). Web conferencing-based tutorials: student perceptions thereof and the effect on academic performance in accounting education. Accounting Education, 27(5), 531–546. https://doi.org/10.1080/09639284.2017.1417876

Cordeiro, G. M., & Simas, A. B. (2009). The distribution of Pearson residuals in generalized linear models. Computational Statistics & Data Analysis, 53(9), 3397–3411. https://doi.org/10.1016/j.csda.2009.02.025

Daymont, T., & Blau, G. (2008). Student Performance in Online and Traditional Sections of an Undergraduate Management Course. Journal of Behavioral and Applied Management, 9(3), 275–294.

Dolce, V., Emanuel, F., Cisi, M., & Ghislieri, C. (2020). The soft skills of accounting graduates: perceptions versus expectations. Accounting Education, 29(1), 57–76. https://doi.org/10.1080/09639284.2019.1697937

Elikai, F., & Schuhmann, P. W. (2010). An Examination of the Impact of Grading Policies on Students’ Achievement. Issues in Accounting Education, 25(4), 677–693. https://doi.org/10.2308/iace.2010.25.4.677

Fogarty, T. J., Zimmerman, A. B., & Richardson, V. J. (2016). What do we mean by accounting program quality? A decomposition of accounting faculty opinions. Journal of Accounting Education, 36, 16–42. https://doi.org/10.1016/j.jaccedu.2016.04.001

Fortin, A., Viger, C., Deslandes, M., Callimaci, A., & Desforges, P. (2019). Accounting students’ choice of blended learning format and its impact on performance and satisfaction. Accounting Education, 28(4), 353–383. https://doi.org/10.1080/09639284.2019.1586553

Gracia, L., & Jenkins, E. (2003). A quantitative exploration of student performance on an undergraduate accounting programme of study. Accounting Education, 12(1), 15–32. https://doi.org/10.1080/0963928032000049375

INEP. (2015). Portaria Inep no 220, de 10 de junho de 2015. Retrieved February 15, 2021, from INEP website: http://download.inep.gov.br/educacao_superior/enade/legislacao/2015/ciencias_contabeis_portaria_inep_n220_10062015.pdf

INEP. (2018). ENADE 2018 - Ciências contábeis. Retrieved February 15, 2021, from INEP website: https://download.inep.gov.br/educacao_superior/enade/provas/2018/ciencias_contabeis.pdf

INEP. (2019). Sinopse Estatística da Educação Superior 2019. Retrieved February 14, 2021, from Censo da educação superior website: https://www.gov.br/inep/pt-br/areas-de-atuacao/pesquisas-estatisticas-e-indicadores/censo-da-educacao-superior/resultados

INEP. (2020). Microdados do Exame Nacional de Desempenho dos Estudantes. Retrieved February 15, 2021, from INEP website: https://www.gov.br/inep/pt-br/acesso-a-informacao/dados-abertos/microdados/enade

International Federation of Accountants. (2019). Handbook of International Education Pronouncements. Retrieved from https://www.ifac.org/system/files/publications/files/Handbook-of-International-Education-Standards-2019.pdf

Jackling, B., & De Lange, P. (2009). Do Accounting Graduates’ Skills Meet The Expectations of Employers? A Matter of Convergence or Divergence. Accounting Education, 18(4–5), 369–385. https://doi.org/10.1080/09639280902719341

Jordan, E. E., & Samuels, J. A. (2020). Research Initiatives in Accounting Education: Improving Learning Effectiveness. Issues in Accounting Education, 35(4), 9–24. https://doi.org/10.2308/ISSUES-2020-019

Leitão, T., Moriconi, G., Abrão, M., & Silva, D. (2010). Uma análise acerca do boicote dos estudantes aos exames de avaliação da educação superior. Revista Brasileira de Educação, 15(43), 21–44. https://doi.org/10.1590/S1413-24782010000100003

Madsen, P. E. (2015). Has the Quality of Accounting Education Declined? The Accounting Review, 90(3), 1115–1147. https://doi.org/10.2308/accr-50947

Madsen, P. E. (2020). Research Initiatives in Accounting Education: Transforming Today’s Students into Accounting Professionals. Issues in Accounting Education, 35(4), 35–46. https://doi.org/10.2308/ISSUES-2020-016

Miranda, G. J., Leal, E. A., Gama, M. A. F., & Miranda, A. B. de. (2018). ENADE: Os Estudantes Estão Motivados a Fazê-Lo? Revista de Educação e Pesquisa Em Contabilidade (REPeC), 13(1), 12–28. https://doi.org/10.17524/repec.v13i1.1720

Miranda, G. J., Lemos, K. C. da S., Oliveira, A. S. de, & Ferreira, M. A. (2015). Determinantes do Desempenho Acadêmico na Área de Negócios. Revista Meta: Avaliação, 7(20), 175–209. https://doi.org/10.22347/2175-2753v7i20.264

Nasu, V. H. (2020). Investigação empírica acerca da relação entre sexo e desempenho acadêmico na educação contábil. Advances in Scientific and Applied Accounting, 13(1), 122–142. https://doi.org/10.14392/ASAA.2020130107

Nasu, V. H., Silva, B. G. da, Borges, Y. M., & Melo, B. A. R. de. (2021). Variáveis institucionais explicativas do desempenho de estudantes de Ciências Contábeis e Administração. Revista Catarinense Da Ciência Contábil, 20, e3221. https://doi.org/10.16930/2237-7662202132211

Papageorgiou, E., & Callaghan, C. W. (2020). Accountancy learning skills and student performance in accounting education: evidence from the South African context. Accounting Education, 29(2), 205–228. https://doi.org/10.1080/09639284.2020.1719426

Pathways Commission. (2012). The Pathways Commission: Charting a national strategy for the next generation of accountants. Retrieved from https://aaahq.org/Pathways-Commission

Phillips, F., Lobdell, B., & Neigum, J. (2020). Does the Effectiveness of Interspersed and Blocked Questions Vary across Readers? Issues in Accounting Education, 35(1), 1–12. https://doi.org/10.2308/iace-52630

Pincus, K. V., Stout, D. E., Sorensen, J. E., Stocks, K. D., & Lawson, R. A. (2017). Forces for change in higher education and implications for the accounting academy. Journal of Accounting Education, 40, 1–18. https://doi.org/10.1016/j.jaccedu.2017.06.001

R Core Team. (2020). R: a language and environment for statistical computing. Vienna, AT: R Foundation for Statistical Computing.

Sanchez, E. de M. (2019). Erros conceituais na aprendizagem contábil: ensine o errado! (Tese de doutorado, Faculdade de Economia, Administração e Contabilidade, Universidade de São Paulo). https://doi.org/10.11606/T.12.2019.tde-23012019-105830

Xiang, M., & Hinchliffe, S. (2019). Chapter 4 Determinants of Students’ Repeating the First College-level Accounting Course. In D. Feldmann & T. J. Rupert (Eds.), Advances in Accounting Education: Teaching and Curriculum Innovations (pp. 71–88). https://doi.org/10.1108/S1085-462220190000022004

Published

2022-12-23

How to Cite

Nasu, V. H., & Silva, B. G. da. (2022). Zero Score, Now What? : Analysis of Accounting Students’ Zero Scores on the ENADE. Journal of Education and Research in Accounting (REPeC), 16(4). https://doi.org/10.17524/repec.v16i4.3060