Is the ATAR a useful predictor of success in ICT?: an empirical study

ABSTRACT

The Australian Tertiary Admission Rank (ATAR) is a measure of a student's overall pre-tertiary academic achievement. For most tertiary degree programs across Australia, the selection of year 12 domestic applicants is based on an ATAR, on the premise that selection based on a student's overall academic achievement prior to university is a predictor of success for tertiary study. This paper is an empirical analysis into whether the ATAR and prior study in programming or mathematics can be used to predict student success in an Information and Communication Technology (ICT) degree. Our study has four key findings: the ATAR is not a significant indicator that a student will graduate on schedule from our ICT degree; the ATAR can be used as significant indicator that a student will successfully complete the first year of our ICT degree; the ATAR can be used as a significant indicator that a student will successfully complete our first-year introductory programming course; and finally, prior learning of ICT-related material is not a significant indicator of whether a student will pass or fail our introductory programming course on their first attempt.

References

1. Francisco Araque, Concepción Roldán, and Alberto Salguero. 2009. Factors influencing university drop out rates. Computers & Education 53, 3 (2009), 563--574.
2. AEN (Australian Education Network). 2017. Australian university rankings. (2017). Retrieved September 2017 from http://www.australianuniversities.com.au/rankings/
3. Lecia J Barker, Charlie McDowell, and Kimberly Kalahar. 2009. Exploring factors that influence computer science introductory course students to persist in the major. In Proceedings of the 40th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '09). 153--157.
4. Theresa Beaubouef and John Mason. 2005. Why the high attrition rate for computer science students: some thoughts and observations. ACM SIGCSE Bulletin 37, 2 (2005), 103--106.
5. Jens Bennedsen and Michael E Caspersen. 2007. Failure rates in introductory programming. ACM SIGCSE Bulletin 39, 2 (2007), 32--36.
6. Maureen Biggers, Anne Brauer, and Tuba Yilmaz. 2016. Student perceptions of computer science: a retention study comparing graduating seniors with CS leavers. In Proceedings of the 39th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '08). 402--406.
7. Kathryn Blyth. 2014. Selection methods for undergraduate admissions in Australia. Does the Australian predominate entry scheme the Australian Tertiary Admissions Rank (ATAR) have a future? Journal of Higher Education Policy and Management 36, 3 (2014), 268--278.
8. Matthew Butler, Michael Morgan, Judy Sheard, Simon, Katrina Falkner, and Amali Weerasinghe. 2015. Initiatives to increase engagement in first-year ICT. In Proceedings of the 20th Conference on Innovation and Technology in Computer Science Education (ITiCSE '15). 308--313.
9. IR Dobson and E Skuja. 2005. Secondary schooling, tertiary entry ranks and university performance. People & Place 13 (2005), 53--62.
10. Deloitte Access Economics. 2017. Australia's digital pulse. Policy priorities to fuel Australia's digital workforce boom. (2017). Retrieved August 2017 from https://www.acs.org.au/content/dam/acs/acs-publications/Australia%27s%20Digital%20Pulse%202017.pdf
11. Dianne Hagan and Selby Markham. 2000. Does it help to have some programming experience before beginning a computing degree program? ACM SIGCSE Bulletin 32, 3 (2000), 25--28.
12. Michael Haungs, Christopher Clark, John Clements, and David Janzen. 2012. Improving first-year success and retention through interest-based CS0 courses. In Proceedings of the 43rd SIGCSE Technical Symposium on Computer Science Education (SIGCSE '12). 589--594.
13. Nicole Herbert, Kristy de Salas, Ian Lewis, Julian Dermoudy, and Leonie Ellis. 2014. ICT curriculum and course structure: the great balancing act. In Proceedings of the 16th Australasian Computing Education Conference (ACE 2014). 21--30.
14. Diane Horton and Michelle Craig. 2015. Drop, fail, pass, continue: persistence in CS1 and beyond in traditional and inverted delivery. In Proceedings of the 46th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '15). 235--240.
15. R James. 2002. Students' changing expectations of higher education and the consequences of mismatches with the reality. Higher Education Research & Development 20 (2002), 70--83.
16. R James, G Baldwin, and C McInnis. 1999. Which university? The factors influencing the choices of prospective undergraduates. Australian Government Department of Education, Training and Youth Affairs.
17. G Marczyk, D DeMatteo, and D Festinger. 2005. Essentials of research design and methodology. John Wiley.
18. GN Marks. 2007. Completing university: characteristics and outcomes of completing and non completing students. ACER - LSAY Research Report 51.
19. C McInnis. 2001. Signs of disengagement? The changing undergraduate experience in Australian universities. (2001). Retrieved December 2017 from https://minerva-access.unimelb.edu.au/handle/11343/33660
20. George Messinis and Peter Sheehan. 2015. The academic performance of first year students at Victoria University by entry score and SES. (2015). Retrieved September 2017 from https://www.vu.edu.au/sites/default/files/cses/pdfs/the-academic-performance-of-first-year-students-at-VU-by-entry-score-and-SES-2009-2013.pdf
21. M Murphy, K Papanicolaou, and R McDowell. 2001. Entrance score and performance: a three year study of success. Journal of Institutional Research 10, 2 (2001), 32--49.
22. N Palmer, E Bexley, and R James. 2011. Selection and participation in higher education. (2011). Retrieved August 2017 from http://www.cshe.unimelb.edu.au/people/james_docs/Selection_and_Participation_in_Higher_Education.pdf
23. Ilias O Pappas, Michail N Giannakos, and Letizia Jaccheri. 2016. Investigating factors influencing students' intention to dropout computer science studies. In Proceedings of the 21st Conference on Innovation and Technology in Computer Science Education (ITiCSE '16). 198--203.
24. Andrew Petersen, Michelle Craig, Jennifer Campbell, and Anya Tafliovich. 2016. Revisiting why students drop CS1. In Proceedings of the 16th Koli Calling International Conference on Computing Education Research (Koli Calling 2016). 71--80.
25. Madeleine RH Roberts, Tanya J McGill, and Peter N Hyland. 2012. Australian ICT degrees: why women leave. In Proceedings of the 14th Australasian Computing Education Conference (ACE 2012). 15--24.
26. Judy Sheard, Angela Carbone, Selby Markham, AJ Hurst, Des Casey, and Chris Avram. 2008. Performance and progression of first year ICT students. In Proceedings of the Tenth Australasian Computing Education Conference (ACE 2008). 119--127.
27. Duane F Shell, Leen-Kiat Soh, Abraham E Flanigan, and Markeya S Peteranetz. 2016. Students' initial course motivation and their achievement and retention in college CS1 courses. In Proceedings of the 47th SIGCSE Technical Symposium on Computer Science Education (SIGCSE '16). 639--644.
28. Vicky Smith and Eugenia Fernandez. 2014. Factors affecting first year retention of CIT students. In Proceedings Of The ASEE Annual Conference & Exposition. 1--11.
29. Tasmanian Department of Education. 2017. 2017 Course Information Handbook Year 11/12. (2017). Retrieved September 2017 from https://documentcentre.education.tas.gov.au/Documents/year11-12-course-information-handbook.pdf
30. UAC. 2017. What is the ATAR? (2017). Retrieved November 2017 from http://www.uac.edu.au/atar/
31. Christopher Watson and Frederick WB Li. 2014. Failure rates in introductory programming revisited. In Proceedings of the 19th Conference on Innovation and Technology in Computer Science Education (ITiCSE '14). 39--44.
32. BC Wilson and S Shrock. 2001. Contributing to success in an introductory computer science course: a study of twelve factors. ACM SIGCSE Bulletin 33, 1 (2001), 184--188.
33. Gerald Wurf and Lindy Croft-Piggin. 2015. Predicting the academic achievement of first-year, pre-service teachers: the role of engagement, motivation, ATAR, and emotional intelligence. Asia-Pacific Journal of Teacher Education 43, 1 (2015), 75--91.

Index Terms

• Social and professional topics

  • Professional topics

    • Computing education