research-article

Open access

Teaching at Scale and Back Again: The Impact of Instructors' Participation in At-Scale Education Initiatives on Traditional Instruction

Authors:

David A. Joyner,

Jolanta Wojcik,

Diana PopescuAuthors Info & Claims

L@S '23: Proceedings of the Tenth ACM Conference on Learning @ Scale

Pages 144 - 155

https://doi.org/10.1145/3573051.3593389

Published: 20 July 2023 Publication History

Abstract

Proponents of at-scale education initiatives often tout the benefits of these programs to the students who enroll in them, but anecdotally, faculty who participate in creating at-scale courses have often commented on how their participation positively impacted their subsequent in-person teaching. In this study, we investigate this potential phenomenon more thoroughly to assess how generalizable this perspective is among participants in these initiatives. We conduct three studies: we interview 78 faculty teaching in at-scale degree programs, examine offering histories for 70 courses offered in one such program, and survey 153 faculty who have developed massive open online courses. Based on these three studies, we propose a list of ways in which in-person instruction benefits from the existence of at-scale teaching initiatives. We further discuss remaining perceived drawbacks of at-scale education as derived from these interviews and surveys.

References

[1]

Gökçe Akçayir and Murat Akçayir. 2018. The flipped classroom: A review of its advantages and challenges. Computers & Education 126 (2018), 334--345.

[2]

Carlos Alario-Hoyos, Iria Estévez-Ayres, Carlos Delgado Kloos, and Julio Villena-Román. 2017. From MOOCs to SPOCs... and from SPOCs to flipped classroom. In Data Driven Approaches in Digital Education: 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, September 12--15, 2017, Proceedings 12. Springer, 347--354.

[3]

Carlos Alario-Hoyos, Iria Manuela Estévez Ayres, Carlos Delgado Kloos, Pedro José Muñoz Merino, Enrique Llorente Pérez, and Julio Villena Román. 2019. Redesigning a freshman engineering course to promote active learning by flipping the classroom through the reuse of MOOCs. (2019).

[4]

Runchana Pam Barger. 2020. Democratization of Education through Massive Open Online Courses in Asia. IAFOR Journal of Education 8, 2 (2020), 29--46.

[5]

Jacob Bishop and Matthew A Verleger. 2013. The flipped classroom: A survey of the research. In 2013 ASEE Annual Conference & Exposition. 23--1200.

[6]

Sandra Kay Brigance. 2011. Leadership in online learning in higher education: Why instructional designers for online learning should lead the way. Performance Improvement 50, 10 (2011), 43--48.

[7]

Christopher G Brinton, Mung Chiang, Shaili Jain, Henry Lam, Zhenming Liu, and Felix Ming Fai Wong. 2014. Learning about social learning in MOOCs: From statistical analysis to generative model. IEEE transactions on Learning Technologies 7, 4 (2014), 346--359.

[8]

YU Chengjie. 2015. Challenges and changes of MOOC to traditional classroom teaching mode. Canadian Social Science 11, 1 (2015), 135--139.

[9]

Suzy Cox and Russell T Osguthorpe. 2003. How do instructional design professionals spend their time? TechTrends 47, 3 (2003), 45--47.

[10]

Jean-Pierre De La Croix and Magnus Egerstedt. 2014. Flipping the controls classroom around a MOOC. In 2014 American Control Conference. IEEE, 2557--2562.

[11]

Tawanna Dillahunt, Zengguang Wang, and Stephanie D Teasley. 2014. Democratizing higher education: Exploring MOOC use among those who cannot afford a formal education. International Review of Research in Open and Distributed Learning 15, 5 (2014), 177--196.

[12]

Peter J Draus, Michael J Curran, and Melinda S Trempus. 2014. The influence of instructor-generated video content on student satisfaction with and engagement in asynchronous online classes. Journal of Online Learning and Teaching 10, 2 (2014), 240--254.

[13]

Stephen J. Dubner. 2010. Quotes Uncovered: What's the Plural of Anecdote? 'https://freakonomics.com/2010/04/quotes-uncovered-whats-the-plural-of-anecdote/'. (2010). Accessed: 2023-01--24.

[14]

Robert M Gagne and Leslie J Briggs. 1974. Principles of instructional design. Holt, Rinehart & Winston.

[15]

Zvi Galil. 2020. OMSCS: The revolution will be digitized. Commun. ACM 63, 8 (2020), 27--29.

Digital Library

[16]

Tao Gan. 2018. Construction of security system of flipped classroom based on MOOC in teaching quality control. Educational Sciences: Theory & Practice 18, 6 (2018).

[17]

Yungwei Hao. 2016. Exploring undergraduates' perspectives and flipped learning readiness in their flipped classrooms. Computers in Human Behavior 59 (2016), 82--92.

Digital Library

[18]

Stephen W Harmon and Nelson C Baker. 2020. Creating the Next in Higher Education at Georgia Tech. In The 60-Year Curriculum. Routledge, 72--86.

[19]

Susanna Hartikainen, Heta Rintala, Laura Pylväs, and Petri Nokelainen. 2019. The concept of active learning and the measurement of learning outcomes: A review of research in engineering higher education. Education Sciences 9, 4 (2019), 276.

[20]

Khe Foon Hew. 2016. Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCS. British Journal of Educational Technology 47, 2 (2016), 320--341.

[21]

Glyn Hughes and Chelsea Dobbins. 2015. The utilization of data analysis techniques in predicting student performance in massive open online courses (MOOCs). Research and practice in technology enhanced learning 10, 1 (2015), 1--18.

[22]

Yuki Ichimura and Katsuaki Suzuki. 2017. Dimensions of MOOCs for quality design: Analysis and synthesis of the literature. International Journal for Educational Media and Technology 11, 1 (2017).

[23]

David Joyner. 2018. Squeezing the limeade: policies and workflows for scalable online degrees. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. 1--10.

Digital Library

[24]

David Joyner and Charles Isbell. 2021. The Distributed Classroom. MIT Press.

[25]

David A Joyner. 2017. Scaling expert feedback: Two case studies. In Proceedings of the Fourth (2017) ACM Conference on Learning@ Scale. 71--80.

Digital Library

[26]

David A Joyner. 2022. Meet Me in the Middle: Retention in a" MOOC-Based" Degree Program. In Proceedings of the Ninth ACM Conference on Learning@ Scale. 82--92.

[27]

David A Joyner, Ashok K Goel, and Charles Isbell. 2016. The unexpected pedagogical benefits of making higher education accessible. In Proceedings of the third (2016) ACM Conference on Learning@ Scale. 117--120.

Digital Library

[28]

David A Joyner and Charles Isbell. 2019. Master's at scale: Five years in a scalable online graduate degree. In Proceedings of the Sixth (2019) ACM Conference on Learning@ Scale. 1--10.

Digital Library

[29]

David A Joyner, Qiaosi Wang, Suyash Thakare, Shan Jing, Ashok Goel, and Blair MacIntyre. 2020. The synchronicity paradox in online education. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 15--24.

Digital Library

[30]

Robert S Kadel, Yakut Gazi, Stephen Harmon, Ashok Goel, and Troy Courville. 2019. Toward a road map for scalable advanced learning ecosystems (SALEs). International Journal on Innovations in Online Education 3, 1 (2019).

[31]

Marianne E Krasny, Bryce DuBois, Mechthild Adameit, Ronnie Atiogbe, Muhammad Lukman Baihaqi Alfakihuddin, Tergel Bold-erdene, Zahra Golshani, Rodrigo González-González, Ishmael Kimirei, Yamme Leung, et al . 2018. Small groups in a social learning MOOC (sIMOOC): strategies for fostering learning and knowledge creation. Online Learning 22, 2 (2018), 119--139.

[32]

Swapna Kumar and Albert Ritzhaupt. 2017. What do instructional designers in higher education really do? International Journal on E-Learning 16, 4 (2017), 371--393.

[33]

Xiaobin Le, Gloria Guohua Ma, and Anthony William Duva. 2015. Testing the flipped classroom approach in engineering dynamics class. In 2015 ASEE Annual Conference & Exposition. 26--1504.

[34]

Chi-Un Lei and Hong Qiang Wei. 2022. Developing Student's Global Competencies at Scale in an Affordable MOOC K12 Outreach Initiative. In Proceedings of the Ninth ACM Conference on Learning@ Scale. 321--324.

Digital Library

[35]

Da Liu. 2016. The reform and innovation of English course: A coherent whole of MOOC, flipped classroom and ESP. Procedia-Social and Behavioral Sciences 232 (2016), 280--286.

[36]

Ana Paula Lopes and Filomena Soares. 2017. ?Flipped classroom with a MOOC" an e-learning model into a mathematics course. In INTED2017 Proceedings. IATED, 4643--4649.

[37]

Natalie B Milman. 2012. The flipped classroom strategy: What is it and how can it best be used? Distance learning 9, 3 (2012), 85.

[38]

Robert L Moore and Stephanie J Blackmon. 2022. From the Learner's perspective: A systematic review of MOOC learner experiences (2008--2021). Computers & Education (2022), 104596.

[39]

Valéria F Moura, Cesar A Souza, José D Oliveira Neto, and Adriana BN Viana. 2017. MOOCS' potential for democratizing education: An analysis from the perspective of access to technology. In Information Systems: 14th European, Mediterranean, and Middle Eastern Conference, EMCIS 2017, Coimbra, Portugal, September 7--8, 2017, Proceedings 14. Springer, 139--153.

[40]

Dillon H Murphy, Kara M Hoover, Karina Agadzhanyan, Jesse C Kuehn, and Alan D Castel. 2022. Learning in double time: The effect of lecture video speed on immediate and delayed comprehension. Applied Cognitive Psychology 36, 1 (2022), 69--82.

[41]

Jamie Murphy, J Bruce Tracey, and Laurel Horton-Tognazzini. 2016. MOOC camp: A flipped classroom and blended learning model. In Information and Communication Technologies in Tourism 2016: Proceedings of the International Conference in Bilbao, Spain, February 2--5, 2016. Springer, 653--665.

[42]

Jaitip Nasongkhla and Siridej Sujiva. 2022. A HyFlex-Flipped Class in Action Learning: A Connectivist MOOC for Creative Problem-Solving. Contemporary Educational Technology 14, 4 (2022), ep392.

[43]

Sergiy O Nesterko, Svetlana Dotsenko, Q Han, Daniel Seaton, Justin Reich, Isaac Chuang, and AD Ho. 2013. Evaluating the geographic data in MOOCs. In Neural information processing systems.

[44]

Linda B Nilson and Ludwika A Goodson. 2021. Online teaching at its best: Merging instructional design with teaching and learning research. John Wiley & Sons.

[45]

Michael Noetel, Shantell Griffith, Oscar Delaney, Taren Sanders, Philip Parker, Borja del Pozo Cruz, and Chris Lonsdale. 2021. Video improves learning in higher education: A systematic review. Review of educational research 91, 2 (2021), 204--236.

[46]

David S Park, Robert W Schmidt, Charankumar Akiri, Stephanie Kwak, and David A Joyner. 2020. Affordable Degrees at Scale: New Phenomenon or New Hype?. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 25--35.

Digital Library

[47]

Mar Pérez-Sanagustín, Isabel Hilliger, Carlos Alario-Hoyos, Carlos Delgado Kloos, and Saif Rayyan. 2017. H-MOOC framework: reusing MOOCs for hybrid education. Journal of Computing in Higher Education 29 (2017), 47--64.

[48]

Ken Petress. 2008. What is meant by" active learning?". Education 128, 4 (2008).

[49]

Michael Prince. 2004. Does active learning work? A review of the research. Journal of engineering education 93, 3 (2004), 223--231.

[50]

Umakishore Ramachandran and Zvi Galil. 2022. Creating a revolutionary academic program. Commun. ACM 65, 10 (2022), 46--56.

Digital Library

[51]

Justin Reich. 2020. Two stances, three genres, and four intractable dilemmas for the future of learning at scale. In Proceedings of the Seventh ACM Conference on Learning@ Scale. 3--13.

Digital Library

[52]

Justin Reich. 2022. Learning Analytics and Learning at Scale. Lang, C., Siemens, G. Wise, AF, Ga?evic, D., Merceron, A.,(eds.) Handbook of Learning Analytics, 2nd ed. Vancouver, Canada: SOLAR (2022).

[53]

Justin Reich and José A Ruipérez-Valiente. 2019. The MOOC pivot. Science 363, 6423 (2019), 130--131.

[54]

Jennifer C Richardson, Iryna Ashby, Ali Nazil Alshammari, Zui Cheng, Brian S Johnson, Terri S Krause, Daeyeoul Lee, Anthony E Randolph, and Huanhuan Wang. 2019. Faculty and instructional designers on building successful collaborative relationships. Educational Technology Research and Development 67 (2019), 855--880.

[55]

María Fernanda Rodríguez, Josefina Hernández Correa, Mar Pérez-Sanagustín, Julio A Pertuze, and Carlos Alario-Hoyos. 2017. A MOOC-based flipped class: Lessons learned from the orchestration perspective. In Digital Education: Out to the World and Back to the Campus: 5th European MOOCs Stakeholders Summit, EMOOCs 2017, Madrid, Spain, May 22--26, 2017, Proceedings 5. Springer, 102--112.

[56]

José A Ruipérez-Valiente, Thomas Staubitz, Matt Jenner, Sherif Halawa, Jiayin Zhang, Ignacio Despujol, Jorge Maldonado-Mahauad, German Montoro, Melanie Peffer, Tobias Rohloff, et al. 2022. Large scale analytics of global and regional MOOC providers: Differences in learners' demographics, preferences, and perceptions. Computers & Education 180 (2022), 104426.

Digital Library

[57]

André A Rupp, Jodi M Casabianca, Maleika Krüger, Stefan Keller, and Olaf Köller. 2019. Automated essay scoring at scale: a case study in Switzerland and Germany. ETS Research Report Series 2019, 1 (2019), 1--23.

[58]

Avneesh Sarwate, Creston Brunch, Jason Freeman, and Sebastian Siva. 2018. Grading at scale in earsketch. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. 1--4.

Digital Library

[59]

Lorrie Schmid, Kim Manturuk, Ian Simpkins, Molly Goldwasser, and Keith E Whitfield. 2015. Fulfilling the promise: do MOOCs reach the educationally underserved? Educational Media International 52, 2 (2015), 116--128.

[60]

Jinal Shah, Monica Khanna, and Hiren Patel. 2021. Technology adoption and continuance of MOOCs: A systematic literature review, synthesis and future research agenda. Journal of Content, Community and Communication 14, 7 (2021), 106--132.

[61]

Patricia Silver, Andrew Bourke, and KC Strehorn. 1998. Universal Instructional Design in higher education: An approach for inclusion. Equity & Excellence 31, 2 (1998), 47--51.

[62]

Arjun Singh, Sergey Karayev, Kevin Gutowski, and Pieter Abbeel. 2017. Grade-scope: a fast, flexible, and fair system for scalable assessment of handwritten work. In Proceedings of the fourth (2017) acm conference on learning@ scale. 81--88.

Digital Library

[63]

Patricia L Smith and Tillman J Ragan. 2004. Instructional design. John Wiley & Sons.

[64]

Min Song, Ying Song, and Zhengxian Wei. 2015. A teaching model of flipped classroom based on mooc. In 2015 Eighth International Conference on Internet Computing for Science and Engineering (ICICSE). IEEE, 269--272.

Digital Library

[65]

Om Prakash Tiwari. 2019. Moocs in developing countries: Opportunities and challenges. Research and Reflections on Education 17, 3 (2019).

[66]

Paraskevi Topali, Alejandro Ortega-Arranz, Erkan Er, Alejandra Martínez-Monés, Sara L Villagrá-Sobrino, and Yannis Dimitriadis. 2019. Exploring the problems experienced by learners in a MOOC implementing active learning pedagogies. In Digital Education: At the MOOC Crossroads Where the Interests of Academia and Business Converge: 6th European MOOCs Stakeholders Summit, EMOOCs 2019, Naples, Italy, May 20--22, 2019, Proceedings 6. Springer, 81--90.

[67]

George Veletsianos and Peter Shepherdson. 2016. A systematic analysis and synthesis of the empirical MOOC literature published in 2013--2015. International Review of Research in Open and Distributed Learning 17, 2 (2016), 198--221.

[68]

Bin Wang, Pei-shun Liu Liu, and Xue-fang Wang. 2018. Research on the application of flipped classroom model based on MOOC in the course PHP dynamic website development. In 2018 International Symposium on Educational Technology (ISET). IEEE, 200--203.

[69]

Kai Wang and Chang Zhu. 2019. MOOC-based flipped learning in higher education: students' participation, experience and learning performance. International Journal of Educational Technology in Higher Education 16, 1 (2019), 1--18.

[70]

Alyssa Friend Wise, Yi Cui, and Wan Qi Jin. 2017. Honing in on social learning networks in MOOC forums: Examining critical network definition decisions. In Proceedings of the seventh international learning analytics & knowledge conference. 383--392.

Digital Library

[71]

Zhang Xinying. 2017. Researching into a MOOC embedded flipped classroom model for college English Reading and Writing course. Beyond the language classroom: researching MOOCs and other innovations (2017), 15--27.

[72]

Marco Yamba-Yugsi, Lourdes Atiaja Atiaja, Sergio Luján-Mora, and Jose Luis Eguia-Gomez. 2022. Determinants of the Intention to Use MOOCs as a Complementary Tool: An Observational Study of Ecuadorian Teachers. Sustainability 14, 22 (2022), 15189.

[73]

Saijing Zheng, Mary Beth Rosson, Patrick C Shih, and John M Carroll. 2015. Designing MOOCs as interactive places for collaborative learning. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale. 343--346.

Digital Library

Cited By

Ahmed TBumbacher EBlikstein PRiedel-Kruse IJoyner DKim MWang XXia M(2024)Large-Scale and Versatile Deployment of Biology Cloud Labs in Schools through Teacher Driven Curricula DesignProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664713(524-529)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664713
Joyner DDuncan AJoyner DKim MWang XXia M(2024)Ten Years, Ten Trends: The First Decade of an Affordable At-Scale DegreeProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3662038(143-153)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3662038
Marino-Jiménez MRamírez-Durand IPareja-Lora ACieza-Esteban A(2024)Research in Latin America: bases for the foundation of a training program in higher educationCogent Education10.1080/2331186X.2024.231943211:1Online publication date: 20-Feb-2024
https://doi.org/10.1080/2331186X.2024.2319432

Index Terms

Teaching at Scale and Back Again: The Impact of Instructors' Participation in At-Scale Education Initiatives on Traditional Instruction
1. Applied computing
  1. Education
    1. Distance learning
    2. E-learning

Recommendations

Increasing Capacity for Computer Science Education in Rural Areas through a Large-Scale Collective Impact Model
SIGCSE '19: Proceedings of the 50th ACM Technical Symposium on Computer Science Education

Students living in rural areas are less likely to attend schools that offer computer science (CS) courses largely because educational institutions in these remote areas lack the resources to staff teaching positions for these courses. This study ...
Master's at Scale: Five Years in a Scalable Online Graduate Degree
L@S '19: Proceedings of the Sixth (2019) ACM Conference on Learning @ Scale

In 2014, Georgia Tech launched the first for-credit MOOC-based graduate degree program. In the five years since, the program has proven generally successful, enrolling over 14,000 unique students, and several other similar programs have followed in its ...
Building Curricular Supports Through Undergraduate Teaching Assistants to Scale Individualized Instruction in CS1
SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V. 2

At the University of Delaware, undergraduate teaching assistants have been used for several years to support students in many of the core computer science courses. Meanwhile, like countless other institutions, computer science instructors continue to be ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

L@S '23: Proceedings of the Tenth ACM Conference on Learning @ Scale

July 2023

445 pages

ISBN:9798400700255

DOI:10.1145/3573051

General Chair:
Daniel Spikol
University of Copenhagen, Denmark
,
Program Chairs:
Olga Viberg
KTH Royal Institute of Technology, Sweden
,
Alejandra Martínez-Monés
Universidad de Valladolid, Spain
,
Philip Guo
UC San Diego, USA

Copyright © 2023 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2023

Check for updates

Author Tags

Qualifiers

Research-article

Conference

L@S '23

L@S '23: Tenth ACM Conference on Learning @ Scale

July 20 - 22, 2023

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 117 of 440 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
527
Total Downloads

Downloads (Last 12 months)320
Downloads (Last 6 weeks)28

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ahmed TBumbacher EBlikstein PRiedel-Kruse IJoyner DKim MWang XXia M(2024)Large-Scale and Versatile Deployment of Biology Cloud Labs in Schools through Teacher Driven Curricula DesignProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3664713(524-529)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3664713
Joyner DDuncan AJoyner DKim MWang XXia M(2024)Ten Years, Ten Trends: The First Decade of an Affordable At-Scale DegreeProceedings of the Eleventh ACM Conference on Learning @ Scale10.1145/3657604.3662038(143-153)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3657604.3662038
Marino-Jiménez MRamírez-Durand IPareja-Lora ACieza-Esteban A(2024)Research in Latin America: bases for the foundation of a training program in higher educationCogent Education10.1080/2331186X.2024.231943211:1Online publication date: 20-Feb-2024
https://doi.org/10.1080/2331186X.2024.2319432

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten