The Multimodal Learning Analytics Handbook

Michail Giannakos, Daniel Spikol, Daniele Di Mitri, Kshitij Sharma, Xavier Ochoa, Rawad Hammad (Herausgeber)

Buch | Softcover

VI, 372 Seiten

2023 | 1st ed. 2022
Springer International Publishing (Verlag)
978-3-031-08078-4 (ISBN)

Artikel merken

This handbook is the first book ever covering the area of Multimodal Learning Analytics (MMLA). The field of MMLA is an emerging domain of Learning Analytics and plays an important role in expanding the Learning Analytics goal of understanding and improving learning in all the different environments where it occurs. The challenge for research and practice in this field is how to develop theories about the analysis of human behaviors during diverse learning processes and to create useful tools that could augment the capabilities of learners and instructors in a way that is ethical and sustainable. Behind this area, the CrossMMLA research community exchanges ideas on how we can analyze evidence from multimodal and multisystem data and how we can extract meaning from this increasingly fluid and complex data coming from different kinds of transformative learning situations and how to best feed back the results of these analyses to achieve positive transformative actions on those learning processes.

This handbook also describes how MMLA uses the advances in machine learning and affordable sensor technologies to act as a virtual observer/analyst of learning activities. The book describes how this "virtual nature" allows MMLA to provide new insights into learning processes that happen across multiple contexts between stakeholders, devices and resources. Using such technologies in combination with machine learning, Learning Analytics researchers can now perform text, speech, handwriting, sketches, gesture, affective, or eye-gaze analysis, improve the accuracy of their predictions and learned models and provide automated feedback to enable learner self-reflection. However, with this increased complexity in data, new challenges also arise. Conducting the data gathering, pre-processing, analysis, annotation and sense-making, in a way that is meaningful for learning scientists and other stakeholders (e.g., students or teachers), still pose challenges in this emergent field. This handbook aims to serve as a unique resource for state of the art methods and processes.

Chapter 11 of this book is available open access under a CC BY 4.0 license at link.springer.com.

Michail (Michalis) Giannakos is a professor of interaction design and learning technologies at the Department of Computer Science of the Norwegian University of Science and Technology (NTNU). He is the head of the Learner-Computer Interaction lab and his research focuses on the design and study of emerging technologies in online and hybrid education settings, and on developing new ways for humans to interact with interactive learning systems.
Giannakos has co-authored more than 200 manuscripts published in prestigious peer-reviewed journals and conferences (including Computers & Education, Computers in Human Behavior, IEEE Pervasive Computing, IEEE TLT, BIT, BJET, ACM TOCE, ACM IDC, ICLS/CSCL, Interact).
Giannakos, together with Mike Horn, is the Editor-in-Chief of the International Journal of Child-Computer Interaction (Elsevier). He is also on the Editorial Board of IEEE Transactions in Learning Technology, IEEE Transactions on Education, Behaviour & Information Technology, and the International Journal of Information Management, and has served as a guest editor on highly recognized journals such as BJET, Computers in Human Behavior, ACM TOCE and IEEE Multimedia. He has served as an evaluator for the European Commission (EC) and the US-NSF, and he recently authored a book on Experimental Studies in Learning Technology and Child-Computer Interaction (Springer) and co-authored the Educational Data Literacy textbook (Springer).
Giannakos has worked at several research projects funded by diverse sources like the EC, Microsoft Research, The Research Council of Norway (RCN), US-NSF, the German agency for international academic cooperation and Cheng Endowment. Giannakos is one of the experts in the Norwegian task force (formed by the ministry of education and research) for introducing learning analytics to Norwegian K-12 schools and universities. He is also a recipient of a Marie Curie/ERCIM fellowship, the Norwegian Young Research Talent award and he is one of the outstanding academic fellows of NTNU (2017-2022).
Giannakos usually attends the ACM Interaction Design and Children (IDC) conference (he was a Chair for IDC 2018, and PC-chair for IDC 2022), the ACM conference on Innovation and Technology in Computer Science Education (ITiCSE) (he was a Chair for ITiCSE 2020), and the Learning Analytics and Knowledge (LAK) conference.
Daniel Spikol is Associate Professor of Computational Thinking in the Computer Science and Science Education departments at the University of Copenhagen (UCPH). He is part of the university's Center for Digital Education, which investigates and helps support digital education transformation. Daniel holds a PhD in Computer Science for Linnæus University, Sweden (2010), an MSc in Visual Studies from Massachusetts Institute of Technology (1992), and a BFA from Rhode Island School of Design (1987).
The central theme of his research investigates how to integrate computational thinking and tinkering into education. His work combines physical computing and robotics with STEM and STEAM education to provide an authentic context to engage people in science and computing. Additionally, his research investigates how people collaborate with multimodal learning analytics (inspired by social signal processing ambient computing). Daniel combines science, design, digital art, and computer science to investigate how people learn and play. He has 70 peer-reviewed scientific publications. He has worked for different companies and research institutes and founded several companies.
Daniel has been active in developing SOLAR's SIG for Multimodal Learning Analytics, participated in the program committees for different conferences such as LAK, EC-TEL, ICALT, AIED, IDC, and ICQE. He has also been a principal investigator for European and natio

Introduction to Multimodal Learning Analytics.- Multimodal Learning Analytics and the Design of Learning Spaces.- Multimodal Systems for Automated Oral Presentation Feedback: A Comparative Analysis.- Modeling the Complex Interplay Between Monitoring Events for Regulated Learning with Psychological Networks.- The role of metacognition and self-regulation on clinical reasoning: Leveraging multimodal learning analytics to transform medical education.- Intermodality in Multimodal Learning Analytics for Cognitive Theory Development: A Case from Embodied Design for Mathematics Learning.- Bridging the Gap between Informal Learning Pedagogy and Multimodal Learning Analytics.- Multimodal Learning Experience for Deliberate Practice.- CDM4MMLA: Contextualized Data Model for MultiModal Learning Analytics.- A Physiology-Aware Learning Analytics Framework.- Once more with Feeling - Emotions in Multimodal Learning Analytics.- The evidence of impact and ethical considerations of Multimodal Learning Analytics: A Systematic Literature Review.- Sensor-based analytics in education: Lessons learned from research in Multimodal Learning Analytics.- Framing the future of Multimodal Learning Analytics.

Erscheinungsdatum	10.10.2023
Zusatzinfo	VI, 372 p. 73 illus., 61 illus. in color.
Verlagsort	Cham
Sprache	englisch
Maße	155 x 235 mm
Gewicht	581 g
Themenwelt	Schulbuch / Wörterbuch ► Unterrichtsvorbereitung ► Unterrichts-Handreichungen
Themenwelt	Mathematik / Informatik ► Informatik
Schlagworte	affective learning processes • AI in education • cognitive learning processes • complex learning data • diverse learning spaces • Learning Analytics • Machine learning in Education • multimodal analysis • Multimodal learning analytics • multimodal teaching
ISBN-10	3-031-08078-5 / 3031080785
ISBN-13	978-3-031-08078-4 / 9783031080784
Zustand	Neuware