Beyond the Visual

An Introduction to Researching Multimodal Phenomena

Frank Serafini (Autor)

Buch | Softcover

264 Seiten

2022
Teachers' College Press (Verlag)
978-0-8077-6684-2 (ISBN)

Artikel merken

Proivdes a survey of contemporary approaches to researching a wide range of visual and multimodal phenomena. Building on his earlier book, Reading the Visual, Serafini shares resources for conducting multimodal research across the social sciences.

Beyond the Visual is a survey of contemporary approaches to researching a wide range of visual and multimodal phenomena. Building on his earlier book, Reading the Visual, Serafini shares resources for conducting multimodal research across the social sciences. Beginning with a comprehensive overview of the theoretical foundations that support the analytical frameworks, the text is organized into two parts—texts and objects, events and spaces—with corresponding analytical approaches. Examples and outlines are provided to help novice and experienced researchers conduct their own studies. Vignettes by some of the most renowned scholars in the field of multimodality research take the reader behind the scenes of various projects to experience the thoughts and decisions that go into conceptualizing and applying the analytical frameworks presented in the book. This resource will enable both students and experienced scholars to acquire new research skills and designs resulting in more rigorous, high-quality research.

Book Features:

Assists researchers and educators to make better connections among theoretical orientations, analytical frameworks, and research designs.
Showcases 16 models for conducting research on visual and multimodal phenomena across a variety of social, virtual, and physical contexts.
Provides examples of how eminent researchers conceive, design, initiate, and conduct their studies.
Explores the research methods cited in the author’s previous book, Reading the Visual.

Frank Serafini is professor of literacy education and children’s literature in the Mary Lou Fulton Teachers College, Arizona State University. His books include Reading the Visual: An Introduction to Teaching Multimodal Literacy and Remixing Multiliteracies: Theory and Practice from New London to New Times. He received the 2021 International Visual Literacy Association (IVLA) Education Award.

Contents

Foreword Theo van Leeuwen xi

Acknowledgments xiii

Introduction 1

PART I: FOUNDATIONS

1. Conceptualizing Visual and Multimodal Phenomena 17

2. Theoretical Foundations of Multimodal Research 32

PART II: ANALYTICAL FRAMEWORKS: TEXTS AND OBJECTS

3. Iconographical Analysis 51

4. Visual Discourse Analysis 58

5. Visual Rhetorical Analysis 65

6. Multimodal Framing Analysis 71

7. Multimodal Content Analysis 78

8. Systemic Functional Multimodal Discourse Analysis 86

9. Multimodal Genre Analysis 93

Research Vignettes: Texts and Objects 99

Research Vignette 1: Young Children’s Multimodal Compositions 99

Lindsey Moses

Research Vignette 2: Multimodal Content of Magazine Covers 102

Stephanie F. Reid, Danielle Kachorsky, and Kathryn P. Chapman

Research Vignette 3: Critical Visual Discourse Analysis of 3-D Sculpture 107

Peggy Albers

Research Vignette 4: Multimodal Content Analysis of Wine Labels 110

Frank Serafini

Research Vignette 5: Examining Wordless Picture Books 115

Evelyn Arizpe and Julie E. McAdam

Research Vignette 6: A Critical Multimodal Comparison of Animation Software 118

Emilia Djonov

Research Vignette 7: Multimodality and Orientation-to- Action in Video Games 122

Jeffrey B. Holmes, Earl Aguilera, and Kelly M. Tran

Research Vignette 8: Animated Movie Adaptations of Literary Picture Books 125

Len Unsworth

PART III: ANALYTICAL FRAMEWORKS: EVENTS AND SPACES

10. Social Semiotic Multimodal Analysis 133

11. Critical Multimodal Analysis 140

12. Mediated Discourse (Interactional) Analysis 147

13. Multimodal Ethnographic Analysis 153

14. Spatial Discourse Analysis 160

15. Multimodal Cultural Analysis 166

16. Digitally Based Multimodal Analysis 173

Research Vignettes: Events and Spaces 180

Research Vignette 9: Mapping (Visual) Identities During COVID-19 180

Jennifer Rowsell

Research Vignette 10: Critical Multimodal Analysis of Voting Spaces 183

Marva Cappello

Research Vignette 11: Multimodal Interaction Analysis of Social Positioning in Young Children at School 187

Katie Bernstein

Research Vignette 12: Understanding Spatial Pedagogy 190

Fei Victor Lim

Research Vignette 13: Collective Multimodal Research of Social Interaction in the COVID-19 Pandemic 194

Elisabetta Adami

Research Vignette 14: Analyzing Children’s Virtual Realities 197

Kathy A. Mills and Lesley Friend

Research Vignette 15: A Multimodal Analysis of Children’s Play 201

Kate Cowan and John Potter

Research Vignette 16: Spatial Discourse Analysis of Informal Outdoor Learning Spaces 204

Louise Ravelli

Epilogue: Looking Back, Moving Forward 209

References 215

Index 235

About the Author and the Contributors 245

Erscheinungsdatum	29.03.2022
Vorwort	Theo Van Leeuwen
Verlagsort	New York
Sprache	englisch
Maße	156 x 229 mm
Gewicht	374 g
Themenwelt	Geisteswissenschaften ► Sprach- / Literaturwissenschaft ► Sprachwissenschaft
	Sozialwissenschaften ► Pädagogik
	Sozialwissenschaften ► Soziologie ► Empirische Sozialforschung
ISBN-10	0-8077-6684-4 / 0807766844
ISBN-13	978-0-8077-6684-2 / 9780807766842
Zustand	Neuware