The Visual made Audible – Co-constructing Sound Effects as Devices of Comic Book Literacy in Primary School

  • Lars Wallner
##plugins.pubIds.doi.readerDisplayName##: https://doi.org/10.18682/cdc.vi89.3810

Résumé

This paper analyses and discusses ongoing comics literacy events where two 3rd Grade students and their teachers are working with comic books, focusing specifically on visual representations of sound. The purpose of the paper is to explore how these representations, as multimodal aspects of comics literacy, provoke literacy experiences in the classroom. Visual representations of sound come in different shapes and sizes, but are generally written outside of speech bubbles in bold letters. Using discursive psychology –allowing the researcher to view participants’ verbal and embodied actions as performing actions in social and situated contexts– the current paper analyses how pairs of students and teachers co-construct visual aspects in comic books, translating them into verbal sound and embodied action. Results show that embodied motion, sensation, and audible sound are utilized to interactively display comic sound effects to enhance the reader’s experience of the narrative. This is done as co-construction between adult and child through re-enactment of the visuals as real-life sound and action –also connecting this to other visual aspects of adjacent panels in order to make this meaningful. The paper argues that this challenges both teachers’ and students’ perceptions of what literacy can be and how sound effects –through the shape, colour and font of the graphic text– influence and enliven the comic narratives created in the classroom.

Références

Allington, D., & Benwell, B. (2012). Reading the Reading Experience: An Ethnomethodological Approach to “Booktalk”. In A. Lang (Ed.), From Codex to Hypertext: Reading at the Turn of the Twenty-first Century (pp. 217-233). Amherst: University of Massachusetts Press.

Carlsson, D. (Ed.) (2013). Kalle Anka och hans vänner [Donald Duck and his Friends]. Malmö: Egmont Kids Media.

Catricalà, M., & Guidi, A. (2015). Onomatopoeias: A new Perspective around Space, Image Schemas and Phoneme Clusters. Cognitive Processes, 16(1), 175-178. doi:10.1007/s10339-015-0693-x

Cohn, N., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2014). The Grammar of Visual Narrative: Neural Evidence for Constituent Structure in Sequential Image Comprehension. Neuropsychologia, 64, 63-70. doi:10.1016/j.neuropsychologia.2014.09.018

Cohn, N., Paczynski, M., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2012). (Pea)nuts and Bolts of Visual Narrative: Structure and Meaning in Sequential Image Comprehension. Cognitive psychology, 65(1), 1-38. doi:10.1016/j.cogpsych.2012.01.003

Dey, S., & Bokil, P. (2016). Syntax of Sound Symbolic Words: A Study of the Hindi Comic Books in India. International Journal of Comic Art, 18(1), 260-277.

Duncan, R., Smith, M. J., & Levitz, P. (2015). The Power of Comics: History, Form, and Culture (2 ed.). London & New York: Bloomsbury.

Edwards, D., & Potter, J. (1992). Discursive Psychology. London: Sage.

Egmont Publishing. (2015). Serier i undervisningen (Om oss) [Comics in Teaching (About Us)]. Retrieved June 8, 2018, from http://www.serieriundervisningen.se/om-oss/

Eisner, W. (2008). Comics and Sequential Art: Principles and Practices from the Legendary Cartoonist / Will Eisner. (Rev. ed. of: Comics & sequential art. 1985 ed.). New York: W. W. Norton & Company.

Eisner, W. (2017). Comics and the New Literacy. In L. Shelton Caswell & J. Gardner (Eds.), Drawing the Line: Comics Studies and INKS, 1994 - 1997 (pp. 3-7). Columbus: Ohio State University Press.

Ferrari, A., Pochet, F., & Zanotta, R. (2012, June 5, 2012). Mästerskapsmysteriet - del 3 [The Championship Mysterium - part 3]. Kalle Anka & C:o, 24-31.

Garfinkel, H. (1984). Studies in Ethnomethodology. Cambridge: Polity Press.

Gee, J. P. (1992). The Social Mind: Language, Ideology, and Social Practice. New York, Westport & London: Bergin & Garvey.

Gruenberg, S. M. (1944). The Comics as a Social Force. The Journal of Educational Sociology, 18(4), 204-213. doi:10.2307/2262693

Hague, I. (2014). Comics and the Senses: A Multisensory Approach to Comics and Graphic Novels. New York: Routledge.

Hammond, H. K. (2009). Graphic Novels and Multimodal Literacy: A Reader Response Study. (Doctoral dissertation), Graduate School of the University of Minnesota.

Hammond, H. K. (2012). Graphic Novels and Multimodal Literary: A High School Study. Bookbird: A Journal of International Children’s Literature, 50(4), 22-32.

Helsby, W. F. (1999). Comics in Education. The Link between Visual and Verbal Literacy: How Readers read Comics. (Doctoral dissertation), University of Southhampton, Southhampton. Retrieved from https://eprints.soton.ac.uk/194425/1/00110707.pdf

Heritage, J. (1987). Ethnomethodology. In A. Giddens & J. Turner (Eds.), Social Theory Today (pp. 224-272). Cambridge: Polity Press.

Ijima-Washburn, P. (30 Sep, 2017). The Comic Book Sound Effect Database. Retrieved June 8, 2018, from http://www.comicbookfx.com/fxlist.php

Jefferson, G. (2004). Glossary of Transcript Symbols with an Introduction. In G. H. Lerner (Ed.), Conversation Analysis: Studies from the First Generation (pp. 13-31). Amsterdam & Philadelphia: John Benjamins.

Jewitt, C. (2008). Multimodality and Literacy in School Classrooms. Review of Research in Education, 32, 241-267. doi:10.3102/0091732X07310586

Jewitt, C. (Ed.) (2011). The Routledge handbook of multimodal analysis. New York, NY.: Routledge.

Khordoc, C. (2001). The Comic Book’s Soundtrack: Visual Sound Effects in Asterix. In R. Varnum & C. T. Gibbons (Eds.), The Language of Comics: Word and image (pp. 156-173). Jackson: University Press of Mississippi.

Kress, G. (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. London & New York: Routledge.

Kunzle, D. (2001). The Voices of Silence: Willette, Steinlen and the Introduction of the Silent Strip in the Chat Noir, with a German Coda. In R. Varnum & C. T. Gibbons (Eds.), The Language of Comics: Word and image (pp. 3-18). Jackson: University Press of Mississippi.

Macbeth, D. (2004). The Relevance of Repair for Classroom Correction. Language in Society, 33, 703-736. doi:10.10170S0047404504045038

McCloud, S. (1993). Understanding Comics: The Invisible Art. New York: William Morrow Paperbacks.

McHoul, A. W. (1978). The Organization of Turns at Formal Talk in the Classroom. Language in Society, 7(2), 183-213.

Mehan, H. (1979). Learning Lessons - Social Organization in the Classroom. Cambridge & London: Harvard University Press.

Pantaleo, S. (2012). Meaning-making with Colour in Multimodal Texts: An 11-year-old Student’s Purposeful ‘Doing’. Literacy, 46(3), 147-155.

Petersen, R. S. (2009). The Acoustics of Manga. In J. Heer & K. Worcester (Eds.), A Comics Studies Reader (pp. 163-171). Jackson: University of Mississippi Press.

Pollmann, J. (2001). Shaping Sounds in Comics. International Journal of Comic Art, 2(1), 9-21.

Potter, J. (1996). Representing Reality - Discourse, Rhetoric and Social Construction. London, Thousand Oaks, & New Delhi: Sage.

Potter, J. (2010). Discursive Psychology and the Study of Naturally Occurring Talk. In D. Silverman (Ed.), Qualitative Analysis: Issues of Theory and Method (3rd vol., pp. 187-207). London: Sage.

Ripley, D. (2012). Classroom Comics: Children’s Medium and the New Literacy. Interdisciplinary Humanities, 29(1), 99-113.

Sabin, R. (2001). Comics, Comix & Graphic Novels: A History of Comic Art. London: Phaidon Press.

Sones, W. W. D. (1944). The Comics and Instructional Method. The Journal of Educational Sociology, 18(4), 232-240. doi:10.2307/2262696

Stolpe, K., Frejd, J., & Wallner, L. (2016). Translating modalities: Preschool teachers’ work with children’s meaning making in science. I J. Lavonen, K. Juuti, J. Lampiselkä, A. Uitto & K. Hahl (Eds.), Electronic Proceedings of the ESERA 2015 Conference. Science education research: Engaging learners for a sustainable future, Part 15 (co-ed. Esmé Glauert & Fani Stylianidou), (p. 2608-2615). Helsinki, Finland: University of Helsinki. Retrieved. June 8, 2018, from http://www.diva-portal.org/smash/record.jsf?pid=diva2:925566

Street, B. V., Pahl, K., & Rowsell, J. (2011). Multimodality and New Literacy Studies. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (pp. 191-200). New York: Routledge.

Sutliff Sanders, J. (2013). Chaperoning Words: Meaning-Making in Comics and Picture Books. Children’s Literature, 41, 57-90. doi:10.1353/chl.2013.0012

Tilley, C. L. (2013). Using Comics to Teach the Language Arts in the 1940s and 1950s. In C. K. Syma & R. G. Weiner (Eds.), Graphic Novels and Comics in the Classroom: Essays on the educational power of sequential art (pp. 12-22). Jefferson: McFarland.

Tilley, C. L., & Weiner, R. G. (2017). Teaching and Learning with Comics. In F. Bramlett, R. T. Cook, & A. Meskin (Eds.), The Routledge Companion to Comics (pp. 358-366). New York & London: Routledge.

Wallner, L. (2017a). Framing Education: Doing Comics Literacy in the Classroom. (Doctoral dissertation), Department of Social and Welfare Studies. Linköping: Linköping University. Retrieved June 8, 2018, from: http://liu.diva-portal.org/smash/record.jsf?pid=diva2:1150907

Wallner, L. (2017b). Speak of the Bubble: constructing comic book bubbles as literary devices in a primary school classroom. Journal of Graphic Novels and Comics, 8(2), 173-192, doi:10.1080/21504857.2016.1270221

Warner, M. (2008). Phew! Whaam! Aaargh! Boo!: Sense, Sensation, and Picturing Sound. The Soundtrack, 1(2), 107-125. doi:10.1386/st.1.2.107/1

Wiggins, S. (2017). Discursive Psychology: Theory, Method and Applications. London: Sage.

Wiggins, S., & Potter, J. (2007). Discursive Psychology. In C. Willig & W. Stainton-Rogers (eds.), The SAGE handbook of qualitative research in psychology (pp. 73-90). Los Angeles: Sage.

Witty, P. (1941a). Children’s Interest in Reading the Comics. The Journal of Experimental Education, 10(2), 100-104. doi:10.1080/00220973.1941.11010239

Witty, P. (1941b). Reading the Comics - A Comparative Study. The Journal of Experimental Education, 10(2), 105-109. doi:10.1080/00220973.1941.1101024.

Yannicopoulou, A. (2004). Visual Aspects of Written Texts: Preschoolers View Comics. L1 - Educational Studies in Language and Literature, 4, 169-181.

Publiée
2020-08-28