The Visual made Audible – Co-constructing Sound Effects as Devices of Comic Book Literacy in Primary School

  • Lars Wallner
Palabras clave: Aula ; alfabetización con cómics ; multimodalidad ; efecto de sonido ; texto sonoro

Resumen

Este artículo discute y analiza las situaciones de alfabetización en las que dos niños de tercer grado y sus profesores trabajan mediante cómics, centrándose específicamente en las representaciones visuales del sonido. El propósito del artículo es explorar cómo estas representaciones, como aspectos multimodales de la alfabetización con cómics, provocan experiencias en las que la alfabetización se desarrolla en el aula. Las representaciones del sonido vienen mostradas por diferentes formas y tamaños, pero generalmente escritas fuera de las burbujas de diálogo con letras en negrita. Utilizando la psicología discursiva –y permitiendo así al investigador ver las acciones verbales y representaciones de los participantes como acciones que se realizan en determinados contextos sociales– el presente artículo analiza cómo parejas de estudiantes y maestros co-construyen aspectos visuales en los cómics, traduciéndolos en sonidos vocales y movimiento incorporado. Los resultados muestran que el movimiento incorporado, la sensación y el sonido audible se utilizan para mostrar interactivamente, en el cómic, los efectos de sonido para mejorar la experiencia narrativa del lector. Esto se hace como co-construcción entre adulto y niño a través de la recreación de lo visual como sonido y acción de la vida real, también conectando esto con otros aspectos visuales de paneles adyacentes para que esto sea significativo. El artículo sostiene que esto desafía las percepciones de los profesores y de los estudiantes sobre qué puede ser la alfabetización y cómo los efectos de sonido, a través de la forma, el color y la fuente del texto gráfico, influyen y animan las narrativas del cómic creadas en el aula.

Citas

Allington, D., & Benwell, B. (2012). Reading the Reading Experience: An Ethnomethodological Approach to “Booktalk”. In A. Lang (Ed.), From Codex to Hypertext: Reading at the Turn of the Twenty-first Century (pp. 217-233). Amherst: University of Massachusetts Press.

Carlsson, D. (Ed.) (2013). Kalle Anka och hans vänner [Donald Duck and his Friends]. Malmö: Egmont Kids Media.

Catricalà, M., & Guidi, A. (2015). Onomatopoeias: A new Perspective around Space, Image Schemas and Phoneme Clusters. Cognitive Processes, 16(1), 175-178. doi:10.1007/s10339-015-0693-x

Cohn, N., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2014). The Grammar of Visual Narrative: Neural Evidence for Constituent Structure in Sequential Image Comprehension. Neuropsychologia, 64, 63-70. doi:10.1016/j.neuropsychologia.2014.09.018

Cohn, N., Paczynski, M., Jackendoff, R., Holcomb, P. J., & Kuperberg, G. R. (2012). (Pea)nuts and Bolts of Visual Narrative: Structure and Meaning in Sequential Image Comprehension. Cognitive psychology, 65(1), 1-38. doi:10.1016/j.cogpsych.2012.01.003

Dey, S., & Bokil, P. (2016). Syntax of Sound Symbolic Words: A Study of the Hindi Comic Books in India. International Journal of Comic Art, 18(1), 260-277.

Duncan, R., Smith, M. J., & Levitz, P. (2015). The Power of Comics: History, Form, and Culture (2 ed.). London & New York: Bloomsbury.

Edwards, D., & Potter, J. (1992). Discursive Psychology. London: Sage.

Egmont Publishing. (2015). Serier i undervisningen (Om oss) [Comics in Teaching (About Us)]. Retrieved June 8, 2018, from http://www.serieriundervisningen.se/om-oss/

Eisner, W. (2008). Comics and Sequential Art: Principles and Practices from the Legendary Cartoonist / Will Eisner. (Rev. ed. of: Comics & sequential art. 1985 ed.). New York: W. W. Norton & Company.

Eisner, W. (2017). Comics and the New Literacy. In L. Shelton Caswell & J. Gardner (Eds.), Drawing the Line: Comics Studies and INKS, 1994 - 1997 (pp. 3-7). Columbus: Ohio State University Press.

Ferrari, A., Pochet, F., & Zanotta, R. (2012, June 5, 2012). Mästerskapsmysteriet - del 3 [The Championship Mysterium - part 3]. Kalle Anka & C:o, 24-31.

Garfinkel, H. (1984). Studies in Ethnomethodology. Cambridge: Polity Press.

Gee, J. P. (1992). The Social Mind: Language, Ideology, and Social Practice. New York, Westport & London: Bergin & Garvey.

Gruenberg, S. M. (1944). The Comics as a Social Force. The Journal of Educational Sociology, 18(4), 204-213. doi:10.2307/2262693

Hague, I. (2014). Comics and the Senses: A Multisensory Approach to Comics and Graphic Novels. New York: Routledge.

Hammond, H. K. (2009). Graphic Novels and Multimodal Literacy: A Reader Response Study. (Doctoral dissertation), Graduate School of the University of Minnesota.

Hammond, H. K. (2012). Graphic Novels and Multimodal Literary: A High School Study. Bookbird: A Journal of International Children’s Literature, 50(4), 22-32.

Helsby, W. F. (1999). Comics in Education. The Link between Visual and Verbal Literacy: How Readers read Comics. (Doctoral dissertation), University of Southhampton, Southhampton. Retrieved from https://eprints.soton.ac.uk/194425/1/00110707.pdf

Heritage, J. (1987). Ethnomethodology. In A. Giddens & J. Turner (Eds.), Social Theory Today (pp. 224-272). Cambridge: Polity Press.

Ijima-Washburn, P. (30 Sep, 2017). The Comic Book Sound Effect Database. Retrieved June 8, 2018, from http://www.comicbookfx.com/fxlist.php

Jefferson, G. (2004). Glossary of Transcript Symbols with an Introduction. In G. H. Lerner (Ed.), Conversation Analysis: Studies from the First Generation (pp. 13-31). Amsterdam & Philadelphia: John Benjamins.

Jewitt, C. (2008). Multimodality and Literacy in School Classrooms. Review of Research in Education, 32, 241-267. doi:10.3102/0091732X07310586

Jewitt, C. (Ed.) (2011). The Routledge handbook of multimodal analysis. New York, NY.: Routledge.

Khordoc, C. (2001). The Comic Book’s Soundtrack: Visual Sound Effects in Asterix. In R. Varnum & C. T. Gibbons (Eds.), The Language of Comics: Word and image (pp. 156-173). Jackson: University Press of Mississippi.

Kress, G. (2010). Multimodality: A Social Semiotic Approach to Contemporary Communication. London & New York: Routledge.

Kunzle, D. (2001). The Voices of Silence: Willette, Steinlen and the Introduction of the Silent Strip in the Chat Noir, with a German Coda. In R. Varnum & C. T. Gibbons (Eds.), The Language of Comics: Word and image (pp. 3-18). Jackson: University Press of Mississippi.

Macbeth, D. (2004). The Relevance of Repair for Classroom Correction. Language in Society, 33, 703-736. doi:10.10170S0047404504045038

McCloud, S. (1993). Understanding Comics: The Invisible Art. New York: William Morrow Paperbacks.

McHoul, A. W. (1978). The Organization of Turns at Formal Talk in the Classroom. Language in Society, 7(2), 183-213.

Mehan, H. (1979). Learning Lessons - Social Organization in the Classroom. Cambridge & London: Harvard University Press.

Pantaleo, S. (2012). Meaning-making with Colour in Multimodal Texts: An 11-year-old Student’s Purposeful ‘Doing’. Literacy, 46(3), 147-155.

Petersen, R. S. (2009). The Acoustics of Manga. In J. Heer & K. Worcester (Eds.), A Comics Studies Reader (pp. 163-171). Jackson: University of Mississippi Press.

Pollmann, J. (2001). Shaping Sounds in Comics. International Journal of Comic Art, 2(1), 9-21.

Potter, J. (1996). Representing Reality - Discourse, Rhetoric and Social Construction. London, Thousand Oaks, & New Delhi: Sage.

Potter, J. (2010). Discursive Psychology and the Study of Naturally Occurring Talk. In D. Silverman (Ed.), Qualitative Analysis: Issues of Theory and Method (3rd vol., pp. 187-207). London: Sage.

Ripley, D. (2012). Classroom Comics: Children’s Medium and the New Literacy. Interdisciplinary Humanities, 29(1), 99-113.

Sabin, R. (2001). Comics, Comix & Graphic Novels: A History of Comic Art. London: Phaidon Press.

Sones, W. W. D. (1944). The Comics and Instructional Method. The Journal of Educational Sociology, 18(4), 232-240. doi:10.2307/2262696

Stolpe, K., Frejd, J., & Wallner, L. (2016). Translating modalities: Preschool teachers’ work with children’s meaning making in science. I J. Lavonen, K. Juuti, J. Lampiselkä, A. Uitto & K. Hahl (Eds.), Electronic Proceedings of the ESERA 2015 Conference. Science education research: Engaging learners for a sustainable future, Part 15 (co-ed. Esmé Glauert & Fani Stylianidou), (p. 2608-2615). Helsinki, Finland: University of Helsinki. Retrieved. June 8, 2018, from http://www.diva-portal.org/smash/record.jsf?pid=diva2:925566

Street, B. V., Pahl, K., & Rowsell, J. (2011). Multimodality and New Literacy Studies. In C. Jewitt (Ed.), The Routledge Handbook of Multimodal Analysis (pp. 191-200). New York: Routledge.

Sutliff Sanders, J. (2013). Chaperoning Words: Meaning-Making in Comics and Picture Books. Children’s Literature, 41, 57-90. doi:10.1353/chl.2013.0012

Tilley, C. L. (2013). Using Comics to Teach the Language Arts in the 1940s and 1950s. In C. K. Syma & R. G. Weiner (Eds.), Graphic Novels and Comics in the Classroom: Essays on the educational power of sequential art (pp. 12-22). Jefferson: McFarland.

Tilley, C. L., & Weiner, R. G. (2017). Teaching and Learning with Comics. In F. Bramlett, R. T. Cook, & A. Meskin (Eds.), The Routledge Companion to Comics (pp. 358-366). New York & London: Routledge.

Wallner, L. (2017a). Framing Education: Doing Comics Literacy in the Classroom. (Doctoral dissertation), Department of Social and Welfare Studies. Linköping: Linköping University. Retrieved June 8, 2018, from: http://liu.diva-portal.org/smash/record.jsf?pid=diva2:1150907

Wallner, L. (2017b). Speak of the Bubble: constructing comic book bubbles as literary devices in a primary school classroom. Journal of Graphic Novels and Comics, 8(2), 173-192, doi:10.1080/21504857.2016.1270221

Warner, M. (2008). Phew! Whaam! Aaargh! Boo!: Sense, Sensation, and Picturing Sound. The Soundtrack, 1(2), 107-125. doi:10.1386/st.1.2.107/1

Wiggins, S. (2017). Discursive Psychology: Theory, Method and Applications. London: Sage.

Wiggins, S., & Potter, J. (2007). Discursive Psychology. In C. Willig & W. Stainton-Rogers (eds.), The SAGE handbook of qualitative research in psychology (pp. 73-90). Los Angeles: Sage.

Witty, P. (1941a). Children’s Interest in Reading the Comics. The Journal of Experimental Education, 10(2), 100-104. doi:10.1080/00220973.1941.11010239

Witty, P. (1941b). Reading the Comics - A Comparative Study. The Journal of Experimental Education, 10(2), 105-109. doi:10.1080/00220973.1941.1101024.

Yannicopoulou, A. (2004). Visual Aspects of Written Texts: Preschoolers View Comics. L1 - Educational Studies in Language and Literature, 4, 169-181.

Publicado
2020-08-28
Cómo citar
Wallner, L. (2020). The Visual made Audible – Co-constructing Sound Effects as Devices of Comic Book Literacy in Primary School. Cuadernos Del Centro De Estudios De Diseño Y Comunicación, (89). https://doi.org/10.18682/cdc.vi89.3810