Eye movements unveil sensitivity of naïve listeners to iconicity of Russian onomatopoeic words
DOI:
https://doi.org/10.7557/6.6880Keywords:
iconicity, onomatopoeic words, Russian, eye tracking, visual world paradigmAbstract
Iconicity between form and meaning of words is considered to be instrumental in relating linguistic forms to sensorimotor experience. Some Russian onomatopoeic words (e.g. bac ‘bang’) depict sounds and indicate action connected to these sounds. This study investigated how sensitive adult Finnish L1 speakers with no prior knowledge of Russian are to the iconicity of spoken onomatopoeic words in Russian. First, an iconicity rating test was used to establish the iconicity levels for each token from the perspective of Finnish native speakers who had never learned Russian before. Second, an eye-tracking experiment using different participants, who were also native in Finnish and unfamiliar with Russian, employed the visual world paradigm to test visual recognition of the meaning of spoken words. Our results revealed that iconicity rating for each token varied within the class of onomatopoeic words, and that iconicity ratings for different words were strongly connected with their semantic transparency.
References
Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). “Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models.” Journal of Memory and Language, 38(4), 419−439. https://doi.org/10.1006/jmla.1997.2558 DOI: https://doi.org/10.1006/jmla.1997.2558
Bergen, B. K. (2004). “The Psychological Reality of Phonaesthemes.” Language (Baltimore), 80(2), 290–311. https://doi.org/10.1353/lan.2004.0056 DOI: https://doi.org/10.1353/lan.2004.0056
Blasi, D. E., Wichmann, S., Hammarström, H., Stadler, P. F., & Christiansen, M. H. (2016). “Sound–meaning association biases evidenced across thousands of languages”. Proceedings of the National Academy of Sciences – PNAS, 113(39), 10818–10823. https://doi.org/10.1073/pnas.1605782113 DOI: https://doi.org/10.1073/pnas.1605782113
Bryant, G. A., & Fox Tree, J. E. (2002). “Recognizing Verbal Irony in Spontaneous Speech.” Metaphor and Symbol, 17(2), 99–117. https://doi.org/10.1207/S15327868MS1702_2 DOI: https://doi.org/10.1207/S15327868MS1702_2
Cooper, R. M. (1974). “The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing.” Cognitive Psychology, 6, 84−107. https://doi.org/10.1016/0010-0285(74)90005-X DOI: https://doi.org/10.1016/0010-0285(74)90005-X
Cosmides, L. (1983). “Invariances in the Acoustic Expression of Emotion During Speech.” Journal of Experimental Psychology, 9, 864–881. https://doi.org/10.1037/0096-1523.9.6.864 DOI: https://doi.org/10.1037/0096-1523.9.6.864
Cuskley, C., & Kirby, S. (2013). “Synesthesia, Cross-modality, and Language Evolution.” In J. Simner and E. M. Hubbard (Eds.), Oxford Library of Psychology. The Oxford Handbook of Synaesthesia, (pp. 869–899). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199603329.013.0043 DOI: https://doi.org/10.1093/oxfordhb/9780199603329.013.0043
Dingemanse, M. (2012). “Advances in the Cross-linguistic Study of Ideophones.” Language and Linguistics Compass, 6(10), 654–672. https://doi.org/10.1002/lnc3.361 DOI: https://doi.org/10.1002/lnc3.361
Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015). “Arbitrariness, Iconicity, and Systematicity in Language.” Trends in Cognitive Sciences, 19(10), 603–615. https://doi.org/10.1016/j.tics.2015.07.013 DOI: https://doi.org/10.1016/j.tics.2015.07.013
Dingemanse, M., Torreira, F., & Enfield, N. J. (2013). “Is “Huh?” a universal word? Conversational infrastructure and the convergent evolution of linguistic items”. PloS One, 8(11), e78273–e78273. https://doi.org/10.1371/journal.pone.0094620 DOI: https://doi.org/10.1371/journal.pone.0078273
Fischer, B. (1992). “Saccadic Reaction Time: Implications for Reading, Dyslexia, and Visual Cognition.” In K. Rayner (Ed.), Eye movements and visual cognition, (pp. 31–45). New York, NY: Springer. https://doi.org/10.1007/978-1-4612-2852-3_3 DOI: https://doi.org/10.1007/978-1-4612-2852-3_3
Goffman, E. (1978). “Response Cries”. Language, 54, 787–815. https://doi.org/10.2307/413235 DOI: https://doi.org/10.2307/413235
Haiman, J. (1998). Talk is Cheap: Sarcasm, Alienation, and the Evolution of Language. Oxford University Press, Incorporated. DOI: https://doi.org/10.1093/oso/9780195115246.001.0001
Hinojosa, J. A., Haro, J., Magallares, S., Duñabeitia, J. A., & Ferré, P. (2021). “Iconicity ratings for 10,995 Spanish words and their relationship with psycholinguistic variables”. Behavior Research Methods, 53(3), 1262–1275. https://doi.org/10.3758/s13428-020-01496-z DOI: https://doi.org/10.3758/s13428-020-01496-z
Hinton, L., Nichols, J., & Ohala, J. J., eds. (1994). Sound Symbolism. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511751806 DOI: https://doi.org/10.1017/CBO9780511751806
Hockett, C. F. (1960). “The Origin of Speech.” Scientific American, 203(3), 88–96. https://doi.org/10.1038/scientificamerican0960-88 DOI: https://doi.org/10.1038/scientificamerican0960-88
Hubbard, E. M., Arman, A. C., Ramachandran, V. S., & Boynton, G. M. (2005). “Individual Differences Among Grapheme-color Synaesthetes: Brain-behavior Correlations.” Neuron, 45, 975–985. https://doi.org/10.1016/j.neuron.2005.02.008 DOI: https://doi.org/10.1016/j.neuron.2005.02.008
Huettig, F., & Altmann, G. T. M. (2005). “Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm.” Cognition, 96(1), B23−B32. https://doi.org/10.1016/j.cognition.2004.10.003 DOI: https://doi.org/10.1016/j.cognition.2004.10.003
Huettig, F., & Altmann, G. T. M. (2007). “Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness.” Visual Cognition, 15(8), 985−1018. https://doi.org/10.1080/13506280601130875 DOI: https://doi.org/10.1080/13506280601130875
Huettig, F., Rommers, J., & Meyer, A. S. (2011). “Using the visual world paradigm to study language processing: a review and critical evaluation.” Acta Psychologica, 137 (2), 151–171. https://doi.org/10.1016/j.actpsy.2010.11.003 DOI: https://doi.org/10.1016/j.actpsy.2010.11.003
Huettig, F., & McQueen, J. M. (2007). “The tug of war between phonological, semantic, and shape information in language-mediated visual search.” Journal of Memory and Language, 54, 460−482. https://doi.org/10.1016/j.jml.2007.02.001 DOI: https://doi.org/10.1016/j.jml.2007.02.001
Imai, M., & Kita, S. (2014). “The Sound Symbolism Bootstrapping Hypothesis for Language Acquisition and Language Evolution.” Philosophical Transactions. Biological Sciences, 369(1651), 20130298–20130298. https://doi.org/10.1098/rstb.2013.0298 DOI: https://doi.org/10.1098/rstb.2013.0298
Iwasaki, N., Vinson, D. P., & Vigliocco, G. (2007). “How does it Hurt, kiri-kiri or siku-siku? Japanese Mimetic Words of Pain Perceived by Japanese Speakers and English Speakers”. In M. Minami (Ed.), Applying Theory and Research to Learning Japanese as a Foreign Language, (pp. 2–19). Cambridge Scholars Publisher.
Just, M.A., & Carpenter, P.A. (1984). “Using eye fixations to study reading comprehension”. In D.E. Kieras, & M.A. Just (Eds.), New methods in reading comprehension research (pp. 151–182). Hillsdale, NJ: Erlbaum.
Kanerva, O. (2018). “Correlation Between Expressiveness and Syntactic Independence of Russian Onomatopoeic Verbal Interjections.” Poljarnyj Vestnik: Norwegian Journal of Slavic Studies, 21, 15–30. https://doi.org/10.7557/6.4435 DOI: https://doi.org/10.7557/6.4435
Kanerva, O., & Häikiö, T. (2022). “Sound symbolic potential of Russian onomatopoeias: Evidence from eye-tracking.” Journal of Experimental Psychology. Learning, Memory, and Cognition, 48(3), 432–445. https://doi.org/10.1037/xlm0001114 DOI: https://doi.org/10.1037/xlm0001114
Karcevskij, S. O. (1984). “Vvedenie v izučenie meždometij.” Voprosy jazykoznanija, 6, 127-137.
Laing, C. E. (2017). “A Perceptual Advantage for Onomatopoeia in Early Word Learning: Evidence from Eye-Tracking.” Journal of Experimental Child Psychology, 161, 32–45. https://doi.org/10.1016/j.jecp.2017.03.017 DOI: https://doi.org/10.1016/j.jecp.2017.03.017
Lupyan, G., & Winter, B. (2018). “Language is more abstract than you think, or, why aren’t languages more iconic?” Philosophical Transactions of the Royal Society of London. Series B. Biological Sciences, 373(1752), 20170137–20170137. https://doi.org/10.1098/rstb.2017.0137 DOI: https://doi.org/10.1098/rstb.2017.0137
Maurer, D., Pathman, T., & Mondloch, C. J. (2006). “The Shape of Boubas: Sound-shape Correspondences in Toddlers and Adults.” Developmental Science, 9(3), 316–322. https://doi.org/10.1111/j.1467-7687.2006.00495.x DOI: https://doi.org/10.1111/j.1467-7687.2006.00495.x
Mchitar′jan, G. S. (2016). Grammatičeskij status i funkcionirovanie glagolʹno-meždometnych form v sovremennom russkom jazyke. Pjatigorsk.
Monaghan, P., & Christiansen, M. H. (2006). “Why Form-meaning Mappings Are Not Entirely Arbitrary in Language.” In R. Sun (Ed.), Proceedings of the 28th Annual Conference of the Cognitive Science Society, (pp. 1838–1843).
Monaghan, P., Christiansen, M., & Chater, N. (2007). “The Phonological-distributional Coherence Hypothesis: Cross-linguistic Evidence in Language Acquisition.” Cognitive Psychology, 55(4), 259–305. https://doi.org/10.1016/j.cogpsych.2006.12.001 DOI: https://doi.org/10.1016/j.cogpsych.2006.12.001
Monaghan, P., Shillcock, R., Christiansen, M., & Kirby, S. (2014). “How Arbitrary Is Language?” Philosophical Transactions. Biological Sciences, 369(1651), 20130299–20130299. https://doi.org/10.1098/rstb.2013.0299 DOI: https://doi.org/10.1098/rstb.2013.0299
Nikitina, T. (2012). “Russian Verboids: A Case Study in Expressive Vocabulary”. Linguistics, 50(2), 165–189. https://doi.org/10.1515/ling-2012-0007 DOI: https://doi.org/10.1515/ling-2012-0007
Nuckolls, J. B. (1999). “The Case for Sound Symbolism.” Annual Review of Anthropology, 28(1), 225–252. https://doi.org/10.1146/annurev.anthro.28.1.225 DOI: https://doi.org/10.1146/annurev.anthro.28.1.225
Pathak, A., Calvert, G., & Motoki, K. (2020). “Long Vowel Sounds Induce Expectations of Sweet Tastes.” Food Quality and Preference, 86, 104033. https://doi.org/10.1016/j.foodqual.2020.104033 DOI: https://doi.org/10.1016/j.foodqual.2020.104033
Perniss, P., & Vigliocco G. (2014). “The Bridge of Iconicity: From a World of Experience to the Experience of Language.” Philosophical Transactions. Biological Sciences, 369 (1654), 20140179. https://doi.org/10.1098/rstb.2013.0300 DOI: https://doi.org/10.1098/rstb.2014.0179
Perry, L. K., Perlman, M., & Lupyan, G. (2015). “Iconicity in English and Spanish and Its Relation to Lexical Category and Age of Acquisition.” PloS One, 10(9), e0137147–e0137147. https://doi.org/10.1371/journal.pone.0137147 DOI: https://doi.org/10.1371/journal.pone.0137147
Porretta, V., Buchanan, L. & Järvikivi, J. (2020). “When processing costs impact predictive processing: The case of foreign-accented speech and accent experience.” Attention, Perception, & Psychophysics, 82, 1558–1565. https://doi.org/10.3758/s13414-019-01946-7 DOI: https://doi.org/10.3758/s13414-019-01946-7
Porretta, V., & Kyröläinen, A.-J. (2019). “Influencing the time and space of lexical competition: The effect of gradient foreign accentedness.” Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(10), 1832–1851. https://doi.org/10.1037/xlm0000674 DOI: https://doi.org/10.1037/xlm0000674
Porretta, V., Kyröläinen, A., van Rij, J., & Järvikivi, J. (2016). VWPre: Tools for Preprocessing Visual World Data. Version 1.2.3, updated 2020-03-08, URL https://CRAN.R-project.org/package=VWPre
Prokopovič, E. N. (1969). Stilistika častej reči (glagol'nye slovoformy). Moscow: Prosveŝenie.
R Core Team. (2022). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna, Austria. URL https://www.R-project.org/
Revill, K. P., Namy, L. L., & Nygaard, L. C. (2018). “Eye Movements Reveal Persistent Sensitivity to Sound Symbolism During Word Learning.” Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(5), 680–698. https://doi.org/10.1037/xlm0000476 DOI: https://doi.org/10.1037/xlm0000476
Rhodes, R. (1994). “Aural Images.” In L. Hinton, J. Nichols, & J. Ohala (Eds.), Sound Symbolism, (pp. 276–292). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511751806.019 DOI: https://doi.org/10.1017/CBO9780511751806.019
Šaronov, I. A. (2008). Meždometija v reči, tekste i slovare. Moscow: Izdatel'skij centr Rossijskogo gosudarstvennogo gumanitarnogo universiteta.
Saussure, F. d., Bally, C., Baskin, W., Reidlinger, A., & Sechehaye, A. (1960). Course in General Linguistics. London: Peter Owen. https://doi.org/10.2307/538001 DOI: https://doi.org/10.2307/538001
Švedova, N. J., ed. (1980). Grammatika russkogo jazyka. Akademija Nauk SSSR, Moscow.
Thompson, A. L., Akita, K., & Do, Y. (2020). “Iconicity ratings across the Japanese lexicon: A comparative study with English”. Linguistics Vanguard: Multimodal Online Journal, 6(1). https://doi.org/10.1515/lingvan-2019-0088 DOI: https://doi.org/10.1515/lingvan-2019-0088
Thompson, R. L., Vinson, D. P., Woll, B., & Vigliocco, G. (2012). “The Road to Language Learning Is Iconic: Evidence from British Sign Language.” Psychological Science, 23(12), 1443–1448. https://doi.org/10.1177/0956797612459763 DOI: https://doi.org/10.1177/0956797612459763
van Rij, J., Wieling, M., Baayen, R. H., & van Rijn, H. (2017). itsadug: Interpreting Time Series and Autocorrelated Data Using GAMMs. R package version 2.4. URL https://cran.r-project.org/package=itsadug
Viimaranta, J., & Vihervä, M. (2019). “The Use of Onomatopoeic Interjections in Predicate Function in Russian and Other Languages: A Perspective from the Corpus of Parallel Texts of the Russian National Corpus”. Scando-Slavica, 65(2), 239–262. https://doi.org/10.1080/00806765.2019.1672092 DOI: https://doi.org/10.1080/00806765.2019.1672092
Voeltz, F. K. E., & Christa Kilian-Hatz, C. eds. (2001). Ideophones. Amsterdam, Philadelphia: John Benjamins. https://doi.org/10.1075/tsl.44 DOI: https://doi.org/10.1075/tsl.44
Wichmann, S., Holman, E. W., & Brown, C. H. (2010). “Sound Symbolism in Basic Vocabulary”. Entropy (Basel, Switzerland), 12(4), 844–858. https://doi.org/10.3390/e12040844 DOI: https://doi.org/10.3390/e12040844
Wierzbicka, A. (2003). “Interjections across Cultures”. In A. Wierzbicka (Ed.), Cross-Cultural Pragmatics: The Semantics of Human Interaction, (pp. 285–340). Mouton de Gruyter. https://doi.org/10.1515/9783110220964.285 DOI: https://doi.org/10.1515/9783110220964.285
Winter, B., Perlman, B., Perry, L. K. & Lupyan, G. (2017). “Which words are most iconic? Iconicity in English sensory words”. Interaction Studies, 18(3), 430–451. https://doi.org/10.1075/is.18.3.07win DOI: https://doi.org/10.1075/is.18.3.07win
Wood, S. N. (2011). “Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models.” Journal of the Royal Statistical Society, Series B (Statistical Methodology), 73 (1), 3–36. https://doi.org/10.1111/j.1467-9868.2010.00749.x DOI: https://doi.org/10.1111/j.1467-9868.2010.00749.x
Xvostunova, T. I. (2000). Funkcionirovanie glagolʹno-meždometnyx form v sovremennom russkom literaturnom jazyke. Saransk.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Tuomo Häikiö, Oksana Kanerva
This work is licensed under a Creative Commons Attribution 4.0 International License.
