Eye movements unveil sensitivity of naïve listeners to iconicity of Russian onomatopoeic words

Authors

DOI:

https://doi.org/10.7557/6.6880

Keywords:

iconicity, onomatopoeic words, Russian, eye tracking, visual world paradigm

Abstract

Iconicity between form and meaning of words is considered to be instrumental in relating linguistic forms to sensorimotor experience. Some Russian onomatopoeic words (e.g. bac ‘bang’) depict sounds and indicate action connected to these sounds. This study investigated how sensitive adult Finnish L1 speakers with no prior knowledge of Russian are to the iconicity of spoken onomatopoeic words in Russian. First, an iconicity rating test was used to establish the iconicity levels for each token from the perspective of Finnish native speakers who had never learned Russian before. Second, an eye-tracking experiment using different participants, who were also native in Finnish and unfamiliar with Russian, employed the visual world paradigm to test visual recognition of the meaning of spoken words. Our results revealed that iconicity rating for each token varied within the class of onomatopoeic words, and that iconicity ratings for different words were strongly connected with their semantic transparency.

References

Allopenna, P. D., Magnuson, J. S., & Tanenhaus, M. K. (1998). “Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models.” Journal of Memory and Language, 38(4), 419−439. https://doi.org/10.1006/jmla.1997.2558 https://doi.org/10.1006/jmla.1997.2558

Bergen, B. K. (2004). “The Psychological Reality of Phonaesthemes.” Language (Baltimore), 80(2), 290–311. https://doi.org/10.1353/lan.2004.0056 https://doi.org/10.1353/lan.2004.0056

Blasi, D. E., Wichmann, S., Hammarström, H., Stadler, P. F., & Christiansen, M. H. (2016). “Sound–meaning association biases evidenced across thousands of languages”. Proceedings of the National Academy of Sciences – PNAS, 113(39), 10818–10823. https://doi.org/10.1073/pnas.1605782113 https://doi.org/10.1073/pnas.1605782113

Bryant, G. A., & Fox Tree, J. E. (2002). “Recognizing Verbal Irony in Spontaneous Speech.” Metaphor and Symbol, 17(2), 99–117. https://doi.org/10.1207/S15327868MS1702_2 https://doi.org/10.1207/S15327868MS1702_2

Cooper, R. M. (1974). “The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing.” Cognitive Psychology, 6, 84−107. https://doi.org/10.1016/0010-0285(74)90005-X https://doi.org/10.1016/0010-0285(74)90005-X

Cosmides, L. (1983). “Invariances in the Acoustic Expression of Emotion During Speech.” Journal of Experimental Psychology, 9, 864–881. https://doi.org/10.1037/0096-1523.9.6.864 https://doi.org/10.1037/0096-1523.9.6.864

Cuskley, C., & Kirby, S. (2013). “Synesthesia, Cross-modality, and Language Evolution.” In J. Simner and E. M. Hubbard (Eds.), Oxford Library of Psychology. The Oxford Handbook of Synaesthesia, (pp. 869–899). Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199603329.013.0043 https://doi.org/10.1093/oxfordhb/9780199603329.013.0043

Dingemanse, M. (2012). “Advances in the Cross-linguistic Study of Ideophones.” Language and Linguistics Compass, 6(10), 654–672. https://doi.org/10.1002/lnc3.361 https://doi.org/10.1002/lnc3.361

Dingemanse, M., Blasi, D. E., Lupyan, G., Christiansen, M. H., & Monaghan, P. (2015). “Arbitrariness, Iconicity, and Systematicity in Language.” Trends in Cognitive Sciences, 19(10), 603–615. https://doi.org/10.1016/j.tics.2015.07.013 https://doi.org/10.1016/j.tics.2015.07.013

Dingemanse, M., Torreira, F., & Enfield, N. J. (2013). “Is “Huh?” a universal word? Conversational infrastructure and the convergent evolution of linguistic items”. PloS One, 8(11), e78273–e78273. https://doi.org/10.1371/journal.pone.0094620 https://doi.org/10.1371/journal.pone.0078273

Fischer, B. (1992). “Saccadic Reaction Time: Implications for Reading, Dyslexia, and Visual Cognition.” In K. Rayner (Ed.), Eye movements and visual cognition, (pp. 31–45). New York, NY: Springer. https://doi.org/10.1007/978-1-4612-2852-3_3 https://doi.org/10.1007/978-1-4612-2852-3_3

Goffman, E. (1978). “Response Cries”. Language, 54, 787–815. https://doi.org/10.2307/413235 https://doi.org/10.2307/413235

Haiman, J. (1998). Talk is Cheap: Sarcasm, Alienation, and the Evolution of Language. Oxford University Press, Incorporated. https://doi.org/10.1093/oso/9780195115246.001.0001

Hinojosa, J. A., Haro, J., Magallares, S., Duñabeitia, J. A., & Ferré, P. (2021). “Iconicity ratings for 10,995 Spanish words and their relationship with psycholinguistic variables”. Behavior Research Methods, 53(3), 1262–1275. https://doi.org/10.3758/s13428-020-01496-z https://doi.org/10.3758/s13428-020-01496-z

Hinton, L., Nichols, J., & Ohala, J. J., eds. (1994). Sound Symbolism. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511751806 https://doi.org/10.1017/CBO9780511751806

Hockett, C. F. (1960). “The Origin of Speech.” Scientific American, 203(3), 88–96. https://doi.org/10.1038/scientificamerican0960-88 https://doi.org/10.1038/scientificamerican0960-88

Hubbard, E. M., Arman, A. C., Ramachandran, V. S., & Boynton, G. M. (2005). “Individual Differences Among Grapheme-color Synaesthetes: Brain-behavior Correlations.” Neuron, 45, 975–985. https://doi.org/10.1016/j.neuron.2005.02.008 https://doi.org/10.1016/j.neuron.2005.02.008

Huettig, F., & Altmann, G. T. M. (2005). “Word meaning and the control of eye fixation: Semantic competitor effects and the visual world paradigm.” Cognition, 96(1), B23−B32. https://doi.org/10.1016/j.cognition.2004.10.003 https://doi.org/10.1016/j.cognition.2004.10.003

Huettig, F., & Altmann, G. T. M. (2007). “Visual-shape competition during language-mediated attention is based on lexical input and not modulated by contextual appropriateness.” Visual Cognition, 15(8), 985−1018. https://doi.org/10.1080/13506280601130875 https://doi.org/10.1080/13506280601130875

Huettig, F., Rommers, J., & Meyer, A. S. (2011). “Using the visual world paradigm to study language processing: a review and critical evaluation.” Acta Psychologica, 137 (2), 151–171. https://doi.org/10.1016/j.actpsy.2010.11.003 https://doi.org/10.1016/j.actpsy.2010.11.003

Huettig, F., & McQueen, J. M. (2007). “The tug of war between phonological, semantic, and shape information in language-mediated visual search.” Journal of Memory and Language, 54, 460−482. https://doi.org/10.1016/j.jml.2007.02.001 https://doi.org/10.1016/j.jml.2007.02.001

Imai, M., & Kita, S. (2014). “The Sound Symbolism Bootstrapping Hypothesis for Language Acquisition and Language Evolution.” Philosophical Transactions. Biological Sciences, 369(1651), 20130298–20130298. https://doi.org/10.1098/rstb.2013.0298 https://doi.org/10.1098/rstb.2013.0298

Iwasaki, N., Vinson, D. P., & Vigliocco, G. (2007). “How does it Hurt, kiri-kiri or siku-siku? Japanese Mimetic Words of Pain Perceived by Japanese Speakers and English Speakers”. In M. Minami (Ed.), Applying Theory and Research to Learning Japanese as a Foreign Language, (pp. 2–19). Cambridge Scholars Publisher.

Just, M.A., & Carpenter, P.A. (1984). “Using eye fixations to study reading comprehension”. In D.E. Kieras, & M.A. Just (Eds.), New methods in reading comprehension research (pp. 151–182). Hillsdale, NJ: Erlbaum.

Kanerva, O. (2018). “Correlation Between Expressiveness and Syntactic Independence of Russian Onomatopoeic Verbal Interjections.” Poljarnyj Vestnik: Norwegian Journal of Slavic Studies, 21, 15–30. https://doi.org/10.7557/6.4435 https://doi.org/10.7557/6.4435

Kanerva, O., & Häikiö, T. (2022). “Sound symbolic potential of Russian onomatopoeias: Evidence from eye-tracking.” Journal of Experimental Psychology. Learning, Memory, and Cognition, 48(3), 432–445. https://doi.org/10.1037/xlm0001114 https://doi.org/10.1037/xlm0001114

Karcevskij, S. O. (1984). “Vvedenie v izučenie meždometij.” Voprosy jazykoznanija, 6, 127-137.

Laing, C. E. (2017). “A Perceptual Advantage for Onomatopoeia in Early Word Learning: Evidence from Eye-Tracking.” Journal of Experimental Child Psychology, 161, 32–45. https://doi.org/10.1016/j.jecp.2017.03.017 https://doi.org/10.1016/j.jecp.2017.03.017

Lupyan, G., & Winter, B. (2018). “Language is more abstract than you think, or, why aren’t languages more iconic?” Philosophical Transactions of the Royal Society of London. Series B. Biological Sciences, 373(1752), 20170137–20170137. https://doi.org/10.1098/rstb.2017.0137 https://doi.org/10.1098/rstb.2017.0137

Maurer, D., Pathman, T., & Mondloch, C. J. (2006). “The Shape of Boubas: Sound-shape Correspondences in Toddlers and Adults.” Developmental Science, 9(3), 316–322. https://doi.org/10.1111/j.1467-7687.2006.00495.x https://doi.org/10.1111/j.1467-7687.2006.00495.x

Mchitar′jan, G. S. (2016). Grammatičeskij status i funkcionirovanie glagolʹno-meždometnych form v sovremennom russkom jazyke. Pjatigorsk.

Monaghan, P., & Christiansen, M. H. (2006). “Why Form-meaning Mappings Are Not Entirely Arbitrary in Language.” In R. Sun (Ed.), Proceedings of the 28th Annual Conference of the Cognitive Science Society, (pp. 1838–1843).

Monaghan, P., Christiansen, M., & Chater, N. (2007). “The Phonological-distributional Coherence Hypothesis: Cross-linguistic Evidence in Language Acquisition.” Cognitive Psychology, 55(4), 259–305. https://doi.org/10.1016/j.cogpsych.2006.12.001 https://doi.org/10.1016/j.cogpsych.2006.12.001

Monaghan, P., Shillcock, R., Christiansen, M., & Kirby, S. (2014). “How Arbitrary Is Language?” Philosophical Transactions. Biological Sciences, 369(1651), 20130299–20130299. https://doi.org/10.1098/rstb.2013.0299 https://doi.org/10.1098/rstb.2013.0299

Nikitina, T. (2012). “Russian Verboids: A Case Study in Expressive Vocabulary”. Linguistics, 50(2), 165–189. https://doi.org/10.1515/ling-2012-0007 https://doi.org/10.1515/ling-2012-0007

Nuckolls, J. B. (1999). “The Case for Sound Symbolism.” Annual Review of Anthropology, 28(1), 225–252. https://doi.org/10.1146/annurev.anthro.28.1.225 https://doi.org/10.1146/annurev.anthro.28.1.225

Pathak, A., Calvert, G., & Motoki, K. (2020). “Long Vowel Sounds Induce Expectations of Sweet Tastes.” Food Quality and Preference, 86, 104033. https://doi.org/10.1016/j.foodqual.2020.104033 https://doi.org/10.1016/j.foodqual.2020.104033

Perniss, P., & Vigliocco G. (2014). “The Bridge of Iconicity: From a World of Experience to the Experience of Language.” Philosophical Transactions. Biological Sciences, 369 (1654), 20140179. https://doi.org/10.1098/rstb.2013.0300 https://doi.org/10.1098/rstb.2014.0179

Perry, L. K., Perlman, M., & Lupyan, G. (2015). “Iconicity in English and Spanish and Its Relation to Lexical Category and Age of Acquisition.” PloS One, 10(9), e0137147–e0137147. https://doi.org/10.1371/journal.pone.0137147 https://doi.org/10.1371/journal.pone.0137147

Porretta, V., Buchanan, L. & Järvikivi, J. (2020). “When processing costs impact predictive processing: The case of foreign-accented speech and accent experience.” Attention, Perception, & Psychophysics, 82, 1558–1565. https://doi.org/10.3758/s13414-019-01946-7 https://doi.org/10.3758/s13414-019-01946-7

Porretta, V., & Kyröläinen, A.-J. (2019). “Influencing the time and space of lexical competition: The effect of gradient foreign accentedness.” Journal of Experimental Psychology: Learning, Memory, and Cognition, 45(10), 1832–1851. https://doi.org/10.1037/xlm0000674 https://doi.org/10.1037/xlm0000674

Porretta, V., Kyröläinen, A., van Rij, J., & Järvikivi, J. (2016). VWPre: Tools for Preprocessing Visual World Data. Version 1.2.3, updated 2020-03-08, URL https://CRAN.R-project.org/package=VWPre

Prokopovič, E. N. (1969). Stilistika častej reči (glagol'nye slovoformy). Moscow: Prosveŝenie.

R Core Team. (2022). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. Vienna, Austria. URL https://www.R-project.org/

Revill, K. P., Namy, L. L., & Nygaard, L. C. (2018). “Eye Movements Reveal Persistent Sensitivity to Sound Symbolism During Word Learning.” Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(5), 680–698. https://doi.org/10.1037/xlm0000476 https://doi.org/10.1037/xlm0000476

Rhodes, R. (1994). “Aural Images.” In L. Hinton, J. Nichols, & J. Ohala (Eds.), Sound Symbolism, (pp. 276–292). Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511751806.019 https://doi.org/10.1017/CBO9780511751806.019

Šaronov, I. A. (2008). Meždometija v reči, tekste i slovare. Moscow: Izdatel'skij centr Rossijskogo gosudarstvennogo gumanitarnogo universiteta.

Saussure, F. d., Bally, C., Baskin, W., Reidlinger, A., & Sechehaye, A. (1960). Course in General Linguistics. London: Peter Owen. https://doi.org/10.2307/538001 https://doi.org/10.2307/538001

Švedova, N. J., ed. (1980). Grammatika russkogo jazyka. Akademija Nauk SSSR, Moscow.

Thompson, A. L., Akita, K., & Do, Y. (2020). “Iconicity ratings across the Japanese lexicon: A comparative study with English”. Linguistics Vanguard: Multimodal Online Journal, 6(1). https://doi.org/10.1515/lingvan-2019-0088 https://doi.org/10.1515/lingvan-2019-0088

Thompson, R. L., Vinson, D. P., Woll, B., & Vigliocco, G. (2012). “The Road to Language Learning Is Iconic: Evidence from British Sign Language.” Psychological Science, 23(12), 1443–1448. https://doi.org/10.1177/0956797612459763 https://doi.org/10.1177/0956797612459763

van Rij, J., Wieling, M., Baayen, R. H., & van Rijn, H. (2017). itsadug: Interpreting Time Series and Autocorrelated Data Using GAMMs. R package version 2.4. URL https://cran.r-project.org/package=itsadug

Viimaranta, J., & Vihervä, M. (2019). “The Use of Onomatopoeic Interjections in Predicate Function in Russian and Other Languages: A Perspective from the Corpus of Parallel Texts of the Russian National Corpus”. Scando-Slavica, 65(2), 239–262. https://doi.org/10.1080/00806765.2019.1672092 https://doi.org/10.1080/00806765.2019.1672092

Voeltz, F. K. E., & Christa Kilian-Hatz, C. eds. (2001). Ideophones. Amsterdam, Philadelphia: John Benjamins. https://doi.org/10.1075/tsl.44 https://doi.org/10.1075/tsl.44

Wichmann, S., Holman, E. W., & Brown, C. H. (2010). “Sound Symbolism in Basic Vocabulary”. Entropy (Basel, Switzerland), 12(4), 844–858. https://doi.org/10.3390/e12040844 https://doi.org/10.3390/e12040844

Wierzbicka, A. (2003). “Interjections across Cultures”. In A. Wierzbicka (Ed.), Cross-Cultural Pragmatics: The Semantics of Human Interaction, (pp. 285–340). Mouton de Gruyter. https://doi.org/10.1515/9783110220964.285 https://doi.org/10.1515/9783110220964.285

Winter, B., Perlman, B., Perry, L. K. & Lupyan, G. (2017). “Which words are most iconic? Iconicity in English sensory words”. Interaction Studies, 18(3), 430–451. https://doi.org/10.1075/is.18.3.07win https://doi.org/10.1075/is.18.3.07win

Wood, S. N. (2011). “Fast Stable Restricted Maximum Likelihood and Marginal Likelihood Estimation of Semiparametric Generalized Linear Models.” Journal of the Royal Statistical Society, Series B (Statistical Methodology), 73 (1), 3–36. https://doi.org/10.1111/j.1467-9868.2010.00749.x https://doi.org/10.1111/j.1467-9868.2010.00749.x

Xvostunova, T. I. (2000). Funkcionirovanie glagolʹno-meždometnyx form v sovremennom russkom literaturnom jazyke. Saransk.

Downloads

Published

2023-11-30

How to Cite

Häikiö, Tuomo, and Oksana Kanerva. 2023. “Eye movements unveil sensitivity of naïve listeners to iconicity of Russian onomatopoeic words”. Poljarnyj vestnik 26 (November):1-23. https://doi.org/10.7557/6.6880.

Issue

Section

Articles (peer reviewed)