Construction of Shared Semantic Spaces through Gestures in Interpreter-Mediated Psychotherapy Sessions

Authors

DOI:

https://doi.org/10.37467/gkarevvisual.v9.2933

Keywords:

Public Service Interpreting, Gesture Studies, Iconic Gestures, Multimodal Corpus

Abstract

Gestures are an inherent part of all face-to-face interactions. Nevertheless, their role in interpreter-mediated events has so far been marginalized in the field of interpreting studies. Based on a multimodal corpus of interactions in child psychiatry with migrant patients, this research focuses on the use of iconic gestures, their role in bridging the linguistic gap and in performing cultural mediation. The results of the study suggest that gestures play a part in the construction of shared semantic spaces and act as a marker of interpreting fidelity, hence, becoming corner stones in the trust-building process between the migrant patients and the public service interpreters.

Downloads

Download data is not yet available.

References

Adam, C. (2011). Gestures in Simultaneous Interpreting. A Descriptive Study. Paper presented at the International Federation of Translators (pp. August 1-4). XIX World Congress.

Andrén, M. (2010). Children’s Gestures between 18 and 30 months [PhD Thesis]. Lund University.

Angelelli, C. V. (2001). Deconstructiong the invisible interpreter. A critical study of the interpersonal role of the interpreter in a cross-cultural/linguistic communication event [PhD dissertation]. Stanford University.

Angelelli, C. V. (2004). Medical Interpreting and Cross-cultural Communication. Cambridge Univesrity Press. DOI: https://doi.org/10.1017/CBO9780511486616

Angelelli, C. V. (2008). The Role of the Interpreter in the Healthcare Setting, A plea for a dialogue between research and practice. In C. Valero Garcés, & A. Martin (Eds.), Crossing Boraders in Community Interpreting, Definitions and Dilemmas (pp. 147-163). John Benjamins Publishing. DOI: https://doi.org/10.1075/btl.76.08ang

Angelelli, C. V. (2019). Healthcare Interpreting Explained. Routledge. DOI: https://doi.org/10.4324/9781315310978

Auer, E., Russel, A., Sloetjes, H., & Wittenburg, P. (2010). ELAN as flexible annotation framework for sound and image processing detectors. In N. Calzolari, B. Maegaard, J. Mariani, J. Odjik, S. Choukri, & S. Piperdis, Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) (pp. 890-893). European Language Resources Association (ELRA).

Aussems, S., & Kita, S. (2017). Seeing Iconic Gestures While Encoding Events Facilitates Children's Memory of These Events. Child Development, 90(4), 1123-1137. DOI: https://doi.org/10.1111/cdev.12988

Baigorri-Jalón, J. (2014). From Paris to Nuremberg: The birth of conference interpreting. John Benjamins Publishing. DOI: https://doi.org/10.1075/btl.111

Baker-Shenk, C. (1991). The interpreter: machine, advocate, or ally? In J. Plant-Moeller, Expanding Horizons: Proceedings of the 1991 RID Convention (pp. 124-140). RID.

Baraldi, C. (2015). An Interactional Perspective on Interpreting as Mediation. Lingue Culture Mediazioni - Languages Cultures Mediation (LCM Journal), 1, 17-36. DOI: https://doi.org/10.7358/lcm-2014-0102-bara

Benayoun, J.-M. (2014). Interprétation-médiation, nomination et perspectives praxématiques. In J.-M. Benayoun, & E. Navarro, Interprétation et médiation. Deux objets pour un concept pluriel (pp. 17-27). Michel Houdiard Editeur.

Boll, F. (2016). Gestural alignment in consecutive interpreting. Proceedings of ISGS Conference 2016

Gesture, Creativity, Multimodality.

Bot, H. (2005). Dialogue Interpreting in Mental Health. Rodopi. DOI: https://doi.org/10.1163/9789004458574

Bouvet, D. (1997). Le corps et la métaphore dans les langues gestuelles. A la recherche des modes de production des signes. L'Hartmann.

Brookes, H. (2014). Gesture and taboo: A cross-cultural prespective. In C. Müller, A. Cienki, E. Fricke, S. Ladewig, D. McNeill, & S. Tessendorf, Body - Language - Communication (Vol. 2, pp. 1523-1530). Walter de Gruyter.

Brookes, H. J. (2011). Amangama amathathu "The three letters". The emergence of a quotable gesture (emblem). Gesture, 11(2), 194-2018. DOI: https://doi.org/10.1075/gest.11.2.05bro

Brugman, H., & Russel, A. (2009). Annotating Multimedia / Multimodal resources with ELAN. In M. T. Lino, M. F. Xavier, F. Ferreira, R. Costa, & R. Silva (Eds.), Proceedings of the Fourth International Conference on Language Resources and Evaluation. European Language Resources Association (ELRA)

Bühler, H. (1986). Linguistic (semantic) and extra-linguistic (pragmatic) criteria for the evaluation of conference interpretation and interpreters. Multilingua, 5(4), 232- 235.

Burridge, K. (2006). Taboo, euphemise, and political correctness. In K. Brown, Encyclopedia of Language and Linguistics (Vol. 12, pp. 455-462). Elsevier. DOI: https://doi.org/10.1016/B0-08-044854-2/01092-0

Cartmill, E. A., Armstrong, B. F., Gleitman, L. R., Goldin-Meadow, S., Medina, T. N., & Trueswell, J. C. (2013). Quality of early parent input predicts child vocabulary 3 years later. Proceedings of the National Academy of Sciences of the United States of America, 110(28), pp. 11278-83. DOI: https://doi.org/10.1073/pnas.1309518110

Cheung, A. (2013). Non-native accents and simultaneous interpreting quality perceptions. Interpreting, 15(1), 25-47. DOI: https://doi.org/10.1075/intp.15.1.02che

Childers, T. L. (1985). Measurement of individual differences in visual versus verbal information processing. Journal of Consumer Research, 12(2), 125–134. DOI: https://doi.org/10.1086/208501

Chwalczuk, M. (2019). Gestural portray of the public service interpreter: strategies of coping with source messages’ nonverbal cues. Poster presented at Gesture and Speech in Interaction - GESPIN 2019 (pp. 11-13 September). Universität Paderborn.

Chwalczuk, M. (2019). When gestures speak louder than words: The role of gestures in community interpreting events. In I. Cobos López, Estudios sobre traducción e interpretación. Especialización, didactica y nuevas lineas de investigación (pp. 471-490). Tirant humanidades.

Chwalczuk, M. (2020, in press). Négociation de l’espace sémantique et co-construction du sens en interprétation-médiation. Vers une analyse multimodale des interactions en service public. In J.-M. Benayoun, & E. Navarro, InterCulturel. La culture dans tous ses E(é)tats.

Clifford, A. (2004). Is Fidelity Ethical? The Social Role of the Healthcare Interpreter. TTR: traduction, terminologie, rédaction, 17(2), 89-114. DOI: https://doi.org/10.7202/013273ar

Collados Aís, Á., Férnadez-Sánchez, M. M., & Manuel Jerez, J. (2001). La interpretación bilateral: características, situaciones comunicativas y modalidades. In A. Collados Aís, & M. M. Férnadez-Sánchez, Manual de interpretación bilateral (pp. 61-77). Comares.

Colletta, J.-M. (2015). Gestur and Language Development: towards a unified theoretical framework. In G. Ferré, & M. Tutton, Gesture and Speech in Interaction - 4th edition (GESPIN 4).

Cook, S. W., & Goldin-Meadow, S. (2006). The role of gesture in learning: Do children use their hands to change their minds? Journal of Cognition and Development, 7(2), 211-232. DOI: https://doi.org/10.1207/s15327647jcd0702_4

Cosnier, J., & Vaysse, J. (1997). Sémiotique des gestes communicatifs. Nouveaux actes sémiotiques, 52, pp. 7-28.

Diriker, E. (1999). Problematizing the Discourse on Interpreting – A Quest for Norms in Simultaneous Interpreting. TextConText, 13, 73-90.

Ducharme, R., & Fraisse, P. (1965). Etude genetique de la memorisation de mots et d’images. Canadian Journal of Psychology, 19(3), 253–261. DOI: https://doi.org/10.1037/h0082907

Ekman, P., & Friesen, W. V. (1969). The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica, 49-98. DOI: https://doi.org/10.1515/semi.1969.1.1.49

Fortis, J.-M. (2018). Prototype theory: On the origins of a theoretical patchwork and its transfer to linguistics. In V. Arigne, & C. Rocq-Migette, Theorization and representations in linguistics (pp. 168-216). Cambridge Scholars Publishing.

Freed, B. (2000). Is fluency, like beauty, in the eyes (and ears) of the beholder. In A. Arbor, & H. Riggenbach, Perspectives on Fluency (pp. 243-265). University of Michigan Press.

Galhano-Rodrigues, I. (2007). Body in interpretation. Nonverbal communication of speaker and interpreter and its relation to words and prosody. In P. Schmitt, & H. Jüngst, Translationqualität. Leipziger Studien zur angewandten Linguistik und Translaktologie (pp. 739-753). Peter Lang Verlag.

Galhano-Rodrigues, I., Zagar Galvão, E., & Cruz-Santos, A. (2019). Recent Perspectives on Gesture and Multimodality. Cambridge Scholars Publishing.

Gile, D. (1995). Regards sur la recherche en interprétation de conférence. Presses universitaires de Lille.

Gile, D. (1999). Variability in the perception of fidelity in simultaneous interpretation. Hermes, Journal of Linguistics, 22, 51-79. DOI: https://doi.org/10.7146/hjlcb.v12i22.25493

Gile, D. (2009). Basic Concepts and Models fot Interpreter and Translator Training. John Benjamins. DOI: https://doi.org/10.1075/btl.8

Gile, D. (2010). Rôles d'interprètes. In Les pratiques de l'interprétation et l'oralité dans la communication interculturelle (pp. 45-56). L'Age d'Homme.

Gillespie, M., James, A. N., Federmeier, K. D., & Watson, D. G. (2014). Verbal working memory predicts co-speech gesture: evidence from individual differences. Cognition, 132(2), 174-180. DOI: https://doi.org/10.1016/j.cognition.2014.03.012

Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001). Explaining math: gesturing lightens the load. Psychological Science, 12(6), 516-522. DOI: https://doi.org/10.1111/1467-9280.00395

Grever, D. (1969). The effects of source language presentation rate on the performance of simultaneous conference interpreters. In E. Foulce, Proceedings of the 2nd Louisville Conference on Rate and/or Frequency Controlled Speech (pp. 162-184). University of Louisville.

Harris, B. (1990). Norms in interpretation. Target, 2(1), 215-219. DOI: https://doi.org/10.1075/target.2.1.08har

Holler, J. (2005). On the pragmatics of multi-modal face-to-face communication: Gesture, speech and gaze in the coordination of mental states and social interaction. In G. Ferré, & T. Mark, Gesture and Speech in Interaction - 4th edition (GESPIN 4) (pp. 17-19).

Holler, J., & Beattie, G. (2003). Pragmatic aspects of representational gestures: Do speakers use them to clarify verbal ambiguity for the listener? Gesture, 3(2), 127-154. DOI: https://doi.org/10.1075/gest.3.2.02hol

Holler, J., & Wilkin, K. (2011). Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35(2), 133-153. DOI: https://doi.org/10.1007/s10919-011-0105-6

Kendon, A. (2004). Gesture. Visible Action as Utterance. University of Pennsylvania Press. DOI: https://doi.org/10.1017/CBO9780511807572

Khaneman, D. (2012). Thinking, Fast and Slow. Farrar, Straus and Giroux.

Kiat, J. E., & Belli, R. F. (2018). The role of individual differences in visualverbal information processing preferences in visualverbal source monitoring. Journal of Cognitive Psychology, 30(1), 701-709. DOI: https://doi.org/10.1080/20445911.2018.1509865

Knapp-Potthoff, A., & Knapp, K. (1987). The man (or woman) in the middle: Discoursal aspects of non-professional interpreting. In K. Knapp, & W. Enninger, Analyzing intercultural communication (pp. 181-211). Mouton. DOI: https://doi.org/10.1515/9783110874280

Kopczyński, A. (1994). Quality in conference interpreting. Some pragmatic problems. In M. Snell-Hornby, F. Pöchhacker, & K. Kaindl, Translation Studies: An Interdiscipline: Selected papers from the Translation Studies Congress, Vienna, 1992 (pp. 189-203). John Benjamins Publishing. DOI: https://doi.org/10.1075/btl.2.24kop

Krystallidou, D. (2017). Non-verbals in dialogue interpreter education: Improving student interpreters’ visual literacy and raising awareness of its impact on interpreting performance. In L. Cirillo, & N. Niemants, Teaching Dialogue Interpreting: Research-based proposals for higher education (pp. 259-274). John Benjamins Publishing. DOI: https://doi.org/10.1075/btl.138.13kry

Krystallidou, D. (2020). Going video: Understanding interpreter-mediated clinical communication through the video lens. In H. Salaets, & G. Brône, Linking up with Video: Perspectives on interpreting practice and research (pp. 181-202). John Benjamins Translation Library. DOI: https://doi.org/10.1075/btl.149.08kry

Kübler, N. (2014). Mettre en oeuvre la linguistique de corpus à l'université. Vers une compétence utile pour l'enseignement/apprentissage des langues ? Retrieved from Recherches en didactique des langues et des cultures: [En ligne] consulté le 18 avril 2020. http://journals.openedition.org/rdlc/1685 DOI: https://doi.org/10.4000/rdlc.1685

Kübler, N. (2015). La linguistique de corpus, un futur de la traduction pragmatique ? Meta, 60(5), 351–351. DOI: https://doi.org/10.7202/1032902ar

Kurz, I., & Basel, E. (2009). The impact of non-native English on Information transfer in SI. Forum, 7(2), 187-212. DOI: https://doi.org/10.1075/forum.7.2.08kur

Ladmiral, J.-R. (2010). Le concept d'interprétation et l'oralité dans la communication interculturelle. In Les pratiques de l'interprétation et l'oralité dans la communication interculturelle (pp. 9-20). L'Age d'Homme.

Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, 41(3), 841-849. DOI: https://doi.org/10.3758/BRM.41.3.841

Lausberg, H., Zaidel, E., Cruz, R. F., & Ptitoe, A. (2007). Speech-independent production of communicative gestures: Evidence from patients with complete callosal disconnection. Neuropsychologia, 45(13), 3092-3104. DOI: https://doi.org/10.1016/j.neuropsychologia.2007.05.010

Lederer, M. (2010). Pratiques d'interprétation différentes - même processus de base? In Les pratiques de l'interprétation et l'oralité dans la communication interculturelle (pp. 33-44). L'Age d'Homme.

McNeill, D. (1992). Hand and Mind: What gestures reveal about thought. University of Chicago Press.

Mead, P. (2005). Methodological issues in the study of interpreters’ fluency. The Interpreters’ Newsletter, 13, 39-63.

Mikkelson, H., & Jourdenais, R. (2015). The Routledge Handbook of Interpreting. Routledge. DOI: https://doi.org/10.4324/9781315745381

Miletich, M. (2015). Accounting for nonverbal communication in interpreter-mediated events in healthcare settings. In Translation and translanguaging in Multilingual Contexts (Vol. 2, pp. 162-181). John Benjamins. DOI: https://doi.org/10.1075/ttmc.1.2.02mil

Napoli, D. J., & Hoeksema, J. (2009). The grammatical versatility of taboo terms. Studies in Language, 33(3), 612-643. DOI: https://doi.org/10.1075/sl.33.3.04nap

Navarro, E. (2013). L'interprétation-médiation. Approche sociolinguistique et perspectives traductologiques [Thèse de doctorat]. Université Paris Diderot.

Navarro, E., & Benayoun, J.-M. (2015). Interprétation et médiation. Migrations, représentations et enjeux socioréférentiels. Michel Houdiard Editeur.

Navarro, E., & Benayoun, J.-M. (2016). Interprétation-médiation: Une étude pragmatique de la désignation d'un nouveau métier. In P. M. Phillips-Batoma, & F. Xiangyun Zhang, Translation As Innovation. Bridging the Sciences and the Humanities (pp. 169-186). Dalkey Archive Press.

Novack, M. A., Goldin-Meadow, S., & Woodward, A. L. (2015). Learning from gesture: How early does it happen? Cognition, 142, 138–147. DOI: https://doi.org/10.1016/j.cognition.2015.05.018

Paivo, A. (1969). Mental imagery in associative learning and memory. Psychological Review, 76(3), 241 263. DOI: https://doi.org/10.1037/h0027272

Pöchhacker, F. (2008). Interpreting as Mediation. In Crossing Boarders in Community Interpreting, Definitions and Dilemmas (pp. 9-26). John Benjamins Publishing. DOI: https://doi.org/10.1075/btl.76.02poc

Pöchhacker, F. (2015). Routledge Encyclopedia of Interpreting Studies. Routledge. DOI: https://doi.org/10.4324/9781315678467

Pöchhacker, F. (2020). "Going video": Mediality and multimodality in interpreting. In H. Salaets, & G. Brône, Linking up with Video: Perspectives on interpreting practice and research (pp. 13-46). John Benjamins Publishing Company. DOI: https://doi.org/10.1075/btl.149.02poc

Poyatos, F. (1987). Nonverbal Communication in Simultaneous and Consecutive Interpretation: A Theoretical Model and New Perspectives. TextConText, 2(2/3), 73-108.

Poyatos, F. (1997). Nonverbal communication and translation: New perspectives and challenges in literature, interpretation and the media. John Benjamins. DOI: https://doi.org/10.1075/btl.17

Pradas Macías, M. (2006). Probing quality criteria in simultaneous interpreting. The role of silent pauses in fluency. Interpreting, 8(1), 25-43. DOI: https://doi.org/10.1075/intp.8.1.03pra

Rennert, S. (2008). Visual Input in Simultaneous Interpreting. Meta: Translators' Journal, 53(1), 204-217. DOI: https://doi.org/10.7202/017983ar

Rohlfing, K., Loehr, D., Duncan, S., Brown, A., Franklin, A., Kimbara, I., et al. (2006). Comparison of multimodal annotation tools. Gesprachsforschung, 7, pp. 99-123.

Rowbotham, S., Holler, J., Lloyd, D., & Wearden, A. (2011). How Do We Communicate About Pain? A Systematic Analysis of the Semantic Contribution of Co-speech Gestures in Pain-focused Conversations. Journal of Nonverbal Behavior, 36(1), 1-21. DOI: https://doi.org/10.1007/s10919-011-0122-5

Rowbotham, S., Holler, J., Lloyd, D., & Wearden, A. (2013). Handling pain: The semantic interplay of speech and co-speech hand gestures in the description of pain sensations. Speech Commun, 57, 244-256. DOI: https://doi.org/10.1016/j.specom.2013.04.002

Salaets, H., & Brône, G. (2020). Linking up with Video: Perspectives on interpreting practice and research. John Benjamins Publishing Company. DOI: https://doi.org/10.1075/btl.149

Seleskovitch, D., & Lederer, M. (2001). Interpréter pour traduire. Didier Erudition.

Shlesinger, M. (1994). Intonation in the production and perception of simultaneous interpretation. In S. Lambert, & B. Moser-Mercer, Bridging the Gap: Empirical Research in Simultaneous Interpretation (pp. 225-236). John Benjamins. DOI: https://doi.org/10.1075/btl.3.17shl

Tryuk, M. (2004). L’interprétation communautaire. Des normes et des rôles dans l’interprétation. Warszawa, TEPSIS.

Zagar Galvao, E. (2020). Gesture functions and gestural style in simultaneous interpreting. In H. Salaets, & G. Brône, Linking up with Video: Perspectives on interpreting practice and research (pp. 151-180). John Benjamins Publishing Company. DOI: https://doi.org/10.1075/btl.149.07gal

Downloads

Published

2022-05-12

How to Cite

Chwalczuk, M. (2022). Construction of Shared Semantic Spaces through Gestures in Interpreter-Mediated Psychotherapy Sessions. VISUAL REVIEW. International Visual Culture Review Revista Internacional De Cultura Visual, 9(2), 207–221. https://doi.org/10.37467/gkarevvisual.v9.2933

Issue

Section

Research articles