Bimodal Bilingualism

The vast majority of bilingual studies involve two spoken languages. Such “unimodal” bilingualism automatically entails a severe production constraint because one cannot physically produce two spoken words or phrases at the same time. In addition, for unimodal bilinguals both languages are perceived by the same sensory system (audition), whereas for bimodal (speech-sign) bilinguals one language is perceived auditorily and the other is perceived visually. This project investigates how these sensory-motor differences in language modality impact the psycholinguistics of bilingualism, the features of co-speech gesture, and the nature of the bilingual brain. Using behavioral and neuroimaging techniques, we ask the following questions:

• What are the consequences of removing constraints on simultaneous articulation of two languages?
• Do bimodal bilinguals code-switch (alternate between languages)?
• Does bimodal bilingualism affect co-speech gesture?
• How do bimodal bilinguals control sign language production while speaking?
• What is the nature of the bimodal bilingual brain?

Funding

This research is supported by the National Institute of Child Health and Human Development (R01 HD047736).

Recent Publications

• Declerck, M., Meade, G., Midgley, K.J., Holcomb, P. J., Roelofs, A., & Emmorey, K. (2021). Language control in bimodal bilinguals: Evidence from ERPs. Neuropsychologia, vol 161. https://pubmed.ncbi.nlm.nih.gov/34487737/
• Declerck, M., Meade, G., Midgley, K., Holcomb, P., Roelofs, A., & Emmorey, K. (2021). On the connection between language control and executive control – an ERP study. Neurobiology of Language, 2(4), 628-646. https://direct.mit.edu/nol/article/2/4/628/97421/On-the-Connection-Between-Language-Control-and
• Emmorey, K.,Mott, M., Meade, G., Holcomb, P.J., Midgely, K.J. (2020). Lexical selection in bimodal bilinguals: ERP evidence from picture-word interference. Language, Cognition and Neuroscience, 36 (7), 840-853.  https://pubmed.ncbi.nlm.nih.gov/34485589/
• Emmorey, K., Li, C., Petrich, J., & Gollan, T. H. (2020). Turning languages on and off: Switching into and out of code-blends reveals the nature of bilingual language control. Journal of Experimental Psychology: Learning, Memory and Cognition, 46(3), 443-454. PMCID: PMC6933100 http://dx.doi.org/10.1037/xlm0000734
• Lee, B., Meade, G., Midgley, K. J., Holcomb, P.J., & Emmorey, K. (2019). ERP evidence for co-activation of English words during recognition of American Sign Language signs. Brain Sciences, 9, 148. PMCID: PMC6627215 https://doi.org/10.3390/brainsci9060148
• Mott, M., Midgley, K.J., Holcomb, P.J., & Emmorey, K. (2020). Cross-modal translation priming and iconicity effects in deaf signers and hearing learners of American Sign Language. Bilingualism: Language and Cognition. PMCID: PMC pending https://doi.org/10.1017/S1366728919000889
• Müller de Quadros, R., Davidson, K., Lillo-Martin, D., & Emmorey, K. (2020). Code-blending with depicting signs. Linguistic Approaches to Bilingualism, 10(2), 290–308. PMCID: PMC pending https://doi.org/10.1075/lab.17043.qua
• Schaller, F., Lee, B., Sehyr, Z.S., O’Grady Farnady, L., & Emmorey, K. (2020). Cross-linguistic metaphor priming in ASL-English bilinguals: Effects of the Double Mapping Constraint. Sign languages & Linguistics, 23, 95-110. https://doi.org/10.1075/sll.00045.sch
• Weisberg, J., Casey, S., Sehyr, Z.S., & Emmorey, K. (2019). Second language acquisition of American Sign Language influences co-speech gesture production. Bilingualism: Language and Cognition. PMCID: PMC739222    https://doi.org/10.1017/S1366728919000208
• Emmorey, K. (2018). Variation in L1 acquisition? Commentary on R.I. Mayberry and R. Kluender “Rethinking the critical period for language: New insights into an old question from American Sign Language.” Bilingualism: Language and Cognition.

older publications >>

Recent Presentations

• Emmorey, K.(2022). Bimodal bilinguals provide insights into the nature of language control. Paper presented at the Society of Experimental Psychologists, May, Chicago, IL.
• Emmorey, K.(2021). Bimodal bilingualism, deafness, and aging. Invited presentation at the National Institute on Aging virtual workshop “Bilingualism and Cognitive Reserve and Resilience”. March, Virtual meeting.
• Declerck, M., Meade, G., Midgley, K.J., Holcomb, P.J., Roelofs, A., & Emmorey, K. (2020). Domain general language control? An ERP study with bimodal bilinguals. Poster presented at AMLap, September, Virtual meeting.
• Mott, M., Midgley, K., Holcomb, P., Meade, G., & Emmorey, K. (2017). Picture-word interference in bimodal bilinguals. Poster presented at the Society for the Neurobiology of Language, November, Baltimore, MD.
• Mott, M., Midgley, K., Emmorey, K., & Holcomb, P. (2017). Effects of iconicity on cross-modal translation priming in hearing learners of American Sign Language and deaf native signers: An ERP study. Poster presented at the Cognitive Neuroscience Society meeting, March, San Francisco, CA.
• Muller de Quadros, R., Lillo-Martin, D., Polinsky, M., & Emmorey, K. (2016). Heritage signers: Bimodal bilingual structures. Paper presented at the Generative Approaches to Language Acquisition North America (GALANA), October, Urbana-Champaign, IL.
• Mott, M., Meade, G., Winsler, K., Campbell, S., Midgley, K., Emmorey, K., & Holcomb, P. (2016). An electrophysiological study of initial American Sign Language acquisition in adult learners. Poster presented at the Cognitive Neuroscience Society, April, New York, New York.
• Silance, N., Giezen, M., & Emmorey, K., (2015). Cross-language semantic interference effects during picture naming in bimodal bilinguals. San Diego State University Student Research Symposium, March, San Diego, California. (pdf)
• Emmorey, K., Petrich, J., & Gollan, T. (2014). Evidence from bimodal bilinguals indicates “turning a language ON” is not costly, but “turning a language OFF” is. Paper presented at the Psychonomic Society Meeting, November, Long Beach, California.

older presentations>>