top of page

Our Research

Interaction between history, social context, and action patterns

Most of our projects are centered around furthering our understanding on how agents’ histories (e.g. having been diagnosed with a disorder, meeting a participant in the laboratory setting versus completing studies with a friend, having gone through a global pandemic) affect the unfolding patterns of action and task performance in varying situations. More recently, we have also started considering situations in which there is human-AI interaction, so including an artificial agent in an interaction. 

Current Projects

How contextual constraints affect conversations

The lab is interested in exploring how conversations are affected by different contextual constraints. We are interested in better understanding these effects multi-modally, starting with interpersonal coordination, acoustic patterns and language dynamics. So far we have focused on bodily interpersonal coordination and language dynamics. 

Our initial study took place during the COVID-19 pandemic and showed that participants (contrary to our prediction) coordinated their bodily movement more during argumentative conversations had over Zoom. To better understand this phenomenon, we are currently conducting data collection to test some of our new hypothesis and the plan to complete the collection of data by May 2026. 

Related Publications

  • *Fan, C., Romero, V., Paxton, A. & Chowdhury, T. (2024). Towards Multimodality: Comparing Quantifications of Movement Coordination. Proceedings of the 26th ACM International Conference on Multimodal Interaction (ICMI).

  • Romero, V. & Paxton, A. (2023). Stage 2: Visual information and communication context as modulators of interpersonal coordination in face-to-face and videoconference-based interactions. Acta Psychologica, 239, 103992. https://doi.org/10.1016/j.actpsy.2023.103992 

  • Romero, V., Chowdhury, T., & Paxton, A. (2023). Language in the Time of COVID: Sensitivity of Linguistic Alignment to Conversation Type and Communication Modality. Proceedings of the Annual Meeting of the Cognitive Science Society, 45(45). Guadalajara, Mexico. https://escholarship.org/uc/item/2hq658w1 

  • Romero, V. & Paxton A. (2021). Registered Report: Stage 1: Visual Information and Communication Context as Modulators of Interpersonal Coordination in Face-to-Face and Videoconference-Based Interactions. Acta Psychologica, 221, 103453. https://doi.org/10.1016/j.actpsy.2021.103453

How social factors affect our actions during interactions

We often observe individuals expertly coordinating their bodily movements with other individuals around them. Whether crossing a road with a group of individuals at a cross-walk, moving a table and chairs with friends or family, or shaking hands with a colleague, individuals frequently perform social behavioral coordination in a robust and flexible manner, with seemingly little or no effort. A central question in the study of joint action and social coordination concerns how the observed movements of other individuals and objects in the environment influence the production of one’s own actions. While several researchers have theorized that such phenomena are the result of the pre-motor cortex representing action execution and observation simultaneously and in a common code, known as the motor contagion account, I argue that the dynamic patterns of coordination that exist between produced and observed movements naturally arise from holistic interactions between the neural, biomechanical, and perceptual subsystems of the agents and the agents’ environment. My research has focused on the interpersonal coordination that arises between agents while performing different tasks. This work, in general has demonstrated that co-acting individuals can become temporarily organized to form acting systems, and that therefore we should study behaviors happening in social situations at the level of the co-acting system, rather than the individuals separately. 
 

My first semester teaching at Colby I taught my Human Movement seminar plus collaborative research course and had one group of students who were interested in investigating how a person’s emotional state might affect interpersonal coordination. This was a well-designed project spear-headed by a hard-working group of students. We discovered a complex relationship between emotion, liking and interpersonal coordination. One of the students, Margaret Hall ’20, reached out to me once she had graduated and we decided the project was interesting enough to polish the paper and try to get it published. We were successful in getting it to publication. I like to highlight this particular study because it is the first time I am lucky enough to get a student motivated to see the whole process through and it was a very rewarding experience. 
 

The second project stemming from the seminar that I would like to highlight is one that was part of the fall of 2021. Students in this course are often interested in how athleticism or being part of a sport team affects coordination abilities and influences the level of interpersonal coordination they might be able to achieve. One group of students studied how interpersonal coordination was affected by whether participants were part of a varsity team sport, an individual sport, or no varsity membership at all. Interestingly, they found that participants who play in a team varsity sport showed significantly more interpersonal coordination while rocking chairs next to another team varsity player than individual varsity athletes and non-athletes. There was no significant difference in level of interpersonal coordination for individual varsity athletes and non-athletes. This was an interesting finding, since we expected that any athlete would show an enhanced level of interpersonal coordination. However, upon closer inspection, we realized that all the team varsity athlete pairs were comprised of team-mates, which is a big confound. This group of students – Eliza Dean ’22, Katharine Dougherty ’22, and Javon Williams ’23 – were so interested in the project that we are currently collecting more data to actually answer a more complex question. We have decided to dig deeper and try to untangle the athletic aspects from the social connections that might be forged by belonging to the same team or being close friends. We are still collecting data for this project with the hope of completing data collection by the end of spring semester 2026.

​

​

Related Publications

  • *Hall, M. & Romero, V. (2021). Emotion in Motion: Investigating the Relationship between Interpersonal Motor Coordination and Emotional States. Modern Psychological Studies, 27, 1, Article 8. https://scholar.utc.edu/mps/vol27/iss1/8/

  • Romero, V., Amaral, J., Fitzpatrick, P., Schmidt, R. C., Duncan, A., & Richardson, M. J. (2016). Can low-cost motion tracking systems substitute a Polhemus system when researching social motor coordination in children?. Behavior Research Methods. , 1-14. DOI 10.3758/s13428-016-0733-1

  • Romero, V., Kallen, R., Riley, M. A., & Richardson, M. J. (2015). Can discrete joint action be synergistic? Studying the stabilization of interpersonal hand coordination. Journal of Experimental Psychology Human Perception and Performance, 41(5), 1223-1235.

  • Washburn, A., Coey, C. A., Romero, V., Malone, M., & Richardson, M. J. (2015). Interaction of intention and environmental constraints on the fractal dynamics of human performance. Cognitive Processing. DOI:10.1007/s10339-015-0652-6.

  • Washburn, A., Coey, C. A., Romero, V. & Richardson, M. J. (2014). Visual Multifrequency Entrainment: Can 1:2, 2:3, and 3:4 Coordination Occur Spontaneously? Journal of Motor Behavior, 46(4), 247-257. https://doi.org/10.1080/00222895.2014.893980

  • Romero, V., Coey, C. A., Schmidt, R. C., & Richardson, M. J. (2012). Movement Coordination or Movement Interference: Visual Tracking and Spontaneous Coordination Modulate Rhythmic Movement Interference. PLoS ONE.  https://doi.org/10.1371/journal.pone.0044761

How Autism affects social interaction and cognition

Children with autism spectrum disorder (ASD) exhibit impairments in social interactions that last throughout their lives. These impairments can severely impede learning and overall social functioning at home and in school, as well as make successful treatment difficult. We study these impairments using a dynamical systems, ecological psychology perspective. 

We strive to improve diagnostic as well as treatment options that already exist to include quantitative, time-evolving behavioral data. Currently, I am focusing on gaining a deeper understanding of the patterns observed in social communication in children with and without autism by using deep machine learning techniques. These new mathematical tools have the potential to unveil those aspects that lead to uncomfortable social interactions with children with ASD. Eventually, the goal would be for us to collaborate with clinical psychologists on advancing and utilizing the new non-linear methods and computational skills I explore during their day-to-day diagnostic routines as well as designing intervention programs informed by the results of these projects.

Related Publications

  • Chowdhury, T. & Romero, V. (2025). Can We Trust Machine Learning? The Reliability of Features from Open-Source Speech Analysis Tools for Behavioral Modeling. Proceedings of the 26th edition of the Interspeech Conference.  https://doi.org/10.48550/arXiv.2506.11072

  • Chowdhury, T., Romero, V. & Stent, A. (2023). Interactional coordination between conversation partners with autism using non-verbal cues in dialogues. Proceedings of the 24th Meeting of the Special Interest Group on Discourse and Dialogue (SIGdial).

  • Chowdhury, T., Romero, V. & Stent, A. (2023). Parameter Selection for Analyzing Conversations with Autism Spectrum Disorder. Proceedings of Interspeech23.

  • Lampi, A., Fitzpatrick, P., Romero, V., Amaral, J., & Schmidt, R. C. (2018). Understanding the influence of social and motor context on the co-occurring frequency of restrictive and repetitive behaviors in Autism. Journal of Autism and Developmental Disorders, 50(5), 1479-1496. https://doi.org/10.1007/s10803-018-3698-3

  • Romero, V., Fitzpatrick, P., *Roulier, S., Duncan, A., Richardson, J. M., & Schmidt, R. C., (2018). Evidence of embodied social competence during conversation in children with autism spectrum disorder. PLoS ONE, 13(3): e0193906.  https://doi.org/10.1371/journal.pone.0193906

  • Romero, V. (2017). Computational Measurement of Social Communication Dynamics in Children with Autism Spectrum Disorder (Document No. ucin1505206539146785) [Doctoral dissertation, University of Cincinnati]. OhioLINK. http://rave.ohiolink.edu/etdc/view?acc_num=ucin1505206539146785

  • Fitzpatrick, P., Romero, V., Amaral, J., Duncan, A., Barnard, H., Richardson, M. J., & Schmidt, R. C., (2017). Social motor synchronization: Insights for understanding social behavior in autism. Journal of Autism and Developmental Disorders, 47(7), 2092-2107. https://doi.org/10.1007/s10803-017-3124-2

  • Fitzpatrick, P., Romero, V., Amaral, J., Duncan, A., Barnard, H., Richardson, M. J., & Schmidt, R. C., (2017). Evaluating the importance of social motor synchronization and motor skills for understanding autism. Autism Research, 10(10), 1687-1699.  https://doi.org/10.1002/aur.1808

  • Amaral, J. L., Romero, V., Kloos, H., & Richardson, M. J. (2017). Complexity and autism spectrum disorder: Exploring hysteresis in a grasping task. AIMS Medical Science, 4(1), 113-130. https://doi.org/10.3934/medsci.2017.1.113

  • Romero, V., Fitzpatrick, P., Schmidt, R. C. & Richardson, M. J. (2016). Using cross-recurrence quantification analysis to understand social motor coordination in children with autism spectrum disorder. In C. L. Webber, Jr., C. Ioana & N. Marwan (Eds.), Recurrence Plots and Their Quantifications: Expanding Horizons. New York, NY: Springer.

Under development: Trustworthy Human-AI Interaction

The goal of this project is to study how interfaces beyond the current “chatbot” affect instructability and trust. Specifically, the project will investigate the integration of cognitively informed and multimodal signals such as facial expressions, eye gaze, gesture, posture, and tone of voice into human-AI interaction. Proposed learning algorithms and interfaces will be evaluated in terms of their ability to influence human trust levels toward correctly calibrated trust.

Related Publications

  • In prep

Under Development: How dance affects personality and relationships 

This line of questioning has been simmering for a while. It comes from working with several RAs that were interested in dance and marrying that with our research understanding of interpersonal coordination. 

Currently, I am in conversations with two other Colby Professors: Ben Baker (in Philosophy) and Matthew Cumbie (in Performance, Theater and Dance) on ways in which we could combine our different lines of research in a meaningful way.

Related Publications

© 2023 by Odam Lviran. Proudly created with Wix.com.

  • facebook-square
  • Flickr Black Square
  • Twitter Square
  • Pinterest Black Square
bottom of page