Cross-Channel Adaptation Reveals Shared Emotion Representation From Face and Biological Motion

Emotions in interpersonal interactions can be communicated simultaneously via various social signals such as face and biological motion (BM). Here, we demonstrate that even though BM and face are very different in visual properties, emotions conveyed by these two types of social signals involve dedicated and common processing mechanisms (N = 168, college students, 2020-2024). By utilizing the visual adaptation paradigm, we found that prolonged exposure to the happy BM biased the emotion perception of the subsequently presented morphed BM toward sad, and vice versus. The observed aftereffect disappeared when the BM adaptors were shown inverted, indicating that it arose from emotional information processing rather than being a result of adaptation to constitutive low-level features. Besides, such an aftereffect was also found for facial expressions and similarly vanished when the face adaptors were inverted. Critically, preexposure to emotional faces also exerted an adaptation aftereffect on the emotion perception of BMs. Furthermore, this cross-channel effect could not only happen from faces to BMs but also from BMs to faces, suggesting that emotion perception from face and BM are potentially driven by common underlying neural substrates. Overall, these findings highlighted a close coupling of BM and face emotion perception and suggested the existence of a dedicated emotional representation that can be shared across these two different types of social signals.