Research Paper Presents Tri-Modal Cross-Attention Model for Sentiment Analysis

A research paper published on 3 June 2026 describes a tri-modal cross-attention architecture with adaptive gating for multimodal sentiment analysis. The framework processes textual, acoustic, and visual signals to infer human emotions. The model introduces a Tri-modal cross-attention module intended to capture interactions among the three modalities.

It also incorporates dynamic gating mechanisms to address modality imbalance and noisy signals.

The approach was evaluated on CMU-MOSI, CMU-MOSEI, and SIMS. On CMU-MOSI the model recorded 85.6 percent accuracy and an 85.2 F1-score, exceeding several existing multimodal sentiment analysis models. Comparable gains were reported on the remaining two datasets.

Ablation studies indicated that each component contributed to the observed performance. The paper states that combining cross-modal attention with adaptive gating supports more robust sentiment prediction across heterogeneous inputs.