Multimodal VLA

Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation

First to extend Vision-Language-Action (VLA) models to Vision-Sound-Language-Action (VSLA) for manipulation, coupling causal audio memory and flow matching for sound-centric control.