AuralSAM2: Enabling SAM2 Hear Through Pyramid Audio-Visual Feature Prompting

Segment Anything Model 2 (SAM2) exhibits strong generalisation for promptable segmentation in video clips; however, its integration with the audio modality remains underexplored. Existing approaches either convert audio into visual prompts (e.g., boxes) via foundation models, or inject adapters into...

Descripción completa

Detalles Bibliográficos

Autores principales:	Liu, Yuyuan, Chen, Yuanhong, Wang, Chong, Han, Junlin, Wu, Junde, Peng, Can, Chen, Jingkun, Tian, Yu, Carneiro, Gustavo
Formato:	Artículo
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition
Acceso en línea:	https://arxiv.org/abs/2506.01015 http://arxiv.org/abs/2506.01015
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!