Poster
in
Affinity Workshop: LatinX in AI
Multimodal Deep Learning for Disaster Classification from Social Media Data in Brazil and Peru
Mariana Risco Cosavalente · Claudio Jung · Sharon C Quispe
Abstract:
This paper compares the performance of pre-trained and fine-tuned Vision-Language Models (SigLIP2 Naflex and SigLIP Multilingual) for classifying disasters in images scraped from social media in Peru and Brazil. While zero-shot inference showed limited results, fine-tuning both models improved performance, with SigLIP2 slightly outperforming the others. The work highlights areas for further improvement in disaster detection models for Latin America.
Chat is not available.
Successful Page Load