Multimodality

DeepCrop🛰️🌾🌽
DeepCrop🛰️🌾🌽

We are creating an AI system for nation-wide agricultural production monitoring based on crowd-sourced and remote-sensing.

Sep 30, 2024

CopernicusLAC🛰️🇪🇺
CopernicusLAC🛰️🇪🇺

Our project is located in Santiago de Chile and operates as a centre dedicated to the storage, processing, and distribution of satellite data of the Copernicus Programme and the provision of services of regional interest for the benefit of all countries in Latin America and the Caribbean (LAC).

Sep 30, 2024

Boosting crop classification by hierarchically fusing satellite, rotational, and contextual data
Boosting crop classification by hierarchically fusing satellite, rotational, and contextual data

This is a new approach to classify crop types using a multimodal hierarchical model combinning satellite data, crop rotation patterns, and local crop distribution. It outperforms existing approaches by leveraging the spatio-temporal context of agricultural parcels, and has shown promising results in cross-country transferability and few-shot learning settings.

Apr 1, 2024

Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness
Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness

TIDA is a new data augmentation method that uses text-to-image generation to create more diverse and realistic training data, helping AI models better understand complex correlations and improve their performance on tasks like gender recognition.

Dec 1, 2023

Opinions in Interactions : New Annotations of the SEMAINE Database
Opinions in Interactions : New Annotations of the SEMAINE Database

We've added new opinion annotations to the SEMAINE dataset, which captures dyadic interactions between humans and virtual agents, resulting in a rich dataset with over 73,000 words and 6 hours of conversation. Our annotations and proposed baseline model using RoBERTa embeddings achieve promising results, with a F1-score of 0.72, making it a valuable resource for opinion detection in human-computer interactions.

Jun 1, 2022