.png){kind=icon}
.png){kind=icon}
Return
Dual-granularity multi-instance multi-label learning with variational autoencoder
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2025.113317.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Multi-instance multi-label learning (MIML) is a weakly supervised approach that models relationships between complex objects and multiple labels, where each object is represented as a bag of instances. A key advantage of MIML is its ability to perform both bag-level and instance-level multi-label predictions, relying solely on bag-level labels. However, a significant performance gap persists between instance-level MIML algorithms and fully supervised learning approaches due to the lack of instance-level labels. Existing MIML algorithms address this challenge by treating bag labels as ambiguous and attempting to reduce supervision imprecision. Moreover, they often assume that instances are independent and identically distributed (i.i.d.) and rely on prior knowledge to learn label correlations, which is impractical in real-world scenarios. To address these challenges, we propose MIMLVAE, a novel dual-granularity MIML algorithm based on a variational autoencoder. MIMLVAE employs a graph attention network to dynamically capture label correlations and instance dependencies, eliminating the i.i.d. assumption and prior knowledge. By treating all instances within a bag equally, it infers effective bag-level and instance-level representations for dual-granularity prediction. At the same time, the label encoder captures label-specific prototype representations, facilitating prototype-based classification at both the bag and instance levels without requiring label disambiguation. Furthermore, MIMLVAE integrates Gaussian mixture model into the shared latent space of features and labels, mitigating posterior collapse and over-regularization. Experiments on six standard MIML datasets demonstrate that MIMLVAE significantly outperforms state-of-the-art methods in both bag-level and instance-level multi-label classification tasks.
Keywords:
Variational autoencoder
Correlation learning
Prototype classifier