| KEYWORD |
Area Ingegneria
Injecting prior knowledge in image interpretation tasks
Parole chiave ARTIFICIAL INTELLIGENCE, DEEP LEARNING, KNOWLEDGE GRAPHS
Riferimenti LIA MORRA
Gruppi di ricerca DAUIN - GR-09 - GRAphics and INtelligent Systems - GRAINS
Descrizione Image interpretation tasks, such as object detection and visual relationship detection, may benefit from neural-symbolic integration in order to inject prior knowledge, e.g., from knowledge graphs, about objects and their relationship into the training objectives of deep neural networks. The goal of this project is to design deep architectures combining convolutional neural networks and trasformers with neural-symbolic components such as Logic Tensor Networks to solve various image interpretation tasks, such as object detection, image classification or visual relationship detection. Multiple thesis are available to tackle the following open issues: i) how to integrate the knowledge into the training process of high-level semantic interpretation (scene graph generation); ii) how to automatically extract and compile prior knowledge from existing sources and format it for appropriate ingestion; iii) how to use Large Language Models (ChatGPT) to extract prior knowledge and logical constraints; iv) how to characterize neural-symbolic architectures, e.g. in terms of types of features learnt, efficiency and interpretability; v) how to combine concept extraction with knowledge induction to close the neuro-symbolic cycle, and how to simplify knowledge acquisition through human-in-the-loop appraoches
Scadenza validita proposta 26/02/2025
PROPONI LA TUA CANDIDATURA