Samuel Cognolato

Ritratto di Luca Bergamin

Curriculum
Computer Science for Societal Challenges and Innovation, XXXVIII series
Grant sponsor

FBK
Supervisor

Luciano Serafini
Co-supervisor
s
Massimo Grassi
Contact
samuel.cognolato@phd.unipd.it

Project description
Sensory signals are what enables humans to experience the outside world. The encoding of each sensory channel is referred to as a sensory modality, and the human brain is capable of combining them. How to endow machines with analogous cognitive capabilities is still an open problem, studied in the discipline of multimodal machine learning, and leads to a wide variety of applications: from audiovisual speech recognition to text-to-image generation, the latter recently attracting widespread public attention. Still, the interactions between pieces of information from different modalities are not explicitly modeled or clearly interpretable. In my Ph.D. project, I aim to build a bridge between heterogeneous sources of information with graphs, a mathematical tool explicitly representing objects and their relationships. I will focus on the generation and manipulation of these structures, serving as common ground for gathering and producing content from/to different modalities. To do so I will explore the field of deep generative models for graphs, with the aim of conditioning such processes using multimodal information