Caricamento in corso...
Transformers: From BERT to ChatGPT (with Applications in Bioengineering) (insegnamento su invito)
01VYGRV
A.A. 2024/25
Course Language
Inglese
Degree programme(s)
Doctorate Research in Ingegneria Elettrica, Elettronica E Delle Comunicazioni - Torino
Course structure
| Teaching | Hours |
|---|---|
| Lezioni | 25 |
Lecturers
| Teacher | Status | SSD | h.Les | h.Ex | h.Lab | h.Tut | Years teaching |
|---|
Co-lectures
Context
| SSD | CFU | Activities | Area context | *** N/A *** | 5 |
|---|
This 25-hour course provides a structured journey through Transformer models, from foundational concepts to specialized architectures and applications. Beginning with two introductory lessons on the basics of the Transformer architecture, including self-attention, encoder-decoder structures, and improvements over traditional models, the course delves into popular models like BERT for language understanding and the GPT family for text generation.
This 25-hour course provides a structured journey through Transformer models, from foundational concepts to specialized architectures and applications. Beginning with two introductory lessons on the basics of the Transformer architecture, including self-attention, encoder-decoder structures, and improvements over traditional models, the course delves into popular models like BERT for language understanding and the GPT family for text generation.
Guest lecture:
Giansalvo Cirrincione - University of Picardie Jules Verne (Amiens, France)
Students will also explore advanced Transformers, such as Reformer and Longformer for handling long sequences, Temporal Fusion Transformer (TFT) for time-series forecasting, Vision Transformer (ViT) for image processing, and specialized models for structured and graph data, such as Graph Transformers. Each lesson includes hands-on coding components where students will implement and experiment with these models in real-world applications in, mainly, bioengineering . By the end of the course, students will gain practical insights into the architecture, interpretability, and diverse applications of Transformer models .
Students will also explore advanced Transformers, such as Reformer and Longformer for handling long sequences, Temporal Fusion Transformer (TFT) for time-series forecasting, Vision Transformer (ViT) for image processing, and specialized models for structured and graph data, such as Graph Transformers. Each lesson includes hands-on coding components where students will implement and experiment with these models in real-world applications in, mainly, bioengineering . By the end of the course, students will gain practical insights into the architecture, interpretability, and diverse applications of Transformer models .
In presenza
On site
Prova di laboratorio di natura pratica sperimentale o informatico
Laborartory test on experimental practice or informatics
P.D.2-2 - Aprile
P.D.2-2 - April
• mercoledì 9 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• giovedì 10 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• venerdì 11 luglio 2025 ore 10-12 - 2 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• martedì 15 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Clarke Dipartimento DET 1° piano, Cittadella Politecnica
• giovedì 17 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• venerdì 18 luglio 2025 ore 10-12 - 2 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• martedì 22 luglio 2025 ore 10- 13 - 3 ore - Sala riunioni Clarke Dipartimento DET 1° piano, Cittadella Politecnica
• mercoledì 23 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• venerdì 25 luglio 2025 ore 10-13 - 3 ore - Sala riunioni Nyquist Dipartimento DET 4° piano, Cittadella Politecnica
• Wednesday 9th July 2025 from 10 to 13 - 3 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Thursday 10th July 2025 from 10 to 13 - 3 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Friday 11th July 2025 from 10 to 12 - 2 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Tuesday 15th July 2025 from 10 to 13 - 3 hours - Meeting room Clarke DET Department first floor, Cittadella Politecnica
• Thursday 17th July 2025 from 10 to 13 - 3 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Friday 18th July 2025 from 10 to 12 - 2 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Tuesday 22th July 2025 from 10 to 13 - 3 hours - Meeting room Clarke DET Department first floor, Cittadella Politecnica
• Wednesday 23th July 2025 from 10 to 13 - 3 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica
• Friday 25th July 2025 from 10 to 13 - 3 hours - Meeting room Nyquist DET Department fourth floor, Cittadella Politecnica