- Knowledge of the main characteristics of artificial intelligence: historical overview and modern definition - Knowledge of how to formalize a learning problem from the mathematical foundations of the optimization objectives to the composition of a deep architecture - Knowledge of the main characteristics of modern deep learning techniques with practical engineering tricks for end-to-end training and fine-tuning the networks - Basic knowledge about how to deal with research questions, how to organize a project and prepare a scientific conference report

- Linear Algebra - Probability theory concepts - Basic concepts of decision theory (model optimization) - Python: Basic elements

Part 1 (16h) - Artificial Intelligence: historical definition, brief overview, modern definition and current role of machine and deep learning - Overview of fundamental knowledge of probability - Overview of decision theory: loss, risk, Probably Approximately Correct (PAC) Learning - K-nearest-neighbour - Principal Component Analysis for dimensionality reduction - K-means Clustering - Perceptron and Support Vector Machines - Cross Validation + 3h python crash course and exercises + 5h lab. practice on K-nearest neighbor, Support Vector Machines, and Cross-Validation Part 2 (16h) - Artificial Neural Networks - Convolutional Neural Networks basic algorithms: Backpropagation and Stochastic Gradient Descent - CNN architectures overview (from Alexnet to ResNet and Transformers) - Training a CNN (data preprocessing, weight initialization and hyperparameter optimization) - Visualizing and Understanding the CNN inner working + 3h pythorch crash course and exercises + 3h CNN classification exercises Part 3 (10h) - Multi-Task and Structured Output Learning (Semantic Segmentation and Detection) - Unsupervised and Metric Learning (Siamese networks and Contrastive Learning for Retrieval) - Generative Networks (Autoencoders and GANs) - Recurrent Neural Networks - Transfer Learning, learning with few samples and across domains + 4h adversarial learning and domain adaptation exercises

- 42 hours of lectures (theory section) - 18 hours of 'laboratory' exercises (practical section)

Slides + State of the art deep learning top conference and journal papers. Optional - specific pointers to chapters of the following books will be indicated during the lectures. Artificial Intelligence: A Modern Approach S. Russell, P.Norvig Deep Learning by I. Goodfellow, Y. Bengio, A. Courville. Understanding Machine Learning: From Theory to Algorithms by Shai Shalev-Shwartz and Shai Ben-David Machine Learning: a Probabilistic Perspective by Kevin P. Murphy The Elements of Statistical Learning, T. Hastie, R. Tibshirani, and J. Friedman Pattern Recognition and Machine Learning, Christopher M. Bishop Machine Learning, Tom M. Mitchell A Course in Machine Learning, Hal Daumé III Neural Networks - a Systematic Introduction, Raul Rojas

Lecture slides; Video lectures (current year);

Exam: Compulsory oral exam; Group project;

- group project (50%): the students are asked to use pre-existing code of state-of-the-art deep learning models, run experiments, and test some suggested extensions. The teams can choose among a set of proposed topics and will submit 10 days before the oral exam a PDF report of 8 pages in IEEE paper format. This part of the exam aims at evaluating the students' ability to understand deep learning code, prepare a rigorous experimental evaluation campaign, as well as report and discuss the obtained results. The evaluation process includes a check on the code and a review of the submitted pdf report. Extra points (for honors, "lode") are assigned to original, well-justified, and experimentally validated method extensions proposed by the students. - individual evaluation (50%): questions on the project, as well as theory and laboratory part of the course program. This part of the exam aims at verifying the equal contribution of all the authors to the project work. The students are asked to present the work done in the project. The content and timing of the presentation will be evaluated as well as the answers to individual questions. The students are also asked about more general theory topics presented in class.

In addition to the message sent by the online system, students with disabilities or Specific Learning Disorders (SLD) are invited to directly inform the professor in charge of the course about the special arrangements for the exam that have been agreed with the Special Needs Unit. The professor has to be informed at least one week before the beginning of the examination session in order to provide students with the most suitable arrangements for each specific type of exam.