PORTALE DELLA DIDATTICA

PORTALE DELLA DIDATTICA

PORTALE DELLA DIDATTICA

Elenco notifiche



Numerical optimization for large scale problems and Stochastic Optimization

02TXDSM, 02TXDNG

A.A. 2023/24

Course Language

Inglese

Degree programme(s)

Master of science-level of the Bologna process in Data Science And Engineering - Torino
Master of science-level of the Bologna process in Ingegneria Matematica - Torino

Course structure
Teaching Hours
Lezioni 60
Esercitazioni in laboratorio 20
Lecturers
Teacher Status SSD h.Les h.Ex h.Lab h.Tut Years teaching
Pieraccini Sandra Professore Ordinario MATH-05/A 30 0 0 0 6
Co-lectures
Espandi

Context
SSD CFU Activities Area context
MAT/08
MAT/09
6
2
C - Affini o integrative
C - Affini o integrative
Attività formative affini o integrative
Attività formative affini o integrative
2023/24
The course aims at introducing some of the main tools for supporting machine learning algorithms. In particular, the focus will be on the computation of the numerical solution of very large scale nonlinear optimization problems. Both unconstrained and constrained problems will be tackled, describing different methods suitable for the various problems according to their classification (e.g., nonlinear least square problems, quadratic programming problems, purely nonlinear problems...). Foundations of stochastic dynamic programming will be also introduced.
Knowledge of the main numerical methods for solving large scale numerical optimization problems, according to the problem type. Ability to choose and correctly apply software for different numerical optimization problems, with a critical investigation of the results obtained.
Knowledge of basic linear algebra and calculus, as well as a basic coding ability.
Convex optimization: - gradient and conjugate gradient methods for linear systems - descent methods - Newton, quasi-Newton, and modified Newton methods - Gauss-Newton method - Globalization techniques Constrained optimization: - Optimality conditions - Projected gradient method - Penalty methods - Alternating direction method of multipliers (ADMM) Stochastic optimization - Static simulation-based optimization (parametric optimization) - Dynamic simulation-based optimization (control optimization)
The course is organized into theoretical lectures and practice classes. Theoretical lectures are devoted to the presentation of the topics, with definitions, properties, and introductory examples. The practice classes are devoted to training the students’ abilities to solve problems and exercises and to perform computations and simulations with common tools.
Slides presented during lesson will be made avalaible through the Portale della Didattica. Other material will be suggested in class and, if possible, made avalaible through the Portale della Didattica. Suggested textbook: J. Nocedal, S. J. Wright, Numerical Optimization, Springer, 2006 A. Gosavi, Simulation-Based Optimization, 2nd edition, Springer, 2015
Lecture slides; Text book; Exercise with solutions ; Lab exercises with solutions; Video lectures (previous years);
You can take this exam before attending the course
Exam: Written test; Compulsory oral exam; Group essay;
The exam is made of two parts: (a) a written test; (b) an oral discussion. The written test is based on topics related to stochastic optimization. The test is made of approximately 4 exercises, consisting of both practical and theoretical questions; it scores up to 8 points and will last approximately one hour. During the test, the use of books, notes, electronic devices (mobile phones, smart watches...), and other unauthorized material is prohibited. The oral discussion is partially based on a mandatory report based on homework assigned during the semester. In detail, some problems will be assigned, aimed at testing students' ability in identifying the correct strategy to solve the problem, in applying the methods presented during the lectures, and in commenting on the practical behavior of the methods applied on some given test problems. The students should write a report on one assignment chosen among those proposed. The report can be the result of teamwork, with each team made of 2 or 3 students. The oral test will then consist of two parts: b1) a discussion on the submitted report, aimed at testing the depth of the student's understanding of the subjects and their ability to explain, defend, reflect, critically evaluate, and possibly improve their work; b2) a discussion on other topics related to unconstrained and constrained optimization, with a special focus on (but not limited to) topics not addressed by the report. Both theoretical aspects and implementation issues and examples of fields of applications will be discussed. The maximum grade for parts (b1) and (b2) of the oral discussions is 12 points each. For part (b1), the grade is based both on the quality of the report and on the student's defense. The final course grade is obtained by summing up the final grades for the written test and for the oral discussion.
In addition to the message sent by the online system, students with disabilities or Specific Learning Disorders (SLD) are invited to directly inform the professor in charge of the course about the special arrangements for the exam that have been agreed with the Special Needs Unit. The professor has to be informed at least one week before the beginning of the examination session in order to provide students with the most suitable arrangements for each specific type of exam.
Esporta Word