Sound in Interaction
A.Y. 2021/2022
Learning objectives
The course aims at providing students with knowledge regarding principles and technologies for the design, the synthesis, and the rendering of sound in interactive contexts. The main application domains include multimodal virtual and augmented realities, sonic interaction design, assistive interfaces, digital musical instruments.
Expected learning outcomes
At the end of the course, the student shall be able to design models for the synthesis and rendering of sound, and to implement them on real-time plaftorms. Additionally, the student shall be able to effectively communicate the learning outcomes, using the modalities of scientific writing.
Lesson period: First semester
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
First semester
Teaching methods
Lectures will be held on the Zoom platform, can be attended both synchronously based on the official timetable and asynchronously as they will be recorded and uploaded on the course website.
Course syllabus and Teaching Resources
The contents and reference material will not be changed.
Assessment methods and Criteria
The oral exam will be held on the Zoom platform, with no further modifications.
Lectures will be held on the Zoom platform, can be attended both synchronously based on the official timetable and asynchronously as they will be recorded and uploaded on the course website.
Course syllabus and Teaching Resources
The contents and reference material will not be changed.
Assessment methods and Criteria
The oral exam will be held on the Zoom platform, with no further modifications.
Course syllabus
The program is focused on the following topics
1) Introduction to audio for virtual reality
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
The main employed software tool is Pure-Data
- Introduction to the pure-data environment
- Dataflow and control
- Managing real-time audio
1) Introduction to audio for virtual reality
- Rendering pipeline
- Approaches to audio synthesis and rendering
- Immersion and presence
2) Procedural models for sound synthesis
- Signal-based synthesis
- Source-based synthesis and physical modeling
- Latency, perceptual and computational aspects
3) 3D sound rendering
- Spatial sound perception
- Reverberation and virtual acoustics
- Binaural rendering
The main employed software tool is Pure-Data
- Introduction to the pure-data environment
- Dataflow and control
- Managing real-time audio
Prerequisites for admission
There are no specific prerequisites other than those required to enroll into the master degree.
Teaching methods
The entire course is taught by lectures.
Teaching Resources
Web site:
http://favanzinisi.ariel.ctu.unimi.it
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
http://favanzinisi.ariel.ctu.unimi.it
For the part on procedural models for sound synthesis:
- Andy Farnell, "Designing Sound", MIT press (2010)
For the part on 3D sound rendering:
- Bosun Xie, "Head-related transfer function and virtual auditory display",
2nd edition, J. Ross Publishing (2013)
- Frank Zotter and Matthias Frank, "Ambisonics"
Springer Open (2019)
https://www.springer.com/gp/book/9783030172060
During the lectures, the instructor provides references to several scientific papers.
Additional complementary material prepared by the instructor is made available through the web site of the course.
Assessment methods and Criteria
The exam consists of the development of a project, which has to be documented through a written essay in the form of a scientific paper, and has to be critically discussed in an oral test. The project can be developed individually or in a group of two students.
The evaluation is given in 30ths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
The evaluation is given in 30ths and is based on the following aspects: mastering of the course topics, ability to apply the acquired knowledge to solving actual problems, logical and critical thinking.
Professor(s)