Multimedia Architectures
A.Y. 2022/2023
Learning objectives
The course aims at presenting digital models and systems for the processing, coding, storage, retrieval and distribution of multimedia information (texts, images, audio, video). The course deals with issues about the analysis, design and synchronization of complex multimedia applications as well as research and development activities in this field will be discussed.
Expected learning outcomes
The students will acquire the necessary knowledge for managing multimedia information and developing related architectures for the storage and communication of images, audio and video. In addition, students will develop high-level analytical and operational skills for the development of complex multi-disciplinary applications.
Lesson period: Second semester
Assessment methods: Esame
Assessment result: voto verbalizzato in trentesimi
Single course
This course cannot be attended as a single course. Please check our list of single courses to find the ones available for enrolment.
Course syllabus and organization
Single session
Responsible
Lesson period
Second semester
Course syllabus
Introduction. Multimedia and digital communication
ORDBMs and ORDBMS in Oracle
Digital texts.Boolean Retrieval Model, Vector Space Model, Probabilistic Model, Semantic Networks
Text IR vs database systems --> Oracle Text
Text IR system --> Sorl
Question Answering
Design of Conversational Experience with DialogFlow
Digital images. Human perception of color. Color models. Data compression. Standards for digital image encoding.
Image IR vs database systems --> Oracle Multimedia
Image Retrieval: from pixels to the semantic space
Digital audio. Sampling, quantization, signal to noise ratio. Standards for digital audio encoding: WAV, AIFF. Audio compression. Elements of psychoacoustics, critical bands, spatial and temporal masking.
Digital video. Video color models. Video compression,predictive coding, motion vectors. Standards for digital video encoding.
Audio-video IR vs database systems --> Oracle Multimedia
Operating systems issues for continuous media. Synchronization of multimedia data. Quality of service. Real-time scheduling. File systems for continuous media. Real-time network protocols
Multimedia information systems. Content description. Languages for metadata: MPEG-7.
Multimedia applications design. Multimedia authoring systems.
ORDBMs and ORDBMS in Oracle
Digital texts.Boolean Retrieval Model, Vector Space Model, Probabilistic Model, Semantic Networks
Text IR vs database systems --> Oracle Text
Text IR system --> Sorl
Question Answering
Design of Conversational Experience with DialogFlow
Digital images. Human perception of color. Color models. Data compression. Standards for digital image encoding.
Image IR vs database systems --> Oracle Multimedia
Image Retrieval: from pixels to the semantic space
Digital audio. Sampling, quantization, signal to noise ratio. Standards for digital audio encoding: WAV, AIFF. Audio compression. Elements of psychoacoustics, critical bands, spatial and temporal masking.
Digital video. Video color models. Video compression,predictive coding, motion vectors. Standards for digital video encoding.
Audio-video IR vs database systems --> Oracle Multimedia
Operating systems issues for continuous media. Synchronization of multimedia data. Quality of service. Real-time scheduling. File systems for continuous media. Real-time network protocols
Multimedia information systems. Content description. Languages for metadata: MPEG-7.
Multimedia applications design. Multimedia authoring systems.
Prerequisites for admission
Database
Teaching methods
Lectures with discussions and presentations of case studies
Teaching Resources
Slides of the lectures: https://svaltolinaam.ariel.ctu.unimi.it/v5/frm3/ThreadList.aspx?fc=nPn23CzhhiyR%2b4q3CxTejFJ43jkNmc58fDaDrPvKG67N6UULesxVQlMh8vspoyqV&roomid=71214
In the slides are reported books, articles websites useful both for studying and insight.
Basic Readings:
- Z. Li, M. Drew. Fundamentals of Multimedia, Pearson Educational, 2004
- Multimedia Applications. In B. Fuhrt (ed), Handbook of Internet Computing, CRC Press, 2000
In the slides are reported books, articles websites useful both for studying and insight.
Basic Readings:
- Z. Li, M. Drew. Fundamentals of Multimedia, Pearson Educational, 2004
- Multimedia Applications. In B. Fuhrt (ed), Handbook of Internet Computing, CRC Press, 2000
Assessment methods and Criteria
Methods of verification are:
1. Written test (max grade 30/30)
2. Oral test, Thematic Deepening, Project (optional) that will result in an increase or decrease in the grade of the written test by + or - 3 points
The evaluation criteria of the written test concern:
- Knowledge of the content
- Adherence of the response to the track
- Ability to make connections
- The relevance of the contents in relation to the question
The evaluation criteria of the oral test/thematic deepening/project concern:
- the focus of the issue
- logical rigour and use of technical language
- fairness and clarity of exposure
- The critical awareness, personal interpretation skills, richness and relevance of the oral presentation
1. Written test (max grade 30/30)
2. Oral test, Thematic Deepening, Project (optional) that will result in an increase or decrease in the grade of the written test by + or - 3 points
The evaluation criteria of the written test concern:
- Knowledge of the content
- Adherence of the response to the track
- Ability to make connections
- The relevance of the contents in relation to the question
The evaluation criteria of the oral test/thematic deepening/project concern:
- the focus of the issue
- logical rigour and use of technical language
- fairness and clarity of exposure
- The critical awareness, personal interpretation skills, richness and relevance of the oral presentation
Educational website(s)
Professor(s)