|
HU Credits:
4
Degree/Cycle:
1st degree (Bachelor)
Responsible Department:
Computer Sciences
Semester:
1st Semester
Teaching Languages:
Hebrew
Campus:
E. Safra
Course/Module Coordinator:
Or Ordentlich
Coordinator Office Hours:
TBA
Teaching Staff:
Prof. Or Ordentlich,
Mr. Tomer Berg
Course/Module description:
The course introduces the basic information measures: entropy, mutual information and divergence, and illustrates how to use those quantities for developing and analyzing performance of compression, communication and statistical inference systems.
Course/Module aims:
To form a gentle introduction to the fascinating field of information theory
Learning outcomes - On successful completion of this module, students should be able to:
-Explain the basic ideas underlying lossless compression and design low-complexity lossless compression systems.
-Explain the basic ideas underlying reliable communication over a noisy channel.
-Compute the fundmemtal limits for basic problems in statistical inference, communication and compression.
Attendance requirements(%):
Teaching arrangement and method of instruction:
Lecture + recitation
Course/Module Content:
-Information measures
-Losslsess compression for sources with a known/unknown statistical model
-Fano’s inequality and its application
-Applications of information theory in statistics
-Communication over a noisy channel and the channel capacity theorem
Required Reading:
Lecture note that will be uploaded to the course's website
Additional Reading Material:
Cover, T. M., and Joy A. Thomas. "Elements of information theory." (2006).
Grading Scheme :
Written / Oral / Practical Exam / Home Exam 90 %
Submission assignments during the semester: Exercises / Essays / Audits / Reports / Forum / Simulation / others 10 %
Additional information:
|
