Introduction to Information Theory

Some of the notes I wrote when I took an information theory course. It contains basic definitions and theorems. It doesn’t get into much details and is sort of an intuitive cheat-sheet. The content aligns with the first few chapters of the book “Elements of Information Theory” by Cover and Thomas, so you can find the proofs there (it is a very well-written and easy-to-read book, I definitely recommend it!)....

July 25, 2022 · 9 min · Saeed Hedayatian

Notes on Stochastic Processes

My handwritten notes/summaries for an undergraduate stochastic processes course that I took in my 8th semester can be found HERE. I examined a lot of books, but I didn’t like the order in which they introduced different topics. These notes are organized in a way that I thought was most intuitive and logical. So if you can read them (and that’s a big if😊) you shouldn’t have any problem following the arguments and the chain of thought....

July 22, 2022 · 1 min · Saeed Hedayatian