Shannon Meets Shannon

He’s met almost everyone else: Wiener, BodeBellmanCarnot, Tesla, Marconi, and of course, Shortz. Bad jokes aside, in an attempt to understand the inverse water filling solution from rate-distortion theory better, I put together some rough notes attempting to connect it and the sampling theorem. It’s kind of old school but makes an interesting exercise for students of information theory and signal processing. There are almost certainly places in the notes where the descriptions could be stated better, and I haven’t thoroughly scrubbed it for typos, so any feedback is both welcomed and encouraged.

sampling-inverse-water-filling v1.0

This entry was posted in Information Theory, Signal Processing. Bookmark the permalink.

1 Response to Shannon Meets Shannon

  1. Pingback: How many people have “met Shannon?” | An Ergodic Walk

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s