# Mutual Information In probability theory and information theory (Scripts) 1.0

Average Rating
User Rating:
Visitors Rating:
My rating:

• Last update: 5 years ago
• Operating system: Linux, Mac OS X, Win All, BSD, Solaris
• Publisher: Guangdi Li (6 other programs)
See full specifications

## Mutual Information In probability theory and information theory (Scripts) Publisher's description

### The definition of mutual information could resort to wiki

The definition of mutual information could resort to wiki:
http://en.wikipedia.org/wiki/Mutual_information

For marginal mutual information, we say it is :
I(A,B)=sum sum P(A,B) log[P(A,B)/P(A)P(B)]

For conditional mutual information, we say it is :
I(A,B|C)=sum sum P(A,B|C) log[P(A,B|C)/P(A|C)P(B|C)]

For mutual information matric, we say it is:
the matric saves all pairs of I(A,B)

Please refer to "ControlCentor.m", we have a simple example for you understanding. If there is any question, please let me know, i will help you as soon as possible.

PS: fast mex programming functions are provided for advance users here too

#### System Requirements:

MATLAB 7.6 (R2008a)
Program Release Status: New Release
Program Install Support: Install and Uninstall

#### Mutual Information In probability theory and information theory (Scripts) Tags:

Click on a tag to find related softwares

## Most Popular

ASK, OOK, FSK, BPSK, QPSK, 8PSK modulation 1.1
ASK, OOK, FSK, BPSK, QPSK, 8PSK modulation contain several functions for digital modulation simulation