Professional Documents
Culture Documents
Lecture 17:
November 8, 2006
Sam Roweis
R5
1e-05
R1
R3
1e-10
R61
1e-15
0
0.2
0.4
0.6
Rate
0.8
2U i
since there are 2i ways of combining the previous equations, and 2U
possible equations.
10
11
f f+
w/N
12
Equivalently,
J < 2N ((f +) log2(f )(1f ) log2(1f ))
< 2N (H2(f )+ log2((1f )/f ))
13
14
The total probability of decoding failure is less than the sum of the
probabilities of failing in these two ways.
We will try to limit each of these to /2.
We can choose N to be big enough that
P (f < w/N < f + ) 1 /2
This ensures that the actual error pattern will be non-typical with
probability less than /2.
We now need to limit the probability that some other codeword
also corresponds to a typical error pattern.
15
16
17