HW2 (Due 9/19)
Continue with tropical island question in HW1. Let's denote \(W_i\) as the weather condition (either sunny or rainy) and \(T_i\) as the temperature on day \(i\).
What is \(H(T_0)\)?
What is \(H(T_0W_0)\)?
What is \(H(T_1W_0)\)?
What is \(I(T_1;T_0W_1)\)?
Let \(X_1\) and \(X_2\) be two discrete random variables whose outcomes do not overlap. And let \(X=X_1\) with prob \(p\) and \(X=X_2\) with prob \((1p)\). Show that \(H(X) = p H(X_1) + (1p) H(X_2) + H(p)\), where \(H(p) \triangleq p \log_2(p)  (1p) \log_2 (1p)\).
(Typical sequences of coinflips) Consider sequences of \(10,000\) coinflips with the probability of head equal to \(0.7\). Show that a sequence with \(7,000\) heads and \(3,000\) tails is typical.
