A source alphabet consists of N symbols with the probability of the first two symbols being the same. A source encoder increases the probability of the first symbol by a small amount $$\varepsilon $$ and decreases that of the second by $$\varepsilon $$. After encoding, the entropy of the source

The power spectral density of a real process X(t) for positive frequencies is shown below. The value of $$E\,\left[ {{X^2}\,(t)} \right]$$ and $$E\,\left[ {X\,(t)} \right]$$, respectively, are

In a base band communications link, frequencies up to 3500 Hz are used for signaling. Using a raised cosine pulse with 75% excess bandwidth and for no inter-symbol interference, the maximum possible signaling rate in symbols per second is

A binary symmetric channel (BSC) has a transition probability of 1/8. If the binary transmit symbol X is such that P(X =0) = 9/10, then the probability of error for an optimum receiver will be