Question

Compute the entropy of a bit string where the probability of a 0 is 45% and...

Compute the entropy of a bit string where the probability of a 0 is 45% and the probability of a 1 is 55%. Compare the result, using the formula sum[ –pi log pi]; Do the same for a 50/50 probability. Comment on your results.

Math   Statistics-And-Probability   
0 0
Add a commentTranscribed image text
Next >

Homework Answers

Answer #1

We have and .

The entropy is given by

For the 50/50 probability, that is when , the entropy is given by

So if we compare the two cases .

Or in other words entropy of 50/50 probability is more than entropy of the given case p0=0.45 and p1=0.55.

Also we can see that 50/50 probability is the discrete uniform case where random variable takes only two vales with same probability and entropy is maximum for discrete unifrom.

0 0
Know the answer?
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Log In

Sign Up

Not the answer you're looking for?
Ask your own homework help question
Similar Questions
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used to estimate this probability. If​ so, approximate​ P(X) using the normal distribution and compare the result with the exact probability. n=50​, p=0.50​, and x=17 For n=50​, p=0.5​, and X=17​, use the binomial probability formula to find​ P(X). Q: By how much do the exact and approximated probabilities​ differ? A. ____​(Round to four decimal places as​ needed.) B. The normal distribution cannot be used.
Consider the probability distribution shown below. x 0 1 2 P(x) 0.05 0.50 0.45 Compute the...
Consider the probability distribution shown below. x 0 1 2 P(x) 0.05 0.50 0.45 Compute the expected value of the distribution. Consider a binomial experiment with n = 7 trials where the probability of success on a single trial is p = 0.10. (Round your answers to three decimal places.) (a) Find P(r = 0). (b) Find P(r ≥ 1) by using the complement rule. Compute the standard deviation of the distribution. (Round your answer to four decimal places.) A...
a bit error probability of pb= 10-3 is required for a system with a data rate...
a bit error probability of pb= 10-3 is required for a system with a data rate of 100 k bits/sec to be transmiited over an awgn channel using coherently detected mpsk modulation.the system bandwidth is 50 khz. assume that the system frequency transfer function of a raised cosine with a roll factor r=1 and a gray code is used for the signal to bit assignment. a) what Es/No is required for the specified Pb? b)wat Eb/No is required? Hint: Note...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used to estimate this probability. If​ so, approximate​ P(X) using the normal distribution and compare the result with the exact probability.n equals 54. p equals 0.7. X equals 46. Use the binomial probability formula to find​ P(X). Can the normal distribution be used to approximate this​ probability? Approximate​ P(X) using the normal distribution. Use a standard normal distribution table. By how much do the exact...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used to estimate this probability. If​ so, approximate​ P(X) using the normal distribution and compare the result with the exact probability. n=6060​, p=0.20.2​, X=25 Can the normal distribution be used to approximate this​ probability? A. ​Yes, the normal distribution can be used because ​np(1−​p) ≥ 10. B. ​No, the normal distribution cannot be used because ​np(1−​p) < 10. C. ​No, the normal distribution cannot be...
Suppose that X follows geometric distribution with the probability of success p, where 0 < p...
Suppose that X follows geometric distribution with the probability of success p, where 0 < p < 1, and probability of failure 1 − p = q. The pmf is given by f(x) = P(X = x) = q x−1p, x = 1, 2, 3, 4, . . . . Show that X is a pmf. Compute the mean and variance of X without using moment generating function technique. Show all steps. To compute the variance of X, first compute...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used to estimate this probability. If​ so, approximate​ P(X) using the normal distribution and compare the result with the exact probability. nequals44​, pequals0.4​, and Xequals19 For nequals44​, pequals0.4​, and Xequals19​, use the binomial probability formula to find​ P(X). nothing ​(Round to four decimal places as​ needed.) Can the normal distribution be used to approximate this​ probability? A. ​No, because StartRoot np left parenthesis 1 minus...
a) Let ?(?) = { 1 for 0 ≤ ? ≤ 1 and −1, for 2...
a) Let ?(?) = { 1 for 0 ≤ ? ≤ 1 and −1, for 2 ≤ ? ≤ 3 be a periodic signal with fundamental period 3. Calculate the Fourier Series coefficients of ?(?), ??, by hand. Simplify your result as much as you can. b) By using a 3x1 subplot, plot ?(?) signal in the first row. Take ? between 0 s and 10 s with an increment of 1 ms. Furthermore, calculate and plot the Fourier series...
What is the income distribution of super shoppers? A supermarket super shopper is defined as a...
What is the income distribution of super shoppers? A supermarket super shopper is defined as a shopper for whom at least 70% of the items purchased were on sale or purchased with a coupon. In the following table, income units are in thousands of dollars, and each interval goes up to but does not include the given high value. The midpoints are given to the nearest thousand dollars. Income range 5-15 15-25 25-35 35-45 45-55 55 or more Midpoint x...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used...
Compute​ P(X) using the binomial probability formula. Then determine whether the normal distribution can be used to estimate this probability. If​ so, approximate​ P(X) using the normal distribution and compare the result with the exact probability. n=54 p=0.4 and x= 17 For nequals=5454​, pequals=0.40.4​, and Xequals=1717​, use the binomial probability formula to find​ P(X). 0.05010.0501 ​(Round to four decimal places as​ needed.) Can the normal distribution be used to approximate this​ probability? A. ​No, because StartRoot np left parenthesis 1...
ADVERTISEMENT
Need Online Homework Help?

Get Answers For Free
Most questions answered within 1 hours.

Ask a Question
ADVERTISEMENT