Question

Determine the entropy of a source with probabilities 2/3,2/9,2/27,2/81,2/243,1/243

Determine the entropy of a source with probabilities 2/3,2/9,2/27,2/81,2/243,1/243

Homework Answers

Answer #1

Assuming the X values are 1, 2, 3, 4, 5, 6, the required entropy is

which can be found from the table below:

X p(X) -Xln(P(X))
1 0.666667 0.176091
2 0.222222 1.306425
3 0.074074 3.391001
4 0.024691 6.42982
5 0.00823 10.42288
6 0.004115 14.31364

Taking the sum, we have entropy as:

Hope this was helpful. Please do leave a positive rating if you liked this answer. Thanks and have a good day!

Know the answer?
Your Answer:

Post as a guest

Your Name:

What's your source?

Earn Coins

Coins can be redeemed for fabulous gifts.

Not the answer you're looking for?
Ask your own homework help question
Similar Questions
Determine the Huffman encoding of a source with probabilities 2/3,2/9,2/27,2/81,2/243,1/243. Compare the average word length to...
Determine the Huffman encoding of a source with probabilities 2/3,2/9,2/27,2/81,2/243,1/243. Compare the average word length to the entropy of the source.
Determine the Huffman encoding of a source with probabilities 1/3,1/4,1/6,1/8,1/12,1/24. Compare the average word length to...
Determine the Huffman encoding of a source with probabilities 1/3,1/4,1/6,1/8,1/12,1/24. Compare the average word length to the entropy of the source.
Without performing any calculations, determine whether the entropy of the system increases or decreases in the...
Without performing any calculations, determine whether the entropy of the system increases or decreases in the dissolution of table salt: NaCl(s) → NaCl(aq) 1.) Unable to determine 2.) decreases 3.) The entropy does not change. 4.) increase
Determine the work mode a) entropy transport rate and b) entropy production rate as 100 hp...
Determine the work mode a) entropy transport rate and b) entropy production rate as 100 hp is continuously dissipated in a mechanical brake operating isothermally at 250 °F.
2. Consider the given seven symbols with probabilities as {A, B, C, D, E, F, G}...
2. Consider the given seven symbols with probabilities as {A, B, C, D, E, F, G} = {0.25, 0.20, 0.18, 0.15, 0.12, 0.06, 0.04}. Use Huffman coding to determine coding bits, entropy and average bits per symbol. Verify the same with Matlab . Verify the same with Matlab .Verify the same with Matlab ( very importent ) .
Determine the entropy expression for a two-state paramagnet as a function of temperature.
Determine the entropy expression for a two-state paramagnet as a function of temperature.
The probabilities associated with the expected principal source of payment for hospital discharges in the United...
The probabilities associated with the expected principal source of payment for hospital discharges in the United States in the year 1990 are listed below: Principle source of Payment Probability Private Insurance 0.412 Medicare 0.325 Medicaid 0.107 Other Govt. Program ???? Self-payment 0.039 Other/ No charge 0.033 Not stated 0.025 a. (Appears as Question #23 in Blackboard) What is the probability that the principal source of payment is Other Govt. Program? b. (Appears as Question #24 in Blackboard) What is the...
The enthalpy of vaporization of methanol is 35.27 kJ/ mol at 64.1 oC. Determine the entropy...
The enthalpy of vaporization of methanol is 35.27 kJ/ mol at 64.1 oC. Determine the entropy change in the system for the vaporization of 2.00 moles of methanol. What is the entropy change in the surroundings (assume Tsurr = 25 oC.)
Continuous Time Markov Chains 1. Find the limiting probabilities for the M/M/s system 2. Determine the...
Continuous Time Markov Chains 1. Find the limiting probabilities for the M/M/s system 2. Determine the condition needed for these to exist.
For each process below, determine the change in entropy of the system. Indicate whether the changes...
For each process below, determine the change in entropy of the system. Indicate whether the changes in the entropy of the surroundings and of the universe will be negative or positive (5 pts each). (a)    One mole of ammonia gas decomposes to nitrogen and hydrogen gases. (b)    12 g of liquid water freezes.