Subject

    Computer Science

    Topic

    Artificial Intelligence

    In the figure, a binary node contains class counts 6 and 2. What is its entropy in bits, rounded to three decimals?

    Illustration for In the figure, a binary node contains class counts 6 and 2. What is its entropy in bits, rounded to
    a)
    0.936
    b)
    0.189
    c)
    0.811
    d)
    0.406

    Explanation

    The class shares are 6/8 = 0.75 and 2/8 = 0.25. Entropy = −0.75 log2 0.75 − 0.25 log2 0.25 ≈ 0.311 + 0.500 = 0.811 bits.

    Find Tutors

    View all Tutors