Entropy of a Mixture

(cgad.ski)

51 points | by cgadski 22 hours ago

2 comments

  • mreid 19 hours ago
    Really nice presentation of divergences. I made a similar attempt (math + interactive JS visualizations) a long time ago for the Bregman divergences: https://mark.reid.name/blog/meet-the-bregman-divergences.htm...

    These visualizations are much nicer than mine though.

    Curious fact, the Bregman divergences are a different class of divergences to the f-divergences that intersect at the KL divergence. That is, KL is (essentially) the only divergence that is both an f-divergence and a Bregman divergence. This is basically because log turns a ratio into a difference.

  • esafak 21 hours ago
    Forgive the meta comment, but is the source for your blog template available? I admire the presentation.
    • prophesi 18 hours ago
      Looks custom with simple HTML & CSS, KaTex for LaTex rendering, and Haxe 4.3.6 for the interactive charts. Never thought to use Haxe in such a way!
      • ykonstant 9 hours ago
        Ah... it is rendered client-side. I thought I finally found a server-side workflow for latex rendering. Unfortunately pandoc filters for server-side rendering (katex or mathjax) result in broken layout: off center equations etc.