"As of today, just after Microsoft announced its membership in the Open Media Alliance, they also quietly changed the internal development status of Vorbis, Opus, WebM and VP9 to indicate they intend to ship all of the above in the new Windows Edge browser."

http://xiphmont.livejournal.com/67752.html

I think this leaves Safari as the last hold out that won't have built-in support.