Well, not really.
Ogg Media is, at best, a temporary hack. It's acceptable, and now it's open source, but it's not exactly what you should be pinning hopes and dreams on.
MP4 container is basically .mov. Which is not all that great, honestly.
Matroska is really the next big thing in container formats, and there's no reason to *not* use it, other than laziness/incompetence.