AFAIK mailservers first try the highest prio, then the second highest etcetera.
It's generally better to use the term distance when it comes to MX RRs. I'm aware the rfc's speak of priority, but a higher priority MX, has a lower number, and vice verse, hence distance makes more sense :)
Niek --