Hi Vincent,
there is already a bug report rotting at fontconfig upstream which covers this exact use case. I have linked your report to the BTS there and explained the situation, so hopefully the default font order gets changed in fontconfig any time soon.
- Fabian