A bug in LyX 1.5.1 (now distributed with Gutsy Gibbon):
When working in formulas within the document, the arrow buttons behave the opposite way. Meaning, if one wants to go left in the formula, the left button will actually make him go right and the right one will make him go left.