I believe that you can get strange movement if the GPS North and the compass North, allowing for the declination between magnetic and frue North, do not line up. In the past this has caused a "toilet bowl effect" but it can manifest itself in other ways.
It may not be the cause of the problem but at least then it can be discounted.