Hmm... My idea is that this situation could be as much a result of the frame being tweeked to one side or the other, in addition to the aforementioned offset.
Thus, in comparison to the the headset, the engine/tranny/swingarm is at an angle, and with as I say, my limited understanding of geometry and physics, I would then hazard that the swingarm/final drive/rear wheel is cocked right of frame/headset centre line, thus causing the rear wheel to be pointed to the left, which then causes the bike to drift right.
When I can actually not be RIDING the thing, or doing the other stuf I am doing on this trip, I will apply the string method to see what's what and report back...