That's because it's based on ACCELERATION. Meaning, if you just do your backswing real gentle like, it'll never get confused because there won't be any large acceleration event to confuxors it. Make your actual, TRUE swing the hard movement, be gentle in everything else. The Wiimote doesn't know which way you're facing. You could be facing away from the tv and play that way and it'd still pick it up.