I can see that that would be very annoying and make SU virtually unusable. I have seen a similar post to yours recently so it might be worth searching the forum for a solution. My setup is similar to yours but I don’t have your issues, so it certainly can all work properly. Have you tried using a different mouse?
BTW, you have not fully filled in your profile to show which version of SU you are using. Such info is really useful to those trying to help out.
PS - is this anything like what you experience: Mouse not aligning to view?