My mouse is acting funny, jumping not doing what it supposed to do at all. Something with the install is wrong I guess, where should I start to look
This is nearly always a protocol problem. The answer depends on if you're running gpm or not; I'll assume you're not.
Run dpkg-reconfigure xserver-xfree86 and tinker with the mouse settings (imps/2 vs autops2 vs ms vs etc etc etc) -- Kent