Looking at the images i can see rather large error on the markers, this may be part of the explanation to the problem you see.
The wrist joint is a little special, it is not a universal joint in traditional sense it has a small segment that creates some distance between flexion and abduction axes. This segment can sometimes lead to the problems you see. If you have a better position of the markers this is less likely to happen.
I would enable the weak drivers for the wrist and then run the parameter optimization.
Once the optimization has been done you should see much smaller errors on markers, and it is likely you can disable the soft drivers for wrist and rerun the motion tracking .