Passat (B6) :: Speed Shifting When Not Accelerating Hard

So I put in a Neuspeed torque arm insert, and that has worked with shifting from 1st to 2nd when accelerating hard. But in my '96 Jetta M5 speed I could throw the shifter around into any gear (except 1st if going fast) at any speed.

With the Passat what I find is that I while I can move quickly to a particular gate, I have to enter the gate slowly. I am thinking this is due to having 6 speeds (narrower gates to fit in same space so I have to be more precise), but then I wonder.

When shifting normally, it is very smooth, it is just when I try to shift fast that I notice this. And it happens even when I am shifing fast "but not" accelerating and the engine is not under load. So this happens when I try to downshift from 6th (at 2,000 rpm) to 5th/4th. Notice this when I am doing 50-60 in 6th and then try to quickly drop into a lower gear to get through a yellow light before it changes.

The solution has been to shift fast to the gate and then slowly push it in, but I still have the old reflexs from the Jetta were it was one fast movement.