You'll have jittering when only usb is plugged in - it is a 5v source and it's not enough for gimbal to operate. So you have to plug both usb and battery in when adjusting the settings in GUI.
I'd check the power lead of the gimbal first.
Have you tried pressing your finger on the third axis...