You need to mess with the gyro trust numbers in advanced settings. We've had this same problem. If you do lots of fast flying with quick changes of direction you want a higher number. Try 100 for 2 minutes, land, then try 50, land, then try 150, you may even try 200 - that's what we're flying...