"Should Hela, the Goddess of Death, ever need a replacement, thou wouldst make a fine choice."

Thor to Morrigan in ULTIMATE MARVEL VS CAPCOM 3

There's this thing that keeps bugging me where it keeps adding another arrow input after doing a diagonal arrow and I don't know how to fix it. I try using my joystick, but it only helps a bit.