Mouse over toolbar buttons on Tools toolbar to see the hotkeys.

E.g. With graph active,
Press1 will enter scale in mode.
Press H will enter Data Highlight mode
Press 9 will enter add straight line mode.
No need to press ESC key to switch modes. E.g. press 9 to enter Add Straight Line mode. press 7 to switch to Add Straight Arrow mode.