Arsenal suffered a shock FA Cup quarter-final exit as the Premier League leaders crashed to an embarrassing 2-1 defeat against second tier Southampton on Saturday.