Speaker doesn't call on Diane Abbott