Color gradient cannot be deleted

When I edit a color gradient, a certain point in the color gradient cannot be deleted.

You need to select the color and hit backspace to delete it.