When I go to settings I cannot exit by clicking "Back"?

Instead the "Play" button gets highlighted/bigger for a moment but the settings menu/overlay does not disappear. How am I supposed to leave?