Is this a feature or is my game configured badly? While it's easy enough to go back into the game, it feels a bit off. If theres a way to not have escape key do that, would be appreciated if you could share.

This is a feature, consider it a panic feature for when your boss surprises you in the office while you are playing. Unfortunately for now there is no way to change the setting.