Whenever I start the program up from my start menu it just pulls up shadow warrior's config. Is there a way to pull up another game's configurator?

This sounds like it refers to the broken way Widows 10 works, or does not in this case. Best way in my opinion is navigating to the game's folder and finding the DOSBox' own configuration file in there.

Yea I think I found it, thanks

For all of the gog dos games I have installed, there is a folder in the game's installed folder called DOSBOX and in there is a program called "GOGDOSConfig.exe". This let's you set some DOSBOX parameters through some choices. I vaguely recall that there is a way to run this program during the initial install, but one can just run the program.

However, I don't like having hundreds, or more, copies of things around, so I muck with the setup after install so all dosbox programs run one instance of dosbox but with individual config files (which I manually adjust).

I've heard they've changed the version of DOSBOX they install, at least for games available more recently, so things might have changed.