Axiom: Is there anyway to run these games in a window?
Yes there is! But you need to edit the DOSBox configuration file for the game to do it. Go to the game's directory and look for a file called something like DOSBoxMM1.conf or similar. Open it in a text editor like Notepad. Then, find the line that reads "fullscreen=true" and change it to "fullscreen=false"
That will make the game launch in a window instead of fullscreen. At any time you can press ALT+ENTER to switch between windowed and fullscreen.
But the window is tiny! Too small to play in. So, go back to the configuration file and find the line that reads "windowresolution=original" and set it to any resolution you like, e.g. "windowresolution=1024x768". That will change the size of the window to whatever you like.
Remember to save your changes to the file! If you're worried about messing something up, make a backup copy before you edit it.
You specifically asked about running the games in "fullscreen windowed" mode. This is possible, but I've never tried it. I think the way you would do this is set windowresoluition to be equal to your screen resolution, but then use a third-party program like ShiftWindow to make it a borderless window that's centered properly. However I've never tried using ShiftWindow with DOSBox so I'm not sure how well it works. Also note that setting windowresolution to a widescreen resolution when the original games ran in a 4:3 resolution might result in a stretched image.