How do you run the game in full screen? I've checked the "dosbox_rebel.conf" and there it says "fullscreen=true" but the game still plays in a window? (Alt+Enter also does nothing).

Alt+Enter should certainly toggle fullscreen no matter what's in the config. What aspect and resolution settings are you using?