Just seconding what keeveek said, it might seem daunting at first but it's actually pretty simple.
The bits to look at would be:
Output: The default is surface and it doesn't support scaling. I usually use ddraw but you can use whatever you prefer.
Aspect: This makes games that used 320x200 with nonsquare pixels look the right shape by scaling them up to 320x240. You almost always want this on true.
Scaler: This multiplies the resolution by whatever. For example for a game that is 320x240, normal2x makes it 640x480, normal3x makes it 960x720.
Finally, you want to scroll back up to
Windowresolution. This is the final stage of scaling to use if you want the picture bigger than 960x720. If you used this from the start without the multipliers then it'd be very blurry and you'd be back where you started, but hopefully the scalers will help preserve some clarity.
While you're in this section, it might be worth changing
Fullresolution to the native resolution you use for your desktop.