It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

I can press the save game button and then load from there so long as I don't exit the game completely.

If I exit completely all saved games are lost and I have to start from scratch.

do you hover over the save files and click it?

Also the saves are bound to your profile.
This means you need to type your name each time the same way to get the progress/files from your profile.