timppu: I would rather reinstall Galaxy again over the old installation, and then uninstall it. That should make sure you get rid of everything.
Randalator: Well, they can't really do that if the Galaxy installer recognizes Galaxy as already installed because of the leftover registry entries...
I don't know about the Galaxy installers, but so far I haven't seen a Windows application installer that would have refused to install because of an existing (broken) installation.
I've used that trick several times when a program has refused to uninstall for some reason, or was removed only partially, including with a couple of GOG games.
Oh well, it doesn't hurt to try. If it refuses to install over an existing installation, then I guess it can't be used.