It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Once I buy a game I like to download the install files and store them on an external hard drive. Unfortunately for some games this process can break one or more of the installation files when I try to install the game later. Does anyone know why this happens and if there is a way to reliably copy the files without having to worry about the file integrity breaking down? I have had this happen recently with Neverwinter Nights 2 and Titan Quest. It seems the games with multiple part installation files are more vulnerable to breakage than the games with a single file.
No posts in this topic were marked as the solution yet. If you can help, add your reply
Are you renaming any of the files?
avatar
moonreaver: Once I buy a game I like to download the install files and store them on an external hard drive. Unfortunately for some games this process can break one or more of the installation files when I try to install the game later. Does anyone know why this happens and if there is a way to reliably copy the files without having to worry about the file integrity breaking down? I have had this happen recently with Neverwinter Nights 2 and Titan Quest. It seems the games with multiple part installation files are more vulnerable to breakage than the games with a single file.
Post edited September 09, 2016 by paladin181
Hmmm... after copying... so the original downloads work? If the integrity is failing, I'd do a scandisk and sector block integrity check...
avatar
paladin181: Are you renaming any of the files?
No. I keep the file names the same.
avatar
rtcvb32: Hmmm... after copying... so the original downloads work? If the integrity is failing, I'd do a scandisk and sector block integrity check...
Yes. After I download the file I can install it fine. Its just after copying the install files to the external hard drive that I have issues. I'll try the scandisk on the external and see if anything comes up.
avatar
moonreaver: Yes. After I download the file I can install it fine. Its just after copying the install files to the external hard drive that I have issues. I'll try the scandisk on the external and see if anything comes up.
You'll probably have to do a sector scan. This will be 20x-40x longer than normal as it will be looking for errors with the actual sectors in question and hopefully marking off ones that are dead.
avatar
moonreaver: Yes. After I download the file I can install it fine. Its just after copying the install files to the external hard drive that I have issues. I'll try the scandisk on the external and see if anything comes up.
avatar
rtcvb32: You'll probably have to do a sector scan. This will be 20x-40x longer than normal as it will be looking for errors with the actual sectors in question and hopefully marking off ones that are dead.
I set the scandisk to do a search for bad sectors. I assume that was what you were talking about when you mentioned sector scan.
avatar
moonreaver: I set the scandisk to do a search for bad sectors. I assume that was what you were talking about when you mentioned sector scan.
Yep. Try not to be using the drive for anything at all while it's busy.
Its late here so I'm just going to go to bed and see what it turns up in the morning.
avatar
moonreaver: Its late here so I'm just going to go to bed and see what it turns up in the morning.
Leave it running on it's own. It could take several hours or longer depending on the size of the drive.
Yeah check that the hard drive(s) are ok. However, I used to have similar problems a couple of years ago, to me it seemed it was related to USB3.0 in Windows 7 because back then I had other USB3.0 problems as well, like the external drives suddenly getting disconnected if I was copying lots of data to them etc. Apparently the Windows 7 USB 3.0 drivers were crap or something, but nowadays, at least after reinstalling Windows 7, I don't recall seeing these problems anymore.

This didn't happen if I used USB 2.0 (e.g. my USB 2.0 hub), and for some reason I had these problems only with external USB drives, not e.g. USB flash drives.

A couple things I have used and use to make sure copying and moving files goes ok:

1. Earlier I used Teracopy for copying or moving files, especially when doing it to those external hard drives. It has an option that it automatically double-checks after file copy or move that the target files are ok, that they have the same CRC32 checksums as the original files. If it detects problems, it will perform the file operation (and verification) again.

I haven't used it lately though, I had some issues that when I had two (or more) accounts in Windows 7 and installed Teracopy on one of them, it didn't seem to work fully on the other accounts. It worked only on the account where it was installed even though it was visible also on the other accounts. Maybe the program's support for multiple Windows accounts/users was incomplete or something, but if you are using just one account in Windows, I guess this doesn't matter. Also I don't know if this works in e.g. Windows 10, the page mentions support only for Windows 8 (I used it in Windows 7).

2. Nowadays I mostly use DVDSig if I have e.g. several files I want to copy or move to the external hard drive. I put all the files to be copied in one folder, run dvdsig "scan" in it (this creates a md5 checksum for all the files in the folder), copy the whole directory to the external hard drive, and then run dvdsig "verify".

If I want to scan and verify my whole external hard drive (2TB or 3TB), I use RHash instead of DVDSig. DVDSig is easier to use for quick checkups, but rhash is more heavy-duty with more options, and with e.g. these benefits:

- It has support for even more advanced checksum algorithms than mere CRC32 or MD5.

- DVDSig didn't seem to be able to scan and verify files which were either very very small, or had some non-ASCII characters in the filename. RHash has no issue with those. For GOG installers and extras files this is not an issue though, they are not too small nor have odd filenames.

- RHash has an option to add checksums for new files it detects, so that you don't have to re-create checksums for all your files every time you add new files to e.g. your external hard drive. That would be silly anyway because if some of the old files have become corrupted in the meantime for some reason, then you'd create new checksums for the corrupted versions.

- RHash is multiplatform so you can use it for your files in Windows, Linux and whatever. DVDSig and TeraCopy are Windows-only I think.


In the long run, I hope filesystems like BtrFS become more commonplace, as they have file integrity check built-in to the filesystem itself so you don't have to use extra utilities like these. They will notice (and even try to fix) if some file gets corrupted during some file operation.
Post edited September 09, 2016 by timppu
I always compare checksums after copying important data.
md5sum is good enough.
avatar
kbnrylaec: I always compare checksums after copying important data.
md5sum is good enough.
I would. Although you might get bogus results if it's basing the results on the cache rather than off the drive's data.

Save md5 hashes
md5sum * > files.md5

check md5 hashes
md5sum -c files.md5
Attachments:
md5sum.png (2 Kb)
avatar
timppu: - RHash has an option to add checksums for new files it detects, so that you don't have to re-create checksums for all your files every time you add new files to e.g. your external hard drive.
This seems useful.
Do you know if there are also GUI programs for Win7 that can check-save-reuse multiple hashes in one go?

I wish that Teracopy or SyncBackFree could do this too..
avatar
timppu: - RHash has an option to add checksums for new files it detects, so that you don't have to re-create checksums for all your files every time you add new files to e.g. your external hard drive.
avatar
phaolo: This seems useful.
Do you know if there are also GUI programs for Win7 that can check-save-reuse multiple hashes in one go?

I wish that Teracopy or SyncBackFree could do this too..
Hmmm it doesn't seem like it would be a hard thing to to do... It really depends on how often files are checked for new/changes/missing/other.

Let's assume I check every, oh... 30 minutes for new files. The directory is scanned, check against files by merging the current md5 with the checked files, sort them, and then find uniques. If it's an MD5 sum then the value is ignored (removed file from download directory), and if it's a new file, you calculate the md5 value and append it to the file... It doesn't sound that hard.
Sorry I misread, you specifically wanted a GUI program with the ability to add checksums for new files (not those which were already copied).
Post edited September 09, 2016 by timppu