It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussionDownloads are getting corrupted(26 posts)solved(26 posts)solved
(26 posts)solved
Pages:
1
2
This is my favourite topic
Posted December 15, 2017
Posting new topics does not work for me on GOG's retarded forum, and I have lost many helpful posts. I just rewrote one, and I'm posting it as a reply to this topic since that's the only way I can post it. You can paste links to it around the internet, and just call it something like "badon's backup article" or whatever. Maybe at some point I should make a formal article out of it.

7 steps to never lose data - Backups are almost useless

A followup on this topic:

https://www.gog.com/forum/general/downloads_are_getting_corrupted/page1

In short, backups should be the LAST thing you do, and you should never need to use your backup unless all other data integrity techniques have failed. For myself, I'm using 7+ data integrity techniques:

1. RAID-1 mirror.

It's like an automated backup that protects against a sudden drive failure.

2. FastCopy.

When I move files around, it verifies the copy operation was error-free.

3. Corz Checksum.

The fastest error detection verifications.

4. MultiPar.

If errors exist, MultiPar repairs them. It's like magic!

5. Vice-Versa PRO backup.

It's the best backup software, and it's one of the VERY FEW that will do verification after copying to the backup, like FastCopy does.

6. Rotating offline backup.

I use a single extra disk to make an extra copy of my backups, and I keep it unconnected to anything. That protects against lightning strikes and massive power surges (like EMP). If my home gets struck by lightning, this 6th technique will survive.

7. Offsite backup.

I usually have 2 disks in step #6 above. One of them is on-site (home), and the other one I take and store somewhere else that I go to frequently (work, friend's house, etc). I carry my on-site backup in my EDC bag. When I go to my offsite location (work), I swap it with my offsite backup. When I go home, I swap my backup with my off-site backup. So, in short, all 3 of my backup disks are rotated between each other's roles.

7A: Online, onsite backup (0 to 2 hours old, frequently updating).
7B; Offline, onsite backup (0 to 3 days old).
7C: Offline, offsite backup (1 to 3 days old).
Post edited December 15, 2017 by badon
Posted December 15, 2017
avatar
argent07: So I'm trying to download a game's installer from my GOG library, and everytime it seems the download gets damaged, and states that i need to re-download the files. I saw one thread state that GOG Galaxy would potentially work.

Well I just tried downloading the backup installer for said game through GOG Galaxy, and 4 out of 6 individual parts for said game are corrupted.

What do I need to do in order to get the installer parts intact for backing up?
Could be this problem:
https://www.gog.com/forum/general/cdnhwgogcom_is_damn_slow_about_2_kbs
Posted December 15, 2017
So....the hard drive I'm putting this onto, a small 1 TB external....arrived to me formatted with FAT32...I'm reformatting that to NTFS, but it can't really be that simple..........can it?

EDIT: This wasn't it AT ALL. And also, when I reslotted the download to try and repair two damaged files....TWO MORE WERE DAMAGED...what the actual hell?


So where can I go to compare the MD5 hash's of GOG's files?
Post edited December 16, 2017 by argent07
Posted December 16, 2017
So the GOG Downloader didn't work for you?

avatar
argent07: So....the hard drive I'm putting this onto, a small 1 TB external....arrived to me formatted with FAT32...I'm reformatting that to NTFS, but it can't really be that simple..........can it?
Not sure if I'm understanding this correctly. You reformatted the drive to NTFS, or you plan to but don't know exactly how to do it?

avatar
argent07: So where can I go to compare the MD5 hash's of GOG's files?
Unfortunately GOG doesn't provide such thing. Here's a Wishlist for it, and are a few others but with very few votes.
All you can do is to ask the GOG support for the hashes or the members here, if you tell us the games you're having problems with.
Posted December 16, 2017
avatar
argent07: So where can I go to compare the MD5 hash's of GOG's files?
You can find some answers in my topic:
https://www.gog.com/forum/general/md5_hashes_for_big_downloads_like_the_witcher_3
Posted December 16, 2017
avatar
argent07: And also, when I reslotted the download to try and repair two damaged files....
Speak English, doc! We ain't scientists!

What do you mean by "reslotting" or "trying to repair damaged files" etc.?

First of all, do you have similar corruption issues when downloading from other sources besides GOG.com, using your web browser? I am not talking about using a bittorrent client or Steam or anything like that (which do constant integrity checking and redownloads corrupted parts), but using the same web browser you are using for GOG downloads?

As some have pointed out, it could be some hardware or connectivity issue at your end. A failing hard drive, faulty RAM, your internet connection is flaky, your USB port has issues (since you are apparently downloading to an external USB drive), or something like that... but as said, then it should happen when downloading big files from elsewhere as well.

So since you use that USB drive, does the issue happen also if you download to some other partition instead, e.g. to your internal hard drive?

Also, did you say that two more files, which were ok before, had suddenly become corrupted too on your hard drive on their own? Just to see if the corruption happens during or after the download...
Post edited December 16, 2017 by timppu
Posted December 16, 2017
1. Drive was reformatted.

2. Cleared the download from the downloader without deleting files, then re-clicking the downloader link to restart it.

3. Files appear to work successfully on my own local hard drive. Copied to the external without moving them over my USB3 "1" port to the external "as is", as in no compression or packing, "broke" three files. Comparison of sizes of one of the files both remote and local indicates that they are the exact same size.




further comparisons will have to occur after i get home from work.
Posted December 16, 2017
Seems like your transfer over the USB port corrupts the files. What Windows version do you have? From what I remember, Windows 7 doesn't have native USB3 drivers, so your external drive will work in USB2 mode, unless you install the USB3 drivers from Intel/AMD.

If this is the case for you, then my guess is that the external drive is not getting enough power, USB2 being limited to 500 mA and the external drive requiring a bit more, usually around 800 mA.

Use this program, USBDeview, and look how much power your external drive draws when is connected. If it's no more than 500 mA, then it probably works in USB2 mode.

And tell us the name of the game you're trying to copy on the external drive and we'll provide you the checksums, if we happen to have it in our library.
Posted December 16, 2017
avatar
tinyE: FOUND THE PROBLEM!
You calling me problematic?
Posted December 17, 2017
avatar
ariaspi: Seems like your transfer over the USB port corrupts the files. What Windows version do you have? From what I remember, Windows 7 doesn't have native USB3 drivers, so your external drive will work in USB2 mode, unless you install the USB3 drivers from Intel/AMD.

If this is the case for you, then my guess is that the external drive is not getting enough power, USB2 being limited to 500 mA and the external drive requiring a bit more, usually around 800 mA.

Use this program, USBDeview, and look how much power your external drive draws when is connected. If it's no more than 500 mA, then it probably works in USB2 mode.

And tell us the name of the game you're trying to copy on the external drive and we'll provide you the checksums, if we happen to have it in our library.
Windows 7 64-bit on an Asrock 990FX mainboard. There is a minor driver update that I can perform, while the drive operates on a USB 2.0 port. And yeah, it was the USB port, because I tried copying the files back to the main hard drive to see if it may have actually been the hard drive itself, and there was an additional file 'damaged'

EDIT: Yeah that was it. Not sure if it's affecting BOTH USB3.0 ports or just the one that's open and available and not being used by a wireless N adaptor, and personally, I don't care. I can live without using that port like it's meant to be....
Post edited December 17, 2017 by argent07
Posted December 17, 2017
avatar
argent07: Windows 7 64-bit on an Asrock 990FX mainboard. There is a minor driver update that I can perform, while the drive operates on a USB 2.0 port. And yeah, it was the USB port, because I tried copying the files back to the main hard drive to see if it may have actually been the hard drive itself, and there was an additional file 'damaged'

EDIT: Yeah that was it. Not sure if it's affecting BOTH USB3.0 ports or just the one that's open and available and not being used by a wireless N adaptor, and personally, I don't care. I can live without using that port like it's meant to be....
Glad you've found the source for your problem. You should check the Windows System logs in Event Viewer. Probably there are Warning and Error entries with the Source being Disk and Ntfs.

To prevent damaging the USB ports from heavy usage, I recommend using an USB extension cable (or USB hub) that you leave pluged-in all the time.
Pages:
1
2
This is my favourite topic
Community
General discussionDownloads are getting corrupted(26 posts)solved(26 posts)solved
(26 posts)solved