It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(4034 posts)(4034 posts)
(4034 posts)
Pages:
1
17
18
19
20
21
50
100
150
200
250
269
This is my favourite topic
Posted December 11, 2015
Ran another verify on my backups last night, only one error so that's good.
It would be great to have the verify command with the -id option so I don't have to run the entire thing again.
For now I just checked the MD5 manually which is probably enough.
Posted December 11, 2015
avatar
Smannesman: It would be great to have the verify command with the -id option so I don't have to run the entire thing again.
Agreed, one of the features I still want. Verification for single items.
Posted December 13, 2015
HOLY SHIT. Was entering the wrong commandline all along. Got html5lib installed. WINNER. Now I just need to get back into getting this script to work!


Script is working like a CHAMP. Currently updating the manifest for my library. I knew it was user error somewhere here. Thanks for the attempts to help me, though. Glad I got this working because backing up through Galaxy SUCKS when it doesn't properly transfer the files from one directory to the other or doesn't "complete the download so I'm left with useless files.
Post edited December 13, 2015 by paladin181
Posted December 13, 2015
avatar
Smannesman: snip.
Ok. Real question time. Since I'm a moron who couldn't figure out how to install the libraries properly earlier....
I went to import my library of back-ups to an existing folder (not the same folder GoGRepo is located). So my game downloads\GoGRepo folder already exists. I imported the files, and after over 4 hours it completed properly without any errors or anything... But the destination folder is completely empty. What did I do wrong?

so here's the command list:
G:\Files\GoGRepo
gogrepo.py import "G:\Files\Game Downloads\GoG Downloads" "G:\Files\Game Downloads\GoGRepo"
Post edited December 13, 2015 by paladin181
Posted December 13, 2015
I wondered earlier about the difference of the backup and import options, maybe this gives some idea what might have gone wrong?

http://www.gog.com/forum/general/gogrepopy_python_script_for_regularly_backing_up_your_purchased_gog_collection_for_full_offline_e/post165

In the end I don't think I ever used either import nor backup (I guess "clean" made "backup" pretty much irrelevant, it is a much better way to cut out the obsolete stuff). I downloaded all my games, and from then on time to time (like once every two weeks or less) re-download the whole manifest from scratch, run clean, and run download.

And sometimes if I feel like it, also run verify after all this. But this less often as it is the most time-consuming thing to do.
Post edited December 13, 2015 by timppu
Posted December 13, 2015
avatar
timppu: I wondered earlier about the difference of the backup and import options, maybe this gives some idea what might have gone wrong?

http://www.gog.com/forum/general/gogrepopy_python_script_for_regularly_backing_up_your_purchased_gog_collection_for_full_offline_e/post165

In the end I don't think I ever used either import nor backup (I guess "clean" made "backup" pretty much irrelevant, it is a much better way to cut out the obsolete stuff). I downloaded all my games, and from then on time to time (like once every two weeks or less) re-download the whole manifest from scratch, run clean, and run download.

And sometimes if I feel like it, also run verify after all this. But this less often as it is the most time-consuming thing to do.
I was trying to avoid re-downloading everything, but it just seems like that's not an option at this point. That's well over 600GB I have to download at this point and it's going to take forever.
Posted December 14, 2015
avatar
paladin181: I was trying to avoid re-downloading everything, but it just seems like that's not an option at this point. That's well over 600GB I have to download at this point and it's going to take forever.
I guess import should do what you want (get the valid exe and bin installers from your existing collection; it won't bring over any of the zip files and such), but something is wrong there. Hopefully the script author can help. The first thing I'd personally try would be to remove white spaces from the directory names, just in case.
Post edited December 14, 2015 by timppu
Posted December 14, 2015
I'm copying the files manually right now and hoping they'll verify when I try to download again. :D I'll try to import from the self directory and update the manifest that way.
Posted December 15, 2015
avatar
paladin181: I'm copying the files manually right now and hoping they'll verify when I try to download again. :D I'll try to import from the self directory and update the manifest that way.
Of course if your existing GOG collection is quite old already, there's also the possibility that all the installers have changed during that time, considering GOG seems to change them quite actively even for minor changes, or quite many got changed due to Windows 10. Still, one would expect at least some old installers having stayed the same.

Have you identified some installers that seem to have remained the same, ie. the import function should recognize them as valid and copy them to the target directory? I'm unsure if the script is supposed to give some feedback even if it can't find any valid files.
Post edited December 15, 2015 by timppu
Posted December 15, 2015
avatar
timppu: Of course if your existing GOG collection is quite old already, there's also the possibility that all the installers have changed during that time, considering GOG seems to change them quite actively even for minor changes, or quite many got changed due to Windows 10. Still, one would expect at least some old installers having stayed the same.

Have you identified some installers that seem to have remained the same, ie. the import function should recognize them as valid and copy them to the target directory? I'm unsure if the script is supposed to give some feedback even if it can't find any valid files.
I copied them manually and ran the download script. It only had to download about 25 GB of files. I then Verified this, and everything was good. So either I fat-fingered the import function (entirely possible, I didn't have an output log, though the files weren't copied anywhere that I can see and the script didn't fail on a "file/directory not recognized" fault) or the input function doesn't work as it would seem it's supposed to. The other problem could be that when importing, the files were already properly named in the proper directories (just not in the overall target directory) as I downloaded them through GoG Galaxy in a binge when it was released and have been manually keeping up with updates. I figured I had missed more than that, honestly.
Post edited December 15, 2015 by paladin181
Posted March 01, 2016
I'm getting a 404 on Broken Age after the update (of Broken Age, there hasn't been an update to gogrepo in ages).
Posted March 01, 2016
avatar
Smannesman: I'm getting a 404 on Broken Age after the update (of Broken Age, there hasn't been an update to gogrepo in ages).
No frequent updates do not mean the software isn't healthy.

I also ran an update yesterday and remember seeing Broken Age. The 404 errors are sometimes due to no md5 information available, it still downloads the installers.

Later at home, I can check if I've got anything downloaded.
Post edited March 01, 2016 by disi
Posted March 01, 2016
avatar
Smannesman: I'm getting a 404 on Broken Age after the update (of Broken Age, there hasn't been an update to gogrepo in ages).
Do you mean during the gogrepo update? Can you still download it with gogrepo though?

As disi said, I think during the update that error refers to no md5 data available on GOG servers? The game will still get downloaded by gogrepo, it is just that during verification it doesn't get verified properly against md5sum, only based on its file size?

I don't have Broken Age yet, but I think I get the same update error each time with Kyn, and The Walking Dead Season 1 (Season 2 doesn't give this error). As said, the games get downloaded fine though.

Earlier I think System Shock 2 update patch used to give this error too, but not anymore. Probably because it doesn't have a separate update patch anymore, the System Shock 2 main installer is now up to date.

None of the other of my 1194 GOG games give that error. I don't know why a few of those games seem to miss the md5 data, maybe GOG should be notified of those three games (Broken Age, Kyn, The Walking Dead Season 1). Not sure if there are any others, hey I don't own ALL GOG games! :)

Ps. Is there some way to check the existence of the md5 data for certain game, from e.g. the download page?
Post edited March 01, 2016 by timppu
Posted March 01, 2016
Ah you're right, it does download.
I thought I'd found a good opportunity to see if the dev was still around, I'm still waiting for the -id on the verify command ;)
Posted March 01, 2016
I'm still around but soooooooooooooooo busy, working two jobs, family, etc :(

gogrepo.py is ABSOLUTELY not dead. When I'm done one of my contracts I will be actively working on this again. It's still solid for now though.

I will improve the error messages so that the 404's are more clear that they are just MD5, and not the file itself.

Thanks for your understanding... and feel free to request features on the github page.

Cheers
Pages:
1
17
18
19
20
21
50
100
150
200
250
269
This is my favourite topic
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(4034 posts)(4034 posts)
(4034 posts)