It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3745 posts)(3745 posts)
(3745 posts)
Pages:
1
50
100
150
200
225
226
227
228
229
250
This is my favourite topic
Posted November 08, 2022
I've fixed the Python 3.11 deprecation issue, and hopefully fixed the thing where it would crash rather than letting you know, that you were missing the token on the dev branch and would appreciate some testing on that. As well as merged the fix for when Locale didn't return a language.

There's a few more changes that will come to dev soonish, but I need to test those first (like moving the detailed MD5 error reports to debug level, and setting up a flag to enable debug level logging) as well as a potential fix for some of the md5 errors that was suggested by pasbec.
Posted November 09, 2022
Finished the testing and it all seems good, so added to dev and then merged dev to master.

ETA - I have also decided to nag GOG support about fixing the @o$@)($@ Imperator Rome installers again, it would be cool if all the installers were on all the servers and the files were also the same across all the servers.
Post edited November 09, 2022 by Kalanyr
Posted November 10, 2022
avatar
Kalanyr: ...as well as a potential fix for some of the md5 errors that was suggested by pasbec.
I'm not sure what this potential fix is supposed to do, but I have just now run a full update on my library with the new version, and there was no noticeable change in the rate of md5/xml errors.

Thank you for all your efforts.
Post edited November 10, 2022 by mrkgnao
Posted November 10, 2022
avatar
Kalanyr: ...as well as a potential fix for some of the md5 errors that was suggested by pasbec.
avatar
mrkgnao: I'm not sure what this potential fix is supposed to do, but I have just now run a full update on my library with the new version, and there was no noticeable change in the rate of md5/xml errors.

Thank you for all your efforts.
I got a decent drop in my testing but there's definitely still issues: about 2% of my games currently have 1 or more issues getting MD5s, which is down from before but it's still a fair chunk.
Posted November 10, 2022
avatar
mrkgnao: I'm not sure what this potential fix is supposed to do, but I have just now run a full update on my library with the new version, and there was no noticeable change in the rate of md5/xml errors.

Thank you for all your efforts.
avatar
Kalanyr: I got a decent drop in my testing but there's definitely still issues: about 2% of my games currently have 1 or more issues getting MD5s, which is down from before but it's still a fair chunk.
Did you test immediately before and after applying the fix? Because I have also noticed an unrelated decent drop in issue rate, beginning a few weeks ago, which I assumed to be due to some GOG change, as nothing had changed on my side.

My current rate is about 0.5%, but I'm running with my fix.
Posted November 10, 2022
avatar
Kalanyr: I got a decent drop in my testing but there's definitely still issues: about 2% of my games currently have 1 or more issues getting MD5s, which is down from before but it's still a fair chunk.
avatar
mrkgnao: Did you test immediately before and after applying the fix? Because I have also noticed an unrelated decent drop in issue rate, beginning a few weeks ago, which I assumed to be due to some GOG change, as nothing had changed on my side.

My current rate is about 0.5%, but I'm running with my fix.
No, there's a couple of weeks between my tests, so might be that. My collection is just to large to practically A/B test on the it (especially at the moment when the lack of Update markers means that a full update can result in nearly half a TB of downloads).
Posted November 11, 2022
avatar
Kalanyr: No, there's a couple of weeks between my tests, so might be that. My collection is just to large to practically A/B test on the it (especially at the moment when the lack of Update markers means that a full update can result in nearly half a TB of downloads).
What I do when I want to test my tool quickly is that I create a smaller manifest with only a few smaller games that cover what I want to test and set the storage to a test directory on my local filesystem.

That tends to do the trick and I don't put my real backup at risk.
Post edited November 11, 2022 by Magnitus
Posted November 17, 2022
avatar
Kalanyr:
Is there a way to add some code that when update is run with skiphidden, hidden games will indeed be skipped, but if they happen to have an update flag, the flag will be cleared (currently it is not)?
Posted November 18, 2022
avatar
Kalanyr:
avatar
mrkgnao: Is there a way to add some code that when update is run with skiphidden, hidden games will indeed be skipped, but if they happen to have an update flag, the flag will be cleared (currently it is not)?
Hmm. I think so.
Posted November 19, 2022
nvm, misread
Post edited November 19, 2022 by phaolo
Posted November 22, 2022
I cant get this download tool to work. I know my user/pass is valid. I also have 2FA disabled. However, this tool keeps saying GOG is asking for a recaptcha. I doubt it's my IP address, since I just now logged into gog.com in a Web browser, no probs. But when i try to log in via the script, nada. I've also tried logging in with a VPN, same issue.

The gogrepo tool by eddie3 gives the same error.

Solved, ignore, I was using an old version from a zip file I've had stored on a flash drive. After noticing the py script had been updated very recently, i tried that instead.
Post edited November 22, 2022 by Enigma83
Posted November 26, 2022
Something's acting up on the GOG side of things - earlier on it flagged majority of my collection as obsolete and moved it to !Orphaned folder. Then there were download problems, with failing to access a number of files mid-download and resulting in their failed downloads (50x error code, I forgot which and removed the log before I thought to post here about it, sorry).

It got much better since, but a few games or bonus materials are still missing from the manifest, with no replacement getting downloaded, while the content is still available on the GOG website for manual download (I kept moving everything back into the main backup directory, before each run of Update and Clean commands - in order to see if the manifest was updated properly, and/or a new version appeared - deleting them from !Orphaned folder, if there actually was a new version).

The games/files in my collection, which are still affected:

deponia_2_chaos_on_deponia (the sole .bin file and all bonus content - the .exe file stays in the main collection folder)

magrunner_dark_pulse (magrunner_avatars.zip file - only that one)

xenonauts (everything, only the !info.txt file is left in the main collection folder)
Post edited November 26, 2022 by piranha1
Posted November 26, 2022
avatar
piranha1: Something's acting up on the GOG side of things - earlier on it flagged majority of my collection as obsolete and moved it to !Orphaned folder. Then there were download problems, with failing to access a number of files mid-download and resulting in their failed downloads (50x error code, I forgot which and removed the log before I thought to post here about it, sorry).

It got much better since, but a few games or bonus materials are still missing from the manifest, with no replacement getting downloaded, while the content is still available on the GOG website for manual download (I kept moving everything back into the main backup directory, before each run of Update and Clean commands - in order to see if the manifest was updated properly, and/or a new version appeared - deleting them from !Orphaned folder, if there actually was a new version).

The games/files in my collection, which are still affected:

deponia_2_chaos_on_deponia (the sole .bin file and all bonus content - the .exe file stays in the main collection folder)

magrunner_dark_pulse (magrunner_avatars.zip file - only that one)

xenonauts (everything, only the !info.txt file is left in the main collection folder)
Try forcing a refresh using update -ids followed by the name of the game folders (also include any language/os setting you usually use)
Post edited November 26, 2022 by Kalanyr
Posted November 27, 2022
Yeah, that helped, thanks. :)
Posted November 27, 2022
Besides using GOG's update tag, is there any other way to check if something has been updated or altered since the last download? Also, would it compare that to the manifest/info files, or would it need the actual downloaded files? I hate the underscored folder names in the gogrepo folder, so I renamed all my backup folders to the proper game name (spacing, caps, etc.) a long time ago. I've mostly used the update and skipknown flags + ids to nab new stuff I've bought and get them in the manifest, but I'm interested in doing a a full recheck to see if I've missed anything.
Pages:
1
50
100
150
200
225
226
227
228
229
250
This is my favourite topic
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3745 posts)(3745 posts)
(3745 posts)