Posted February 22, 2022
Tarhiel
Unn Von Taffer
Tarhiel Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Feb 2010
From Germany
Magnitus
Born Idealist
Magnitus Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Mar 2011
From Canada
Posted February 22, 2022
mrkgnao: Given that MaGog collected hundreds of pieces of information on every single one of the thousands of games in GOG's catalogue every six hours for more than six years with rarely a noticeable effect, I consider the stress created by a full update utterly negligible.
MaGoG was a single entity. Heck, even my 10000-30000 requests, if taken by themselves are a drop in the ocean. Now, empower hundreds, maybe thousands, of users to do the same thing (and they're not all doing it nice and sequential like Magog was over the course of a day, its more random than that with a bunch of live users) and its another story.
This is really a case of "What if everyone was doing as I do?".
I'm pretty sure that between all 3 unofficial clients, we're talking about hundreds of users at this point. If those clients were more mainstream (ie, really well polished extremely easy to setup and use with a gui), we'd be talking thousands.
Post edited February 22, 2022 by Magnitus
phaolo
Durik - Half-Orc
phaolo Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Dec 2013
From Italy
Posted February 22, 2022
I doubt blotunga meant just updating the manifest but not downloading the files.. what would that accomplish? O_o
Expecially for new big games that get frequent changes (if you don't have them, I'm speaking in general).
mrkgnao: I do a regular update (i.e. flagged games) whenever I notice a GOG flag, which could easily be several times a day. I do a full update about once or twice a month.
Wouldn't that just download way more files in those months (4-6 for me), instead of just doing 1 full update? Expecially for new big games that get frequent changes (if you don't have them, I'm speaking in general).
mrkgnao
https://www.amazon.com/dp/B00HCZVCTO
mrkgnao Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Apr 2009
From United States
Posted February 22, 2022
phaolo: I doubt blotunga meant just updating the manifest but not downloading the files.. what would that accomplish? O_o
The purpose of that is to find all those installer updates that GOG did not flag (and there are a lot of those). You do a full update, then download those unflagged new installers, not your entire library. It's not that different from a regular update, except that it takes much longer and finds unflagged games. But it's essential to do that regularly, otherwise your library is not up to date. mrkgnao: I do a regular update (i.e. flagged games) whenever I notice a GOG flag, which could easily be several times a day. I do a full update about once or twice a month.
phaolo: Wouldn't that just download way more files in those months (4-6 for me), instead of just doing 1 full update? Expecially for new big games that get frequent changes (if you don't have them, I'm speaking in general).
Post edited February 22, 2022 by mrkgnao
timppu
Don't worry, be sorry.
timppu Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Jun 2011
From Finland
Posted February 22, 2022
blotunga: Not everyone has the same workflow. I for example have gogrepo on a Synology NAS, automatically updating my library weekly and full once a month. The first time I downloaded my library it took 5+ days.
phaolo: Isn't that.. way too frequent? O_o I recall Kalanyr said to use gogrepo sparingly to not stress Gog's servers (expecially during sales).
I run it like 3 times a year..
I also don't normally run an update for months (two or three, sometimes more, months, if I just don't feel like doing it)... but I admit that right now I wish I had run a full update recently, if there really are issues now with gogrepo working. :D
Well, at least I have a "pretty recent" (ie. some months old) snapshot of my games, and at least downloading the games I've bought during the last few months shouldn't be too hard, even manually. So at least it could be worse.
Then again, if you wait longer before the next update, you might many times skip downloading versions that appeared in between. So on the average you will be downloading less from GOG servers, sometimes much less, like when I skipped a couple of Cyberpunk 2077 updates before I re-downloaded the game, I avoided downloading the whole game again a couple of times.
Post edited February 22, 2022 by timppu
B1tF1ghter
Execute order $rep_string
B1tF1ghter Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Jun 2015
From Other
Posted February 22, 2022
low rated
I haven't followed this thread in a while.
I have some questions.
Please excuse my rudeness but I don't have time to read the few dozen pages since the last time I checked the thread so I will just stright out ask.
1. What is the current most actively worked on / updated fork ?
2. Does it use GOG API for the *downloads* already ?
3. Does it support download pause / resume (within same chunk / file) ?
4. Would it survive IP change mid download ?
5. Does it allow getting checksums / downloads of non-latest builds ?
I would appreciate the response.
Feel free to make it in-depth.
I have some questions.
Please excuse my rudeness but I don't have time to read the few dozen pages since the last time I checked the thread so I will just stright out ask.
1. What is the current most actively worked on / updated fork ?
2. Does it use GOG API for the *downloads* already ?
3. Does it support download pause / resume (within same chunk / file) ?
4. Would it survive IP change mid download ?
5. Does it allow getting checksums / downloads of non-latest builds ?
I would appreciate the response.
Feel free to make it in-depth.
blotunga
GrumpyOldGamers.CyringOutMiserably
blotunga Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Apr 2012
From Other
Posted February 22, 2022
Basically this. Not every update is flagged, if you accidentally click in your library to an updated/new game, gogrepo update will miss it etc. I prefer to play it safe.
Nice idea with the filters, I only identified a handful (too lazy), but could you paste somewhere your full list, I think I might add some more :)
I'm using these at the moment: "patch_*.exe" "patch_*.bin" "patch_*sh" "*_(32bit)_*.exe" "*_(32bit)_*.bin"
Nice idea with the filters, I only identified a handful (too lazy), but could you paste somewhere your full list, I think I might add some more :)
I'm using these at the moment: "patch_*.exe" "patch_*.bin" "patch_*sh" "*_(32bit)_*.exe" "*_(32bit)_*.bin"
Post edited February 22, 2022 by blotunga
Magnitus
Born Idealist
Magnitus Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Mar 2011
From Canada
Posted February 22, 2022
timppu: Then again, if you wait longer before the next update, you might many times skip downloading versions that appeared in between. So on the average you will be downloading less from GOG servers, sometimes much less, like when I skipped a couple of Cyberpunk 2077 updates before I re-downloaded the game, I avoided downloading the whole game again a couple of times.
Fair enough.phaolo
Durik - Half-Orc
phaolo Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Dec 2013
From Italy
Posted February 22, 2022
blotunga: Basically this. Not every update is flagged, if you accidentally click in your library to an updated/new game, gogrepo update will miss it etc. I prefer to play it safe.
That's why I don't even bother with the non-full update ¯\_(O_o)_/¯ For installers I use:
(I've manually downloaded the few required found by the community)
-skipfiles patch_* setup_*_32_* setup_*_(32bit)*
For extras the list is long tho (I wish it allowed regex):
-skipfiles *.dmg *.sh *.gz *_german.zip *_german_2* *_german_v* *_de.zip *_french.zip *_fr.zip *_spanish.zip *_es.zip *_italian.zip *_ita.zip *_it.zip *_russian.zip *_russian_2* *_russian_v* *_ru.zip *_polish.zip *_pl.zip *_zh.zip *_handbuch.zip *_manuel.zip *_avatar*.zip *_trailers.zip *_sample.zip *_demo.zip *_wav.zip *_wma.zip blitzkrieg_v2*.zip driftmoon_vanilla* setup_outcast_* rott_2013_level* setup_strike_suit* bonus_pack_*_.zip *_redkit.zip all_goodies.zip
I skip some of these because they're old\alt versions, or they're mostly duplicates, or they're way too big (rott editor), etc.
Also, some of the similar entries are needed due to Gog's.. variable naming convention.
Post edited February 22, 2022 by phaolo
Andtha
New User
Andtha Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Feb 2013
From Austria
Posted February 22, 2022
I'm new to the party. I just downloaded gogrepo.py from https://github.com/eddie3/gogrepo and ran it on my Linux machine. 1) login was successful (to my surprise, I was afraid of the reCAPCHA thing). 2) downloading the game details only gets me "xml parsing error trying to get md5 data for ..."
I looked in this discussion for fixes, but I'm not sure what to change in the script. Even though it says it's not for Python 3 yet (README.md from the github repo), it actually runs with python 3.9.9 on my machine. Is the md5 error related somehow?
I cannot find a line with
response.url.replace('?', '.xml?')
as mentioned in this thread (somewhere), only
page.geturl().replace('?', '.xml?')
so I don't know how to fix this.
Help appreciated.
I looked in this discussion for fixes, but I'm not sure what to change in the script. Even though it says it's not for Python 3 yet (README.md from the github repo), it actually runs with python 3.9.9 on my machine. Is the md5 error related somehow?
I cannot find a line with
response.url.replace('?', '.xml?')
as mentioned in this thread (somewhere), only
page.geturl().replace('?', '.xml?')
so I don't know how to fix this.
Help appreciated.
Post edited February 22, 2022 by Andtha
timppu
Don't worry, be sorry.
timppu Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Jun 2011
From Finland
Posted February 22, 2022
Since no one has replied yet, I say what I can:
2. No idea.
3. You can exit the script (while it downloads) anytime you want with Ctrl-C, and then continue by running the same gogrepo download command again. It will resume the downloads from where you left (I think also partial downloads).
Just remember that if you wait so long (before resuming your downloads) that some of the files have been updated/replaced on the GOG servers, then you have to run also "gogrepo update" again, to get the details for the changed files.
4. Yes, if you "pause" and "resume" the download as mentioned in the previous point.
5. I don't think so.
B1tF1ghter: 1. What is the current most actively worked on / updated fork ?
2. Does it use GOG API for the *downloads* already ?
3. Does it support download pause / resume (within same chunk / file) ?
4. Would it survive IP change mid download ?
5. Does it allow getting checksums / downloads of non-latest builds ?
1. Kalanyr's fork is at least the one most talked about in this thread. No idea if there is some other "unknown" fork that is currently more actively updated. 2. Does it use GOG API for the *downloads* already ?
3. Does it support download pause / resume (within same chunk / file) ?
4. Would it survive IP change mid download ?
5. Does it allow getting checksums / downloads of non-latest builds ?
2. No idea.
3. You can exit the script (while it downloads) anytime you want with Ctrl-C, and then continue by running the same gogrepo download command again. It will resume the downloads from where you left (I think also partial downloads).
Just remember that if you wait so long (before resuming your downloads) that some of the files have been updated/replaced on the GOG servers, then you have to run also "gogrepo update" again, to get the details for the changed files.
4. Yes, if you "pause" and "resume" the download as mentioned in the previous point.
5. I don't think so.
PraetorianWolfie
ScummVM Developer
PraetorianWolfie Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Jul 2009
From Greece
Posted February 22, 2022
Andtha: I'm new to the party. I just downloaded gogrepo.py from https://github.com/eddie3/gogrepo and ran it on my Linux machine. 1) login was successful (to my surprise, I was afraid of the reCAPCHA thing). 2) downloading the game details only gets me "xml parsing error trying to get md5 data for ..."
I looked in this discussion for fixes, but I'm not sure what to change in the script. Even though it says it's not for Python 3 yet (README.md from the github repo), it actually runs with python 3.9.9 on my machine. Is the md5 error related somehow?
I cannot find a line with
response.url.replace('?', '.xml?')
as mentioned in this thread (somewhere), only
page.geturl().replace('?', '.xml?')
so I don't know how to fix this.
Help appreciated.
That particular fix is indeed similar for the line that you identified: I looked in this discussion for fixes, but I'm not sure what to change in the script. Even though it says it's not for Python 3 yet (README.md from the github repo), it actually runs with python 3.9.9 on my machine. Is the md5 error related somehow?
I cannot find a line with
response.url.replace('?', '.xml?')
as mentioned in this thread (somewhere), only
page.geturl().replace('?', '.xml?')
so I don't know how to fix this.
Help appreciated.
https://github.com/eddie3/gogrepo/blob/2cd3ac4a77d3e5104662fcfb4d96e7129a758bfe/gogrepo.py#L360
You change it to:
tmp_md5_url = page.geturl() + '.xml'
(Keep the indentation of the line identical).
It won't resolve all of the new issues (bad xml responses, gzipped responses) but it will resolve trying to download with a bad url.
Andtha
New User
Andtha Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Feb 2013
From Austria
B1tF1ghter
Execute order $rep_string
B1tF1ghter Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Jun 2015
From Other
Orkhepaj
SuperStraight Win10 Groomer Smasher
Orkhepaj Sorry, data for given user is currently unavailable. Please, try again later. View profile View wishlist Start conversation Invite to friends Invite to friends Accept invitation Accept invitation Pending invitation... Unblock chat Registered: Apr 2012
From Hungary
Posted February 22, 2022
trigonometrie: Id welcome a common download api.
The valve steam launcher is a giant behemoth and every other launcher also brings its own copy of chromium embedded framework or electron. This is duplication that isn't necessary.
garbage chromium broaf The valve steam launcher is a giant behemoth and every other launcher also brings its own copy of chromium embedded framework or electron. This is duplication that isn't necessary.
they are so slow all the time... cant even get proper small pics and takes time to load them when you scroll..