It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3863 posts)(3863 posts)
(3863 posts)
Pages:
1
27
28
29
30
31
50
100
150
200
250
258
This is my favourite topic
Posted August 26, 2016
avatar
solar_dome: ... Even if the page was populated with hashes for all the available files, would it be useful, or a waste of time? ...
Depends on how cautious people are and how often GOG updates the relevant files. Maybe not the most important feature but at least nice to have.
Posted August 31, 2016
Getting a lot of errors like below:

22:55:57 | ( 3 / 258) fetching game details for akalabeth_world_of_doom...
22:56:08 | request failed: <urlopen error [Errno 10054] An existing connection was forcibly closed by the remote host> (3 retries left) -- will retry in 5s...
22:56:14 | request failed: <urlopen error [Errno 10054] An existing connection was forcibly closed by the remote host> (2 retries left) -- will retry in 5s...
22:56:20 | request failed: <urlopen error [Errno 10054] An existing connection was forcibly closed by the remote host> (1 retries left) -- will retry in 5s...
22:56:25 | error
Traceback (most recent call last):
File "gogrepo.py", line 650, in cmd_update
filter_extras(item.extras, item_json_data['extras'])
File "gogrepo.py", line 373, in filter_extras
fetch_file_info(d, False)
File "gogrepo.py", line 299, in fetch_file_info
with request(d.href, byte_range=(0, 0)) as page:
File "gogrepo.py", line 174, in request
return request(url=url, args=args, byte_range=byte_range, retries=retries-1, delay=HTTP_RETRY_DELAY)
File "gogrepo.py", line 174, in request
return request(url=url, args=args, byte_range=byte_range, retries=retries-1, delay=HTTP_RETRY_DELAY)
File "gogrepo.py", line 174, in request
return request(url=url, args=args, byte_range=byte_range, retries=retries-1, delay=HTTP_RETRY_DELAY)
File "gogrepo.py", line 161, in request
page = opener.open(req)
File "C:\Python27\lib\urllib2.py", line 429, in open
response = self._open(req, data)
File "C:\Python27\lib\urllib2.py", line 447, in _open
'_open', req)
File "C:\Python27\lib\urllib2.py", line 407, in _call_chain
result = func(*args)
File "C:\Python27\lib\urllib2.py", line 1241, in https_open
context=self._context)
File "C:\Python27\lib\urllib2.py", line 1198, in do_open
raise URLError(err)
URLError: <urlopen error [Errno 10054] An existing connection was forcibly closed by the remote host>
Juts did a full reinstall of my OS,
installed Python 2.7.12
downloaded get-pip.py (placed in Python and ran
installed html5lib
performed --upgrade
installed six
performed --upgrade

and now gogrepo.py has been giving me issues throwing that error and other errors all over the place, especially with the "upgrade" argument

Also when i clean it cannot "clean" due to file existing... is this a file permission/ownership issue?
I took ownership of the entire drive
added my user with full control
ensured SYSTEM and ADMINISTRATORS is Full Control
Post edited August 31, 2016 by Starkrun
Posted September 02, 2016
avatar
woolymethodman: github project / download here:

https://github.com/eddie3/gogrepo

Hi GOG Community!

I've been a long time GOG customer and I've recently created a Python script that allows you to save all your GOG content locally for complete offline enjoyment. I am a big fan of their DRM-free practices and love the feeling of OWNING my collection that I paid for (just like big box game days)... of being able to download and keep my entire collection at home, offline. I wanted to contribute my script I used for personal use to regularly keep my complete collection up to date with GOG's latest updates, and my latest purchases. Steam is great, but I feel I'm renting $1000s worth of games from them with no real solution should steam disappear or at go temporarily offline (has happened tons of time during my only free time window for gaming...)

...

Happy GOGing!
Just want to say THANK YOU!
Great script.

As you mentioned on the github site you are open for suggestions: you could add the videos and pics from the game site for downloading. this way one can build up a little galley site. :-)

Again, many thanks.
Greez from Europe to Canada!
Post edited September 02, 2016 by StevyB
Posted September 03, 2016
avatar
StevyB: you could add the videos and pics from the game site for downloading
With a single image a folder will apply it as a "preview" in a certain view mode in windows... I could see this as a nice feature but i dont think they serve the images this way... after they removed the old "shelf" system they did away with them..

but there is a place here for boxart for games... search for any game and most have a nice cover image.

Edit: Found the community list here for DVD covers from GOG members

unofficial, official spreadsheet with links to covers &lt;&lt;::HERE::&gt;&gt;
Post edited September 03, 2016 by Starkrun
Posted September 03, 2016
I get this error now:

Traceback (most recent call last):
File "D:\GOG\gogrepo.py", line 1096, in <module>
main(process_argv(sys.argv))
File "D:\GOG\gogrepo.py", line 1071, in main
cmd_update(args.os, args.lang, args.skipknown, args.updateonly, args.id)
File "D:\GOG\gogrepo.py", line 575, in cmd_update
json_data = json.load(reader(data_request))
File "C:\Python27\lib\json\__init__.py", line 291, in load
**kw)
File "C:\Python27\lib\json\__init__.py", line 339, in loads
return _default_decoder.decode(s)
File "C:\Python27\lib\json\decoder.py", line 364, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "C:\Python27\lib\json\decoder.py", line 382, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
could it be GOG changed something?
The only new game is Titan Quest
Post edited September 03, 2016 by disi
Posted September 03, 2016
avatar
Starkrun: and now gogrepo.py has been giving me issues throwing that error and other errors all over the place, especially with the "upgrade" argument
Could it have something to do with the request time thingamajig?
I remember GOG blocking me if I had too many web requests going.
But I don't remember it throwing out those errors though.

BTW I used it to download something today.
Post edited September 03, 2016 by Smannesman
Posted September 03, 2016
avatar
disi: I get this error now:
I used gogrepo earlier today without problems, also got Titan Quest with it. I was running it on Linux Mint.
Posted September 04, 2016
avatar
disi: I get this error now:
avatar
timppu: I used gogrepo earlier today without problems, also got Titan Quest with it. I was running it on Linux Mint.
Only the German version of the page is broken :(
I deleted my cookie, changed the page display to English on the website, recreated my cookie and now it works...
Posted September 13, 2016
After almost 24 hours of downloading the stupid thing crashed on me. Now what am I to do
Posted September 13, 2016
Earlier reply was eaten by GOG.

avatar
Magmarock: After almost 24 hours of downloading the stupid thing crashed on me. Now what am I to do
Just restart the download. It will continue from there, those files which were already downloaded fully will not be downloaded again. Partially downloaded files will be downloaded again.
Posted September 13, 2016
avatar
timppu: Earlier reply was eaten by GOG.

avatar
Magmarock: After almost 24 hours of downloading the stupid thing crashed on me. Now what am I to do
avatar
timppu: Just restart the download. It will continue from there, those files which were already downloaded fully will not be downloaded again. Partially downloaded files will be downloaded again.
Cools thanks.

Off topic but do you know anything about creating local repositories?
Posted September 13, 2016
avatar
Magmarock: After almost 24 hours of downloading the stupid thing crashed on me. Now what am I to do
gogrepo.py should never crash, even after 24 hours. Do you have a stacktrace to share?
Posted September 14, 2016
avatar
Magmarock: After almost 24 hours of downloading the stupid thing crashed on me. Now what am I to do
avatar
woolymethodman: gogrepo.py should never crash, even after 24 hours. Do you have a stacktrace to share?
no I got frustrated and deleted it. I'll try again some other time. I was running it from a live iso though.
Posted September 20, 2016
avatar
woolymethodman:
Can you confirm whether gogrepo is still working after GOG's addition of a captcha to the login earlier today?

See here for more details:
https://www.gog.com/forum/general/magog_a_search_engine_for_gog_games/post1484
Posted September 20, 2016
avatar
woolymethodman:
avatar
mrkgnao: Can you confirm whether gogrepo is still working after GOG's addition of a captcha to the login earlier today?

See here for more details:
https://www.gog.com/forum/general/magog_a_search_engine_for_gog_games/post1484
I've seen captcha on gog before, usually from too many login attempts and the like. Is it enforced now?

EDIT: hmm seems like it is. That's problematic :)

If you already have a login cooking from a previous gogrepo.py login, it will continue to work. I guess easiest way to solve this is to export browser login cookie
Post edited September 21, 2016 by woolymethodman
Pages:
1
27
28
29
30
31
50
100
150
200
250
258
This is my favourite topic
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3863 posts)(3863 posts)
(3863 posts)