It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3896 posts)(3896 posts)
(3896 posts)
Pages:
1
40
41
42
43
44
50
100
150
200
250
260
This is my favourite topic
Posted December 04, 2016
avatar
phaolo: Ugh.. btw, I still have to start from 0
Happy downloading then. :D

How many games, and over what kind of connection (speed, monthly data caps?)?
Post edited December 04, 2016 by timppu
Posted December 04, 2016
avatar
phaolo: Ugh.. btw, I still have to start from 0
avatar
timppu: Happy downloading then. :D
How many games, and over what kind of connection (speed, monthly data caps?)?
600+. No data caps here, I think.
It will just take forever..

woolymethodman where are you T_T
Posted December 04, 2016
avatar
timppu: Happy downloading then. :D
How many games, and over what kind of connection (speed, monthly data caps?)?
avatar
phaolo: 600+. No data caps here, I think.
It will just take forever..

woolymethodman where are you T_T
My 766 are 2.18TB just what I download from GOG.com cleaned.
English and German if available...
Post edited December 04, 2016 by disi
Posted December 04, 2016
avatar
disi: My 766 are 2.18TB just what I download from GOG.com cleaned.
English and German if available...
Holy s**t.
Magog says "only" 678 GB for me, but then there are the extras to consider too.
Btw, I don't own a lot of the big new games.
Post edited December 10, 2016 by phaolo
Posted December 04, 2016
After 1 week of testing and automated downloading I have completed my first complete GOG backup today (win+mac+linux with english + german, round about 1.3 TB). After the Desura-Disaster it seems better to have a backup...

Thanks for the script! Very easy to use... I hope anyone can make the same thing for Humble-Bundle...
There are some ideas and basic working scripts in this thread:
https://www.gog.com/forum/general/humble_version_of_gogrepo
Post edited December 04, 2016 by Lebostein
Posted December 15, 2016
Uh oh. Started getting weird feedback on clean updates.

00:09:57 | loading local manifest...
00:09:57 | fetching game product data (page 1)...
00:09:59 | fatal...
Traceback (most recent call last):
File "G:\Files\GOGRepo\gogrepo.py", line 1090, in <module>
main(process_argv(sys.argv))
File "G:\Files\GOGRepo\gogrepo.py", line 1065, in main
cmd_update(args.os, args.lang, args.skipknown, args.updateonly, args.id)
File "G:\Files\GOGRepo\gogrepo.py", line 573, in cmd_update
json_data = json.load(reader(data_request))
File "C:\Python27\lib\json\__init__.py", line 290, in load
**kw)
File "C:\Python27\lib\json\__init__.py", line 338, in loads
return _default_decoder.decode(s)
File "C:\Python27\lib\json\decoder.py", line 366, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "C:\Python27\lib\json\decoder.py", line 384, in raw_decode
raise ValueError("No JSON object could be decoded")
ValueError: No JSON object could be decoded
Anyone have a clue what broke? I haven't changed any programs that I'm aware of.
EDIT: Just a few days ago (8DEC2016) my logs read normally:
22:17:29 | loading local manifest...
22:17:29 | fetching game product data (page 1)...
22:17:30 | fetching game product data (page 2 / 5)...
22:17:30 | fetching game product data (page 3 / 5)...
22:17:31 | fetching game product data (page 4 / 5)...
22:17:31 | fetching game product data (page 5 / 5)...
22:17:32 | found 486 games !!!!!!
22:17:32 | ( 1 / 486) fetching game details for a_boy_and_his_blob...
etc
Post edited December 15, 2016 by paladin181
Posted December 15, 2016
Never mind. Apparently my cookie had gone bad. Logging in again with gogrepo worked.
Post edited December 15, 2016 by paladin181
Posted December 30, 2016
Ok, another issue then. I can't get this to recognize The Wither 3 GotY edition. It refuses.

02:29:18 | (417 / 490) fetching game details for the_witcher_3_wild_hunt_game_of_the_year_edition_game...
02:29:45 | error
Traceback (most recent call last):
File "G:\Files\GOGRepo\gogrepo.py", line 647, in cmd_update
filter_downloads(item.downloads, item_json_data['downloads'], lang_list, os_list)
File "G:\Files\GOGRepo\gogrepo.py", line 347, in filter_downloads
fetch_file_info(d, True)
File "G:\Files\GOGRepo\gogrepo.py", line 309, in fetch_file_info
shelf_etree = xml.etree.ElementTree.parse(page).getroot()
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1182, in parse
tree.parse(source, parser)
File "C:\Python27\lib\xml\etree\ElementTree.py", line 657, in parse
self._root = parser.close()
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1654, in close
self._raiseerror(v)
File "C:\Python27\lib\xml\etree\ElementTree.py", line 1506, in _raiseerror
raise err
ParseError: no element found: line 1, column 0
02:29:45 | (418 / 490) fetching game details for theme_hospital...
After that, there is no entry in my downloads folder for the GotY edition. This is the only game for which this happens and it happens every time.
Post edited December 30, 2016 by paladin181
Posted December 30, 2016
Make sure you're using the latest gogrepo.py. It will catch parse error on MD5 parsing and ignore it.
Posted December 30, 2016
high rated
Hello gogrepo community,

Just wanted to let everyone know that I've been silently working on big gogrepo.py changes with the odd hour I have free here and there. I'm planning to have a release on Jan 7th. As a heads up, the "gog-manifest.dat" will no longer be compatible. The new file will be called "gog-db.dat".. so you'll want to run a full update after the release. gog-db.dat for now will be a utf-8 text file with very long strings, however in near future it may become something else, like sqlite. You'll still be able to get a text version of the database with a new "dump" command.

Some of the improvements include MUCH faster update process (including removing 1second sleep between requests!), better downloader code (including fixing fragmentation issue), better resume support (chunk-based MD5 rather than entire file), a configuration file (avoid having to always do -os -lang and game dir, for example), ignore list, updated readme, and more.

Thanks for your patience.
Posted December 31, 2016
avatar
woolymethodman: Just wanted to let everyone know that I've been silently working on big gogrepo.py changes
Thank you very much woolymethodman! :D
Posted December 31, 2016
Fantastic news - thanks woolymethodman :)
Posted January 01, 2017
Hi there. This works amazingly and I have some constitutive feedback to give.

1. Patches are redundant in a fresh archive download since the installers are pre patched.

2. this is for the readme. It took me a little while to workout how savedir worked. This is because I kept typing
savedir /location/to/folder -savedir=/location/to/folder. What you're suppose to type is just "/location/to/directory" use quotes to make sure it works because some directories have spaces in them. I think this could be better explained in the readme.

Anyway, that's me feedback and thank you so much for this great program.
Posted January 01, 2017
1. Unfortunately this is not an absolute rule.. often patches are newer than the installer.

2. Yes it will be more clear. It will also be configurable in a configuration file to save always having to input it or make a wrapper script.
Posted January 01, 2017
avatar
woolymethodman: 1. Unfortunately this is not an absolute rule.. often patches are newer than the installer.

2. Yes it will be more clear. It will also be configurable in a configuration file to save always having to input it or make a wrapper script.
How about a download option to ignore them?
Pages:
1
40
41
42
43
44
50
100
150
200
250
260
This is my favourite topic
Community
General discussiongogrepo.py - Python script for regularly backing up your purchased GOG collection for full offline enjoyment(3896 posts)(3896 posts)
(3896 posts)