It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
avatar
Kalanyr: On the latest build the default behaviour for -verify is that a file is marked as verified in the manifest and will be skipped for subsequent checks unless the md5 and/or size changes (or the name changes and no md5 data is available to verify that it's the same file), this happens at verification time.
avatar
phaolo: Ah great. But I wonder if stopping the script could break the manifest if it happens at the wrong time.
Theoretically, but there's actually some code in place already that should stop that happening as long as you use the break key (Ctrl-C on windows) combination rather than just closing the window or killing the process, which prevents breaking while a manifest write is in progress.

avatar
Kalanyr: Python's md5 implementation actually seems to be worse with large files (small files verify extremely quickly but there's fixed overhead), I suspect the default memory management is pretty questionable (it gets really bad with the extremely large Linux files which can be ~20-30 GB). It's also very sensitive to fragementation since it has to read the entire file sequentially for every file verified. I could use the md5 chunk data to do threaded verification where that's available but that has it's own problems (the md5 chunk data and md5 for the full file sometimes disagree due to GOG whoopsies).
avatar
phaolo: Mm, I see.
Btw at least gogrepo's downloaded files are preallocated without fragmentation, no?
Yeah, preallocation and remembering verification status got implemented because one of my hold storage devices got super fragmented and it was taking ~2 days to verify each time.
Ah, I didn't know that Ctrl+C had exit procedures. Good to know.
Btw I always use it, instead of closing the window.

And I like preallocation, I wish browsers used it too..
Stupid q, how do I use the GUI program someone made for this script? https://github.com/Twombs/GOGRepo-GUI .....
avatar
dbzlotrfan: Stupid q, how do I use the GUI program someone made for this script? https://github.com/Twombs/GOGRepo-GUI .....
I don't know, as I've never used the GUI, but you might get a faster reply if you post in the author's (i.e. Timboli's) thread. here:
https://www.gog.com/forum/general/gogplus_download_checker
I hope this isnt double posted. As I tried posting this hours ago on the main thread as I was directed to but I do not see it there when I refresh the page.

There is mention that one can change the default directory in the gogrepoc script for downloading their entire libraries. I do not however see anywhere that explains how to do this, or where to find the directory in the python code. I have taught myself overnight how to get it running and opening the scripts. However my harddrive is tiny and I own over 2000 games on here so I really need to target a different location so I can get my library downloaded.

I am using cmd to run the script. I change the directory to where I have python and the script installed as that was the only way i could get it to run. Once I get to the directory I type python download -os windows - lang en. It then starts downloading everything but its nearly 4 terrabytes. I have most of that downloaded already in a seperate drive in an external on D:\ inside a folder called GOG. What do I type in CMD to get it to recognize those files as install files and to skip them. More than 1600 games of my 2000+ game library are already downloaded so this would save me days of downloads so any help would be appreciated. I will admit I am unfamiliar with python having taught myself all of it to get it to work around 2am monday morning, so if you can tell me what to type that would be EXCELLENT!
Sorry I see what happened. Somehow I click reply on the wrong tab and replied to the other thread again. Apologies. Thanks for all the help.
avatar
eatatralphs: Sorry I see what happened. Somehow I click reply on the wrong tab and replied to the other thread again. Apologies. Thanks for all the help.
Just in case you didn't get the answer its

gogrep(c).py download DirectoryPath [-options]....
can someone give instructions on how to install everything involved with this? I got as far as installing Pyhon installed, and after that, I have no idea how to install HTML5lib, I see on the site it says

$ pip install html5lib


ok, where do I type that? I click on python.exe and I get >>> on the screen, if I type that I get

File "<stdin>", line 1
$ pip install html5lib
^
SyntaxError: invalid syntax
avatar
eisberg77: can someone give instructions on how to install everything involved with this? I got as far as installing Pyhon installed, and after that, I have no idea how to install HTML5lib, I see on the site it says

$ pip install html5lib

ok, where do I type that? I click on python.exe and I get >>> on the screen, if I type that I get

File "<stdin>", line 1
$ pip install html5lib
^
SyntaxError: invalid syntax
You have to first install pip with a script from https://pip.pypa.io/en/stable/installation/ (I used get-pip.py)

Then install libraries like:
pip install html5lib html2text pyOpenSSL requests six
Post edited December 04, 2021 by phaolo
avatar
eisberg77: can someone give instructions on how to install everything involved with this? I got as far as installing Pyhon installed, and after that, I have no idea how to install HTML5lib, I see on the site it says

$ pip install html5lib

ok, where do I type that? I click on python.exe and I get >>> on the screen, if I type that I get

File "<stdin>", line 1
$ pip install html5lib
^
SyntaxError: invalid syntax
avatar
phaolo: You have to first install pip with a script from https://pip.pypa.io/en/stable/installation/ (I used get-pip.py)

Then install libraries like:
pip install html5lib html2text pyOpenSSL requests six
I did all that

I have gogrepoc.py in the same folder as python.exe

and when I run python gogrepoc.py login

I get
File "D:\Python\gogrepoc.py", line 106
<title>gogrepoc/gogrepoc.py at master · Kalanyr/gogrepoc · GitHub</title>
^
SyntaxError: invalid character '·' (U+00B7)
avatar
eisberg77: File "D:\Python\gogrepoc.py", line 106
<title>gogrepoc/gogrepoc.py at master · Kalanyr/gogrepoc · GitHub</title>
^
SyntaxError: invalid character '·' (U+00B7)
Uh.. did you download the correct file?
Maybe you got the html page instead of the script

Try to save this directly:
https://raw.githubusercontent.com/Kalanyr/gogrepoc/master/gogrepoc.py
Post edited December 04, 2021 by phaolo
avatar
eisberg77: File "D:\Python\gogrepoc.py", line 106
<title>gogrepoc/gogrepoc.py at master · Kalanyr/gogrepoc · GitHub</title>
^
SyntaxError: invalid character '·' (U+00B7)
avatar
phaolo: Uh.. did you download the correct file?
Maybe you got the html page instead of the script
yeah, someone else ended up telling me I needed to download RAW, I had no idea. So it is working now. Currently fetching game details.

When that is done doing "python gogrepoc.py download D:\gog" will download all my games including extras into the D:\gog directory, right?
avatar
eisberg77: When that is done doing "python gogrepoc.py download D:\gog" will download all my games including extras into the D:\gog directory, right?
Yeah. Maybe keep the directory path between double quotes in case you'll reuse the command with a different dir with spaces.
Btw you could also specify filters to skip unwanted files, like for example:
-os windows -lang en -skipfiles patch_*
Ok so I downloaded 3 terrabytes doing what yall suggested. Thank you.

My download though was interrupted due to my drive getting full. I have cleared another terrabytre off but when I tried to resume it is now wanting to redownload everything from start. What do i type to get the coding to resume only files that have not been downloaded? Thanks for any help.
avatar
eatatralphs: Ok so I downloaded 3 terrabytes doing what yall suggested. Thank you.

My download though was interrupted due to my drive getting full. I have cleared another terrabytre off but when I tried to resume it is now wanting to redownload everything from start. What do i type to get the coding to resume only files that have not been downloaded? Thanks for any help.
As long as you point the download command to the same path where your already downloaded games are, it shouldn't start downloading from scratch. First it quickly checks which files are already completely downloaded (the same filename and filesize in the manifest file and the target download directory, I think), and then downloads those which fail the check.

You are running the download command, not the update command, right?
Post edited December 13, 2021 by timppu