It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
avatar
phaolo: Lgogdownloader is Linux-only, right?
It is. But according to Sude you might be able to compile it for Windows.

avatar
timppu: About lgogdownloader, does it have an option to check your whole local library that the file integrity is ok, similar to "gogrepo.py verify"?
lgogdownloader --status checks the file integrity. You also could use that to check for differences in the directory structure compared to gogrepo as it would list the files as missing which it would download to a different location.

Edit: Actually I kind of abuse the status option for that (with an empty XML directory). I think the "official" option to check the integrity (and repair the files) is lgogdownloader --repair.
Post edited September 24, 2017 by eiii
avatar
eiii: lgogdownloader --status checks the file integrity. You also could use that to check for differences in the directory structure compared to gogrepo as it would list the files as missing which it would download to a different location.
Thanks. Do you know what methods lgogdownloader uses for file integrity check, specifically for those few installers that don't have md5 checksum available from GOG.com, e.g. "A Golden Wake" and "Kyn", possibly some others too? I know The Walking Dead Season 1 and X3: Terran War Pack miss some md5 checksums as well, but apparently only for patch files, so I couldn't care less about those two... As long as I can check the integrity of the main installer files which are up to date.

Also how about the extras, does it check their zip file integrity?
avatar
eiii: It is. But according to Sude you might be able to compile it for Windows.
Eh thanks, but he also said "I only test on Linux so no guarantees about Windows compatibility".
I don't want to risk problems..
avatar
timppu: Do you know what methods lgogdownloader uses for file integrity check, specifically for those few installers that don't have md5 checksum available from GOG.com, e.g. "A Golden Wake" and "Kyn", possibly some others too? I know The Walking Dead Season 1 and X3: Terran War Pack miss some md5 checksums as well, but apparently only for patch files, so I couldn't care less about those two... As long as I can check the integrity of the main installer files which are up to date.
When GOG does not provide checksums lgogdownloader cannot verify if the download has been correct. But lgogdownloader can create local checksums, so you at least can detect when anything harms your files after the download.

avatar
timppu: Also how about the extras, does it check their zip file integrity?
I don't think that lgogdownloader uses special checks for special file types. But better ask Sude about such technical details. ;)

avatar
phaolo: Eh thanks, but he also said "I only test on Linux so no guarantees about Windows compatibility".
I don't want to risk problems..
Yes, probably someone who actually would use lgogdownloader under Windows would have to test it. :)
Post edited September 23, 2017 by eiii
...
avatar
eiii: you always can ask in the lgogdownloader thread.
Is there a way to tell how much the script will download before actually starting the download?
avatar
JunglePredator: Is there a way to tell how much the script will download before actually starting the download?
Yes, use the download command with the -dryrun option
avatar
JunglePredator: Is there a way to tell how much the script will download before actually starting the download?
avatar
bratmaxe: Yes, use the download command with the -dryrun option
Thanks.
BTW, you can append -h to any command of gogrepo to display the list of possible parameters.
Holy s**t, I finally tried Gogrepo and.. even if abandoned, it's still great! :D

I left it working in the background and it downloaded all my games.
Those 4 concurrent downloads were a cool idea to finish the process in a reasonable time.
And the speed was surpringly fast, good job Gog!

---

About the file fragmentation, instead.. LOL.
I used an empty temporary HDD and the result was still a disaster.
I expected some fragments, but not 100% ! 4GB files now have ~60,000 pieces XD

How can some of you not care about this?
Sadly, no new gogrepo version means no file pre-allocation.

Luckly, trasferring these to a proper external storage will fix this.
Post edited September 26, 2017 by phaolo
Btw, it's possible to skip games?

For example, I think I only need:
- the_incredible_adventures_of_van_helsing_final_cut_game
Instead of:
- the_incredible_adventures_of_van_helsing_complete_pack
- the_incredible_adventures_of_van_helsing_ii_complete_pack
- the_incredible_adventures_of_van_helsing_iii_complete_pack

---

Also, I wish I could use aliases, so I could rename & place the directories what\wherever I want:

-Games
--gamename1_year_developer (gog)
---version dos
---version cd
---mods
---savegames
---other
--gamename2_year_developer (store2)
...
--gamenameN_year_developer (gog)
Post edited September 26, 2017 by phaolo
avatar
phaolo: About the file fragmentation, instead.. LOL.
I used an empty temporary HDD and the result was still a disaster.
I expected some fragments, but not 100% ! 4GB files now have ~60,000 pieces XD

How can some of you not care about this?
Because it doesn't really affect anything. I have over 2 terabytes of GOG installers on two external USB hard drives (downloaded with gogrepo), and I see no issue whatsoever whenever I decide to install some GOG game. If there is some theoretical slow down because the installer is fragmented, meh, still doesn't affect me. So in the worst case I have to wait 3.5 minutes instead of 3 minutes due to fragmentation to install a game, who cares?

If, for some reason, I felt the fragmentation was a real problem, then I would simply defragment those two hard drives. I still don't understand why you think this is such a meaningful problem, how does it affect your life? Or don't you simply like the idea of there being files fragmented on your hard drive?

BTW, are you using the vanilla gogrepo, or one of the newer forks? I am still using the old vanilla gogrepo.

avatar
phaolo: Btw, it's possible to skip games?
I recall there is now an option to skip downloading games which are hidden in your GOG account. So those games you don't want to download with gogrepo, first hide them in your GOG account, and then use that gogrepo option to skip hidden games. Sorry I don't know how to use that as I haven't used the feature, but I recall reading it was implemented at some point.

avatar
phaolo: Also, I wish I could use aliases, so I could rename & place the directories what\wherever I want:
No, gogrepo uses the directory names that GOG provides for games, and that's it. If you start changing them etc., then the gogrepo clean command will consider all directories and files which it doesn't recognize as obsolete (and move them into the !orphaned folder), and the gogrepo download command will redownload everything that you had changed.

You pretty much have to accept the directory structure and filenames that gog provides, when using gogrepo. That is the simplest way for gogrepo to know for sure what files are current and what are obsolete. If you want to start meddling with your filenames and folder structures, then it may be better to download your stuff manually (or at least not use gogrepo after the first download).

However, if you want to keep some additional files or folders, you can keep them inside e.g. the !orphaned folder. For instance, I keep the old CD version of Riven (that GOG recently replaced with the DVD version) under the !orphaned directory where the gogrepo clean command earlier moved it (because it considered it as an obsolete version). It stays there and gogrepo will not care for it anymore.
Post edited September 26, 2017 by timppu
avatar
phaolo: Those 4 concurrent downloads were a cool idea to finish the process in a reasonable time.
Since you worry about file fragmentation, shouldn't you have used on one concurrent download at a time (downloading only one file at a time)? Even if gogrepo had preallocated free space for your downloads, they would have become fragmented anyway if you download several files at a same time. The number of download threads can be changed by editing the gogrepo.py script directly.

Normally the amount of download threads shouldn't affect your download speed either. If you e.g. have a 10Mbit/s internet connection, that's the speed at which your GOG games will come to you, no matter if you are downloading one or six files at the same time (in some special cases that might be different).

Ps. I checked the fragmentation status of one of my USB HDDs where I keep half of my GOG installers. Defraggler says 63% fragmentation, is that supposed to be bad? As said, I don't see any ill effects though, the games install fine etc.

Maybe I will run Defraggler on those two external hard drives, while I am at it. At least then they are defragged, and any further fragmentation will come only from new or updated GOG installers.
Post edited September 26, 2017 by timppu
avatar
timppu: BTW, are you using the vanilla gogrepo, or one of the newer forks?
I used the vanilla gogrepo.

avatar
timppu: Since you worry about file fragmentation, shouldn't you have used on one concurrent download at a time (downloading only one file at a time)?
It would have taken more time and I'm not sure how many fragments I would have avoided that way.
Anyway, as I said, I used an empty temporary HDD to deal with fragmentation (way faster than a full defrag).

avatar
timppu: Normally the amount of download threads shouldn't affect your download speed either. If you e.g. have a 10Mbit/s internet connection, that's the speed at which your GOG games will come to you, no matter if you are downloading one or six files at the same time (in some special cases that might be different).
Can Gog reach a stable 10Mbit/s for a download? I doubt it.
But for ~3Mbit/s it was perfect.
Btw, a limiter was another wanted option in a new version, to avoid saturating the line.

avatar
timppu: Ps. I checked the fragmentation status of one of my USB HDDs were I keep half of my GOG installers. Defraggler says 63% fragmentation, is that supposed to be bad? As said, I don't see any ill effects though, the games install fine etc.
The more you access those files, the more it's bad for the HDD and its life.
The heads have to move on the platters N thousands times more than with 1 fragment.
Rarely used drives are probably ok, but if you instead frequently update & install games..

avatar
timppu: Maybe I will run Defraggler on those two external hard drives, while I am at it. At least then they are defragged, and any further fragmentation will come only from new or updated GOG installers.
Don't do it if they're too full, however.
Defrag needs some free space to properly move files around.
Post edited September 26, 2017 by phaolo
avatar
phaolo: Can Gog reach a stable 10Mbit/s for a download? I doubt it.
But for ~3Mbit/s it was perfect.
As long as we are talking about 10Mbit/s (and not 10Mbytes/sec), sure. 10Mbit/s is considered as the lowest offered broadband internet connection in many countries, even 4G mobile phones offer much higher speeds these days.

10Mbit/s is about 1.2Mbytes/sec, and I easily get that in GOG.com both with browser and gogrepo downloads, even if downloading only one file at a time. When I try at 30-50Mbit/s speeds with my 4G phone, I usually seem to get that too with one file. So at least in my case it isn't GOG that is severely limiting how fast I can download one file from them, so having many simultaneous downloads doesn't increase the download speed.

I said though there may be special cases, like:

- I don't know what is the situation in other countries. Some US and Australian folks complain about low download speeds, so I am unsure if they can maximize their download speeds by downloading many GOG files at the same time, or is it irrelevant for their download problems.

- If someone has some 100Mbit/s or 1Gbit/s internet connection, I have no idea if gog lets one download at full speed then.

- I recall earlier (like 2 years ago) sometimes seeing GOG letting me download some files only at around 400kbit/s. In those cases it made sense to download several files at the same time because usually the other downloads were coming at max, and even if they weren't, 4x 400kbit/s is still four times faster than 1x 400kbit/s. However, I haven't seen these download hiccups for a long time, now I always get as fast speeds as I can download.

Did you try it yourself, ie. you don't get a download at full speed from GOG.com if you download only one file at a time?

avatar
phaolo: Btw, a limiter was another wanted option in a new version, to avoid saturating the line.
Yeah it would be nice, but nowadays if I need the internet connection temporarily for something demanding (online gaming, watching HD youtube videos etc.), I normally just cancel (pause) gogrepo downloads for that time, and then restart it afterwards. Sure it can cause a few gigabytes of extra downloading at worst case because gogrepo doesn't resume partial downloads (but downloads them all over), but I can live with that. A few minutes of extra waiting, pffft.

avatar
phaolo: The more you access those files, the more it's bad for the HDD and its life.
The heads have to move on the platters N thousands times more than with 1 fragment.
Frankly, that is years away anyway, at which point I probably have moved my GOG installers to a newer and bigger hard drive anyway (which even might be a SSD drive in case the bigger SSDs finally become affordable). I am not even convinced it has that big effect on the durability of a hard drive, you are the first person I've seen stating that (HDD durability) as a reason to defragment files.

The times I've broken hard drives have usually been that I have stupidly fried the circuit board when moving or handling a hard drive, maybe sometime dropping a hard drive, and one was apparently fried due to extreme heat in the old laptop (the internal hard drive became overheated).

avatar
phaolo: Don't do it if they're too full, however.
Defrag needs some free space to properly move files around.
(Defragging) Yeah I know, they are only about 60-70% full at this point (there are some other files on those HDDs too besides just my GOG games). After all that is why I divided my GOG installer collection to two hard drives, because they went over the 2TB limit.
Post edited September 26, 2017 by timppu