Posted December 13, 2020
high rated
I don't know if Galaxy is any better but using the standalone version of Cyberpunk, and it takes hours for me to download it (not your fault), about an hour to verify it (because who knows after downloading something for days), and about an hour to install it.
You'd think that it is using some crazy compression, but nope.
The sum of all the install files: 103GB
The sum of all the files after install: 59.6GB
That's right... the installer is bigger than the final product.
I used the innoextract tool to investigate. There were 47.2GB worth of non-English language files not installed.
With this amount of bloat, surely it would have been smarter to make installers for each language.
And still 59.6GB+47.2GB=106.8GB, so all this long compression times just to save 3GB. You would save space just by splitting the installers by language. Save GOG some bandwidth costs as well.
I can only deduce that the .archive files in Cyberpunk are already heavily compressed, at least by the standards of whatever compression algorithm the GOG installer is using, it can barely compress anything out of it if anything at all (maybe the compression gains were from the non .archive files)
Specific to Cyberpunk, I also note that it is a bit strange for a Game to be using compressed files in the final product, especially ones so heavily compressed, because this adds overhead to the game performance as the computer (or console) has to spend CPU time in decompressing the files rather than putting that CPU time towards running the game itself. Maybe the Cyberpunk Developers could get more performance by not using such strong compression on the Game Files.
But that's not all, looking at the Task Manager while it is verifying or installing, it is single threaded. I have a CPU with 12 Threads so I got 11 Threads here doing nothing. It should be 12X faster than it is if it were using a modern compression algorithm.
These GOG installers are straight out of the 00s and just don't scale with modern games which are dozens of Gigabytes big.
It doesn't help in this case that whoever packaged Cyberpunk in particular didn't pay much attention to what they were doing to realise that the compression gains were negligible and should have turned off the compression if possible, let alone including all the language files in the main installer when each one is about 4.5-5GB (and there are 11 of them).
To be clear, the once the game is installed, the other 10 languages are not even copied over at all, the the game runs perfectly fine without them.
With all this extra time downloading unnecessary language files, verification of that big download (optional), and installing it (where the installer is decompressing everything on a single thread, on files which are practically already fully compressed in the first place and will stay fully compressed) this all adds up to a huge waste of time of many hours multiplied by however many thousands of people used the GOG standalone installer, and who waited for the Cyberpunk download to complete with all these extra unnecessary files (languages they don't need). I wonder what that would add up to, it would be quite a lot.
If nothing changes, it is just going to happen again the next time there is a big game.
I kindly suggest updating the GOG installers to utilise lzma (7-zip/.7z) format for compression, with multiple threads, which actually a very easy task to do given the amount of resources available for that. And please ask the person packaging them up to kindly pay close attention to 1. The overall download size where possible to exclude files and 2. Not to use strenuous compression techniques on files which can hardly be compressed any further.
Thank you very much.
You'd think that it is using some crazy compression, but nope.
The sum of all the install files: 103GB
The sum of all the files after install: 59.6GB
That's right... the installer is bigger than the final product.
I used the innoextract tool to investigate. There were 47.2GB worth of non-English language files not installed.
With this amount of bloat, surely it would have been smarter to make installers for each language.
And still 59.6GB+47.2GB=106.8GB, so all this long compression times just to save 3GB. You would save space just by splitting the installers by language. Save GOG some bandwidth costs as well.
I can only deduce that the .archive files in Cyberpunk are already heavily compressed, at least by the standards of whatever compression algorithm the GOG installer is using, it can barely compress anything out of it if anything at all (maybe the compression gains were from the non .archive files)
Specific to Cyberpunk, I also note that it is a bit strange for a Game to be using compressed files in the final product, especially ones so heavily compressed, because this adds overhead to the game performance as the computer (or console) has to spend CPU time in decompressing the files rather than putting that CPU time towards running the game itself. Maybe the Cyberpunk Developers could get more performance by not using such strong compression on the Game Files.
But that's not all, looking at the Task Manager while it is verifying or installing, it is single threaded. I have a CPU with 12 Threads so I got 11 Threads here doing nothing. It should be 12X faster than it is if it were using a modern compression algorithm.
These GOG installers are straight out of the 00s and just don't scale with modern games which are dozens of Gigabytes big.
It doesn't help in this case that whoever packaged Cyberpunk in particular didn't pay much attention to what they were doing to realise that the compression gains were negligible and should have turned off the compression if possible, let alone including all the language files in the main installer when each one is about 4.5-5GB (and there are 11 of them).
To be clear, the once the game is installed, the other 10 languages are not even copied over at all, the the game runs perfectly fine without them.
With all this extra time downloading unnecessary language files, verification of that big download (optional), and installing it (where the installer is decompressing everything on a single thread, on files which are practically already fully compressed in the first place and will stay fully compressed) this all adds up to a huge waste of time of many hours multiplied by however many thousands of people used the GOG standalone installer, and who waited for the Cyberpunk download to complete with all these extra unnecessary files (languages they don't need). I wonder what that would add up to, it would be quite a lot.
If nothing changes, it is just going to happen again the next time there is a big game.
I kindly suggest updating the GOG installers to utilise lzma (7-zip/.7z) format for compression, with multiple threads, which actually a very easy task to do given the amount of resources available for that. And please ask the person packaging them up to kindly pay close attention to 1. The overall download size where possible to exclude files and 2. Not to use strenuous compression techniques on files which can hardly be compressed any further.
Thank you very much.