It seems that you're using an outdated browser. Some things may not work as they should (or don't work at all).
We suggest you upgrade newer and better browser like: Chrome, Firefox, Internet Explorer or Opera

×
avatar
mrkgnao: Please don't until Yepoleb fixes his script to have the same results as yours.
I'll keep my AirTable up and updated for a while, no worries :). As to the "fixes", first two points I mentioned are definitely worthwhile, but maybe the third shouldn't be addressed?

I've always felt that by filtering out some of GOG's versioning problems they never really got any incentive to address them :/.
Post edited September 11, 2022 by WinterSnowfall
avatar
mrkgnao: Please don't until Yepoleb fixes his script to have the same results as yours.
avatar
WinterSnowfall: I'll keep my AirTable up and updated for a while, no worries :). As to the "fixes", first two points I mentioned are definitely worthwhile, but maybe the third shouldn't be addressed?

I've always felt that by filtering out some of GOG's versioning problems they never really got any incentive to address them :/.
I've reported some of the versioning problems weeks and months ago directly to GOG support. They were silently ignored.
avatar
mrkgnao: I've reported some of the versioning problems weeks and months ago directly to GOG support. They were silently ignored.
A bit of "public shaming" can do wonders, and the GOG DB has a lot more visibility than my glorified spreadsheet ;).
avatar
mrkgnao: I've reported some of the versioning problems weeks and months ago directly to GOG support. They were silently ignored.
avatar
WinterSnowfall: A bit of "public shaming" can do wonders, and the GOG DB has a lot more visibility than my glorified spreadsheet ;).
I tried that too --- https://www.gog.com/forum/general/the_forest_of_forgotten_fickets
avatar
WinterSnowfall: Ah, now I can finally retire and grab that margarita on a tropical island somewhere :P. Glad to see this up and running and thank you for your work. It looks better part of GOG DB, gotta say :).
Thanks, enjoy your retirement! ;)

avatar
WinterSnowfall: - I simply skip comparisons for any offline installer that matches on .*(gog-.*)$
They're at the bottom of the page, legitimate entries and are not hurting anyone. I don't see a reason to cut off the list at an arbitrary date.

avatar
WinterSnowfall: - I don't collect any build versions from named branches (such as "dev" or "beta")
That's a good suggestion, I can probably implement that very easily.

avatar
WinterSnowfall: - there are some that will be blatantly false positives (like The Little Acre) - having a manual way of ignoring those in the backend and not listing them in the table is useful
Everything in GOG DB is designed to require no regular maintenance because I have very little interest in personally reviewing results and crowdsourcing the data is also laborious and requires human interaction. If someone else wants to maintain a blacklist I'm open to taking that into account and pointing people to them. A simple text file on Github would be perfect, a forum thread where somebody manually confirms submissions works too. As long as I'm not responsible for keeping it updated I'm open to suggestions.
avatar
Yepoleb: They're at the bottom of the page, legitimate entries and are not hurting anyone. I don't see a reason to cut off the list at an arbitrary date.
Fair enough, but they're going to be there until the end of times :P. You have been warned.

avatar
Yepoleb: [...] personally reviewing results and crowdsourcing the data is also laborious and requires human interaction.
... story of my life until you've kindly provided a retirement option :P.

avatar
Yepoleb: If someone else wants to maintain a blacklist I'm open to taking that into account and pointing people to them. A simple text file on Github would be perfect, a forum thread where somebody manually confirms submissions works too. As long as I'm not responsible for keeping it updated I'm open to suggestions.
I assume by "blacklist" you mean a text file with ids which you'd simply hide in your list, right?

I can probably add something to GitHub once you've finalized the changes. It's not like I'll throw away my current delta code, so I can maintain a known false positive list reasonably up to date. If anyone wants to contribute to the maintenance I'm fine with sharing the GitHub repo.
avatar
WinterSnowfall: I assume by "blacklist" you mean a text file with ids which you'd simply hide in your list, right?
I think ID + the specific versions is better, because any future updates should be flagged again. These 3 values separated by your favorite unicode separation character in a text file works or any other common data format like JSON or CSV.
avatar
Yepoleb: I think ID + the specific versions is better, because any future updates should be flagged again. These 3 values separated by your favorite unicode separation character in a text file works or any other common data format like JSON or CSV.
That's actually pretty much how I do it currently, so makes sense. I'll create a draft later next week. Will probably add the game title as an extra field, as well as the reason for blacklisting, for readability. I expect 99% of entries to be semi-permanent anyway. Oh, and most likely I'll go for a CSV since I can easily export it from my current discrepancy table. Will post back once I get around to it. Cheers!
avatar
Yepoleb: These products have a changelog entry of when they were added, so I won't remove them for being empty.
Yes, you're right. I've quickly dismissed them as being worthless and frankly forgot that the other ids only included an empty prices.json and no changes.json. That's fine, I can see how the changelog could still have some informational value in the future, if anything else happens with those products. I've adjusted my script to account for these cases and everything is running smoothly now, as it did before. Thanks again!

EDIT: As for your version discrepancy discussion: If you would like to keep all entries visible, maybe it would make sense to colorcode or otherwise visually distinguish legacy installers and false positives from the discrepancies that actually differ in content.
Post edited September 12, 2022 by Kevin04
avatar
Kevin04: EDIT: As for your version discrepancy discussion: If you would like to keep all entries visible, maybe it would make sense to colorcode or otherwise visually distinguish legacy installers and false positives from the discrepancies that actually differ in content.
That's not a bad idea at all. Instead of not listing the ids covered in the blacklist I'll create, you could simply gray them out and add a legend to explain they're known false positives. I guess that's the best of both worlds.
avatar
Yepoleb: I've added my own version of WinterSnowfall's download version mismatch table at https://www.gogdb.org/user/version_mismatch (with his approval). It will be better integrated into the site later.

avatar
Kevin04: Thanks, most of the problematic product ids are gone now. However, there are still 77 left when I run my script against the current gogdb_2022-09-09.tar.xz.
avatar
Yepoleb: These products have a changelog entry of when they were added, so I won't remove them for being empty.
Just out of curiosity, how often will the new table be updated? I get the feeling it's automated, so perhaps daily, or real-time?

Oh, and I wouldn't mind seeing a column for the discrepancy age.
Post edited September 12, 2022 by drrhodes
avatar
drrhodes: Just out of curiosity, how often will the new table be updated? I get the feeling it's automated, so perhaps daily, or real-time? Oh, and I wouldn't mind seeing a column for the discrepancy age.
Every 2 hours, just like the rest of the site. I won't add a column with discrepancy age because it's unlikely going to be different than the build age. It can't be longer than the build age (can't be outdated before the version is released) and the only way for it to be shorter is if a download is released that matches the version, which is later rolled back. Just not worth dealing with state data.
avatar
drrhodes: Just out of curiosity, how often will the new table be updated? I get the feeling it's automated, so perhaps daily, or real-time? Oh, and I wouldn't mind seeing a column for the discrepancy age.
avatar
Yepoleb: Every 2 hours, just like the rest of the site. I won't add a column with discrepancy age because it's unlikely going to be different than the build age. It can't be longer than the build age (can't be outdated before the version is released) and the only way for it to be shorter is if a download is released that matches the version, which is later rolled back. Just not worth dealing with state data.
Thanks for the reply. I wasn't clear about what I wanted to see. Anything on this list has a difference between the last uploaded build and the last uploaded downloader. That's the difference I'd like to see and maybe some of the large numbers would help kick gog into gear about fixing them.