[Scummvm-devel] Web site: standardization of compatibility score

[Johannes Schickel]

On 09/27/2011 01:26 PM, Arnaud Boutonné wrote:
> I mentioned in the previous mail the possibility to add the name 
> engine next to the game titles in the compatibility page, and I'd like 
> to suggest another modification, based on several discussions I 
> already had in the past concerning the compatibility score. Currently, 
> the score is really subjective, and may be misleading. We may benefit 
> using a more standardized method, based on objective criteria. For 
> example, we could use :
> A+ - Completable, based on original sources (currently 98%, with 
> exceptions)
> A - Completable (currently 90%-95%)
> B - Completable with occasional glitches (currently 75%-80%)
> C - Completable without missing features (currently 70%, with exceptions)
> X - Not confirmed completable, playthrough required (currently 50%)
>
> This is of course a suggestion, please tell your opinions!

This is a long standing issue... I recently wanted to look into that 
myself, but since my attempts to get our website to run with Lighttpd 
failed and I didn't bother to look into Apache I just gave up on it 
again. Good to have someone else looking into it again.

I don't really think we need to make a difference between A and A+ for 
the users to be honest. I would just go with a simple system based on 
four levels:

A (Green) - Completable.
B (Yellow) - Completable with occasional glitches.
C (Orange) - Completable without missing features.
D (Red) - Not completable/Horribly broken/Just not working.

On a different front I don't think we should list games with unknown 
status on the compat page at all. Also we should tag games which are 
known to be broken (as in not completable, maybe even only not 
completable in certain circumstances, but that is probably better 
decided on a per case base) in official releases with Not completable on 
the compat page of the release.

On your initial line: I don't think we need to tag the game names with 
the engine name. After all games with same name and different engine so 
far only occur in the AGI/SCI sections and those have two different 
sections on the compat page after all. So I don't see the gain to 
confuse the user with an odd name next to the game they are looking at, 
it should suffice if the category name confuses them ;-).

// Johannes