[Date Prev][Date Next] [Thread Prev][Thread Next] [Date Index] [Thread Index]

[Debconf-team] penta ranking calculation metrics



I'm concerned that the rating metric is wrong in penta when reviewers
leave one of the three categories in a "don't know" state.

for example, if i say "+" for all three categories (relevance,
actuality, acceptance), the score will be 50. (50 + 50 + 50)/3

if i say "+" for relevance and acceptance, but "0", the score shows 37.
 This seems slightly wrong -- i'd have expected 33.  but meh, not a very
big deal.

A bigger deal is if i say "+" for relevance and acceptance, but leave
actuality as unspecified (because i don't know anything about the
presenter), the score also drops to 37.  I'd have expected it to stay at
50:  (50 + 50)/2

In particular, i'm proposing that unspecified axes should be removed
from both the numerator and the denominator, rather than just being
treated as a 0 in the numerator.

Any thoughts on this?  Am i misunderstanding something?

	--dkg

Attachment: signature.asc
Description: OpenPGP digital signature


Reply to: