Ranking Scores

Introduction

When Ranking, for each Measure, you select a Ranking from a list of values for Option One and Option Two.

Each Ranking on the list has a description. This helps you choose the most appropriate Ranking. 

Each Ranking on the list has a value. These are used to calculate scores. Two main scores are calculated:

1. Score 1: How much better/worse is Option Two compared with the base case of Option One?

By averaging the Option Two rank values, you get a value that indicates how much better or worse each Benefit is impacted if you choose Option Two instead of Option One as an unchanged base case.

This score is sometimes called the 'Weighted Score'.

2. Score 2: How much better/worse is Option Two compared with an updated case for Option One?

This is a value that indicates how much better or worse each Benefit is impacted if you choose Option Two instead of Option One as a changed base case. It can be that for the comparison you want to use Option One rankings the are not always the base case, and so Score 2 will be of most interest.

This score is sometimes called the 'Weighted Improvement'.

Examples

A. Compare a second Option (Option Two) differs from a first Option (Option One) (as the base case).   

B. Compare a second Option (Option Two) differs from a first Option (Option One) (if the base case ranking is different). 

You most likely want to understand how a new Option (Option Two) differs in its benefits impact from Option One at the base case level. This is (A) below.

An additional requirement that is also met is (B) below. This is to revisit Option One (often the Base case) and adjust the benefit now expected from it compared to what it was before. For example, if Option One was agreed to two years ago, is the level of benefit still the same, got worse or improved for any of the measures?

More on these two requirements and worked examples are below.

Note: The Rankings to choose from can be changed by Managers and Administrators.

A. Option One delivers base case benefits - How Option Two differs.  

Option One was expected to deliver certain benefits as a base case. 

How does Option Two compare? How does Option Two compare to the level of Benefit expected from Option One?

Two values are used to identify the measure and benefit changes for Option Two. When this is compared to Option One at the base case level. 

A. The Percentage Change in benefit expected from Option Two, compared to Option One before this Assessment.

        - for each Measure.

        - for each Benefit.

To delete: See Percentages in example... E.g. Option Two Change %

B. Ranking Value Change in benefit expected from Option Two, compared to Option One before this Assessment. 

        - for each Measure.

        - for each Benefit.

To delete: See Numbers in example... E.g. Weighted Score

B. Option One may differ from the base case - How Option Two differs.

Option One before the Assessment was expected to deliver certain benefits, but this may have changed since the last review.

How does Option Two compare to the current level of benefit expected from Option One? To the new view of Benefits for Option One made as part of this Assessment?

As before, two values are used to identify the change in the level of measure and benefit change for Option Two. When this is compared to the new assessment of Option One. It uses both a percentage scale to show this, and your own values used for the scores.

This is the difference between Option One and Option Two.

A. The Percentage Change in benefit expected from Option Two, compared to Option One

        - for each Measure.

        - for each Benefit.

To delete: See Percentages in example... E.g. Option Two Change %

B. Ranking Value Change in benefit expected from Option Two, compared to Option One

        - for each Measure.

        - for each Benefit.

To delete: See Numbers in example... E.g. Weighted Improvement

There are values associated with these Rankings. 

1. The value of the ranking for Option One and Option Two

A value used is the Percentage Change that Option Two provides:

- For each Measure.

- For each Benefit (the average percentage change of all its Measures).

The percentage change is calculated by using the highest Assessment Ranking value.

For example, if the highest value is 3, this represents a 100% improvement.

Rank a Measure with a value of 2, is a 67% change. A value of 1.5 is a 50% change etc.

Selecting a Ranking with a value of -1 is the same as a -33% change in benefits.

Option Two net improvement: Whatever the score of Option One, is Option Two better or worse?

The higher the number, the greater the improvement that Option Two provides.

The lower the number, the worse Option Two is.

Option Two summary - from best to worse:

• Measure D: a 2.0 improvement. If the maximum Ranking value is 3, there is a 67% change. 
• Measure A: a 0.5 improvement - a 17% change. 
• Measure C: 0. The same - no better, no worse. 0% change.
• Measure B: a -1.0 worsening. -33% change.

• Measure A.
  • Option One: 0        No change to expected benefits since last reviewed.
  • Option Two: 0.5     Expected to deliver an improvement in this benefit measure.
  • Option Two improvement on original Option One: 0.5 or 17%.
  • Option Two improvement on latest Option One update: 0.5 or 17% as Option One is still at 0 - no change.      
• Measure B.
  • Option One: 0        No change to expected benefits since last reviewed.  
  • Option Two: -1.0
  • Option Two improvement on original Option One: -1.0 or -33%. 
  • Option Two improvement on latest Option One update: 0.5 or 17% as Option One is still at 0 - no change.
• Measure C.
  • Option One: -1.0    A negative change to expected benefits since last reviewed. 
  • Option Two: 0
  • Option Two improvement on original Option One: 0 or 0%.
  • Option Two improvement on latest Option One update: 1 or 33% as Option One is now -1.0 - worse.
• Measure D.
  • Option One: 0.5     A positive change to expected benefits since last reviewed. 
  • Option Two: 2.0
  • Option Two improvement on original Option One: 2.0 or 67%.
  • Option Two improvement on latest Option One update: 1.5 or 50%. Option One is now 0.5 - better.