Lesson Outcomes
By the end of this lesson, you will be able to:
- Identify criteria for measuring the effectiveness of a solution.
- Link measurement criteria to the original problem definition.
- Distinguish between effective and ineffective solutions.
- Identify suitable indicators for measuring results.
Lesson Overview
Implementing a solution does not automatically mean that you have solved the problem.
You need to determine whether the solution actually achieved its intended purpose. Evaluation therefore involves monitoring progress and evaluating results.
Before you can measure effectiveness, you need clear criteria. These criteria provide the basis for deciding whether the solution worked.
The criteria must relate directly to the original problem definition.
What Are Measurement Criteria?
Measurement criteria are the standards you use to determine whether the implemented solution is effective.
For example, suppose the original problem is:
Customer complaints have increased significantly over the past six months.
Possible measurement criteria could include:
- Reduction in the number of complaints.
- Improved customer satisfaction.
- Faster response times.
- Reduced repeat complaints.
The criteria should allow you to answer:
Did the solution actually improve the situation?
Criteria for Measuring Effectiveness
The Learner Guide identifies five criteria:
- Feasibility
- Suitability
- Acceptance
- Return on investment
- Alignment to role or strategy
Let’s examine each.
1. Feasibility
Feasibility asks:
Can the solution work within the circumstances in which it operates?
Consider:
- Available resources.
- Time.
- Skills.
- Technology.
- Organisational capacity.
A solution may appear effective in theory but become ineffective if the organisation cannot realistically maintain it.
2. Suitability
Suitability asks:
Does the solution address the actual problem?
The Learner Guide explains that a successful solution should achieve its stated goals and meet the identified need effectively.
For example:
Problem: Customers wait too long for service.
Solution: Increase advertising.
Advertising may increase customer numbers, but it does not address the waiting-time problem.
The solution therefore has poor suitability for the problem.
3. Acceptance
Acceptance asks:
Will the people affected by the solution accept and use it?
A technically effective solution can still fail if people refuse to use it.
The Learner Guide emphasises that a successful solution must be acceptable to those who implement it and those affected by it.
Consider:
- Employee acceptance.
- Customer acceptance.
- Stakeholder support.
- Willingness to use the solution.
4. Return on Investment
Return on investment asks:
Does the benefit justify the resources invested?
Consider:
- Financial cost.
- Time invested.
- Resources used.
- Benefits achieved.
The Learner Guide describes an effective solution as having a good cost/benefit ratio and being economical relative to what it achieves.
For example:
A solution costs R100 000 but produces only R10 000 of measurable benefit.
Another solution costs R30 000 and produces R80 000 of benefit.
The second solution may provide the better return.
5. Alignment to Role or Strategy
A solution should support the organisation’s broader role and strategy.
Ask:
Does this solution support what the organisation is trying to achieve?
A solution may solve a local problem but create conflict with wider organisational priorities.
For example, a department could reduce its costs by cutting a service that the organisation considers strategically important.
The solution might improve the department’s immediate performance while working against the organisation’s broader objectives.
Measuring Whether the Solution Works
Your criteria must be measurable where possible.
Ask:
How will we know that the solution has worked?
The Learner Guide specifically recommends asking whether the decision’s success is measurable and, if so, how it will be measured.
Example
Problem: Employee absenteeism is too high.
Solution: Introduce an attendance-management programme.
Criterion: Reduce absenteeism.
Indicator: Number of absentee days per month.
Measurement: Compare attendance records before and after implementation.
This gives the organisation evidence rather than relying on assumptions.
From Criteria to Indicators
A useful way to structure evaluation is:
↓
Solution
↓
Criterion
↓
Indicator
↓
Measurement
↓
Result
Example
| Stage | Example |
|---|---|
| Problem | High customer complaints |
| Solution | New customer-service process |
| Criterion | Effectiveness |
| Indicator | Number of complaints |
| Measurement | Monthly complaint records |
| Result | Complaints reduced by 30% |
This approach makes the evaluation more objective.
Monitoring Progress
Evaluation does not begin only after implementation ends.
The Learner Guide describes monitoring progress as an ongoing process that helps fine-tune a course of action.
During monitoring, ask:
- Has the situation changed?
- Do we need more or fewer resources?
- Do we need a different alternative solution?
These questions help determine whether the solution remains appropriate as circumstances change.
Feedback
Feedback provides information about how the solution is performing.
Useful feedback can come from:
- Employees.
- Managers.
- Customers.
- Other departments.
- Existing communication channels.
The Learner Guide emphasises that feedback should test effectiveness and reflect changing circumstances that may require the plan to change.
What Does a Successful Solution Look Like?
The Learner Guide identifies several characteristics of a successful solution.
A successful solution:
- Solves the problem effectively.
- Meets the stated goals.
- Works within the relevant constraints.
- Is acceptable to users.
- Avoids or minimises negative side effects.
- Provides an appropriate cost/benefit outcome.
Remember that a solution does not need to be perfect to be useful. You should assess the degree to which it achieves its intended purpose.
Practical Example
Problem
A department experiences frequent delays in processing customer applications.
Solution
The department introduces an electronic application system.
Measurement criteria
| Criterion | Possible Indicator |
|---|---|
| Feasibility | System operates within available resources |
| Suitability | Processing time decreases |
| Acceptance | Employees and customers use the system |
| Return on investment | Benefits justify implementation costs |
| Alignment | Supports the organisation’s digital strategy |
The team can now collect evidence and determine whether the solution is achieving its purpose.
Key Notes / Lesson Summary
- Evaluation determines whether the implemented solution achieved its intended purpose.
- Establish measurement criteria before evaluating results.
- Link the criteria to the original problem definition.
- The five criteria identified in the Learner Guide are feasibility, suitability, acceptance, return on investment, and alignment to role or strategy.
- Use measurable indicators wherever possible.
- Monitor progress continuously.
- Use feedback to determine whether the solution remains effective.
- Consider both benefits and negative side effects.
- A solution should work within constraints and provide an appropriate cost/benefit outcome.