Purpose of the lesson

Develop objective criteria for measuring demand-execution performance, allocate measurement responsibilities and evaluate actual results, variances and non-conformance.

Practical outcome

By the end of this lesson, you must be able to:

• Select valid demand-execution performance measures.
• Establish measurable performance targets.
• Define measurement formats, data sources and timeframes.
• Develop criteria for identifying policy and process non-conformance.
• Measure positive and negative performance variances.
• Rate the degree, severity and implications of performance.
• Allocate monitoring responsibilities.
• Evaluate performance and recommend corrective action.

1. Gather the required information

Obtain:

• Demand-execution operational plan
• Customer-order schedule
• Customer contracts and service-level agreements
• Demand forecast
• Actual customer orders
• Inventory and allocation reports
• Back-order information
• Delivery records
• Customer complaints and returns
• Demand-management policies
• Order-processing procedures
• Existing performance reports
• Organisational objectives and customer priorities

Confirm the scope, reporting period and responsible operational area.

2. Define the evaluation scope

State clearly:

• Process being evaluated
• Customers and products covered
• Facility or business unit
• Reporting period
• Operational objectives
• Applicable policies and procedures
• Service-level commitments
• Intended users of the evaluation report

A clear scope prevents unrelated data from affecting the result.

3. Translate objectives into performance measures

Develop measures that show whether demand-execution objectives are being achieved.

Each measure must be relevant to the operational objective.

4. Define each measure

Prepare a measurement specification for every KPI.

Using written definitions ensures that different employees calculate the measure consistently.

5. Develop appropriate targets

Targets should be:

• Linked to operational objectives
• Measurable
• Realistic but challenging
• Time-bound
• Supported by reliable data
• Consistent with customer agreements
• Approved by authorised stakeholders

Use suitable sources such as:

• Contractual service levels
• Approved budgets
• Historical performance
• Operational capacity
• Customer requirements
• Internal benchmarks
• External benchmarks where reliable

Do not select a target merely because it produces a favourable result.

6. Specify measurement formats

Select a format that makes results easy to calculate, compare and act upon.

Suitable formats include:

• Daily monitoring register
• Weekly exception report
• Monthly scorecard
• Performance dashboard
• Variance report
• Back-order ageing report
• Customer-level service report
• Corrective-action register

Performance scorecard template

7. Set measurement timeframes

Specify:

• Data collection frequency
• Calculation date
• Reporting deadline
• Review date
• Escalation deadline
• Corrective-action deadline
• Follow-up measurement period

Use a frequency suited to the measure:

Critical operational failures should not wait for the monthly report before being escalated.

8. Develop policy non-conformance criteria

Policy non-conformance occurs when an approved organisational rule is not followed.

Examples include:

• Stock allocated outside approved customer priorities
• Orders accepted without required authorisation
• Customer information handled incorrectly
• Unapproved substitutions
• Performance data deliberately changed
• Back orders removed without valid resolution
• Customer commitments made outside delegated authority

Define:

• The policy requirement
• Evidence of compliance
• Conditions constituting non-conformance
• Severity level
• Responsible reviewer
• Required escalation

9. Develop process non-conformance criteria

Process non-conformance occurs when an approved operational procedure is not followed.

Examples include:

• Order information not validated
• Orders released after the cut-off
• Stock not allocated in time
• Back orders not recorded
• Revised dates not communicated
• Required system updates omitted
• Complaints not escalated
• Delivery documents not retained

Non-conformance criteria register

10. Establish variance criteria

Calculate:

Variance = Actual performance − Target performance

Example:

• Target order accuracy: 98%
• Actual order accuracy: 95%

Variance = 95% − 98% = −3 percentage points

Interpret results consistently:

• Positive variance: Actual performance exceeds the target.
• Zero variance: Actual performance meets the target.
• Negative variance: Actual performance falls below the target.

For measures where lower values are better, such as back-order rate or cost, interpret the direction carefully. A result above the maximum target is unfavourable.

11. Rate the degree of performance

Use predefined ranges.

Adapt the ranges to the importance and sensitivity of the measure.

12. Determine severity

Rate the seriousness of underperformance or non-conformance.

Consider:

• Number of customers affected
• Quantity outstanding
• Duration
• Financial effect
• Contractual consequence
• Reputational effect
• Risk of recurrence
• Effect on essential customers

Overperformance should also be evaluated. It may indicate genuine improvement, an unsuitable target, excess resources or inaccurate data.

13. Allocate responsibilities

Use a responsibility matrix.

Ensure that:

• The responsible person has access to the data.
• The KPI owner has authority to act.
• Results receive independent review.
• Escalation responsibilities are clear.
• No important measure remains unassigned.

14. Collect and validate performance data

Check:

• Completeness
• Accuracy
• Correct reporting period
• Consistent units
• Duplicate records
• Approved exclusions
• Changes to customer commitments
• Traceability to source records

Document any limitation that could affect the reliability of the evaluation.

15. Evaluate demand-execution performance

Follow this process:

1. Confirm the measure and target.
2. Collect validated data.
3. Calculate actual performance.
4. Calculate the variance.
5. Determine whether the variance is favourable or unfavourable.
6. Check policy and process compliance.
7. Rate the degree and severity.
8. Determine operational implications.
9. Identify the root cause.
10. Recommend corrective action.
11. Assign responsibility and a completion date.
12. Report and monitor the result.

16. Assess operational implications

Determine the effect on:

• Customers
• Back orders
• Inventory availability
• Production and procurement
• Warehouse workload
• Transport schedules
• Fulfilment costs
• Service-level compliance
• Customer retention and reputation

Link every significant result to a practical operational consequence.

17. Develop corrective actions

Corrective actions may include:

• Improve order validation.
• Revise customer-priority controls.
• Correct inventory records.
• Adjust demand-planning assumptions.
• Expedite critical replenishment.
• Introduce back-order alerts.
• Revise picking or delivery schedules.
• Improve customer communication.
• Train responsible employees.
• Correct performance-reporting rules.

Specify:

• Action
• Responsible person
• Due date
• Required resources
• Evidence of completion
• Success measure
• Follow-up date

18. Prepare the evaluation report

Include:

• Evaluation scope and period
• Measures, targets and definitions
• Data sources and limitations
• Positive and negative variances
• Degree and severity of performance
• Policy non-conformance
• Process non-conformance
• Operational implications
• Root causes
• Corrective actions
• Responsibilities and deadlines
• Overall conclusion

Practical task

You are provided with demand-execution plans and performance reports.

Complete the following:

1. Define the evaluation scope.
2. Specify appropriate performance measures and targets.
3. Develop calculation definitions for each measure.
4. Select reporting formats and timeframes.
5. Develop policy and process non-conformance criteria.
6. Allocate measurement and review responsibilities.
7. Validate the supplied performance data.
8. Evaluate actual performance.
9. Calculate positive and negative variances.
10. Rate the degree, severity and implications of performance.
11. Recommend corrective actions.
12. Prepare a complete demand-execution evaluation report.

Required evidence

Include the following in your Portfolio of Evidence:

• Source operational plans and reports
• Evaluation scope
• Performance-measure specifications
• Target-setting record
• Reporting formats and timeframes
• Policy and process non-conformance criteria
• Responsibility matrix
• Data-validation record
• Performance calculations
• Completed scorecard
• Variance and severity analysis
• Corrective-action plan
• Demand-execution evaluation report
• Evidence of review or approval
• Completed observation checklist
• Learner declaration of authenticity

Competence checklist

Lesson Summary

To evaluate demand-execution performance, translate operational objectives into valid measures, targets, calculation methods, reporting formats and timeframes. Establish objective criteria for policy and process non-conformance and assign each monitoring and corrective responsibility. Validate the data, calculate positive and negative variances, and assess the degree, severity, and implications of performance. Document the results, non-conformances, root causes, and corrective actions in a complete evaluation report.