Purpose of the lesson
Develop objective criteria for measuring production performance, allocate responsibility for measurement and evaluate performance, variances and operational non-conformance.
Practical outcome
By the end of this lesson, you must be able to:
- Specify valid production performance measures and targets.
- Define measurement methods, formats and timeframes.
- Develop policy and process non-conformance criteria.
- Allocate responsibility for performance measurement.
- Calculate positive and negative performance variances.
- Evaluate underperformance and overperformance.
- Determine the degree, severity and implications of results.
- Recommend and monitor corrective actions.
1. Gather the required information
Obtain:
- Production operational plan
- Approved production schedule
- Customer and replenishment requirements
- Production-order records
- Planned and actual output
- Standard production rates
- Quality and inspection reports
- Rework, rejection and scrap records
- Material-usage reports
- Employee and labour-hour records
- Equipment and downtime reports
- Maintenance schedules
- Production cost reports and budgets
- Safety and operating procedures
- Previous performance reports
Confirm the reporting period, products, production lines and shifts included in the evaluation.
2. Define the evaluation scope
State:
- Production facility or department
- Production lines and products covered
- Shifts included
- Reporting period
- Operational objectives
- Applicable policies and procedures
- Customer and inventory commitments
- Responsible managers
- Users of the evaluation report
A defined scope ensures that results from different lines, products or periods are not combined incorrectly.
3. Convert objectives into performance measures
| Production objective | Performance measure |
|---|---|
| Complete production according to schedule | Schedule adherence |
| Achieve planned output | Production-plan attainment |
| Produce acceptable products first time | First-pass yield |
| Reduce defective output | Defect or rejection rate |
| Minimise additional processing | Rework rate |
| Control material usage | Material-yield or shrinkage rate |
| Use employees effectively | Labour productivity |
| Use machinery effectively | Equipment utilisation |
| Control operating expenditure | Cost per accepted unit |
| Limit breakdowns | Equipment availability |
| Support customer commitments | Orders completed by required date |
Select measures that directly support production and supply-chain objectives.
4. Define each measure
Prepare a specification for every KPI.
| Field | Information required |
|---|---|
| Measure | KPI name |
| Purpose | What it evaluates |
| Definition | Items included and excluded |
| Formula | Approved calculation |
| Data source | System or source record |
| Target | Required result |
| Frequency | Measurement interval |
| Owner | Person accountable for performance |
| Reviewer | Person validating the result |
| Escalation | Action required when performance fails |
Definitions must explain how rework, rejected products, planned downtime and authorised process losses are treated.
5. Establish production targets
Set targets using:
- Approved production plans
- Customer requirements
- Inventory-replenishment requirements
- Equipment capacity
- Standard production rates
- Quality specifications
- Historical performance
- Approved budgets
- Safety requirements
- Reliable benchmarks
Examples include:
| Measure | Example target |
|---|---|
| Schedule adherence | At least 95% |
| Production-plan attainment | At least 98% |
| First-pass yield | At least 97% |
| Rework rate | No more than 2% |
| Material shrinkage | No more than 1% |
| Labour productivity | At least 22 units per hour |
| Equipment utilisation | At least 85% |
| Cost per accepted unit | No more than budget |
Targets should encourage efficiency without compromising safety or quality.
6. Specify measurement formats
Use formats suitable for operational and management control:
- Hourly production record
- Shift output report
- Daily schedule-adherence report
- Quality and defect register
- Rework and scrap report
- Material-usage report
- Downtime register
- Employee-productivity report
- Weekly exception report
- Monthly production scorecard
- Corrective-action register
Production scorecard
| Measure | Target | Actual | Variance | Status | Owner |
|---|---|---|---|---|---|
| Schedule adherence | 95% | 90% | −5% | Below target | Production manager |
| First-pass yield | 97% | 98% | +1% | Above target | Quality manager |
7. Set measurement timeframes
| Performance information | Suggested timeframe |
|---|---|
| Output and downtime | Hourly or per shift |
| Safety or critical quality failure | Immediately |
| Production-order progress | Daily |
| Material usage | Per production order or shift |
| Labour productivity | Daily or weekly |
| Equipment utilisation | Daily or weekly |
| Production cost | Monthly |
| Formal evaluation | Monthly or quarterly |
Escalate critical failures immediately instead of waiting for the standard reporting date.
8. Develop policy non-conformance criteria
Production policy non-conformance may include:
- Operating equipment without authorisation
- Bypassing safety controls
- Using an unapproved material
- Releasing rejected products
- Recording false production information
- Changing specifications without approval
- Performing unauthorised overtime
- Disposing of materials outside approved procedures
Policy criteria register
| Policy requirement | Evidence | Non-conformance condition | Severity |
|---|---|---|---|
| Use approved materials | Material-issue record | Unapproved substitute used | Major |
| Observe safety controls | Safety checklist | Mandatory control bypassed | Critical |
| Release accepted products only | Quality-release record | Rejected stock released | Critical |
9. Develop process non-conformance criteria
Process non-conformance may include:
- Production starts late.
- Required setup checks are omitted.
- Work instructions are not followed.
- Material usage is not recorded.
- Quality inspections are missed.
- Changeovers exceed the standard.
- Rework is not authorised or recorded.
- Maintenance activities are not completed.
- Finished goods are not transferred correctly.
- Production orders are closed with incomplete quantities.
Define the required evidence, tolerance and severity for each process.
10. Calculate production performance
Schedule adherence
Schedule adherence = Orders completed as scheduled ÷ Orders scheduled × 100
Production-plan attainment
Plan attainment = Actual output ÷ Planned output × 100
First-pass yield
First-pass yield = Units accepted without rework ÷ Total units produced × 100
Rework rate
Rework rate = Units requiring rework ÷ Total units produced × 100
Material shrinkage
Shrinkage rate = Unexplained material loss ÷ Total material issued × 100
Deduct approved process loss before calculating unexplained shrinkage.
Labour productivity
Labour productivity = Accepted output ÷ Labour hours used
Equipment utilisation
Equipment utilisation = Productive operating time ÷ Available equipment time × 100
Cost per accepted unit
Cost per accepted unit = Total production cost ÷ Accepted finished units
11. Calculate and interpret variance
Use:
Variance = Actual performance − Target
For measures such as output, quality and productivity, results above target are generally favourable.
For rework, defects, shrinkage and cost, actual results above the maximum target are unfavourable.
State both:
- Numerical variance
- Favourable or unfavourable interpretation
12. Evaluate underperformance
Underperformance may result from:
- Material shortages
- Equipment breakdowns
- Employee shortages
- Skills gaps
- Excessive setup and changeover time
- Quality failures
- Rework
- Poor production sequencing
- Unplanned downtime
- Inaccurate production standards
- Infrastructure disruption
Determine whether the result affects inventory, warehouse schedules, transport plans or customer deliveries.
13. Evaluate overperformance
Overperformance may indicate:
- Genuine process improvement
- Higher employee productivity
- Reduced downtime
- Improved material quality
- Better production sequencing
It may also indicate:
- Targets set too low
- Quality checks being bypassed
- Excessive equipment use
- Unauthorised overtime
- Inaccurate production data
- Overproduction and excess inventory
Verify unusually favourable results before accepting them.
14. Determine severity and implications
Consider:
- Customer or replenishment orders affected
- Quantity short or overproduced
- Duration of the failure
- Quality and safety exposure
- Cost
- Material loss
- Capacity consumed by rework
- Effect on downstream schedules
- Risk of recurrence
| Severity | Description |
|---|---|
| 1—Low | Minimal operational effect |
| 2—Moderate | Limited output, time or cost effect |
| 3—High | Inventory or customer commitment affected |
| 4—Major | Serious quality, cost or continuity failure |
| 5—Critical | Safety, legal or severe customer consequence |
15. Allocate responsibilities
| Activity | Responsible role |
|---|---|
| Record production output | Production operator or administrator |
| Confirm quality results | Quality controller |
| Record labour hours | Production supervisor |
| Record downtime | Machine operator or maintenance planner |
| Calculate KPIs | Production analyst |
| Review results | Production manager |
| Investigate material variance | Materials and production managers |
| Approve corrective action | Operations manager |
Every measure must have a data collector, owner, reviewer and corrective-action owner.
16. Validate production data
Check:
- Production-order references
- Product and line information
- Planned and actual quantities
- Start and completion times
- Accepted, rejected and reworked units
- Material issues and returns
- Employee hours
- Equipment availability and downtime
- Cost allocations
- Approved schedule changes
- Duplicate entries
Record any limitation that affects the reliability of the evaluation.
17. Evaluate performance
Follow this process:
- Confirm the operational objective.
- Select the approved measure and target.
- Validate the data.
- Calculate actual performance.
- Calculate and interpret the variance.
- Check policy and process compliance.
- Rate the degree and severity.
- Determine operational implications.
- Identify the root cause.
- Recommend corrective action.
- Allocate responsibility and deadlines.
- Report and monitor the result.
18. Identify root causes
Investigate:
| Area | Possible cause |
|---|---|
| Employees | Absence, insufficient training or poor work method |
| Equipment | Breakdown or inadequate maintenance |
| Materials | Shortage, defect or late delivery |
| Methods | Incorrect setup or unclear procedure |
| Measurement | Inaccurate records or standards |
| Planning | Unrealistic schedule or poor sequencing |
| Quality | Weak process controls |
| Environment | Power or infrastructure disruption |
Use verified evidence and a structured technique such as the Five Whys.
19. Develop corrective actions
Possible actions include:
- Revise production sequencing.
- Correct production standards.
- Improve material planning.
- Implement preventive maintenance.
- Train or reallocate employees.
- Strengthen setup verification.
- Improve quality controls.
- Reduce unnecessary changeovers.
- Control material movements.
- Investigate excess rework.
- Coordinate production with warehouse and transport schedules.
Corrective-action plan
| Performance gap | Root cause | Corrective action | Owner | Due date | Success measure |
|---|---|---|---|---|---|
| Schedule adherence below target | Repeated breakdowns | Revise preventive-maintenance plan | Maintenance manager | 20 August | Adherence ≥95% |
| Rework above target | Incorrect machine setup | Introduce independent setup checks | Production supervisor | 15 August | Rework ≤2% |
20. Prepare the evaluation report
Include:
- Scope and reporting period
- Measures, targets and calculation rules
- Data sources and limitations
- Positive and negative variances
- Policy non-conformance
- Process non-conformance
- Underperformance and overperformance
- Degree and severity
- Customer, cost, inventory and safety implications
- Root causes
- Corrective actions
- Responsibilities and deadlines
- Overall conclusion
Practical task
You are provided with production plans and performance reports.
Complete the following:
- Define the evaluation scope.
- Specify production performance measures and targets.
- Define measurement methods and data sources.
- Set reporting formats and timeframes.
- Develop policy and process non-conformance criteria.
- Allocate measurement responsibilities.
- Validate the performance information.
- Calculate actual performance and variances.
- Evaluate underperformance and overperformance.
- Rate the degree, severity and implications.
- Recommend corrective actions.
- Prepare a production-performance evaluation report.
Required evidence
Include the following in your Portfolio of Evidence:
- Source production plans and reports
- Evaluation scope
- KPI definitions and targets
- Reporting formats and timeframes
- Policy and process non-conformance criteria
- Responsibility matrix
- Data-validation record
- Production calculations
- Production scorecard
- Variance and severity assessment
- Root-cause analysis
- Corrective-action plan
- Production evaluation report
- Evidence of review or approval
- Completed observation checklist
- Learner declaration of authenticity
Competence checklist
| Assessment criterion | Competent | Not yet competent | Comments |
|---|---|---|---|
| Specify valid production measures and targets | |||
| Define measurement methods and data sources | |||
| Specify suitable formats and timeframes | |||
| Develop policy non-conformance criteria | |||
| Develop process non-conformance criteria | |||
| Allocate criteria to responsible people | |||
| Validate production-performance information | |||
| Calculate positive and negative variances | |||
| Evaluate underperformance and overperformance | |||
| Determine the degree and severity of performance | |||
| Explain customer, cost, inventory and safety implications | |||
| Recommend appropriate corrective actions | |||
| Produce a complete evaluation report | |||
| Submit complete supporting evidence |
Lesson Summary
To evaluate production performance, convert operational objectives into clearly defined measures, targets, calculation methods and reporting timeframes. Establish criteria for detecting policy and process non-conformance and allocate measurement responsibilities. Validate production data, calculate positive and negative variances and evaluate both underperformance and overperformance. Determine the degree, severity and implications of each result, identify root causes and document measurable corrective actions in a complete production evaluation report.