This Quarter 4 (Q4) FY 2021-22 Fire Services Outcomes Framework Progress Report provides an update on the Country Fire Authority (CFA) and Fire Rescue Victoria (FRV) fire services performance indicators, in line with legislated requirements.

Reporting on Outcomes

The Year Two to Five Fire Services Reform Implementation Plan (Year 2-5 Plan) outlines a shared course of action for fire services agencies over four years to implement the vision set out in the 2017 Fire Services Statement (Fire Services Statement). The Year One Fire Services Reform Implementation Plan included CFA actions 1.17 and 1.18 and FRV actions 2.16 and 2.17, which provided a level of agency accountability to prepare and report on Outcomes Frameworks, indicators, and measures. The Year 2-5 Plan does not include actions relating to Outcomes Framework reporting, however legislative provisions in the Fire Rescue Victoria Act 1958 require CFA and FRV to provide FSIM with quarterly performance-based updates measured against their individual Outcomes Frameworks.

Both agencies recognise that adopting an outcomes approach is a long-term proposition. There are no legislative requirements for CFA and FRV to produce Outcomes Framework indicators that specifically provide insight into Fire Service Reform outcomes and the indicators that inform CFA and FRV performance are determined by each agency. While agency outcomes broadly align to fire services reform outcomes, the supporting measures, baselines, and data are insufficient to tell a comprehensive story of fire services reform impact and complementarity.

Two years into reporting on outcomes, agencies have improved indicator selection and data identification, collection, and analysis. However, explanations of baselines, targets and supporting data for many of the agencies’ indicators is immature and some indicators and measures are still being refined. Further work needs to be done to clearly communicate how indicators and the supporting measures demonstrate progress towards defined, agency-specific outcomes. Settling this work will allow agencies to focus on the right data and information to make better decisions to improve service and program delivery for Victorians.

In Q4, FSIM has presented the data provided by the agencies and made commentary where possible on specific trends, risks, and successes, however a clear story of how each agencies’ activities and programs are influencing outcomes for the community is not yet achieved.

Service Level Agreements

Finalising Service Level Agreements (SLAs) is a key outstanding program of work arising from reform implementation and is fundamental to reform success. FSIM acknowledges that service level agreements have been challenging and complex and agencies have developed interim work arounds where a solution is yet to be agreed. However, two years into reform, these foundational agreements – which set out operational and service delivery expectations and requirements – are not finalised. This is impacting service delivery effectiveness and efficiency. The ongoing delays, and in some cases, inability to finalise agreements highlights an absence of agreed principles that underpin new service arrangements and will be a focus for FSIM monitoring in year three.

Engagement

COVID-19 related restrictions continued to impact CFA and FRV engagement with personnel and the community into FY 2021-22. However, CFA and FRV have seen improvements in engagement in the latter part of the year through increased adaptability to, and the lifting of, restrictions.

CFA’s annual Attitudes and preparedness of households in high bushfire risk areas survey shows that CFA continues to trend above 93% for community trust in the CFA brand, noting that this trust continues to increase. CFA continues to actively engage with the community at events, community education programs, home and property visits and e-learning modules. FSIM notes that CFA is engaging with nearly 50% of residents in extreme fire risk areas however there is still more work to be done to improve engagement with communities in extreme fire risk areas. FRV continues to make progress providing community education and risk reduction programs this quarter however did not meet its target set in FY 2020-21. FRV anticipates that results will improve in FY 2022-23 following increases in staff training to deliver programs and work to improve reporting.

CFA introduced a new indicator this quarter to count the number of volunteers sitting on steering committees and project governance committees. FSIM is supportive of CFA providing more opportunities for volunteers to have input into CFA’s policy and strategic direction. FRV met the target of 100% for ‘stations and work sites visited against schedule’ in Q4. This result builds on an improved Q3 result arising from eased COVID-19 restrictions.

Workforce

CFA has reported a significant increase in staff unplanned absences this quarter. CFA report that this is due to a substantial increase in staff reporting absent due to COVID-19 isolation protocols. CFA volunteer compensation claims reported are below baseline but have recorded a substantial increase in claims since Q3 FY 2021-22. CFA report that there is often a delay (unless there is some immediate serious impact to an individual) in compensation claim submissions where incidents may have occurred in previous quarters, which could account for this increase in Q4.

FRV monitors separations of all FRV staff to assist in identifying issues relating to workplace culture and capability and exceeded its turnover target by 1.3% in Q4. This target was set to establish a more diverse and inclusive workforce, recognising its aging workforce profile. However, exceeding this target can have consequences for FRV service delivery due to reduced workforce capacity. There is a possible correlation emerging between exceeding the workforce turnover target and not meeting its permanent non-operational staff FTE target, resulting in FRV needing to fill higher than anticipated corporate services support roles.

Capability

While CFA and FRV are both making progress against their respective capability indicators, there are some outstanding issues arising primarily from a backlog of training due to COVID-19 restrictions. Capability will remain a key area of focus for FSIM in FY 2022-23 noting the reform objective that firefighters have the right skills and access training and support.

CFA introduced a new indicator in this quarter to report on the number of digitised training courses made available online, demonstrating adaptability in response to COVID-19 related restrictions. CFA met its baseline regarding satisfaction with overall baseline and reported just below the baseline in satisfaction with digitised training. However, CFA did not meet its baseline for an increase in the average number of courses completed by CFA members. While CFA have been able to respond and adapt to impacts to training, it is not resulting in more CFA members undertaking training courses.

FRV made considerable progress against its specialist skills indicator by addressing COVID-19 induced backlogs in emergency medical response (EMR), trench rescue and heavy rescue. In Q1, FRV reported a result of 24.3% against a target of 100% by Q4 FRV had progressed this result to 83%.

FRV has consistently not met its core skills maintenance target across the year with a result of 86.7% of Division A staff having completed core skills training against a target of 95%. FSIM notes that Division B staff are currently not captured in results for this indicator and as a result FSIM cannot effectively evaluate skills maintenance results of all FRV firefighters. FRV advises it intends to incorporate Division B results in FY 2022-23 reporting.

Fire Fatalities & Prevention Activities

CFA and FRV have both reported fire fatalities in Q4. This is the first time FRV have reported preventable fire fatalities as part of their Year Two Outcomes Framework reporting.

CFA did not meet its aspirational target of zero fire-related fatalities and injuries this quarter. There were four fire related fatalities in Q4, which exceeds the four-year rolling average baseline by three fatalities. CFA also reported nine fire related injuries in Q4, which is an improvement on their four-year rolling average baseline of 74.

FRV reported on the number of preventable fire-related fatalities recorded by the FRV Fire Investigation Unit in FY 2021-22. This is the first time FRV have reported on preventable fire related fatalities in their Year Two Outcomes Framework reporting as a part of their best practice emergency response outcomes and recorded 12 preventable fire-related fatalities during the FY 2021-22. FRV reports that smoking, mobility issues and hoarding contributed to these deaths.

FRV reported fire-related fatality prevention measures such as increases in hoarding and residential risk referrals in Q4. In addition, FRV collaborated with CFA in a joint smoke alarm campaign focusing on the importance of having multiple smoke alarms in the home. FRV reports that the campaign evaluation found that awareness and perceived importance of installing interconnected smoke alarms was significantly higher for those exposed to the campaign.

CFA continues to report increases in homes where CFA has installed smoke alarms, replaced inoperable smoke alarms, and have provided fire prevention devices to vulnerable community members this quarter. FSIM commends CFA and FRV on their fire prevention activities, in particular their collaborative smoke alarm community engagement activities, and looks forward to better understanding of the impact of CFA and FRV prevention approaches on fire-related fatalities and injuries in future reporting.

Definitions

Reference to fire services agencies

References to the fire services in this document relate specifically to CFA and FRV. Where more than one fire services agency is referenced in this document, they are listed in alphabetical order.

Comparison between agencies’ performance against published Outcomes Frameworks

As the two outcomes frameworks are based on the agencies’ own strategic and operational priorities and data, comparisons between the agencies should not be made.

Purpose and background

This independent quarterly report provides observations on CFA and FRV quarterly performance against the measures set out in their respective outcomes frameworks. The report also assesses the progress of CFA and FRV towards their outcomes-based fire services performance indicators, where possible.

Fire Services Implementation Monitor (FSIM)

FSIM was appointed in 2020 in accordance with the Fire Rescue Victoria Act 1958 (the Act). FSIM’s functions under the Act are to assess the effectiveness of agencies in delivering against Implementation Plan actions and provide independent assurance to government and the community on the progress made towards modern fire services providing for a safer Victoria. FSIM is required to prepare and publish quarterly reports on CFA and FRV Outcomes Frameworks measures under s141 of the Act.

The role of outcomes frameworks in monitoring and evaluation

Outcomes frameworks are a monitoring and evaluation tool linking a vision to a set of outcomes, indicators (including targets), and measures. They help demonstrate the value and achievements of agencies and can be used to identify change. They can also determine whether agencies are moving towards agreed outcomes while identifying areas for improvement and help focus monitoring and evaluation on potential high-risk issues.

FSIM’s approach

This report provides commentary where possible, on progress made towards the reform outcomes and on operational performance against the emergency sector’s vision for safer, more resilient communities. FSIM reviews CFA’s and FRV’s quarterly results and provides a summary and analysis of the quarter’s data and, where possible, trend data across the first years of reformed operations, taking into consideration Implementation Plan priorities and the operational performance reported by both agencies.

Limitations on data

CFA and FRV published their respective Year Two Outcomes Frameworks in Q1 FY 2021-22. CFA continues to review and refine its outcome framework and is undertaking planning to realise improvement opportunities in a Year Three Outcomes Framework. FRV’s Year Two Outcomes Framework is currently being reviewed against FRV’s inaugural Strategic Plan 2022-2032, which is due to be launched in September 2022. FRV’s report continues to include outputs from its year one framework and includes measures from its year two framework.

It is FSIM’s expectation that agencies will be able to better explain their progress towards their respective outcomes as their data matures and they can substantiate linkages between actions and outcomes. Outcomes reporting is a long-term program of data identification, development and analysis and more time is required to enable fire service agencies to understand and report on the impact their work has on volunteers, staff, and the broader Victorian community, beyond outputs.

Publication of reports

FSIM publishes quarterly reports on this website. Publishing these quarterly reports promotes transparency of the fire services activities and outputs and as their outcome indicators, measures and data improve, may provide meaningful benchmarking to measure the impact of the government's reform agenda on the fire services agencies, other emergency services stakeholders, and the broader community over time.

Country Fire Authority Q4 results overview

CFA has transitioned to its Year Two Outcomes Framework and provided data for all measures in the year two framework. CFA recognises that there are improvements to be made to link the measured data to outcomes. The planned continuous improvement approach to mature CFA’s outcomes framework includes improving data quality and integrity, refining baselines, and setting appropriate targets where relevant to demonstrate progress towards intended outcomes. Currently, CFA uses a range of approaches to set baselines, some of which include pre-reform data, and some which have had pre-reform data excluded. CFA’s broader outcomes review and planning will consider how baselines can more accurately reflect post-reform operations and other improvement opportunities.

CFA has included 15 annual indicators in this Q4 report. CFA will release a number of new indicators in the FY 2022-23 on workforce complaints handling, training, and seasonal preparedness audit. 1

Appendix A provides a complete report of CFA Outcomes Framework data reported in Q4.

Introduction

CFA’s Year Two Outcomes Framework comprises four goals that form the basis of CFA’s outcome reporting and related measures and indicators:

• We put the community at the centre of everything we do
• We deliver programs and services that make a positive difference
• We provide a great place to volunteer and work
• We are a progressive emergency service.

This section provides insights into CFA’s progress towards these goals.

Overview of progress towards outcomes

Putting the community at the centre of everything CFA does

CFA’s goal to put the community at the centre of everything CFA does includes quarterly and annual measures on community engagement and community knowledge of fire risk.

Generally, CFA is tracking close to baselines in Q4 for indicators under this goal. CFA measures community trust in the CFA brand and trust in CFA advice and services on an annual basis. The 2022 results from the Attitudes and preparedness of households in high bushfire risk areas survey show that CFA continues to trend above 93% for community trust in the CFA brand.

CFA reported 19,355 engagements with the community in Q4. This shows that CFA continues to actively engage with the community at events, CFA community education programs, home and property visits and e-learning modules. CFA also reports that almost half of those in extreme fire risk areas are engaging with CFA but there is still more work to be done to improve engagement with communities in extreme fire risk areas.

CFA has introduced an annual indicator to measure fuel management activities across community members’ land in high fire risk areas. CFA reports that this result is tracking above baseline due to easing of COVID-19 related restrictions which has increased the availability of members to deliver planned burns. Furthermore, CFA reports improved reporting processes and weather conditions conducive to fuel management activities as supporting above baseline results.

Delivering programs and services that make a positive difference

CFA’s programs and services goal captures operational performance data including the number and containment of fires, fatalities and injuries, stock loss, and preventative intervention including smoke alarm installation.

CFA continues to report on 13 indicators for this outcome. Most indicator quarterly results met or are tracking close to baseline, however CFA reports the number of grass and scrub fires, containment of bushfires and structure fires are slightly off track and not meeting baseline.

In Q4, CFA reports a continued increased in the number of smoke alarms installed and replaced in homes and the number of fire prevention devices disseminated to vulnerable communities. CFA has also met baseline on the number of house fires, average time spent supressing structure fires and complete structure loss due to structure fires this quarter. These are positive results, however CFA is trending slightly below baseline for the percentage of structure fires contained to room of origin this quarter. Research has shown that working smoke alarms significantly reduce the risk of death from residential fires[2]. CFA reports that its evaluation of CFA’s smoke alarm installation program requires at least 36 months of service delivery data to compare with fatalities reported in households to determine impact of its smoke alarms installation program.

CFA reported a year-to-date total of 2,868 grass and scrub fires which is above YTD baseline of 2,289. CFA notes that this increase is in line with previously recorded and comparable seasonal variations. While a decrease against the baseline for grass and scrub fires was not met, CFA’s containment of grass and scrub fires to 5 hectares measure is in line with its baseline with a result of 93% of fires contained. Containment of fires to five hectares reduces the risk of damage to large areas providing good outcomes for community.

CFA has an aspirational target for zero fatalities and injuries in the Country Area of Victoria. This aspirational target was not met with CFA recording 4 fatalities this quarter and a total of 16 fire related fatalities and 49 fire related injuries this year. FSIM notes that the result is increasing year on year since FY 2020-21.

Providing a great place to volunteer and work

CFA’s great place to volunteer and work goal captures OH&S data, diversity measures, training progress and delivery against corporate requirements.

CFA is generally tracking well against baselines for this goal. However, hazard reporting continues to track significantly below the baseline. CFA has reported a delay to the release of a new hazard reporting checklist that will assist in targeting key hazards for identification and control, with an anticipated release in FY 2022-23. CFA notes that the hazard reporting checklist will primarily be used by brigades at brigade sites and will not replace, supersede, or circumvent CFA’s online hazard reporting system.

CFA’s indicators met or are tracking close to baseline on their diversity and inclusion indicators such as female participation rates, increase in volunteer members under the age of 40, and CFA participation in diversity and inclusion networks and groups.

CFA reported a significant increase in unplanned absences in Q4 due to CFA staff reporting COVID-19 related absences. CFA have also reported four WorkCover claims this quarter, which continues to trend below the five-year YTD baseline. The increase in Volunteer Compensation claims this quarter, albeit recording below YTD five-year average baseline, is reported by CFA to be due to delays in volunteer compensation claim submissions and CFA note that some of the compensation claim incidents would have occurred in Q3.

A progressive emergency service

CFA’s progressive emergency service goal captures data on timeliness of reporting and implementing audit recommendations, workplan delivery and number of after-action reviews.

CFA has improved its results in decreasing overdue audits and recommendations. CFA has undertaken work to address internal audit approaches which has resulted in the number of open internal audit items reducing from 147 to 76 (35 items or 46% of these remaining open audit items are overdue).

CFA has included a new indicator that counts the number of volunteers sitting on steering committees and project governance committees. FSIM supports CFA providing more opportunities for volunteers to have input into CFA’s policy and strategic direction as this will inform CFA’s Year 2-5 Implementation Plan objective of a volunteer workforce that feels engaged, safe and respected.

Fire Rescue Victoria Q4 Results Overview

FRV’s transition to the Year Two Outcomes Framework continues to progress. FRV continues to report on Year One Outcomes Framework performance measures and has provided 17-year two framework indicators in Q4. As noted in previous reports, FRV has not developed FY 2021-22 targets for year one framework measures as it did not plan to report on these measures beyond June 2021. FRV continues to use the FY 2020-21 targets for performance measures as noted in the data tables at Appendix B.

FRV’s existing and future performance reporting will need to be reviewed to align with the new FRV Strategic Plan 2022-2032, following its release in September 2022.

Appendix B provides a complete report of FRV outcomes framework data reported in Q4 (performance measures and outcomes measures).

Introduction

FRV continues to build its data set for reporting against its Year Two Outcomes Framework. As an interim measure, FRV continues to provide data against its Year One Outcomes Framework that reports against the three domains of community, service, and people.

FRV’s year two framework comprises three domains that form the basis of FRV’s outcome reporting and related measures and indicators. These domains are:

• Prevention and Preparedness: Victorians understand risk in their local environment and know how to prevent and prepare for emergency incidents.
• Response and Recovery: Victorians can rely on a world-class fire and rescue emergency response.
• Organisational Excellence: Victorians value FRV as a leading, progressive, and accountable fire and rescue service.

This section provides insights into FRV’s progress against its year one framework domains and towards its year two framework goals.

Overview of progress against year one framework domains

This section provides insights into FRV’s progress against its year one framework domains.

Community

FRV’s community domain captures performance data on community education programs, risk referrals, and containment of fires.

FRV continues to make progress providing fire education and risk reduction programs this quarter, exceeding the quarterly target of 80 set in FY 2020-21. With the relaxing of COVID-19 restrictions, increases in staff training to deliver programs and work to improve reporting being undertaken in Q4, FRV anticipates that results will continue to improve in FY 2022-23.

FRV continues to report below the target for containment of structure fires. As in Q3, FSIM notes that containment information is incomplete for over 700 fires within this dataset. Significant incomplete data means that this result is not a true reflection of FRV’s containment of structure fire result. FRV has reported that work has been undertaken in Q4 to deliver training on incident data reporting to reduce instances of incomplete containment information being reported.

As in Q3, FRV reported an above target result for residential and hoarding risk referrals this quarter. Hoarding and residential risk referrals enable targeted assistance and education aimed to influence and reduce the impact of fire within the community.

Service

FRV’s service domain captures data on fleet availability, response times, service level agreement status and specialist capability skills maintenance.

As noted in Q3, the finalisation of Service Level Agreements remains one of the key outstanding issues arising from the reform’s implementation. The reported figure of 88% relates to agreements in principle and not executed agreements. This is the third quarter in a row that FRV has reported a result of 88% and significant progress has not been reported since Q4 FY 2020-21. As noted in the Q3 2021-22 report, the inability to progress and finalise these agreements is having an impact on the efficiency and effectiveness of service delivery within the agencies.

As SLAs have not yet comprehensively defined each agencies’ roles and responsibilities in the delivery of some services, agencies continue to grapple with duplication, extended timeframes for approvals and lack of clarity of how services are delivered. FSIM notes the significant challenges in finalising this program of work and considers finalising SLAs to be a priority issue for both agencies as they underpin agencies’ agreement on complementary fire service delivery.

FRV’s positive fleet availability result means that firefighters can respond to emergencies with fleet that is maintained and available. Response times in general are tracking close to the FY 2020-21 target with 88% of structure fires responded within 7.7 minutes in FRV’s response area, noting that this target relates to FRV’s overall footprint, and not individual maintenance areas. FSIM notes that most (323 of 409 incidents) that missed the 7.7 benchmark responded within an additional two minutes however 25 incidents missed the benchmark by more than 5 minutes. FRV EMR response times recorded a positive result, exceeding target by 3.7% in Q4.

FRV reported a road crash rescue result of 84% which is below the FY 2020-21 target of 90%. FRV notes that key contributing factors to not meeting benchmark times for this quarter include traffic congestion, particularly for incidents that occurred on freeways and distances of over 18 km to incident.

The FRV specialist capability skills maintenance result has increased since Q3 but is below the FY 2020-21 target of 100%. As reported in Q2, FRV have experienced significant training backlogs due to COVID-19 restrictions and addressing training backlogs in EMR, trench rescue and heavy rescue specialist skills contributed to the improved results in Q4.

People

FRV’s people domain captures data on core skills maintenance, FRVSafe, staff engagement, workforce turnover, staff numbers, engagement with local government authorities (LGAs) and representation at state emergency management meetings.

FRV remains below target for core skills maintenance with 86.7% of Division A core maintenance drills scheduled and completed. Since reporting on this measure, Division B core maintenance skills data has not been reported under this measure, this could lead to a perception that Division B employees are not represented by the FRV in the same way Division A staff are. It is critical that FRV demonstrates core skill maintenance of all employees captured in this measure. FRV reports that Division B data will be reported in Q1 FY 2022-23.

FRV met the target of 100% for ‘stations and work sites visited against schedule’ in Q4. This result builds on an improved Q3 result arising from eased COVID-19 related restrictions.

FRV continues to report FRVSafe escalation issues in Q4, however FRV is tracking close to target in reviewing and closing out OH&S incident reports. FRV reports that work is being undertaken to remedy incident report escalation issues to improve results for ‘FRVSafe initial investigations within 14 days’ measure.

FRV exceeded its workforce turnover FY 2020-21 target by 1.3% for all employees, reporting that 46 corporate staff separated from the FRV in Q4 with 31 from voluntary separations and the remaining 15 were due to planned end of fixed term contracts. FRV has set a turnover target that it deems appropriate to establish a more diverse and inclusive workforce, recognising the aging workforce profile. However, over exceeding the turnover target has the potential to impact FRV business operations.

Overview of FRV progress towards year two outcomes

As noted above, FRV provided data against 17 of 30 Year Two Outcomes Framework indicators in Q4, with a number of measures informing each indicator. This section provides insights into FRV’s progress against its year two framework domains.

Domain 1: Prevention and Preparedness: Victorians understand risk in their local environment and know how to prevent and prepare for emergency incidents

Outcome: Safer homes

FRV’s safer homes outcome captures data on preventable structure fires attended by FRV and the number of homes with working smoke alarms.

FRV reports that the number and rate of residential structure fires attended by FRV remains consistent with historical trends throughout FY 2021-22. FRV also reports no noticeable deviation in preventable residential structure fire common causes and locations over the past four quarters. Residential structure fires with smoke alarms by type of residence: Hostels (Class 1b), recorded a 17% decrease in Q4 however in Q1-Q3 FY 2021-22 FRV reported 100% which is indicative of a small sample size and high regulatory compliance in the Hostel sector.

FRV report that its community education and awareness campaigns have improved community awareness of the importance of having a smoke alarm installed in the home. FRV reports that over a quarter of Victorians claim they recall media about installing a smoke alarm, and smoke alarm awareness as measured in 2021 increased over the course of a joint CFA and FRV smoke alarm awareness campaign, rising from levels recorded in 2020. FRV also report that community awareness of the importance of having multiple smoke alarms located in different rooms in the home is measuring positively. FRV notes that this outcome will be a long-term outcome and is not immediately translatable to quarter-to-quarter change in data. Programs of this nature promote behaviour change over years.

Outcome: A well-regulated built environment

FRV’s well-regulated built environment outcome captures data on preventable fires in high-risk buildings, impacts from fire due to early detection and decrease in unwanted false alarms.

Preventable fires in higher risk buildings such as offices, shops, factories, and public buildings continues to trend up in Q4. Additionally, locations with 6 or more false alarms have increased, FRV reports that the result is in line with previous years showing increases consistent with seasonal variation. FRV reports that 110,650 fire safety equipment services were undertaken within buildings in FY 2021-22 consistently undertaking between 26,000 and 30,000 services each quarter.

Outcome: Enabled, empowered and resilient communities

FRV’s enabled, empowered and resilient communities outcome currently uses the number of non-structure fire incidents attended by FRV in FRV Fire Districts according to incident type.

FRV included a new measure this quarter that counts the number of people educated by Fire Equipment Services to understand, prepare, mitigate, and respond to fire and other emergencies. In FY 2021-22, FRV reports 7,107 people have attended Emergency Management training by FES which includes participating in evacuation drills, attending presentations, seminars, and webinars.

FRV also reports an increase in EMR and rescues and other medical assistance, which may be attributed to increased demands on Victoria’s emergency medical services as a new wave of COVID-19 and seasonal influenza impacts the community.

Domain 2: Response and Recovery – Victorians can rely on a world class fire and emergency response

Outcome: A best-practice emergency response

FRV’s a best-practice emergency response outcomes captures data on preventable fire fatalities, FRV contribution to EM arrangements, and structure fire and emergency medical response times.

FRV reports 12 preventable fire fatalities in FY 2021-22. One third of properties associated with a fatality had a working smoke alarm, while half of the fatalities occurred in the bedroom. FRV also reported key factors that contributed to fatalities this quarter which include mobility issues, smoking and hoarding. FRV reports that they were not notified of hoarding risk at sites prior to the four fire fatality incidents. FRV rely on firefighter, family member and community services agencies to report properties that exhibit signs of hoarding risk. FRV acknowledges that there may be a large proportion of properties in FRV’s response area affected by hoarding that remain unknown to FRV.

Domain 3: Organisational Excellence. Victorian’s value FRV as a leading, progressive, and accountable fire and rescue service

Outcome: A diverse and inclusive organisation

FRV’s diverse and inclusive organisation outcome compares workforce turnover by men and women and measures the number and proportion of women in leadership roles.

FRV’s a diverse and inclusive organisation outcome captures FRV employment data on women in operational and leadership roles, Aboriginal and Torres Strait islander and LGBTIQ+ people, people with a disability and people from culturally diverse backgrounds.

FRV reports a consistent result compared to Q3 for measures against the indicator number of women firefighters in all ranks and leadership roles and has reported the recruitment of nine women firefighters out of 768 women applicants in FY 2021-22.

Outcomes: A data driven and innovative organisation

FRV’s data driven and innovative organisation outcome captures data on FRV’s participation in research, data analytics and evaluation to support evidence informed decision making and community and firefighter safety.

FRV notes that commentary against this outcome is limited with only one measure being reported this quarter.

Outcomes: A socially and environmentally responsible organisation and respected partner

FRV’s socially and environmentally responsible organisation and respected partner outcome currently captures data on workforce turnover by gender and age.

FRV reports workforce turnover by age and gender. This data highlights that in FY 2021-22, 86 operational employees over the age of 55 and 102 men in total departed the organisation. With an ageing and male dominated operational workforce, FRV has an opportunity to fill operational roles with a younger demographic and increase its intake of women noting FRV have a target to reach 400 women firefighters by 2025.

---

Footnote

1 Increase in staff satisfaction with the handling and outcomes of complaints; Increase in percentage of training courses led by volunteer trainer/ assessors; Increase in the number of joint FRV/CFA training and exercises; Increase in participation in the Seasonal Preparedness Audit

This is the final quarter in year two of the outcomes-based fire services performance reporting. FSIM acknowledges the significant work undertaken by CFA and FRV in developing, refining, and reporting on their Outcomes Frameworks and looks forward to further progress being made by the agencies in their Outcomes Framework reporting in year three.

Recently, the Victorian Government shifted its strategic direction to focus on outcomes to demonstrate its value to the community. In the past, government and command control environments such as the CFA and FRV have measured what it does (outputs), but not necessarily what they have achieved (outcomes). Focusing on outcomes instead of outputs allows agencies to better identify the long-term aims of what they want to achieve and evaluate their progress towards those aims. However, identifying and reporting meaningful change takes time, resources, and specialist expertise to transition from an output to an outcomes-orientated approach.

CFA and FRV are continuing to refine their Outcomes Framework indicators and improve their data collection and analysis approaches. Their performance-based measures are not setup to describe reform change but are focused on the strategic aims of the individual agencies.

Although it is important that the public are provided with regular updates on agency performance, quarterly progress updates, as currently reported, provide limited progress insight between quarters, and require longer time frames for data and analysis to mature to support agencies in their transition from delivering a story of outputs to a story of outcomes.

The CFA Outcomes Framework uses an annual baseline total and year to date (YTD) baseline total in lieu of a target measure. This report includes the YTD baseline which is a rolling five-year average of the cumulative, quarter three performance against indicators.

In Q4, CFA provide data for annual and quarterly performance indicators. The data available from page 16 in the report document.

Fire Services Outcome Framework Progress Report Q4

PDF 4.16 MB

(opens in a new window)

The FRV Year One performance measures use an annual target to assess performance against indicators. Some targets, however, are based on a YTD cumulative result and have been identified as such in this report. FSIM has aimed to make a comparison with FY 2020-21 Q4 targets where possible. FSIM notes that as FRV consolidates outcomes reporting to replace performance reporting, a baseline will be established across suitable outcome measures.

Data against performance indicators is available from page 43 in the report document.

Fire Services Outcome Framework Progress Report Q4

PDF 4.16 MB

(opens in a new window)